Introduction to Fluentd & Fluent Bit
Meet the Cast
HOST
David Flanagan
@rawkode
Stay ahead in cloud native
Tutorials, deep dives, and curated eventsβno fluff.
In this episode, we take a look at using Fluentd for log collection within a Kubernetes cluster, as well as using Fluent Bit for stream processing.
πΏ Rawkode Live
Hosted by David McKay / π¦ https://twitter.com/rawkode
Website: https://rawkode.live
Discord Chat: https://rawkode.live/chat
#RawkodeLive
π° Timeline
00:00 - Holding screen
00:50 - Introductions
03:00 - Introduction to Fluentd and Fluent Bit (Slides)
18:30 - When should I use Fluentd vs Fluent Bit
22:00 - Deploying Fluentd with kubectl
30:00 - Setting up Kibana
34:00 - Deploying Fluent Bit with Helm
40:00 - Config Visualizer
48:00 - Filtering logs
01:00:00 - Stream processing with Fluent Bit
π₯ About the Guests
Anurag Gupta
Building | ex-Product @ Elastic, MSFT, Treasure Data. All tweets are my own
π¦ https://twitter.com/Anurag_Gup
𧩠https://github.com/agup006
π https://agup.tech/
Eduardo Silva
Software Engineer at @TreasureData, observability & hacking http://fluentbit.io; Kubernetes & Logging
π¦ https://twitter.com/edsiper
𧩠https://github.com/edsiper
π https://edsiper.com/
π¨ About the Technologies
Fluent Bit
Fluent Bit is an open source Log Processor and Forwarder which allows you to collect any data like metrics and logs from different sources, enrich them with filters and send them to multiple destinations. It's the preferred choice for containerized environments like Kubernetes.
Fluent Bit is designed with performance in mind: high throughput with low CPU and Memory usage. It's written in C language and has a pluggable architecture supporting more than 70 extensions for inputs, filters and outputs.
Fluent Bit is a CNCF (Cloud Native Computing Foundation) subproject under the umbrella of Fluentd.
We are part of a wide community, no vendor lock-in.
π https://fluentbit.io/
π¦ https://twitter.com/fluentbit
𧩠https://github.com/fluent/fluent-bit/
#Logging #StreamProcessing #BigData
Fluentd
Fluentd is an open source data collector for unified logging layer.
Fluentd allows you to unify data collection and consumption for a better use and understanding of data.
π https://www.fluentd.org/
π¦ https://twitter.com/fluentd
𧩠https://github.com/fluent/fluentd
Related Videos
Fuck you, Hashicorp ... an IBM Company.
HashiCorp archived the repo without warning. Here is why their excuse about "product market fit" is a lie.
Replace Your GitHub Actions YAML with CUE
Are you tired of copy-pasting YAML between repositories only to be bitten by typos after pushing?
MinIO, we won't miss you.
MinIO just announced maintenance mode for their community edition β and honestly? Good riddance.
Relaunching Klustered ... with Heroku Vibes
Building and Launching a Marketing Page on Heroku with AI in Under 20 Minutes
Comments