Introduction to Fluentd & Fluent Bit

In this episode, we take a look at using Fluentd for log collection within a Kubernetes cluster, as well as using Fluent Bit for stream processing.

🍿 Rawkode Live

Hosted by David McKay / 🐦 https://twitter.com/rawkode
Website: https://rawkode.live
Discord Chat: https://rawkode.live/chat

#RawkodeLive

🕰 Timeline

00:00 - Holding screen
00:50 - Introductions
03:00 - Introduction to Fluentd and Fluent Bit (Slides)
18:30 - When should I use Fluentd vs Fluent Bit
22:00 - Deploying Fluentd with kubectl
30:00 - Setting up Kibana
34:00 - Deploying Fluent Bit with Helm
40:00 - Config Visualizer
48:00 - Filtering logs
01:00:00 - Stream processing with Fluent Bit

👥 About the Guests

Anurag Gupta

Building | ex-Product @ Elastic, MSFT, Treasure Data. All tweets are my own

🐦 https://twitter.com/Anurag_Gup
🧩 https://github.com/agup006
🌏 https://agup.tech/

Eduardo Silva

Software Engineer at @TreasureData, observability & hacking http://fluentbit.io; Kubernetes & Logging

🐦 https://twitter.com/edsiper
🧩 https://github.com/edsiper
🌏 https://edsiper.com/

🔨 About the Technologies

Fluent Bit

Fluent Bit is an open source Log Processor and Forwarder which allows you to collect any data like metrics and logs from different sources, enrich them with filters and send them to multiple destinations. It's the preferred choice for containerized environments like Kubernetes.
Fluent Bit is designed with performance in mind: high throughput with low CPU and Memory usage. It's written in C language and has a pluggable architecture supporting more than 70 extensions for inputs, filters and outputs.
Fluent Bit is a CNCF (Cloud Native Computing Foundation) subproject under the umbrella of Fluentd.
We are part of a wide community, no vendor lock-in.

🌏 https://fluentbit.io/
🐦 https://twitter.com/fluentbit
🧩 https://github.com/fluent/fluent-bit/

#Logging #StreamProcessing #BigData

Fluentd

Fluentd is an open source data collector for unified logging layer.
Fluentd allows you to unify data collection and consumption for a better use and understanding of data.

🌏 https://www.fluentd.org/
🐦 https://twitter.com/fluentd
🧩 https://github.com/fluent/fluentd

Resources related to this video will be displayed here, including links, downloads, and additional materials.