Introduction to Fluentd & Fluent Bit

2021-01-16

In this episode, we take a look at using Fluentd for log collection within a Kubernetes cluster, as well as using Fluent Bit for stream processing.


šŸæ Rawkode Live

Hosted by David McKay / šŸ¦ https://twitter.com/rawkode
Website: https://rawkode.live
Discord Chat: https://rawkode.live/chat

#RawkodeLive

šŸ•° Timeline

00:00 - Holding screen
00:50 - Introductions
03:00 - Introduction to Fluentd and Fluent Bit (Slides)
18:30 - When should I use Fluentd vs Fluent Bit
22:00 - Deploying Fluentd with kubectl
30:00 - Setting up Kibana
34:00 - Deploying Fluent Bit with Helm
40:00 - Config Visualizer
48:00 - Filtering logs
01:00:00 - Stream processing with Fluent Bit

šŸ‘„ About the Guests

Anurag Gupta

Building | ex-Product @ Elastic, MSFT, Treasure Data. All tweets are my own

šŸ¦ https://twitter.com/Anurag_Gup
šŸ§© https://github.com/agup006
šŸŒ https://agup.tech/


Eduardo Silva

Software Engineer at @TreasureData, observability & hacking http://fluentbit.io; Kubernetes & Logging

šŸ¦ https://twitter.com/edsiper
šŸ§© https://github.com/edsiper
šŸŒ https://edsiper.com/


šŸ”Ø About the Technologies

Fluent Bit

Fluent Bit is an open source Log Processor and Forwarder which allows you to collect any data like metrics and logs from different sources, enrich them with filters and send them to multiple destinations. It's the preferred choice for containerized environments like Kubernetes.
Fluent Bit is designed with performance in mind: high throughput with low CPU and Memory usage. It's written in C language and has a pluggable architecture supporting more than 70 extensions for inputs, filters and outputs.
Fluent Bit is a CNCF (Cloud Native Computing Foundation) subproject under the umbrella of Fluentd.
We are part of a wide community, no vendor lock-in.

šŸŒ https://fluentbit.io/
šŸ¦ https://twitter.com/fluentbit
šŸ§© https://github.com/fluent/fluent-bit/

#Logging #StreamProcessing #BigData


Fluentd

Fluentd is an open source data collector for unified logging layer.
Fluentd allows you to unify data collection and consumption for a better use and understanding of data.

šŸŒ https://www.fluentd.org/
šŸ¦ https://twitter.com/fluentd
šŸ§© https://github.com/fluent/fluentd