SlideShare a Scribd company logo

Fluentd in #tkrk10

•
•
SATOSHI TAGOMORI
SATOSHI TAGOMORI

About Fluentd in TokyoRubyKaigi10

Related slideshows

Log analysis with Hadoop in livedoor 2013
Log analysis with Hadoop in livedoor 2013Log analysis with Hadoop in livedoor 2013
Log analysis with Hadoop in livedoor 2013
 
NPStudy LT Lagopus Router v19.07
NPStudy LT Lagopus Router v19.07NPStudy LT Lagopus Router v19.07
NPStudy LT Lagopus Router v19.07
 
Apache Spark 1000 nodes NTT DATA
Apache Spark 1000 nodes NTT DATAApache Spark 1000 nodes NTT DATA
Apache Spark 1000 nodes NTT DATA
 
1 of 13
Download to read offline
Fluentd: The ruby based middleware across the world TAGOMORI Satoshi (@tagomoris) 2013/01/14 TokyoRubyKaigi10 #tkrk10 13年1月14日月曜日
TAGOMORI Satoshi (@tagomoris) NHN Japan Corp. 13年1月14日月曜日
13年1月14日月曜日
Fluentd "Fluentd" is a lightweight and flexible log collector. Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds. http://fluentd.org 13年1月14日月曜日
Fluentd easy to install/setup (from rubygems.org) plugins easy to install (from rubygems.org) easy to write (with ruby!) stability (no one crashes in this 1 year) throghput (17500 msgs/sec) td-agent (rpm/deb: ruby and fluentd and some plugins) 13年1月14日月曜日
Fluentd plugins Input plugins Output plugins Buffer plugins Output plugins as filters filtering, transformation, conversion, aggregation, ... 89 plugins! (2013/01/12) 13年1月14日月曜日
Semi-Realtime aggregation in Fluentd (with growthforecast) HTTP Response Status (2xx, 3xx, 4xx, 5xx) HTTP Response Times (Avg, [50,90,95,98,99]%tiles) Beside of transferring 13年1月14日月曜日
Fluentd loggers Ruby, Perl, Python, Node.js, PHP Java, Scala, D Haskell, Erlang, Lua, R 13年1月14日月曜日
Fluentd is used with HTTP Access logs, application logs, ... MongoDB, Cassandra, Redis, Couch, MySQL, PostgreSQL, .... AWS S3, Hadoop HDFS, TreasureData, ... Flume, Scribe, Kafka, ... Zabbix, GrowthForecast, Splunk, IRC, ... 13年1月14日月曜日
Fluentd vs. rsync + batches rsyslog / syslog-ng flume / storm / kafka 13年1月14日月曜日
Fluentd users 13年1月14日月曜日
What Fluentd is What be wanted for long long time from any languages by platform engineers by application engineers by service maintainers 13年1月14日月曜日
Fluentd users may be newbie rubyists (or not) wants to work with many rubyists! Thanks! 13年1月14日月曜日

More Related Content

Fluentd in #tkrk10

  • 1. Fluentd: The ruby based middleware across the world TAGOMORI Satoshi (@tagomoris) 2013/01/14 TokyoRubyKaigi10 #tkrk10 13年1月14日月曜日
  • 2. TAGOMORI Satoshi (@tagomoris) NHN Japan Corp. 13年1月14日月曜日
  • 4. Fluentd "Fluentd" is a lightweight and flexible log collector. Fluentd receives logs as JSON streams, buffers them, and sends them to other systems like Amazon S3, MongoDB, Hadoop, or other Fluentds. http://fluentd.org 13年1月14日月曜日
  • 5. Fluentd easy to install/setup (from rubygems.org) plugins easy to install (from rubygems.org) easy to write (with ruby!) stability (no one crashes in this 1 year) throghput (17500 msgs/sec) td-agent (rpm/deb: ruby and fluentd and some plugins) 13年1月14日月曜日
  • 6. Fluentd plugins Input plugins Output plugins Buffer plugins Output plugins as filters filtering, transformation, conversion, aggregation, ... 89 plugins! (2013/01/12) 13年1月14日月曜日
  • 7. Semi-Realtime aggregation in Fluentd (with growthforecast) HTTP Response Status (2xx, 3xx, 4xx, 5xx) HTTP Response Times (Avg, [50,90,95,98,99]%tiles) Beside of transferring 13年1月14日月曜日
  • 8. Fluentd loggers Ruby, Perl, Python, Node.js, PHP Java, Scala, D Haskell, Erlang, Lua, R 13年1月14日月曜日
  • 9. Fluentd is used with HTTP Access logs, application logs, ... MongoDB, Cassandra, Redis, Couch, MySQL, PostgreSQL, .... AWS S3, Hadoop HDFS, TreasureData, ... Flume, Scribe, Kafka, ... Zabbix, GrowthForecast, Splunk, IRC, ... 13年1月14日月曜日
  • 10. Fluentd vs. rsync + batches rsyslog / syslog-ng flume / storm / kafka 13年1月14日月曜日
  • 12. What Fluentd is What be wanted for long long time from any languages by platform engineers by application engineers by service maintainers 13年1月14日月曜日
  • 13. Fluentd users may be newbie rubyists (or not) wants to work with many rubyists! Thanks! 13年1月14日月曜日