[PLUG-ANNOUNCE] Announcement: August PLUG Advanced Topics: Using Mozilla's Heka project for log and event stream processing
Michael Dexter
dexter at ambidexter.com
Tue Aug 18 05:23:47 UTC 2015
Portland Linux/Unix Group Advanced Topics Meeting Announcement
Who: Nathan Williams
What: Using Mozilla's Heka project for log and event stream processing
Where: Free Geek, 1731 SE 10th Avenue, Portland (Left Entrance)
When: Tuesday, August 18th, 2015 at 7pm
Why: The pursuit of technology freedom
Stream: http://pdxlinux.org/live/
Talk: A Practical Introduction to Scalable Stream Processing with Heka
and how the log and event processing system at Treehouse has evolved
from a typical Elasticsearch/Logstash/Kibana setup into a Heka-based
system. We will also discuss the why behind this move and where we are
headed.
Heka is an open source stream processing software system developed by
Mozilla. Heka is a “Swiss Army Knife” type tool for data processing,
useful for a wide variety of different tasks, such as:
* Loading and parsing log files from a file system.
* Accepting statsd type metrics data for aggregation and forwarding to
upstream time series data stores such as graphite or InfluxDB.
* Launching external processes to gather operational data from the local
system.
* Performing real time analysis, graphing, and anomaly detection on any
data flowing through the Heka pipeline.
* Shipping data from one location to another via the use of an external
transport (such as AMQP) or directly (via TCP).
* Delivering processed data to one or more persistent data stores.
https://github.com/mozilla-services/heka
Nathan is a sysadmin by trade who's been into Linux, automation and data
for the last 10 years and is currently working at Treehouse as a systems
developer.
Calagator Page: http://calagator.org/events/1250468938
Many will head to the Lucky Lab at 915 SE Hawthorne Blvd. after the meeting.
Rideshares Available
PLUG Page with information about all PLUG events: http://pdxlinux.org/
Follow PLUG on Twitter: http://twitter.com/pdxlinux
PLUG is open to everyone and does not tolerate abusive behavior on its
mailing lists or at its meetings.
See you there!
Michael Dexter
PLUG Volunteer
More information about the PLUG-announce
mailing list