[PLUG-ANNOUNCE] Announcement: August PLUG Advanced Topics: Using Mozilla's Heka project for log and event stream processing

Michael Dexter dexter at ambidexter.com
Tue Aug 18 05:23:47 UTC 2015


Portland Linux/Unix Group Advanced Topics Meeting Announcement

Who: Nathan Williams
What: Using Mozilla's Heka project for log and event stream processing
Where: Free Geek, 1731 SE 10th Avenue, Portland (Left Entrance)
When: Tuesday, August 18th, 2015 at 7pm
Why: The pursuit of technology freedom
Stream: http://pdxlinux.org/live/

Talk: A Practical Introduction to Scalable Stream Processing with Heka 
and how the log and event processing system at Treehouse has evolved 
from a typical Elasticsearch/Logstash/Kibana setup into a Heka-based 
system. We will also discuss the why behind this move and where we are 
headed.

Heka is an open source stream processing software system developed by 
Mozilla. Heka is a “Swiss Army Knife” type tool for data processing, 
useful for a wide variety of different tasks, such as:

* Loading and parsing log files from a file system.

* Accepting statsd type metrics data for aggregation and forwarding to 
upstream time series data stores such as graphite or InfluxDB.

* Launching external processes to gather operational data from the local 
system.

* Performing real time analysis, graphing, and anomaly detection on any 
data flowing through the Heka pipeline.

* Shipping data from one location to another via the use of an external 
transport (such as AMQP) or directly (via TCP).

* Delivering processed data to one or more persistent data stores.

https://github.com/mozilla-services/heka

Nathan is a sysadmin by trade who's been into Linux, automation and data 
for the last 10 years and is currently working at Treehouse as a systems 
developer.

Calagator Page: http://calagator.org/events/1250468938

Many will head to the Lucky Lab at 915 SE Hawthorne Blvd. after the meeting.

Rideshares Available

PLUG Page with information about all PLUG events: http://pdxlinux.org/
Follow PLUG on Twitter: http://twitter.com/pdxlinux

PLUG is open to everyone and does not tolerate abusive behavior on its 
mailing lists or at its meetings.

See you there!

Michael Dexter
PLUG Volunteer



More information about the PLUG-announce mailing list