Logstash is a powerful open source data processing pipeline. It helps you collect, parse, store, and analyze data from a variety of sources. It can ingest data from a variety of sources, such as log files, databases, and message queues. Logstash can also transform and enrich data before it is stored in a data store, such as Elasticsearch. Logstash is highly extensible, allowing you to add new inputs, filters, and outputs to customize the data processing pipeline. As a data processing pipeline, Logstash enables you to process data from multiple sources, including unstructured data, and to output it in various formats, such as JSON or CSV. Logstash is used by organizations of all sizes, from small startups to large enterprises. It is also used for a variety of purposes, such as log collection and analysis, application monitoring, and security analytics.
Logstash needs other tools to add functionality to serve as complete log management tools and also provides very limited correlation. While Motadata is a complete package to manage and analyze log from any source and also provides correlation with flow data and metrics.
The Discontinued Project has been discontinued according to its github page. See https://github.com/mozilla-services/heka/
The discontinued logsniffer is no longer maintained. The latest version, 0.5.6, released in July 2016, can still be downloaded from GitHub.
Warning The link goes to a scam website now.
Loom comes with an automated log analysis engine that analyzes logs in all formats, in real time as they are transmitted.