Awesome Logging Infrastructure Using The Elastic Stack
One of the hottest and most widely used tools for log monitoring and analytics at the moment is the Elastic Stack:
- Elasticsearch doing the hard work of analyzing and searching large amounts of data.
- Logstash for parsing and enrichment.
- Beats as a lightweight agent or forwarder.
- Kibana for powerful visualizations.
This talk gives you an overview of the four technologies, how they are working together, and how they can solve your problems.
- We start off by installing Elasticsearch and then explore the querying and visualization capabilities of Kibana.
- Then we monitor the virtual machine on which the Elastic Stack is running by using Filebeat to collect various logs, Metricbeat for system metrics, and Packetbeat to monitor the network. We explore how to monitor various applications such as nginx, MongoDB, or Redis and how to make the stack more resilient by buffering messages in a queue.
- Finally, we take a look at the default dashboards in Kibana and how to add security and a lot more with X-Pack.
Everybody must have a laptop with the current version of Virtualbox installed and we need 2.5GB or memory for the VM.
Philipp will provide a USB stick with a VM that contains all the dependencies, so you won’t need to download anything.