Drupal 8 integration with ELK stack to provide tracking and reporting in multi-tier enterprise architecture.

In the context of digital enterprises increasingly multi channel delivery becoming important and hence the work that I am doing is finding an important place in many an enterprise solutions. For the past 5 months I have been working on logging for to create reports and metrics which will be more efficient, more real time which gives you computed result in the form of various charts, graphs and data tables. Achieving this for a multi tier application as per the enterprise customer needs is done using ELK stack.

ELK Stack? so "ELK" is the acronym for Elasticsearch, Logstash, and Kibana. It is  the most popular open source logging platform. ELK makes possible to get Everything Unfold in Real Time. Elastic Stack to enrich your analyses, and simplify your architecture.

In this session, we will walk through:

• How to place Drupal for ELK.
• How to make customized logs to generate efficient reports.
• Why there is a need of customizing Drupal logs?
• Advantages of attaching guzzle middleware to Drupal kernel master requests.
• How efficient and useful to have kibana visualizations and dashboards.
• Better report to satisfy enterprise customer needs.
• Initiative to propose a layer to customise logs as a part of Drupal core.

This session also includes a detailed demonstration on the following,

• Define log structure as per the application - a multi tier application.
• Implement the custom logs defined in Drupal with the help of guzzle.
• Setup filebeat, logstash and kibana to implement ELK stack.
• View realtime logs with filters at kibana.

• Use of visualizations to generate reports such as data table, charts, timely report etc.
• Create sample dashboard to visualize the reports to find the following in a go.
• Most visited pages  Which page have more loading time.
• Error reports across pages.

Intended Audience:

• Anyone who is curious to know about ELK.
• Anyone who needs to have a look at the drupal logs as a structured data.