PBS MoM Log Analysis in ELK Stack

Users/Site Administrators
4

Hi All,

Project: PBS MoM log Analysis in ELK Stack

Below are my leanings from the project:

  1. Just to give an overview ELK Stack consists of four main components i.e: Elasticsearch, Logstash, Kibana and Filebeat(to be installed on client machine).

  2. Elasticsearch, Logstash, Kibana were installed on Centos7 instance and Filebeat was installed on PBS Pro Cluster(Has shared file system).

  3. Filebeat can be installed on multiple clients in-case the log data is coming from different sources.

  4. Grok filter in logstash helps us reading pbs_mom logs. It needs to be designed as per your requirements.

  5. Analyzed PBS mom_logs through Kibana and have created a sample dashboard which shows visualizations of the data. Below are the snapshots:

    image
    image.png786×356 22.2 KB

    image
    image.png866×366 20.9 KB

Any further ideas are highly welcome!!

Thanks,
Rakhen

1 Like