Content Packs Log Analytics Log Insight vRealize Operations Insight

OpenStack: Demystifying OpenStack logs using vRealize Log Insight

The VMware Integrated OpenStack (VIO) team is happy to announce the availability of the OpenStack content pack for Log Insight! The content pack features 11 dashboards, 56 widgets in an easy to understand, visual representation on how well operationally, the OpenStack setup is working.

Background

An OpenStack setup usually consists of a very (large) pool of compute, storage and network resources. One of the biggest challenges for OpenStack administrators is monitoring these stacks and analyzing logs for anomaly and problem detection. The OpenStack Log Insight Content Pack gives operators and administrators a powerful tool to monitor their OpenStack setup and is the log monitoring product for the VMware Integrated OpenStack (VIO) solution.

OpenStack VIO Compute (Nova) supports the VMware vSphere product family. The VMware vCenter drivers enable the nova-compute service to communicate with VMware vCenter servers that manage the ESXi host clusters. The VMware virtual disk driver enables the management of the OpenStack Block Storage volumes on vCenter managed data stores.

Datacenter networks contain many devices – servers, network equipment, storage systems and security appliances. OpenStack Networking (Neutron) allows for a pluggable, scalable and API-driven system for managing networks and IP addresses. Object Storage offers a cost effective, scale-out storage that allows for a fully distributed storage platform that is API-accessible and can be integrated directly into applications for backup, archiving and data retention.

 

OpenStack Log Insight Error Dashboard
Log Insight Error Dashboard For OpenStack

OpenStack + Log Insight

Using the powerful log analytics and graphing capabilities of Log Insight, an administrator can see trends and issues as well as trigger alerts on specific events of interest. Having different OpenStack component’s events logged in the same tool allows an administrator to correlate events that led to a situation and to help in troubleshooting and root cause analysis. Log Insight provides a single interface to monitor and manage all OpenStack component’s logs simplifying troubleshooting and correlating events.

VIO OpenStack Overview Dashboard
VMware VIO Overview Dashboard

Log Insight includes new cluster technology to allow your log analytics efforts to scale to new heights.

Log Insight helps users find virtual infrastructure problems with the addition of Intelligent Grouping Machine learning technology that groups data and adds predictive analytics, an important technology that aids in detecting problems more quickly and effectively. Log Insight features an intuitive GUI-based interface that makes it easy to run interactive searches as well as deep analytical queries for quick, actionable insights.

In addition to the native out of the box capabilities of Log Insight, OpenStack Log Insight Content Pack provides operators and administrators with additional tools and dashboards to monitor their OpenStack environments. The dashboards and widgets include some OpenStack specific information and views, for example:

  • Detailed widgets for each OpenStack component Nova, Neutron, Keystone, Cinder …etc.
  • API specific metrics, such as API requests per hour, API response time, etc.
  • Environment utilization such as average vCPU/RAM usage per host and per instance
OpenStack Error Dasboard in Log Insight
OpenStack Error Dashboard in Log Insight

The OpenStack content pack offers easy to understand, visual representation on how well operationally, the OpenStack setup is working. The content pack sorts the log messages collected by feature and technology type, for quick simple representation of messages by severity level, and the impact of these operationally. The Overview dashboard gives a summarized view of the events that have been recorded on the OpenStack setup.

The richness of these dashboards is due to both the extensibility of the OpenStack setup, verbose logging, and the flexibility of Log Insight.  Together, these tools give administrators a valuable tool in monitoring and troubleshooting their OpenStack environment.

Where do I get the Content Pack?

You can download this OpenStack content pack from solution exchange –

https://solutionexchange.vmware.com/store/products/openstack-content-pack

OR You can download the content pack from the in-product Marketplace in Log Insight 2.5 or newer –

 

Content Pack Market Place
Content Pack Market Place

 

Summary

The OpenStack content pack offers easy to understand, visual representation on how well operationally, the OpenStack setup is working. The content pack sorts the log messages collected by feature and technology type, for quick simple representation of messages by severity level, and the impact of these operationally. The Overview dashboard gives a summarized view of the events that have been recorded on the OpenStack setup.

The richness of these dashboards is due to both the extensibility of the OpenStack setup, verbose logging, and the flexibility of Log Insight.  Together, these tools give administrators a valuable tool in monitoring and troubleshooting their OpenStack environment.

And don’t forget to try Log Insight. Take a hands on lab now….

Log Insight Hands On Lab

Comments

7 comments have been added so far

  1. Hi Yogi

    We’ve been using the vRealize Automation Content pack for some time now and it’s been incredibly useful. We had some initial setup to do to classify our servers in agent groups and define the log locations.

    Following this we’re now using the Open Stack content pack and were surprised that there was no documentation on how to configure it. No agent groups to add servers to to pick u configuration. We’re now seeing that although we’ve installed the agent on a number of our servers we’re only getting default OS logging and none of the expected Open Stack intelligence.

    Is there any configuration for this config pack or should it work out of the box?

  2. Hi Alistair,

    Thanks for trying the content pack.
    The only setup steps required for the content pack to work are:
    If the hostname or IP address of LogInsight server was already specified in ‘Syslog Server Address’ field during OpenStack deployment, no other configuration is required.

    If OpenStack is not deployed yet, enter hostname or IP of LogInsight server in ‘Syslog Server Address’ field in OpenStack deployment wizard.

    If OpenStack is already deployed, but syslog was not configured during deployment.
    1) Login to vSphere Web Client.
    2) Navigate to Home -> VMware Integrated OpenStack.
    3) Select the ‘Manage’ tab.
    4) Select settings and Syslog Server.
    5) Edit Syslog server address, protocol and port number.

    Do you know if these steps have been done? If you have and you are still not getting any data we might need to check over a webex with folks from the VIO team. Let me know.

    1. Hi Yogita, thanks for your quick response.

      Quick summary is that we’ve not configured syslog from open stack to the log insight server.

      We are using Ubuntu Open Stack and we’ve installed and configured the Log Insight agent with the default settings which uses the cfapi protocol rather than syslog. This is working because we’re getting some events from the OS via the Linux Management Pack (/var/log/auth.log and /var/log/syslog) but none of the open stack intelligence or dashboards we’re hoping for.

      Should we be using syslog rather tha cfapi and should we be configuring this in the openstack application rather than the log insight agent?

      Thanks again for your help

      Alistair

      1. Aha, I think that is where the issue is ; this content pack does not have an agent config as VIO did not support installing the agent and collecting logs. If you have installed the agent and would like to use it to collect logs then you will have to find out the log locations of the VIO components and create your own agent config and add it to the liagent.ini. If this seems like a huge and complicated task my recommendation is that you should configure the openstack application to send syslog to the LI server directly. Hope this helps.

        1. Fantastic, thanks Yogita.

          So to summarise we should be able to use the contect pack for a non VMware Integrated version of open stack but we will need to configure the open stack components to ensure their application logs are delivered (somehow) to the log insight sever.

          Thanks again

          Alistair

          1. Yes you should however certain widgets like those on dashboard VMware – VIO may not work as they expect the log format in a specific way. You can clone the widgets to your user space and modify the widget query to look for the log type in your environment.

  3. Hello Yogita,
    it will be possible to have an example of how to configure an agent for a nova-compute for example? or for glance? when using a standard Openstack installation (not VIO)?
    i’ve configured an agent oin this way : for nova controller):
    [filelog|nova_novacc]
    directory=/var/log/nova
    parser=auto

    [filelog|neutron_novacc]
    directory=/var/log/neutron

    but it only grabs some very basic informations and it populates 2 out of 10 oif the panels in the nova dashboard

    any tips?

    Many thnaks

    Kind Regards

Leave a Reply

Your email address will not be published. Required fields are marked *