Saturday, September 14, 2019

FogLogic Launches AIOpsipedia

FogLogic has created AIOpsipedia, an informational and educational resource for IT Operations professionals looking to explore the world of AIOps and IT ops modernization. 

AIOpsipedia defines the most important AIOps-related terms and concepts, people and organizations, and tools and technologies. 


Friday, September 13, 2019

IT App Complexity Caused by Large Data Sets, Multiple Platforms, High Volumes

According to AppDynamics, large data sets and multiple platforms and high volumes of data of multiple types are among the sources of complexity in enterprise application environments. 



AIOps Reduce False Alarm Noise

AIOps platforms enhance IT operations by combining big data, machine learning and visualization to create actionable insights. 

Compared to more traditional monitoring tools, AIOps seeks to reduce noise (false alarms or redundant events), capture anomalies on a dynamic basis, provide a better causality trail, to help identify incident causes, then extrapolate to future events and take actions to resolve problems, either automatically or with IT staff approval. 


A sampling of AIOps platforms would include a large number of firms, ranging from Anodot to VuNet. These suppliers have the ability to ingest data from multiple sources, including historic and real-time streaming, and/or have different offerings that include proprietary, open source, free and commercialized versions, including deployment that cuts across on-premises and SaaS-based options.


AIOps platforms have historically focused on a single data source like logs or metrics. New data stores include digital experience data, order data, sentiment data from social media, service desk requests and statuses and account activity. 


OpsRamp Says Alerting, Root Cause Analysis, Anomaly Detection are Top AIOps Use Cases

AIOps platforms enhance IT operations by combining big data, machine learning and visualization to create actionable insights. The top use cases for AIOps tools include intelligent alerting (69 percent), root cause analysis (61 percent), and anomaly detection (55 percent), according to one survey conducted for OpsRamp. 

The survey found the three biggest advantages of using AIOps tools are productivity gains from the elimination of low-value, repetitive tasks across the incident lifecycle (85 percent), rapid issue remediation with faster root cause analysis (80 percent), and better infrastructure performance through reduction in incident and ticket volumes (77 percent). 

With modern machine learning technologies, 40 percent of organizations fixed incidents 26 percent-50 percent faster, 37 percent reduced mean time to resolve by 51 percent to 75 percent while 10 percent brought down overall incident resolution times by more than 76 percent, OpsRamp says. 

Compared to more traditional monitoring tools, AIOps seeks to reduce noise (false alarms or redundant events), capture anomalies on a dynamic basis, provide a better causality trail, to help identify incident causes, then extrapolate to future events and take actions to resolve problems, either automatically or with IT staff approval.

Visibility is the Big Problem AIOps Tries to Solve

As disparate apps proliferate in enterprise environments, so have the number of uncorrelated data sources, the sheer amount of data produced and the number of false alarms and operational problems whose causes are opaque.

Visibility is the big problem AIOps attempts to remedy. Operations teams often cannot correlate data from multiple monitoring systems. Today, the objective is prediction, not simply observation; application performance, not simply hardware status; the ability to ingest and make sense of apps that produce huge volumes of data. 

Two decades ago, for example, operations staff could not monitor an app server's performance inside a Java virtual machine (JVM).

Today, the issue is resiliency and performance issues of containerized microservices, analysts at Forrester say. 

AIOps applies artificial intelligence, machine learning or other advanced analytics to business and operations data, providing correlations, prescriptive and predictive answers in real time. 

Enterprise monitoring solutions using an AIOps approach include CA Technologies, Zenoss and others, Forrester notes. 

Intelligent analytics overlay apps provided by firms such as BigPanda, FixStream, and Moogsoft have developed solutions that provide an intelligent overlay of AI or ML algorithms that ops teams can apply across multiple monitoring solutions. 


AIOps Best for Anomalies, Noise, Alert Correlation

Within the IT operations and monitoring space, AIOps is most suitable for appli­cation performance monitoring, informa­tion technology infrastructure management), network performance monitoring and diagnostics and information technology event correlation and analysis, say analysts at Boston Consulting Group.

The common denominator for AIOps is that the systems help automate routine manual operations activities.

 Three use cases hold the greatest short-term potential, according to BCG:
  • Anomaly detection
  • Noise reduction
  • Triaging and alert correlation

Anomalies and unusual behavior—such as a sudden spike in application use—is a clear use case, reducing the amount of manual observation and hard-coded rules that require teams to define anomalies up front. BCG says only about 11 percent of CIOs currently use anomaly detection AIOps tools, but that figure should grow to 42 percent by 2021.

Machine learning algorithms built into AIOps platforms could prioritize alerts on the basis of their business impact and filter out false positives, freeing IT operations teams to spend their time addressing critical alerts instead of managing static filters, writing rules, and adjusting thresholds to reduce alert noise, BCG argues.

About nine percent of CIOs now use noise reduction tools in AIOps, but our survey data shows that the percentage could rise to 42 percent by 2021.

AIOps also could automatically associate alerts that cut across various IT services into a single incident to speed up triage. That could help teams determine whether different alerts are related, and then cluster the results into a single, unified incident. 

For example, a monitoring tool might create multiple memory and page-fault alerts from hosts of the same SQL cluster. The ML algorithm in the AIOps tool, when properly trained through supervised learning, could correlate alerts into a single incident, allowing the IT operations team to distinguish between alerts belonging to that incident and similar but unrelated alerts. 

About 10 percent of the CIOs surveyed by BCG say they already use some sort of AIOps-enabled triaging solution today, and 40 percent say that they’re open to using this type of solution within the next three years.

The market for core AIOps is projected to grow from $9.4 billion in 2017 to $13.8 billion in 2021, a compound annual growth rate of 10 percent. AIOps orchestrators—platforms built to orchestrate insight and actions on the basis of log data from various monitoring solutions—are expected to grow by 26 percent over the same period, BCG predicts. 


BCG believes AIOps will help transform IT operations in three critical ways, providing end-to-end visibility, providing evidence-backed insights and recommendations and executing recommendations automatically.

Eventually, IT teams will have to decide how much they allow the machine learning algorithms to make independent decisions about configuration of services and environments. Few will be comfortable, early on. Later on, with experience, attitudes could change. 



MWC and AI Smartphones

Mobile World Congress was largely about artificial intelligence, hence largely about “AI” smartphones. Such devices are likely to pose issue...