Grafana Labs Announces Updates to Kubernetes Monitoring Solution, Open Source Innovations, and Findings from 2024 Observability Survey
Grafana Labs, the company behind the world's most ubiquitous, open and composable operational dashboards, today announced new enhancements to help address the challenges of Kubernetes monitoring and provided updates on its contributions to the open source ecosystem. These updates come in advance of KubeCon + CloudNativeCon Europe, the industry's largest open source conference dedicated to Kubernetes, Prometheus, and other cloud-native technologies, taking place March 19-22 in Paris, France. These new developments will be featured at the Grafana Labs KubeCon booth (L6).
The company also released the findings from its second annual Observability Survey which provides insight into the evolving observability market. For example, despite open source technology continuing to be a critical piece of 98% of respondents' observability stacks, it's still not enough to offset concerns about cost, which is cited as their biggest concern when it comes to observability. The report underscores the critical role observability plays in modern IT landscapes, delving into the number and types of observability tools organizations are using; the challenges and benefits that come with centralized observability; and the impact of company size and industry on adoption and maturity.
Kubernetes Monitoring Enhancements in Grafana Cloud
"As Kubernetes becomes a de facto standard and organizations continue to mature in their observability strategy, integrating your infrastructure fleets with your observability platform becomes more powerful and necessary," said Tom Wilkie, Grafana Labs CTO and CNCF Governing Board member. "This is highlighted by the results of our 2024 Observability Survey, which shows the escalating importance of cost efficiency and the CNCF's findings that Kubernetes adoption drove up costs for almost 50% of respondents. That's why we're focused on making it easy to get started with observability and Kubernetes monitoring with Grafana Cloud, including our generous forever free tier, to help customers understand the behavior of their infrastructure and improve resource utilization."
Kubernetes Monitoring in Grafana Cloud makes it easier to monitor Kubernetes clusters by allowing users to visualize and analyze key metrics related to Kubernetes environments, track resource usage, and gain insights into the behavior of their applications within Kubernetes. New updates offer seamless setup and deployment, quick and easy issue management, fine-grained cost monitoring, and more:
- Deploy and scale easier: Users no longer have to use Grafana Agent or Grafana Agent Operator to manually configure infrastructure data. With the new Grafana Kubernetes Monitoring Helm chart, it's easier to send metrics, logs, events, traces, and cost metrics to Grafana Cloud. Plus, you can customize the chart for your specific needs. In addition, IBM Cloud is now a configurable option as part of the out-of-the-box Helm chart.
- Respond to alerts quicker: You can now respond to and troubleshoot Kubernetes alerts without leaving the context of Grafana Kubernetes Monitoring. You can start your troubleshooting either through the "Pods in trouble" section on the home page or the Alerts page. The updated Alerts page provides a centralized location to view all alerts related to your Kubernetes infrastructure and the applications running within it. From here, you can see graphs showing alerts by cluster and namespace, as well as by alert severity, making it easier to filter and drill down into issues to resolve them more quickly.
- Get a 360° view of your infrastructure data: The Kubernetes monitoring interface now provides a comprehensive overview and detailed analysis of your cluster's health and performance. The main page offers a snapshot of critical issues, displaying graphs for Clusters, Nodes, Pods, and containers, regardless of your cloud provider or Kubernetes distribution. In addition, the new time picker facilitates historical data analysis, allowing for the examination of resource usage over selected time frames, which is crucial for addressing inefficiencies and managing costs.
- Monitor, predict, and optimize resource usage: The New Summary views for Clusters, Nodes, Workloads and Namespaces now correlate CPU, memory, and storage usage, aiding in performance troubleshooting and identifying underutilized resources. Predictive features, enabled by the Machine Learning plugin, provide forecasts for CPU and memory usage to optimize resource allocation in every component insights view. Together, these features enable a robust approach to managing Kubernetes clusters, ensuring efficient resource use and cost-effectiveness.
- Keep on top of Kubernetes costs: Kubernetes Monitoring provides cost monitoring tools that allow you to correlate resource management to cost attribution. With the new Pod and Container detail pages, users can now see a breakdown of costs on a per-container or per-pod basis.
- Bring your own tools: Kubernetes Monitoring is now listed in the AWS marketplace as an EKS add-on. In addition, ClickHouse, InfluxDB and Presto integrations are now available to use with Kubernetes Monitoring and provide out-of-the-box dashboards, alerts and recording rules for an easy services observability start.
Additional Kubernetes Updates
- Robust Application Observability integration: Monitor the application layer running on your Kubernetes infrastructure at the pod and workload level. Identify root causes quickly by waving off the complexity of correlating infrastructure health with application performance. Never lose context and easily navigate between Application Observability and Kubernetes Monitoring apps in Grafana Cloud.
- Kubernetes support in Beyla: Grafana Labs' 2024 Observability Survey found that eBPF is one of the technologies respondents are most excited about. Now, with Grafana Labs' open source eBPF-based auto-instrumentation tool Beyla adding full Kubernetes support, users can incorporate Kubernetes metadata into the telemetry it generates, allowing for grouping and filtering by deployment, namespace, cluster, and other parameters. With this update, the Grafana Beyla configuration now "understands" Kubernetes semantics to provide a more fine-grained selection of services to instrument.
- Grafana Operator migration: Grafana Operator, the open source Kubernetes operator that helps you manage your Grafana instances within and outside of Kubernetes, will now officially be managed by Grafana Labs. Moving the operator under the Grafana Labs umbrella will help ensure seamless compatibility with Grafana Cloud, foster a more focused and collaborative community effort, drive better documentation, and keep up with cutting-edge feature development.
Continued support of CNCF open source projects
As the only company to be a leading contributor to both OpenTelemetry and Prometheus, Grafana Labs is committed to continuing to invest in these projects as they see strong adoption, separately and together. According to the 2024 Observability Survey, an overwhelming majority of respondents report that they are investing in Prometheus (89%) or OpenTelemetry (85%). Almost 40% of respondents use both in their operations, and more than 50% increased their usage of both projects over the past year. As reliance on these projects continues to grow, Grafana Labs is focused on increasing interoperability with each other and Grafana.
"Grafana Labs' history with OpenTelemetry can be traced back to its predecessor projects, OpenCensus and OpenTracing. However, our investment in the project has only increased over time as we identify areas that make sense for our users," said Juraci Paixão Kröhling, Principal Software Engineer at Grafana Labs and OpenTelemetry Governing Board Member. "With metrics, and more recently logging, marked as stable in OpenTelemetry, we're seeing the project gain momentum among Grafana users as more people are coupling it with Prometheus as the backend. Because we want to be where our users are, our goal is to continue to make it easier for them to get value from OpenTelemetry."
You can learn more about Grafana Labs' open source contributions at the following KubeCon talks:
- Tuesday, March 19 at 15:15 CET: Observability Day Session ? Real-World Sampling ? Lessons Learned After Reducing ~80% of Our O11y Costs featuring Juraci Paixão Kröhling, Principal Software Engineer
- Tuesday, March 19 at 15:50 CET: Cilium + eBPF Day Session ? Curveballs: Learnings from Instrumenting Managed Runtime Applications with eBPF featuring Mario Macías, Senior Software Engineer, and Nikola Grcevski, Principal Software Engineer
- Tuesday, March 19 at 17:35 CET: Lightning Talk ? Debunking Myths About Environmental Sustainability in the Cloud, Building a Greener CNCF Landscape featuring Niki Manoledaki, Software Engineer & CNCF Environmental Sustainability Lead
- Wednesday, March 20 at 16:30 CET: Session ? Disintegrated Telemetry: The Pains of Monitoring Asynchronous Workflows featuring Johannes Tax, Principal Software Engineer
- Thursday, March 21 at 17:25 CET: Session ? Prometheus Update from the Maintainers featuring Bryan Boreham, Distinguished Engineer
- Thursday, March 21 at 17:25 CET: Session ? Rebuilding Your Cloud Native Community: Lessons Learned from Stardew Valley featuring Imma Valls, Senior Developer Advocate
- Friday, March 22 at 14:00 CET: Contribfest ? Hands-On Scaling of Prometheus Metric Collection with Kubernetes Operators featuring Jesus Vazquez, Senior Software Engineer
- Friday, March 22 at 16:00 CET: Session ? Deploying with Confidence: Lessons Learned Navigating Deployments of a 100-Strong Development Team featuring Stephanie Hingtgen, Senior Software Engineer II, and Michael Mandrus, Senior Software Engineer
About Grafana Labs
Grafana Labs provides an open and composable monitoring and observability stack built around Grafana, the leading open source technology for dashboards and visualization. There are more than 3,000 Grafana Labs customers, including Bloomberg, Citigroup, Dell Technologies, Salesforce, and TomTom, and more than 20 million users of Grafana around the world. Grafana Labs helps companies manage their observability strategies with the LGTM Stack, which can be run fully managed with Grafana Cloud or self-managed with the Grafana Enterprise offerings, both featuring scalable metrics (Grafana Mimir), logs (Grafana Loki), and traces (Grafana Tempo) as well as extensive enterprise data source plugins, dashboard management, alerting, reporting, and security. Grafana Labs is backed by leading investors Lightspeed Venture Partners, Lead Edge Capital, GIC, Sequoia Capital, Coatue, and J.P. Morgan. Follow Grafana Labs on LinkedIn and Twitter or visit https://grafana.com.
News published on and distributed by:
