Home Page: https://wiki.ith.intel.com/display/ITSODMS/Observability+Data+Management+Suite+Home

[TOC]

Operator

Prometheus-operator

https://prometheus-operator.dev/

https://github.com/prometheus-operator/prometheus-operator

The prometheus operator manages the Promentheus Clust atop Kubernetes.

Opentelemetry-operator

https://github.com/open-telemetry/opentelemetry-operator

Kubernetes reflector

https://github.com/emberstack/kubernetes-reflector

Reflector is a Kubernetes addon designed to monitor changes to resources (secrets and configmaps) and reflect changes to mirror resources in the same or other namespaces.

OpenTelemetry

Agent & Gateway

Configure by CR opentelemetrycollectors.opentelemetry.io

Agent collect Metric, Logs, and can add labels or attributes, and finally push the data to the opentelemetry gateway.

Gateway receive the data from all of the Agent, and store the data to prometheus, jaeger and elasticsearch.

Metrics

Jaeger

Metrics

Exporter

Telegraf

cAdvisor

eBPF-exporter

IPMI-exporter

EMON-exporter

OpenTelemetry-Collector

Prometheus

Service Discovery

prometheus discovery metrics api by CR servicemonitors.monitoring.coreos.com.

For kubernetes components metrics, add servicemonitor by kube-prometheus-stack.

 1NAMESPACE        NAME                                           AGE
 2default          odms-grafana                                   2d19h
 3default          odms-kube-prometheus-alertmanager              2d19h # kube-prometheus-stack
 4default          odms-kube-prometheus-apiserver                 2d19h # kube-prometheus-stack
 5default          odms-kube-prometheus-coredns                   2d19h # kube-prometheus-stack
 6default          odms-kube-prometheus-kube-controller-manager   2d19h # kube-prometheus-stack
 7default          odms-kube-prometheus-kube-etcd                 2d19h # kube-prometheus-stack
 8default          odms-kube-prometheus-kube-proxy                2d19h # kube-prometheus-stack
 9default          odms-kube-prometheus-kube-scheduler            2d19h # kube-prometheus-stack
10default          odms-kube-prometheus-kubelet                   2d19h # kube-prometheus-stack
11default          odms-kube-prometheus-prometheus                2d19h # kube-prometheus-stack
12default          odms-kube-state-metrics                        2d19h
13default          odms-otel-gateway-monitor                      2d19h # Metrics for otel
14default          odms-prometheus-node-exporter                  2d19h
15odms-operators   odms-kube-prometheus-operator                  17d   # kube-prometheus-stack

Grafana

Configure DataResource

 1kind: ConfigMap
 2metadata:
 3  labels:
 4    app: odms-otel-grafana
 5    grafana_datasource: "1"    # label for grafane, who is the operator?
 6  name: odms-otel-grafana-datasource
 7  namespace: default
 8apiVersion: v1
 9data:
10  datasource.yaml: |-
11    apiVersion: 1
12    datasources:
13      - name: "Prometheus"

Configure DashBoard

 1apiVersion: v1
 2kind: ConfigMap
 3metadata:
 4  labels:
 5    grafana_dashboard: "1"   # label for grafane, who is the operator?
 6  name: odms-dashboards
 7  namespace: default
 8data:
 9	CPU.json: |-
10		# dashboard json configuration

NFS

  1. Where is the grafana dashboras configuration?
  2. Where is the data resource of Metrics, Log & Trace?

Reference

How to install and configure an NFS server on Ubuntu

NFS external provisioner