Skip to main content

Ceph

Monitor Ceph — cluster health, OSD status, pool I/O, PG states, and capacity utilization — using Ceph's built-in MGR Prometheus module.

Pattern: Ceph MGR prometheus module → Prometheus scrape → xScaler remote_write


Prerequisites

  • Ceph Octopus (15.x) or later
  • Ceph MGR accessible from Prometheus
  • xScaler tenant credentials (token + tenant ID)

Enable Prometheus Module

ceph mgr module enable prometheus

Metrics are exposed at http://<mgr-host>:9283/metrics.


Option A — Prometheus

scrape_configs:
- job_name: ceph
static_configs:
- targets: ['ceph-mgr-host:9283']
scrape_interval: 60s

remote_write:
- url: https://euw1-01.m.xscalerlabs.com/api/v1/push
authorization:
credentials: <token>
headers:
X-Scope-OrgID: <tenant-id>

Option B — Grafana Alloy

prometheus.scrape "ceph" {
targets = [{"__address__" = "ceph-mgr-host:9283"}]
forward_to = [prometheus.remote_write.xscaler.receiver]
scrape_interval = "60s"
}

prometheus.remote_write "xscaler" {
endpoint {
url = "https://euw1-01.m.xscalerlabs.com/api/v1/push"
authorization {
type = "Bearer"
credentials = "<token>"
}
headers = { "X-Scope-OrgID" = "<tenant-id>" }
}
}

Option C — OpenTelemetry Collector

receivers:
prometheus:
config:
scrape_configs:
- job_name: ceph
static_configs:
- targets: ['ceph-mgr-host:9283']
scrape_interval: 60s

processors:
batch:
timeout: 10s

exporters:
otlphttp/xscaler:
endpoint: https://euw1-01.m.xscalerlabs.com
headers:
Authorization: "Bearer <token>"
X-Scope-OrgID: "<tenant-id>"
compression: gzip

service:
pipelines:
metrics:
receivers: [prometheus]
processors: [batch]
exporters: [otlphttp/xscaler]

Logs

Collect Ceph cluster log including OSD, MON, and MDS events. Add the following to your Alloy config:

local.file_match "ceph_logs" {
path_targets = [{
__address__ = "localhost",
__path__ = "/var/log/ceph/ceph.log",
instance = constants.hostname,
job = "integrations/ceph",
}]
}

loki.source.file "ceph_logs" {
targets = local.file_match.ceph_logs.targets
forward_to = [loki.write.xscaler.receiver]
}

loki.write "xscaler" {
endpoint {
url = "https://euw1-01.l.xscalerlabs.com/api/v1/logs/push"

http_client_config {
authorization {
type = "Bearer"
credentials = env("XSCALER_TOKEN")
}
}

headers = { "X-Scope-OrgID" = env("XSCALER_TENANT_ID") }
}
}

Key metrics

MetricDescription
ceph_health_statusOverall cluster health (0=OK, 1=WARN, 2=ERR)
ceph_cluster_total_bytesTotal cluster capacity
ceph_cluster_used_bytesUsed cluster capacity
ceph_osd_inOSDs marked in
ceph_osd_upOSDs currently up
ceph_pool_rd_bytesPool read throughput
ceph_pool_wr_bytesPool write throughput
ceph_pg_activeActive placement groups