Skip to main content

Monitor alerts

Two pages answer "what is happening" and "did anyone get told": Active alerts and Settings.

Active alerts

Open Insights → Alerting → Active alerts.

Everything firing right now, grouped by the contact point it routes to. The grouping is the useful part: it shows the routing tree's decisions, so an alert sitting under a contact point you did not expect is a routing problem you can see rather than guess at.

Three counts sit at the top, with a refresh control beside them:

CountMeaning
ActiveFiring and notifying
SilencedFiring, with a silence holding the notification
InhibitedFiring, with an inhibition rule holding the notification

A rising Silenced count during an incident usually means a silence set for an earlier problem is covering this one too.

Filter

ControlUse
SearchMatch on an alert name or a label, for example cluster=us-east-1
StateAll, Firing, Silenced, Inhibited
ReceiverNarrow to one contact point

Read a row

Each row carries a severity dot, the alert name, its state, the summary annotation and how long it has been active. Open a row for the full label set.

ChipMeaning
FiringNotifying normally
SuppressedA silence or an inhibition rule is holding the notification back

Act on a row

Silence opens a new silence with matchers already built from that alert's labels. See Silences.

Settings

Open Insights → Alerting → Settings.

Delivery attempts

The recent notification deliveries, with what happened to each one. This is the page that answers "did that page actually go out".

StatusMeaning
SentDelivered to the contact point
FailedThe contact point rejected it or could not be reached. The error is on the row
PendingWaiting for group wait or group interval to elapse
SuppressedThe repeat interval has not elapsed, so this is a repeat that was held
MutedA mute timing on the policy is active
SkippedNothing to deliver to, most often a contact point with no integrations

A row here for every notification you expected, all reading Sent, means the problem is downstream in Slack or the mail server. No row at all means the problem is in routing.

Configuration history

Every applied alerting configuration, newest first, with the receiver it routed to and how many contact points it had.

Restore puts a previous configuration back. Use it when a routing edit broke notifications and you would rather roll back than debug.

Restoring replaces the current routing tree, contact points, templates, mute timings and inhibition rules with the ones in that entry. Anything created since is gone. Alert rules and silences are separate and are left alone.

Which Alertmanager handles routing

OptionWhat it means
Built-inThe Alertmanager that ships with xScaler. Routing, grouping, silences and delivery all happen here, managed for you
ExternalAlerts are forwarded to your own Alertmanager instances, and you own routing, grouping and delivery there

Built-in is the default and is what the rest of these docs describe. Choose External when you already run Alertmanager and want one routing configuration across xScaler and everything else feeding it. Add one URL per instance under External Alertmanager URLs; alerts are sent to all of them.

Switching to External leaves the contact points and policies in xScaler in place and stops using them, so switching back restores what you had.

Alertmanager status

Version, cluster status, uptime and peer count. Worth a glance when notifications stop across the board rather than for one rule.

Rule state

The alert rule list carries each rule's current state. See Alert rules for what the chips mean.

History retention

Alert state changes and delivery records are kept for 30 days.

Permissions

ActionRole
View active alerts, delivery attempts, history and statusMember
Silence an alertEditor
Restore a configurationEditor

Next

Notifications are not arriving walks the delivery path from rule to inbox.