Skip to main content

Get alerted when something breaks

Alice, the platform engineer, turns on deploy notifications for the model qwen-chat and creates an alert token, so an alert from her own tool starts a Nova investigation and she hears about a problem before Bob does. She writes the alert rules in that tool.

Before you start​

  • An alerting tool with webhooks and your rules.
  • Organization owner or admin. Slack needs Enterprise.

1. Alice turns on notifications​

Path: Workloads > Models > qwen-chat > Update > Notifications (qwen-chat is your model deployment's name)

  1. Application Pipeline Notifications on.
  2. Slack Notifications on (Enterprise).
Open zoom view

Notifications step: Application Pipeline Notifications switch, Slack Notifications switch

Notifications step: Application Pipeline Notifications switch, Slack Notifications switchNotifications step: Application Pipeline Notifications switch, Slack Notifications switch

The email card reads Enabled.

2. Alice creates the alert token​

Path: Nova > Settings > Incidents

  1. Post results to Slack channel #incidents (your own incident channel; Enterprise).
  2. Select Create alert token and copy it.
Open zoom view

Settings, Incidents: Post results to Slack channel, Create alert token, Advanced

Settings, Incidents: Post results to Slack channel, Create alert token, AdvancedSettings, Incidents: Post results to Slack channel, Create alert token, Advanced

Rotate token replaces the token; Remove turns alerts off.

3. Alice points the tool at Nova​

Path: your alerting tool

  1. Webhook URL https://astropulse.io/api/alerts/alertmanager.
  2. Header Authorization: Bearer <your alert token>.

Send a test alert; your tool shows it accepted.

Send only what a person would investigate

Every alert you send starts an investigation, at 10 Nova units on every plan (1 unit when Nova can read nothing), so route only the rules worth one. Results reach Slack on Enterprise and the console on Free. Cost alerts for cost anomalies are opt-in.

4. An alert starts an investigation​

Path: Nova > Investigations

  • Open the investigation the alert started.
NovaNova
What happened with qwen-chat in the last day?
Ask Nova

Nova reads the incidents an alert, a chat or a Slack thread started, and names each by number.

Clean up​

Remove the alert token and the rule in your tool, so a firing alert stops reaching Nova, and turn off any notification channel you no longer want. For the full order, see Clean up.