​

SLO Runbook

​

SLO targets

​

Error budget

• Monthly error budget: 43.8 minutes of downtime
• Budget burn rate alert at: 5× burn rate (depletes budget in 6 days)

​

Sentry alerts

​

Recommended alert rules

​

Example Sentry alert (via Sentry API)

# Create an alert for any new error in the production environment
curl -X POST https://sentry.io/api/0/projects/{org}/{project}/rules/ \
  -H "Authorization: Bearer $SENTRY_AUTH_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "New error in production",
    "conditions": [{"id": "sentry.rules.conditions.first_seen_event.FirstSeenEventCondition"}],
    "filters": [{"id": "sentry.rules.filters.tagged_event.TaggedEventFilter","key":"environment","value":"production"}],
    "actions": [{"id": "sentry.mail.actions.NotifyEmailAction","targetType": "IssueOwners"}],
    "frequency": 30
  }'

​

Cloudflare Analytics alerts

• Set alert: Error rate > 1% over a 5-minute window → notify via email
• Set alert: P99 CPU time > 50ms (as a proxy for latency) → notify via email

# Via Cloudflare API - create a Workers alert
curl -X POST https://api.cloudflare.com/client/v4/accounts/{account_id}/alerting/v3/policies \
  -H "Authorization: Bearer $CF_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "{app} high error rate",
    "alert_type": "workers_script_alert",
    "enabled": true,
    "mechanisms": {"email": [{"id": "admin@thefactory.dev"}]},
    "filters": {
      "services": ["{app}"],
      "limit": "1"
    }
  }'

​

PostHog funnel monitoring

• Signup funnel: user_signup → email_verified → first_action
• Conversion funnel: page_view → cta_click → checkout_started → subscription_created

• Conversion drop > 20% week-over-week
• subscription_created events drop > 10% day-over-day

​

Incident response

1. P1 (site down): Immediate rollback via wrangler rollback --env production, notify in #incidents.
2. P2 (elevated errors): Investigate Sentry, check recent deploy, consider rollback.
3. P3 (latency degradation): Check Neon query performance, review Hyperdrive health.
4. P4 (business metric drop): Review PostHog funnels, check for A/B test side effects.

​

On-call rotation

• Monthly active users > 1,000 per app
• Revenue per app > $5,000 MRR