Resolved GitHub · degraded service

Incident with Webhooks and Actions

Posted 9 Nov 10:00 UTC, last seen today 13:21 UTC.

GitHub status page On the status board

Unknown Duration: the provider stated no start

9Updates posted

6Other incidents at the same time

What it affected

As the provider names it

WebhooksActions

What the provider posted

Newest first

9 Nov 11:50 UTCResolvedOn November 9, 2026, from 09:23 to 11:40 UTC, one of our job queue clusters was degraded, delaying webhook deliveries, Actions workflow runs, and Dependabot and dependency graph updates. Until mitigation at 10:37 UTC, an average of 26% of webhook deliveries were delayed, peaking at 30%, and the backlog cleared by 11:40 UTC. Some deliveries were delayed by up to 3.5 hours, and delays for a small share began as early as 01:00 UTC. Actions skips events older than 30 minutes, so some workflow runs did not start. The incident was caused by a degraded host that had slowed one of the cluster's Kafka brokers since November 7. The broker stopped reporting the metrics our alerts rely on, so we did not identify it until it stalled the cluster on November 9. We mitigated the incident by removing the broker from service. We have since added an alert that pages us within 30 minutes when a host slows a broker this way, so we can remove the broker before it affects customers.
9 Nov 11:50 UTCResolvedThis incident has been resolved. Thank you for your patience and understanding as we addressed this issue. A detailed root cause analysis will be shared as soon as it is available.
9 Nov 11:45 UTCMonitoringThe degradation affecting Webhooks has been mitigated. We are monitoring to ensure stability.
9 Nov 11:42 UTCUpdateWebhooks is experiencing degraded performance. We are continuing to investigate.
9 Nov 11:17 UTCUpdateWebhooks is experiencing degraded availability. We are continuing to investigate.
9 Nov 11:06 UTCUpdateThe degradation affecting Actions has been mitigated. We are monitoring to ensure stability.
9 Nov 10:47 UTCUpdateWe've applied a mitigation and are monitoring for recovery.
9 Nov 10:28 UTCUpdateWe're investigating delays in Actions runs start times and webhook deliveries.
9 Nov 10:00 UTCInvestigatingWe are investigating reports of degraded performance for Actions and Webhooks

Around it

From the sources ChangeIntel reads; a match in time is not a cause

Elsewhere at the same time

Palo Alto Networks cloud services Prisma Cloud: App: alert remediation is unavailable
Palo Alto Networks cloud services Scheduled Maintenance for File Manager (FileMgr) in France region
Cloudflare Increased error rates and reduced success rates for Workflows operations
OpenAI Degraded Performace on ChatGPT Work
Palo Alto Networks cloud services Enterprise DLP: US West Elevated Latency
GitHub Increased timeouts due to surge in anonymous users

Earlier incidents in the 14 days before

GitHub: Increased timeouts due to surge in anonymous usersService incident · 9 Nov
GitHub: Increase in timeouts for some unauthenticated usersService incident · 8 Nov
GitHub: Degraded performance for multiple GitHub servicesService incident · 5 Nov
GitHub: Incident with ActionsService incident · 2 times, latest 5 Nov
GitHub: Incident with Actions and PagesService incident · 4 Nov

Keep track

Service status now: every provider ChangeIntel reads, with ongoing incidents first.
Status RSS feed: new and ended incidents as they happen.
Everything about GitHub: its changes, known issues and incidents on one timeline.

What changed

Status: Investigating → Resolved · Incident state: Ongoing → Ended
9 Nov 2026

Page history

Changes are dated when recorded; day views use the last saved version from that UTC day, and citations stay fixed.

Cite this version

Field-level log (9)

Up to 100 recent field edits are shown; older edits may be outside retention.

12 Nov 2026 · 19:17:42 UTC SummaryThis incident has been resolved. Thank you for your patience and understanding as we addressed this issue. A detailed root cause analysis will be shared as soon as it is available. → On November 9, 2026, from 09:23 to 11:40 UTC, one of our job queue clusters was degraded, delaying webhook deliveries, Actions workflow runs, and Dependabot and dependency graph updates. Until mitigation at 10:37 UTC, an average of 26% of webhook deliveries were delayed, peaking at 30%, and the backlog cleared by 11:40 UTC. Some deliveries were delayed by up to 3.5 hours, and delays for a small share began as early as 01:00 UTC. Actions skips events older than 30 minutes, so some workflow runs did not start. The incident was caused by a degraded host that had slowed one of the cluster's Kafka brokers since November 7. The broker stopped reporting the metrics our alerts rely on, so we did not identify it until it stalled the cluster on November 9. We mitigated the incident by removing the broker from service. We have since added an alert that pages us within 30 minutes when a host slows a broker this way, so we can remove the broker before it affects customers.
9 Nov 2026 · 11:51:46 UTC StageInvestigating → Resolved
9 Nov 2026 · 11:51:46 UTC Observed stateOngoing → Ended
9 Nov 2026 · 11:51:46 UTC SummaryWebhooks is experiencing degraded performance. We are continuing to investigate. → This incident has been resolved. Thank you for your patience and understanding as we addressed this issue. A detailed root cause analysis will be shared as soon as it is available.
9 Nov 2026 · 11:46:42 UTC SummaryWebhooks is experiencing degraded availability. We are continuing to investigate. → Webhooks is experiencing degraded performance. We are continuing to investigate.
9 Nov 2026 · 11:20:59 UTC SummaryThe degradation affecting Actions has been mitigated. We are monitoring to ensure stability. → Webhooks is experiencing degraded availability. We are continuing to investigate.
9 Nov 2026 · 11:15:53 UTC SummaryWe've applied a mitigation and are monitoring for recovery. → The degradation affecting Actions has been mitigated. We are monitoring to ensure stability.
9 Nov 2026 · 10:50:26 UTC SummaryWe're investigating delays in Actions runs start times and webhook deliveries. → We've applied a mitigation and are monitoring for recovery.
9 Nov 2026 · 10:30:08 UTC SummaryWe are investigating reports of degraded performance for Actions and Webhooks → We're investigating delays in Actions runs start times and webhook deliveries.