Status updates | PromethistAI Incidents and maintenance reported on status page for PromethistAI https://status.promethist.ai/ en Maintenance: Authentication Service Upgrade https://status.promethist.ai/maintenance/1099229 Thu, 22 Oct 2026 19:30:00 -0000 https://status.promethist.ai/incident/1099229#6abde0f8427958cf345c3f0ebbdc80293119cb657d64327d2516da6352701b48 Maintenance Maintenance completed Maintenance: Authentication Service Upgrade https://status.promethist.ai/maintenance/1099229 Thu, 22 Oct 2026 17:31:47 -0000 https://status.promethist.ai/incident/1099229#202dedaa4def6125b4416eb2a4dabd8512e2071801e555b4cb15e2e7b0442ccf Maintenance Today, October 22, 2026, from 21:15 to 21:30 CEST, we will be performing scheduled maintenance on our authentication endpoint to upgrade it to a newer version. During this window, users may experience intermittent issues when logging in, including failed sign-in attempts or being unexpectedly signed out. Users who are already signed in should generally not be affected. If you run into a login problem during the maintenance window, please wait a few minutes and try again. We will update this notice once the maintenance is complete. Thank you for your patience. Voice conversations unavailable, 7–8 October 2026 https://status.promethist.ai/incident/1085047 Thu, 08 Oct 2026 06:53:00 -0000 https://status.promethist.ai/incident/1085047#5eafe81977803e17ec9d852911d4737b00d030d229e119dd8aeea712eb299c3f Incident ## What we are changing | Action | Status | |---|---| | Restore the Soniox payment and service | Done | | Add Soniox to our health checks and re-enable the check for the backup provider | Done | | Check account balances and billing status of all AI providers automatically, with an alert well before funds run out | In progress | | Move Soniox from card top-ups to invoiced billing | In progress | | Evaluate an additional backup speech-recognition provider | In progress | | In the app: if no transcript arrives within a few seconds, show a clear message and offer to continue in text | In progress | Voice conversations unavailable, 7–8 October 2026 https://status.promethist.ai/incident/1085047 Wed, 07 Oct 2026 19:18:00 -0000 https://status.promethist.ai/incident/1085047#fc272c001af78c8c9a0d0d147fe69417f0944eead300656d8d342c575939fda5 Incident **Summary.** From 19:18 UTC on 7 October to 06:53 UTC on 8 October 2026 (21:18–08:53 CEST), voice conversations on the Promethist platform did not work in our EU and US regions. Users could start a conversation, but their speech was not converted to text, so the AI agent never received what they said. Text conversations were not affected, and everything except speech recognition kept working normally. The trigger was a routine automatic payment that our speech-recognition provider, Soniox, failed to process. Our backup provider did not take over and our monitoring did not alert us, so we learned about the problem from a customer the next morning. We are sorry. This was our failure, and this report explains what happened and what we are changing. ## Customer impact - **Affected:** all voice conversations in the EU and US regions for 11 hours 35 minutes. The busiest period was 06:00–06:53 UTC (08:00–08:53 CEST), when morning usage started. - **What users saw:** a loading indicator that never finished. The app showed no error and did not suggest switching to text. - **Not affected:** text conversations, agent configuration in Promethist Studio and all other platform features. No customer data was lost or exposed. ## Timeline - **7 Oct 19:18 UTC (21:18 CEST)**: Soniox fails to process a routine automatic top-up of our prepaid balance, although the card has sufficient funds. The balance runs out and Soniox starts rejecting speech-recognition requests. Automatic failover to our backup provider also fails. - **7 Oct 19:18 – 8 Oct 06:53 UTC (21:18 – 08:53 CEST)**: Voice conversations fail in the EU and US regions. - **8 Oct, morning**: A customer reports that voice conversations are not working. - **8 Oct 06:53 UTC (08:53 CEST)**: Our team manually re-submits the payment. Soniox accepts requests again and voice conversations recover. - **8 Oct 07:08 UTC onwards (09:08 CEST onwards)**: We start the incident review and agree the remediation plan below. ## Why it happened We pay Soniox through a prepaid balance that is topped up automatically by card. This top-up is a routine operation that had always worked before. On 7 October Soniox failed to process it, even though the card had sufficient funds. When the balance reached zero, Soniox stopped processing our requests. Our EU and US regions share one Soniox account balance, so both regions were affected at the same moment. Several safeguards that should have limited the impact also failed: 1. **The backup provider did not take over.** The platform is designed to switch to a second speech-recognition provider (Google) when the primary fails. During the incident the backup returned errors too. We are confirming the cause of the errors. 2. **Monitoring did not alert us.** Our health checks did not cover Soniox, and the check for the backup provider had been paused. Our automated log review, which should have flagged the spike in errors, had stopped running shortly before the incident. 3. **Users got no error message.** The app is designed to show an error when speech recognition fails. Instead it kept waiting, and users had no way to know they could continue in text. ## What we are changing | Action | Status | |---|---| | Restore the Soniox payment and service | Done | | Add Soniox to our health checks and re-enable the check for the backup provider | Done | | Check account balances and billing status of all AI providers automatically, with an alert well before funds run out | In progress | | Move Soniox from card top-ups to invoiced billing | In progress | | Evaluate an additional backup speech-recognition provider | In progress | | In the app: if no transcript arrives within a few seconds, show a clear message and offer to continue in text | In progress | We will update this report as each item is completed. ## What you can do - If voice stops responding, switch to text mode in the app. Text conversations do not depend on speech recognition. - Follow [status.promethist.ai](https://status.promethist.ai). - For questions about this incident, contact us at [support.promethist.ai](https://support.promethist.ai/). We know you rely on Promethist for conversations that matter to your people. We apologise for the disruption.