Resolved -
Processing times and error rates have returned to expected levels
Aug 11, 22:46 BST
Monitoring -
Following further mitigations we are seeing continued recovery in processing time and error rates across all affected environments and processors. We will continue to monitor closely.
Aug 11, 21:59 BST
Update -
We are continuing to see elevated error rates from the LLM provider that supports Digitize Request classification and Schema Job extraction. Jobs are taking longer than usual to complete and a proportion are reaching their time limit and erroring.
Mitigations already in production are showing improvement, and a further mitigation is being tested now.
Aug 11, 18:57 BST
Identified -
We are currently investigating an increase in errors from our LLM provider used for Digitize Request classification and Schema Job extraction. This may result in longer processing times, and a small subset of jobs may time out.
Our engineering team is actively working to mitigate the issue and restore standard processing times. We will provide updates as more information becomes available.
Aug 11, 16:35 BST