Resolved -
This incident has been resolved.
Nov 13, 14:10 PST
Update -
If you are waiting for a specific urgent message, you can locate it in GoSecure reports and attempt to release it manually. This should trigger an immediate delivery attempt, although the message may still be deferred if Microsoft is unable to accept it.
Microsoft's Exchange Online service disruptions have improved significantly since yesterday, but the issue has not yet been fully resolved.
GoSecure services remain operational. At the height of the disruption yesterday, we had hundreds of thousands of deferred messages awaiting delivery to Microsoft. That backlog has now decreased to tens of thousands and continues to decline gradually.
It remains to be seen whether the backlog will increase again as the business day gets underway. This will largely depend on how much Microsoft's mail delivery capacity remains affected.
While this is a significant improvement, mail delivery may continue to experience delays until Microsoft's services fully recover and the remaining backlog has cleared.
Otherwise, no action is necessary. Deferred messages will continue retrying automatically until delivery succeeds or the configured retry period expires.
Nov 13, 04:54 PST
Update -
Microsoft continues to experience intermittent mail delivery issues.
So far, we are only observing temporary SMTP 4xx errors, with no permanent 5xx failures reported. Messages affected by these errors will continue to be deferred and automatically retried.
Examples of the responses we're receiving from Microsoft:
421 4.3.2 The maximum number of concurrent connections
451 4.7.0 Temporary server error. Please try again later.
You may also see errors in GoSecure reports similar to:
redcondor.net.ConnectionException: core.iio.ConnectionExpiryException: WAITING: 60.000s
This indicates a connection timeout. Essentially, GoSecure was communicating with the destination mail server but did not receive the expected response within 60 seconds.
These messages are also deferred and automatically retried.
GoSecure services remain operational, and we will continue monitoring Microsoft's delivery responses.
Nov 12, 12:18 PST
Monitoring -
Microsoft 365 / Exchange Online Service Disruption
Microsoft is currently investigating issues affecting Exchange Online. Users may experience difficulty connecting to their mailboxes, and GoSecure is observing temporary delivery failures when attempting to deliver messages to Microsoft 365.
GoSecure services are operating normally. Messages receiving temporary delivery failures from Microsoft are being deferred and will automatically retry delivery.
We are currently seeing the following response from Microsoft:
`421 4.3.2 The maximum number of concurrent connections per resource forest has exceeded a limit, closing transmission channel.`
These temporary failures do not indicate that messages have been lost. Deferred messages will continue to retry automatically, and normal delivery should resume once Microsoft's service issues are resolved.
Microsoft's current service advisory:
Microsoft is investigating reports of users experiencing issues accessing Exchange Online mailboxes through multiple connection methods in the Americas.
Additional information is available in the Microsoft 365 admin center under incident EX1550543.
Nov 12, 10:55 PST