Networking issues causing Datafeed corruption and Slurper outages

Updates

Resolved
August 22, 2023 at 9:37 PMUTC
Resolved
August 22, 2023 at 9:37 PMUTC
This incident has been resolved.
Monitoring
August 22, 2023 at 8:47 PMUTC
Monitoring
August 22, 2023 at 8:47 PMUTC
We've restarted more of our systems and are seeing recovery. Please reach out if you're still seeing issues.
Update
August 22, 2023 at 5:26 PMUTC
Update
August 22, 2023 at 5:26 PMUTC
We are currently seeing network connectivity issues at our provider's datacenter in Frankfurt. Pilots and controllers connected to Germany 1 & 2 may occasionally be timed out by the AFV Slurper and lose audio connection.

We've also observed occasional corruption of the Datafeed. Applications using the Datafeed (SimAware, VAT-Spy, VATprism, etc) will occasionally not be able to fetch network data.
Identified
August 22, 2023 at 4:41 PMUTC
Identified
August 22, 2023 at 4:41 PMUTC
While the issues with Slurper have resolved, we're still seeing occasional corruption of the Datafeed. Applications using the Datafeed (SimAware, VAT-Spy, VATprism, etc) will occasionally not be able to fetch network data.
Monitoring
August 22, 2023 at 4:24 PMUTC
Monitoring
August 22, 2023 at 4:24 PMUTC
We're starting to see recovery at this time. The Datafeed is back to its normal state and AFV connections are no longer being timed out.
We'll keep monitoring this incident in case any further issues come up.
Identified
August 22, 2023 at 2:00 PMUTC
Identified
August 22, 2023 at 2:00 PMUTC
Our compute provider is experiencing networking issues that are affecting our Datafeed and Slurper systems.

VAT-Spy, Simaware, and other consumers of the Datafeed may occasionally receive incorrect or corrupt data.
Pilots and controllers may occasionally become disconnected from Audio for VATSIM.

Thank you for your patience while we work towards a resolution with our vendors.

VATSIM - Networking issues causing Datafeed corruption and Slurper outages – Incident details

All systems operational