Ziron Status

Thu Jul 11 2019 12:08:19 GMT+0000 (Coordinated Universal Time)

[outbound voice] Small increase in UK fixed/mobile call failures

Jul 11, 12:08 UTC
Resolved - This incident has been resolved.

Jul 11, 10:49 UTC
Monitoring - We are aware of an issue with an upstream operator partner that has been causing a small increase in call failures to UK fixed and mobile. The operator concerned have advised that they have resolved the issue but we will continue to monitor.


Fri Aug 16 2019 22:07:24 GMT+0000 (Coordinated Universal Time)

[lookups] HLR (legacy) and home_network lookups blocked to UK/EE

Aug 16, 22:07 UTC
Resolved - This incident has been resolved.

Aug 16, 16:46 UTC
Monitoring - We have rerouted lookup traffic towards UK EE to an alternative operator partner and will continue to monitor traffic statistics.

Aug 16, 14:30 UTC
Identified - An operator partner have been requested by UK operator EE to cease all lookup traffic towards their network with immediate effect. At this time HLR (legacy) and home_network lookups to UK EE subscribers will fail.

Please note that hashed_imsi and get_country lookups to UK EE subscribers are not affected by this issue, nor are HLR (legacy) or home_network lookups to other UK networks or other countries.

We are working with other operator partners to find a suitable replacement and will update this incident in due course.


Tue Aug 20 2019 03:00:29 GMT+0000 (Coordinated Universal Time)

[lookups] Third party maintenance affecting hashed_imsi and get_country services

Aug 20, 03:00 UTC
Completed - The scheduled maintenance has been completed.

Aug 19, 23:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Jul 25, 15:15 UTC
Update - Event has been updated, please note new date/time.

Jul 17, 12:34 UTC
Scheduled - An operator partner is performing maintenance to their network, which will affect certain lookup services.

Start time: 2019-08-19 23:00 GMT
End time: 2019-08-20 03:00 GMT

Affected services: A migration to a new network environment will mean requests to the hashed_imsi and get_country lookup services will time out during a 45 minute period during the maintenance window

If you experience any issues following this maintenance, please contact Ziron Support.


Thu Aug 29 2019 11:13:55 GMT+0000 (Coordinated Universal Time)

[lookups] Issues with hashed_imsi and get_country lookups

Aug 29, 11:13 UTC
Resolved - This incident has been resolved.

Aug 29, 07:21 UTC
Monitoring - Service is returning to normal - we will update this incident with further information shortly once we have heard back from our operator partner.

Aug 29, 07:07 UTC
Investigating - We are investigating issues with the following lookup services:

get_country
hashed_imsi


Wed Sep 04 2019 22:20:26 GMT+0000 (Coordinated Universal Time)

[billing] Backlog of transaction data

Sep 4, 22:20 UTC
Resolved - This incident has been resolved.

Sep 4, 14:10 UTC
Identified - We have identified that account financial transaction data for the period 2019-09-04 00:02:08 - 2019-09-04 12:25:35 has not been processed correctly. This is in the process of being rectified, but in the meantime usage reports and prepaid balances may be incorrect.


Tue Sep 10 2019 22:30:31 GMT+0000 (Coordinated Universal Time)

Emergency maintenance to London outbound SBCs

Sep 10, 22:30 UTC
Completed - The scheduled maintenance has been completed.

Sep 10, 22:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Sep 10, 14:33 UTC
Scheduled - We will be performing emergency maintenance to our London outbound SBCs.

Start time: 2019-09-10 22:00 GMT
End time: 2019-09-10 22:30 GMT
Affected services: Outbound calls using our London SBCs may drop or fail to establish for a brief period during this window.

If you experience any issues following this maintenance, please contact Ziron Support.


Tue Oct 08 2019 18:03:06 GMT+0000 (Coordinated Universal Time)

Intermittent APIv2 issues

Oct 8, 18:03 UTC
Resolved - This incident has been resolved.

Oct 8, 17:20 UTC
Monitoring - We've discovered an intermittent DNS resolution problem with one of the K8S worker nodes that was causing containers to misbehave. The offending node was drained and all affected containers have been moved to other nodes.

Oct 8, 16:53 UTC
Investigating - We are currently investigating some intermittent DNS resolution issues on our primary London K8S cluster on which APIv2 is based. This in turn may cause issues with porting request submission via the dashboard and APIv1.


Mon Oct 14 2019 17:08:47 GMT+0000 (Coordinated Universal Time)

[lookups] home_network lookup timeouts

Oct 14, 17:08 UTC
Resolved - This incident has been resolved.

Oct 14, 15:22 UTC
Monitoring - The third party provider has advised that they have suffered a failure of an application server, which has now been replaced. Lookups response times have now returned to normal.

Oct 14, 15:00 UTC
Identified - We have identified an issue with a third party provider that is resulting in timeouts for home_network lookups. We are engaging with their support team, and will update shortly. No other lookup services are affected at this time.


Fri Nov 15 2019 18:50:32 GMT+0000 (Coordinated Universal Time)

Routing instability and packet loss to London sites

Nov 15, 18:50 UTC
Resolved - This incident has now been resolved, however please see https://www.zironstatus.com/incidents/1rl0cfxc1d5f for related emergency maintenance tonight which may affect the London Volta site.

Nov 15, 16:55 UTC
Monitoring - It appears our network services partner suffered a core router failover at the London Volta site, which in turn caused some short routing instability. Services remain stable and we will continue to monitor.

Nov 15, 16:43 UTC
Investigating - We are investigating some routing instability and packet loss around our London sites which is affecting outbound voice and inbound voice traffic.


Sat Nov 16 2019 00:00:32 GMT+0000 (Coordinated Universal Time)

At risk: third party emergency maintenance at London Volta

Nov 16, 00:00 UTC
Completed - The scheduled maintenance has been completed.

Nov 15, 21:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Nov 15, 18:48 UTC
Scheduled - One of our connectivity suppliers has advised that they will carrying out emergency maintenance tonight to apply software updates to some of their routers within the London Volta site. We do not expect any loss of service, but there may be minor packet loss and disruption while traffic reroutes.