RESOLVED: Service Outage

Daisy Wholesale (Murphx) are currently experiencing a Service Outage which started on the 7th November 2011 at 14:44 and is still ongoing

For your information a summary of this outage is below:

Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 7th November 2011 at 14:44 and is still ongoing
Description: Our alerting systems have notified us of an issue with Level 3 transit provision at our Telehouse East POP. As Level 3 are a supplier of ours, this may have a service effect on customers, however we would expect the resilient alternate routing to negate this. Level 3 technicians are investigating the issue and will provide an update in due course

We apologise for any inconvenience this outage may cause and will be issuing further updates until resolution.

Update: 08/11/2011 @ 5am

This ticket is now closed. Full service has been restored by Level 3, traffic is flowing once more over the Level 3 transit interconnect. We are waiting for a full report from Level 3 as to the cause of the issue, when we have these details we will update you.

RESOLVED: BT Service Outage

Dear Support,

Murphx currently experiencing a Service Outage which started on the 26th September 2011 at 10:21 and is still ongoing

For your information a summary of this outage is below:

Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 26th September 2011 at 10:21 and is still ongoing
Description: BT are reporting a loss of service at the Ponders End exchange as the result of a MUX failure. Some broadband end users may be experiencing a loss of broadband service. Dialling codes affected are :

0203132,
0203231,
0203234,
0208211,
0208216,
0208245,
0208292,
0208350,
0208351,
0208364,
0208372,
0208443,
0208804,
0208805.

UPDATE:  13:30

This ticket is now closed. BT are reporting that service has been restored after completing a change of hardware.

We apologise for any inconvenience this outage may cause and will be issuing further updates until resolution.

RESOLVED: Service Outage

Murphx are currently experiencing a Service Outage which started on the 31st August 2011 at 10:33 and is still ongoing

For your information a summary of this outage is below:
Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 31st August 2011 at 10:33 and is still ongoing
Description: BT are reporting a partial loss of service in the Kingston area. Some broadband end users may be experiencing a loss of broadband service. Dialling codes affected are as follows:

01183,
01189,
01245,
01255,
01258,
01263,
01268,
01271,
01273,
01278,
01305,
01322,
01328,
01342,
01359,
01362,
01363,
01371,
01403,
01424,
01449,
01473,
01474,
01483,
01488,
01508,
01553,
01621,
01622,
01634,
01689,
01737,
01760,
01761,
01793,
01843,
01865,
01920,
01932,
01953,
01983,
0203069,
0203132,
0203247,
0203259,
0203260,
0207005,
0207068,
0207510,
0207515,
0207531,
0207537,
0207538,
0207719,
0207987,
0208287,
0208297,
0208305,
0208309,
0208312,
0208316,
0208317,
0208318,
0208331,
0208463,
0208465,
0208473,
0208652,
0208661,
0208665,
0208671,
0208674,
0208678,
0208683,
0208684,
0208689,
0208770,
0208836,
0208852,
0208853,
0208854,
0208855,
0238025,
0238026,
0238027,
0238032,
0238036,
0238039,
0238048,
0238051,
0238052,
0238057,
0238070,
0238076,
0238077,
0238078,
0238079,
0238087,
0238090,
0238094,
0239223,
0239224,
0239225,
0239226,
0239234,
0239235,
0239236,
0239242,
0239243,
0239261,
0239264,
0239271,
0239278,
0239279,
0239311,
0239279.

UPDATE: 12:30pm

This has now been resolved on the 31st August 2011 at 12:15. BT are reporting that service has been restored after completing a change of hardware.

We apologise for any inconvenience this outage may cause and will be issuing further updates until resolution.

RESOLVED: Service Outage

Murphx experienced a Service Outage which started on the 30th August 2011 at 09:59 . This has now been resolved on the 30th August 2011 at 10:56.

For your information a summary of this outage is below:

Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 30th August 2011 at 09:59 . This has now been resolved on the 30th August 2011 at 10:56
Description: BT are reporting a partial degradation of service in the Reading area. Some broadband end users may be
experiencing a loss of broadband service. Dialling codes affected are as follows:

01179,
01183,
01189,
01202,
01208,
01225,
01235,
01237,
01243,
01252,
01256,
01258,
01264,
01271,
01275,
01278,
01288,
01296,
01308,
01326,
01344,
01363,
01367,
01373,
01380,
01392,
01395,
01404,
01409,
01425,
01454,
01458,
01460,
01483,
01489,
01491,
01494,
01579,
01608,
01626,
01635,
01726,
01730,
01736,
01747,
01749,
01752,
01761,
01793,
01794,
01823,
01865,
01962,
01963,
01980,
01983,
01993,
0238081,
0238084,
0238087,
0239234,
0239235,
0239255,
0239278,
0239311,
0239255,
0239278.

Notes: This ticket is now closed. BT are reporting that service has been restored after completing a change of hardware.

We apologise for any inconvenience this outage may have caused.

RESOLVED: Service Outage

Murphx are currently experiencing a Service Outage which started on the 1st August 2011 at 13:55 and is still ongoing

UPDATE: 1st August 2011 at 16:24

For your information a summary of this outage is below:

Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 1st August 2011 at 13:55 . This has now been resolved on the 1st August 2011 at 16:24
Description: We are currently investigating a network issue affecting a small number of subscribers within our RBM POP. Further updates will be provided shortly.

For your information a summary of the update is below:

Notes: This ticket is now closed. Following on from the earlier DOS attack a smal number of subscribers dropped within our RBM POP, this caused a minor imbalance of sessions on one of our LNS routers in THE which has since been rectified. The impact would have been a disconnection and immediate reconnection for the small number of subscribers affected.

We apologise for any inconvenience this outage may have caused.

RESOLVED: Telecity Meridian Gate power outage

We are experiencing abnormal network activity, which is currently being investigated. We will update you as soon as the problem is resolved. We apologise for any inconvenience caused.

Updates: 10:35am

Telecity Meridian Gate (Datacenter in London) Power Outage 09:13 to 09:40 affected backup Gateways and failover/redundant Hosted services.

Updates: 11:15am

Telecity Meridian Gate (Datacenter in London) Power Outage still ongoing.

Updates: 11:20am

The power is now back.

STATEMENT

A power outage at Telecity Meridian Gate in London Docklands on the 27th July 2011 impacted the NTA Voice platform. We are awaiting an RFO from the data centre to explain why there was another power outage on such a large scale.

Please be assured we still investigating alternative options to prevent a re-occurrence and will keep you updated.

In order to provide up-to-date information about any issues or planned service maintenance of our network or equipment in the future can you please provide us with mobile numbers that we can send SMS messages to in order to give you these important updates. If there are any additional email addresses you would like added to the notifications please reply and we will add these to out systems.

We apologise the inconvenience this has caused.

Planned Engineering Works Notification

Dear Customers,

This is an advance notification of Planned Engineering Works

For your information a summary of this work is below:

Category: Planned Engineering Works
Service Element: Broadband Aggregation Network
Maintenance Window: The work will start on 4th August 2011 at 01:00 and is scheduled to end at 06:00
Description: BT have advised us of planned engineering work necessary to complete Front End Router resilience enhancement on our 21CN links in Telehouse North and Telehouse East originating in the Stepney Green Exchange. Any subscribers terminated on these links may lose connection whilst this work is completed. BT inform us that all WBMC shared services will be parked on radius on the night. This will mean that all 21CN customers (no matter where they are connected) will not be able to establish or re-establish connection during this time (01:30 – 03:00 approx). Any disconnected sessions will start to re-establish after this time. This means that the 21CN customer base has a potential risk of seeing an outage if they drop active sessions and try to re-establish connectivity during the Radius down time. All established sessions connected to other sites will not be affected by Radius being, in effect, turned off
Service Outage Expected: Yes
Expected Outage Duration: 20 minutes
Service Impact Description: Subscribers may experience an outage of up to 20 minutes during this maintenance window.

We apologise for any inconvenience this essential maintenance may cause and will be issuing further updates until resolution.

RESOLVED: Broadband Service Outage

Murphx currently experiencing a Service Outage which started on the 13th June 2011 at 10:54 and is still ongoing

For your information a summary of this outage is below:

Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 13th June 2011 at 10:54 and is still ongoing
Description: We have just experienced a drop in BT services in our Telehouse East POP. We are investigating this and will provide more information as soon as BT have provided a root cause for this issue.

UPDATE  3:10pm

For your information a summary of the update is below:

Notes: BT have confirmed that the source of the issue is a hardware fault at their exchange. Engineers are on site and will be replacing the hardware. Testing will then take place to confirm the configuration before the circuit is brought back into service.

UPDATE: 5:30pm

For your information a summary of the update is below:

Notes: This ticket is now closed. BT have confirmed that service has now been restored.

We apologise for any inconvenience this outage may have caused.

RESOLVED: Broadband Service Outage

We currently experiencing a Service Outage which started on the 26th May 2011 at 17:15 and is still ongoing

For your information a summary of this outage is below:

Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 26th May 2011 at 17:15 and is still ongoing
Description: We are currently experiencing an issue with one of our BT 21CN centrals in Telehouse North. End users have rolled to additional capacity which may lead to customers experiencing a degradation of Broadband Services.

The issue has been escalated to BT who are investigating the cause.

We apologise for any inconvenience this outage may cause and will be issuing further updates until resolution.

UPDATE  26th May 2011 at 18:30

Latest update on the issue with one of our BT 21CN centrals in Telehouse North. BT have now traced the fault, following the upgrade work they performed last night, there is an issue with BGP preferring the shortest path. This is affecting the routing of traffic across the central. BT are currently working on a fix to the issue.

UPDATE  27th May 2011 at 01:45

Notes: This ticket is now closed. We have seen traffic across the BT 21CN central in Telehouse North with the issue return to normal in the past ten minutes and BT have just confirmed that they have updated the configuration on their equipment to resolve the issue.

RESOLVED: Broadband Service Outage

Daisy Wholesale (Murphx) experienced a Service Outage which started on the 7th February 2011 at 08:01 and this issue is still ongoing..

For your information a summary of this outage is below:

Category: Service Outage
Service Element: Broadband Aggregation Network
Time the Outage occurred: on the 7th February 2011 at 08:01 and this issue is still ongoing.
Description: We are currently investigating a network issue affecting a number of subscribers within our Redbus POP. Further updates will be provided shortly.

For your information a summary of the update is below:

Notes: We experienced a failure of one of our 622 pipes in Redbus Meridian at approximately 8AM today. BT are currently investigating the issue and will update us in due course.

We apologise for any inconvenience this outage may cause and will be issuing further updates until resolution.