Tuesday, June 26, 2012

Royal Bank Of Scotland IT 'Glitch' Turns Into 7-Day Catastrophe

The unacceptable failure from the IT perspective, here:


Not since Dick Jones' demonstration of ED-209 in Robocop has the word "glitch" been so inappropriately used.

In more real terms, what RBS have experienced is a catastrophic systems failure, which has then caused a cascading systems failure. This is where a single unrecoverable error occurs, causing an initial critical system to fail, and then has an equally show-stopping effect on other systems dependent on it. ...


The initial problem should have required so many failures in so many redundant backups and secondary systems that the probability of it happening becomes astronomical. The subsequent reversal of the change that caused the problem should have taken hours, or a day at maximum.

However... they managed it. They have created the biggest failure of a "modern" financial system in UK history, spanning 7 full days and affecting customers across the country without any clear plan or set expectation of when service would be restored. In the meantime... house purchases have fallen through, flights have been cancelled, business deals have evaporated, bills have gone unpaid. All that's missing is a plague of locusts or a Monty Python foot from the clouds.

For many people, life has been completely and in some cases irreparably disrupted.