15 minutes more

I’ve recently been handed over the reigns to a project at work which is rather important to our traders. Unfortunately, it’s a system with a lot of external dependencies – by my count, there’s about seven different external systems that could fail at anytime, and if any one of them go down, there’s not much we can do until it comes back up.

So, today was pretty much as bad as it gets – three of the external systems went down during different parts of the day. Unfortunately, the reason they go down seems to vary every time, making it almost impossible to simulate in a test environment. So the best I can do is code as defensively as possible around the issue, try and extrapolate other reasons which may cause failure, and then release another patch. And of course, just when I think I’ve got everything solved, along comes another new problem, the likes of which I haven’t seen before.

Worst of all, due to the different timezones supported by the external systems, I have to wait until they’ve all finished their end-of-day cycles before I can release a patch. Unfortunately for me, this happens to be at 10:45 PM local time. So, recently, night after night I’ve been staying up, waiting for 10:45 PM to tick over, so I can update the server, run some tests, and then go to bed.

15 minutes more…

Posted in uk, work
One comment on “15 minutes more
  1. helen says:

    Well, that sounds like a special kind of hell :(

Leave a Reply

Recent Comments

  • Bill Foley (v.senior): Our Dyson was born in the Retrovision Hospital on 4/1/2007. Given a bit of a thrashing on DIY projects in addition to the house. New motor needed in 8/2013, parts and labour...
  • rich: Too right! Everything about phil and teds is annoying,,from where the valve is to chopping your fingers off trying to open it , to scraping it along the floor after your ve chopped your...
  • Jenni: OMG! I now know why you and Nathan were friends at school! Nathan has several spreadsheets dedicated to our solar production and when our solar wasn’t producing to the capacity it was...
  • viiviiviivii: Long time no writing ;) Fuel consumption is a fickle thing, another way is to try on reddit, or perhaps Today Tonight (if that is still on the air!). ;)
  • Ben: I’m in for river fire too.

Random Photos

Navigators

Paris at night

Giant Scooby

Suzie and Nick at The Buttery

Boules with M&D

Archives

2014 (24)
2013 (71)
2012 (87)
2011 (121)
2010 (159)
2009 (175)
2008 (137)
2007 (166)
2006 (235)
2005 (330)
2004 (278)