15 minutes more

I’ve recently been handed over the reigns to a project at work which is rather important to our traders. Unfortunately, it’s a system with a lot of external dependencies – by my count, there’s about seven different external systems that could fail at anytime, and if any one of them go down, there’s not much we can do until it comes back up.

So, today was pretty much as bad as it gets – three of the external systems went down during different parts of the day. Unfortunately, the reason they go down seems to vary every time, making it almost impossible to simulate in a test environment. So the best I can do is code as defensively as possible around the issue, try and extrapolate other reasons which may cause failure, and then release another patch. And of course, just when I think I’ve got everything solved, along comes another new problem, the likes of which I haven’t seen before.

Worst of all, due to the different timezones supported by the external systems, I have to wait until they’ve all finished their end-of-day cycles before I can release a patch. Unfortunately for me, this happens to be at 10:45 PM local time. So, recently, night after night I’ve been staying up, waiting for 10:45 PM to tick over, so I can update the server, run some tests, and then go to bed.

15 minutes more…

Posted in uk, work
One comment on “15 minutes more
  1. helen says:

    Well, that sounds like a special kind of hell :(

Leave a Reply

Recent Comments

  • Julian: Challenging pitch, provocative play – that match had it all. Incidentally, the stance I’m holding in the first picture is also the one I use for golf.
  • Tim: Just to let you know I’ve done exactly the same thing. Let’s just say the gentleman behind me nearly died as the shot rung out! Glad I’m not the only one!!
  • Janet: Good luck, my Epson WP4530 is 18 months old and is giving me a paper jam error message. The paper isn’t out and there is no paper jam. I have spent 3 hours inspecting, cleaning and...
  • Jason: I did the tank swim many years ago as part of a work thing – pretty cool!
  • Leanne: Congratulations guys that is wonderful news!!!!

Random Photos

Gerrod and Nick.

Clockwise from my left: Brad, Ali, Suzie, Kate, and Al

Gerrod on the ferry

Rowena Cade memorial sign

Universal Studios

The Croatia gang - Julian, Shelley, Kristy, Gerrod, Liming and David

Archives

2015 (2)
2014 (40)
2013 (71)
2012 (87)
2011 (121)
2010 (159)
2009 (175)
2008 (137)
2007 (166)
2006 (235)
2005 (330)
2004 (278)