Archive for the ‘Technology’ Category

AWS Update

Monday, May 5th, 2014

At the end of April I went to the AWS Summit at ExCeL London, partly to keep up with the competition but largely because the attendees are a different crowd to those you get at your average IBM conference. I managed to miss most of the keynote, partly by design (no early start and an off-peak ticket) and partly due to someone driving in to a level-crossing in Southampton! Having watched the video subsequently, I don’t think I missed a great deal. The only announcements from Amazon that peaked my interest was the arrival of Amazon WorkSpaces in Ireland and the availability of the Twitter stream in Amazon Kinesis.

As in common with the rest of the day, it was the customer slots that were the most interesting. For example, SwiftKey talked about their use of Hadoop on AWS to crunch Wikipedia in other languages to build a starter set for their language models, through to CloudFront as the CDN for serving the final models up to their customers.

I had an interesting chat over lunch with someone who was actually an IBM customer and then wandered the expo watching demos by some of the likely suspects in the cloud deployment, management and monitoring space (Chef, Splunk, DataDog, …).

After lunch the breakout sessions began with six parallel tracks this year. I went to Deployment Done Right first, covering Elastic Beanstalk, OpsWorks and CloudFormation. The only new news for me was an aside that Beanstalk nows supports Docker. It seems like pretty lame support for containerisation though as you appear to get an EC2 instance per image. The accompanying presentation from Sportpursuit.com was most notable for the long list of open source software in use (Nginx, PHP, Magento, Varnish, Redis, Memcached, Elasticsearch, Jenkins, Capistrano, Capify EC2, Boto, …).

Next up was Dynamic Content Acceleration covering the CloudFront CDN and Route 53 DNS with the aim of knocking a second off your response times. The customer this time was import.io which is an interesting site in its own right, providing the capability to turn websites in to structured data (for free).

For the last session of the day I picked Scaling on AWS for the First 10 Million Users which did not, as you might expect, spend a lot of time on auto-scaling, but covered all aspect of application architecture that would contribute to scaling. The customer was the mobile taxi app firm Hailo who are pursuing a micro-services architecture. They are using containerisation (they didn’t specify which) and are apparently writing their own controller to manage the distribution of those containers across EC2 instances to balance workload.

Synchronised training

Friday, May 2nd, 2014

For the past couple of years, uploading my running training has been a bit of a faff. I like to use a desktop app (SportTracks) so that, whatever the changing fads online, I still have all of my data in one place. (It goes back to 2006 when I first got my Forerunner 305. Some day I may even important my old Polar Training Software data.) The desktop app also has some interesting plugins. One of these I used to push my training to dailymile for comparison with a few friends and colleagues and for the widget on this site. However, I’m also partial to a bit of segment stealing on Strava. Sadly no simple SportTracks plugin for Strava so that was a separate upload.

After a bit of search and experimentation, my new workflow is to upload to the SportTracks website which then syncs seamlessly (in both directions) to the desktop app. Then I’m using the excellent online tool Tapiriik to automatically synchronise the data from SportTracks to Strava.

On the plus side, this means I’m now only downloading once and it doesn’t have to be on the machine with SportTracks installed. Also, without really thinking about it, it means I know have 8 years worth of data synced back to Strava!

On the negative side, Tapiriik doesn’t support dailymile so that will have to go by the wayside, at least for now. That means you’ll see a slightly squished Strava widget in the sidebar of this site. The other major downside is cost. The SportTracks site has an annual subscription of $35. Whilst the site is nice and they are continually adding good features, if it weren’t for the sync with the desktop app I wouldn’t be forking out that money. We’ll see how things are going come renewal time. Automatic sync on Tapiriik also comes at a cost but a mere $2 pa for what is a very slick site and available as open source if you really wanted to host it yourself.

Now I just need to decide whether to add Garmin Uploader to my shopping list so that I don’t even need to turn on the Mac! (Works with my Nexus 7 but not my S2 unfortunately.)

Logsearch & Decker

Friday, April 4th, 2014

Yesterday evening I headed up to the London PaaS User Group meeting as there were two Cloud Foundry related sessions on the agenda. First up was David Laing talking about the open source Logsearch project, a bosh deploy of an Elastic search ELK log analysis cluster. His employer (City Index) has this hooked up to Cloud Foundry system logs and, in some cases, they’re also using it for analysis of application logs with addition parsers. They’re looking for people to get involved in the project and help with the next phase: anomaly detection. One major hole in the solution as it currently stands: it’s only suitable for private PaaS as their is no access control over the logged data.

Up second was an entertaining pitch by Colin Humphreys, Founder and CEO of ours hosts CloudCredo, on how to sell hats to monkeys. That was the back story anyway, it was actually about how there is space in the stack for something that gives you the flexibility of IaaS over what you run but the simplicity of management, scaling and load balancing of PaaS. That something is Container as a Service. Specifically, the ability to push Docker files to Cloud Foundry using a custom stack for the DEA. Something that Colin is referring to as Decker.

Colin gave a nice demo but it is obviously still early days. Currently you can only push Docker files not images. There is also no staging at the moment – the image is created when each instance starts – consequently it is not taking any advantage of intermediate images. There is obviously lots of scope for improvement and it’s definitely one to watch. It was also interesting that Colin is currently focussing on the Docker side with the DEA interactions set to change with the introduction of Diego. The project is open source but Colin recommended waiting until he writes some docs before you try picking it up!

WebSphere Appliance Management Center

Tuesday, April 24th, 2012

I haven’t posted anything product related since the release of WebSphere ESB 7.5 in June last year where I hinted at pastures new. Those of you that I’m connected to on LinkedIn will know that I subsequently became Technical Lead for a product called WebSphere Appliance Management Center. WebSphere Appliance Management Center provides off-box management and monitoring of multiple WebSphere DataPower SOA appliances. The development for the management component of the product moved to Hursley shortly after the initial release (named 4.0 after the coincident firmware release). The new team put together a fix pack later in the year which delivered support for the new Service Gateway XG45 appliance.

Today saw the announcement of the next chapter in the WebSphere Appliance Management Center story. Significantly, you will find this in the WebSphere DataPower Appliances firmware V5.0 announcement letter as the next version will no longer be a chargeable product in its own right. Instead, it will be freely downloadable and supported free of charge for all customers with a current support entitlement for a WebSphere DataPower SOA appliance.

Not only will it cost you less – but we’ll also be giving you less! The team has been working flat out to create a much lighterweight offering which is faster to install and less resource intensive. The management user interface has also been extensively reworked to be more responsive and better support user interaction patterns. In particular, the current restrictions around managed set membership will be lifted allowing much great flexibility for firmware and configuration deployment. In addition to the existing domain management capabilities, you will also be able to manage configuration at the service level. All of this will be available for download on June 26.

For those attending IBM Impact next week who’d like to find out more about this exciting new release, I’ll be co-presenting on WebSphere Appliance Management Center (Monday, 5:15-6:30pm, Lando 4305). We will also be hosting a series of round table sessions in Toscana 3701 (Monday, 10:45-12:00; Tuesday, 1:20-2:45pm; Thursday 3:15-4:30pm) which will be your chance to shape the future direction of the product. Alternatively, please feel free to contact me directly or post questions in the DataPower developerWorks forum.

Casio AWG100 review

Monday, April 16th, 2012

1022Yes – I can be bought! For the price of a watch, WatchCo.com have bought themselves a scattering of links in this review. I was given a budget of $200 which still left me with a huge selection of watches to choose from on their website. My main criteria for a watch is that it tells the time, and the right time at that. Consequently, I found myself looking at what the site calls automatic watches (solar or kinetic powered) and atomic watches (radio controlled – not nuclear powered!). The overlap between those two categories is unfortunately rather small (particularly once you’ve taken out the watches that are incorrectly labelled as atomic). I eventually settled on the G-Shock AWG100 from the range of Casio watches. Sadly well under my budget at $130!

Of course, you may need to factor in customs fees when buying from overseas sites like US based WatchCo.com. It cost £25.23 to retrieve the small package from the sorting office: £17.23 in VAT and £8 in Royal Mail international handling fee. Thankfully, in my case that was refunded as part of writing this review. Having unboxed the watch, I was generally pleased with the look of the watch. I have pretty slim wrists and some watches just look far too big and bulky. This one doesn’t although, as you can see from the second photo, the end of the strap does stick out a bit as I’m nearly on the smallest setting. The strap is consequently something I might look at replacing.

1019The watch very nearly met my main criteria: it was showing the correct time… for NYC. Seemingly you have to manually tell the watch your location, at which point the hands chugged their way round to the right time. By default the watch only adjusts the time from the radio signal once a day at one of six preset times throughout the night but you can force it to perform an update which I duly did. One of the small digital ‘dials’ on the front of the watch tells you which transmitter it is receiving a signal from which seems rather a waste of screen real-estate. Bizarrely, it seems the signal from Germany is stronger here than that from the UK! The manual gives detailed instructions on how to position your watch on the window sill to receive a signal which seemed a bit of a faff. The watch does tell you when it performed the last update and I was therefore glad to see that it seems to manage to do so from the comfort of my bedside table.

Only time will tell how the solar charging works out. The manual cautions you against keeping your watch out of sight under your jacket. Not a problem for me as I’m almost always have my sleeves rolled up! The only real evidence of this aspect of the watch (beyond the patterning on the dial) is that, after a period in the dark, the digital part of the display is turned off to conserve power until it sees the light again or you press a button.

The other two digital parts to the display generally show the seconds (the watch has no second hand) and the time or day/date. The dials are also used for viewing the battery charge, world times, countdown timer (not less than a minute), stopwatch (one lap time), alarm (only beeps 10 times so not one I’d want to rely on after a heavy night) and, if necessary, manually setting the time. Unavoidably for this design of watch, the hands can sometimes make the display hard to read. It also isn’t possible to read them in the dark as the LED light just illuminates the hands.

All-in-all, a reasonable looking watch which does its main function of telling the time accurately competently. I’m not sure I’d fork out £80 for the watch (not counting the import costs) but I’m generally a cheapskate when it comes to watches. It will, therefore, probably be replacing my previous timepiece that came free with a running book! Thanks WatchCo.com!

WebSphere ESB 7.5 available

Friday, June 3rd, 2011

WebSphere ESB 7.5 is generally available from Passport Advantage as of today (as are WSRR 7.5, WebSphere ESB Registry Edition 7.5 and the 7.5 BPM stack) and the InfoCenter is also live. Having been the Development Lead and then Release Architect, I feel a certain sense of parental pride in this delivery but, as always, the credit goes to the wider team. It shall also be my last as I am parting company with the WebSphere ESB development team and moving on to pastures new. I can’t say more at the moment but all will be revealed sometime this month.

WebSphere ESB 7.5 Preview

Wednesday, June 1st, 2011

As announced about a month ago, WebSphere ESB 7.5 is due to be available at the end of this week. Having presented on the subject at Impact, I felt I should provide a little more background to some of the new features described in the announce letter. Time permitting, I’ll cover some of the topics in further details once the product has been released.

Back online

Sunday, March 20th, 2011

Shortly after moving my blog to an EC2 instance I received an ominous email stating:

We have noticed that one or more of your instances are running on a host degraded due to hardware failure.

The risk of your instances failing is increased at this point. We cannot determine the health of any applications running on the instances. We recommend that you launch replacement instances and start migrating to them.

After a bit of searching around it seemed that, as my instance is EBS backed, I should just need to stop it and restart it and, in all likelihood, it would move to another host. Sounded simple enough but the stop seemed to be taking forever. After downloading the command line tools I tried to force the stop but still no luck – except when I logged in again the following night it was finally showing as stopped. Unfortunately, when I tried to start it I received the following error: “Server.InternalError: Internal error on launch”.

I posted a question on the EC2 forum and, as you can see, was told that the root volume was in an “abnormal attachment state”. You’ll also see that my attempts to force a detach via the AWS Management Console appeared to fail or at least, the console thought the volume was still attached and therefore wouldn’t let me reattach it. Reverting to the command line utilities again allowed me to successfully detach and reattach the volume and then start the instance. Another delay whilst the DNS refresh took effect (perhaps I should try out an Elastic IP) and, about three days after I first hit stop, the site is finally back online. I’m putting it down as a learning experience!