Cloud Wars: VMWare vs Microsoft vs Google vs Amazon Clouds
October 1, 2008
A short time ago in a data centre, far far away…..
All the big players are setting out their cloud pitches, Microsoft are set to make some big announcements at their Professional Developer Conference at the end of October and VMWare made their VDC-OS announcements at VMWorld a couple of weeks ago, Google have had their App Engine in beta for a while and Amazon AWS is pretty well established.
With this post I hope to give a quick overview of each, I’ll freely admit I’m more knowledgeable on the VMWare/Microsoft offerings… and I stand to be corrected on any assumptions I’ve made on Google/AWS based on my web reading.
So, What’s the difference between them…?
VMWare vCloud - infrastructure led play
VMWare come from the infrastructure space, to-date they have dominated the x86 virtualization market, they have some key strategic partnerships with storage and network vendors to deliver integrated solutions.
The VMWare VDC-OS pitch is about providing a flexible underlying architecture through servers, network and storage virtualisation. why? because making everything ‘virtual’ makes for quick reconfiguration - reallocating resource from one service to another is a configuration/allocation change rather than requiring an engineer visit (see my other post on this for more info)
because VMWare’s pitch is infrastructure led it has a significant practical advantage in that it’s essentially technology agnostic (as long as it’s x86 based) you, or a service provider have the ability to build and maintain an automated birth–>death bare ‘virtual metal’ provisioning and lifecycle system for application servers/services as there is no longer a tight dependency for everything on physical hardware, cabling etc
There is no one size fits all product in this space so a bespoke solution based around a standard framework tool like Tivoli, SMS, etc. is typically required depending on organisational/service requirements.
No re-development is necessarily required to move your applications into a vCloud (hosted or internal) you just move your VMWare virtual machines to a different underlying VDC-OS infrastructure, or you use P2V, X2V tools like Platespin to migrate to a VDC-OS infrastructure.
In terms of limitations - apps can’t necessarily scale horizontally (yet) as they are constrained by their traditional server based roots. The ability to add a 2nd node doesn’t necessarily make your app scale - there are all kinds of issues around state, concurrency etc. that the application framework needs to manage.
VMWare are building frameworks to build scale-out provisioning tools - but this would only work for certain types of applications and is currently reactive unless you build some intelligence into the provisioning system.
Scott Lowe has a good round-up of VDC-OS information here & VMWare’s official page is online here
Google AppEngine- pure app framework play
An application framework for you to develop your apps within - it provides a vastly parallel application and storage framework - excellent for developing large applications (i.e Google’s bread & butter)
Disadvantage is it’s a complete redevelopment of you applications into Google compatible code, services & frameworks. You are tied into Google services - you can’t (as I understand it) take your developed applications elsewhere without significant re-development/porting.
The Google AppEngine blog is here
Microsoft Cloud Services Hosted Application stack & Infrastructure play
An interesting offering, they will technically have the ability to host .net applications from a shared hosting service, as well as integrating future versions of their traditional and well established office/productivity applications into their cloud platform; almost offering the subscription based/Software+Services model they’ve been mooting for a long time.
Given Microsoft’s market current dominance, they are very well positioned to make this successful as large shops will be able to modify existing internal .net services and applications to leverage portions of their cloud offering.
With the future developments of Hyper-V Microsoft will be well positioned to offer an infrastructure driven equivalent of VMWare’s VDC-OS proposition to service and support migration from existing dedicated Windows and Linux servers to an internal or externally hosted cloud type platform.
David Chou at Microsoft has a good post on Microsoft and clouds here
Amazon Web Services - established app framework with canned virtualization
the AWS platform provides a range of the same sort of functionality as Google AppEngine with SimpleDB, SQS and S3 but with the recently announced ability to run Windows within their EC2 cloud makes for an interesting offering with the existing ability to pick & choose from Linux based virtual machine instances.
I believe EC2 makes heavy use of Xen under the hood; which I assume is how they are going to be delivering the Windows based services, EC2 also allows you to choose from a number of standard Linux virtual machine offerings (Amazon Machine Image, AMI).
This is an interesting offering, allowing you to develop your applications into their framework and possibly port or build your Linux/Windows application services into their managed EC2 service.
Same caveat applies though, your apps and virtual machines could be tied to the AWS framework - so you loose your portability without significant re-engineering. on the flip-side they do seem to have the best defined commercial and support models and have been well established for a while with the S3 service.
Amazon’s AWS blog is available here
Conclusion
Microsoft & VMWare are best positioned to pick up businesses from the corporate’s who will likely have a large existing investment in code and infrastructure but are looking to take advantage of reduced cost and complexity by hosting portions of their app/infrastructure with a service-provider.
Microsoft & VMWare offerings easily lend themselves to this internal/external cloud architecture as you can build your own internal cloud using their off-the-shelf technology, something that isn’t possible with AWS or Google. This is likely to be the preferred model for most large businesses who need to retain ownership of data and certain systems for legal/compliance reasons.
leveraging virtualization and commercial X2V or X2X conversion tools will make transition between internal and external clouds simple and quick - which gives organisations a lot of flexibility to operate their systems in the most cost/load-effective manner as well as retain detailed control of the application/server infrastructure but freed up from the day-day hardware/capacity management roles.
AWS/Google are ideal for Web 2.0 ,start-ups and the SME sector where there is typically no existing or large code-base investment that would need to be leveraged. For a greenfield implementation these services offer low start-up cost and simple development tools to build applications that would be complicated & expensive to build if you had to worry about and develop supporting infrastructure without significant up-front capital backing.
AWS/Google are also great for people wanting to build applications that need to scale to lots of users, but without a deep understanding of the required underlying infrastructure, whilst this is appealing to corporate’s I think the cost of porting and data ownership/risk issues will be a blocker for a significant amount of time.
Google Apps are a good entry point for the SME/start-up sector and startups, and could well draw people into building AppEngine services as the business grows in size and complexity, so we may see a drift towards this over time. Microsoft have a competing model and could leverage their established brand to win over customers if they can make the entry point free/cheap and cross-platform compatible, lots of those SME/start-ups are using Mac’s or Netbooks for example.
Workstation VMs loose network connectivity
October 1, 2008
I’ve had a problem recently with VM Workstation on my laptop, both with previous beta versions and the current RTM build. My Windows XP Virtual machine that I use to run Outlook via Unity (and indeed all VM’s on my laptop) loose network connectivity via the host occasionally, this seems to affect VM’s configured for both Bridged and NAT mode - they just can’t ping anything. I do suspend/resume my Vista laptop quite a lot throughout the day, often with VM’s running so I guess this is one of the main reasons it gets upset.
The only fix I’ve found so far is to restart the VMWare NAT Service a couple of times, and sometimes it won’t stop so I have to kill the vmnat process via Task Manager (show processes for all users) and then restart the VMNat service via services under ‘Administrative Tools’ in control panel.
I’ve not managed to isolate this to a problem with specific VMWare or one of my 3rd party tools (AV/SSLVPN) yet, but will keep digging; let me know if you have similar problems.
I know of a similar, but different problem with the Trend OfficeScan Personal firewall service - but the workaround doesn’t resolve the problem and seems independent of it.
VMWare Workstation 6.5 Release
September 30, 2008
I’ve been running the beta versions for a while and have been impressed with the new Unity feature; finally matching what Parallels for the Mac has had for ages.
my previous posts here and here and how it is particularly useful for running more than one version of Outlook.
As ever, clean uninstall of the beta and reinstall of the RTM code, performance is excellent now, and Unity seems to work very well.
Quick (content obscured) screen shot below of how well it integrates into the desktop, even works with the Flip-3D feature in Vista
Unity icon colour is configurable
and I notice there are a load of per-VM configuration settings for how you can mark Unity presented windows.
Good stuff - Unity is definitely the killer feature that allows you to seamlessly run apps on a single desktop, wonder is this available in ACE/Player and would be good if you could do this in future with Linux apps onto a Windows desktop.
VMWare vCloud
September 15, 2008
The news is out, VMWare are building some very interesting technology frameworks to enable you to build your own cloud architectures, but also to be able to transition VMs from your environment to a service provider offering a hosted service and mix & match as required.
All very clever stuff, I’ve been working with VMWare on this for the last couple of weeks and it all links in nicely to an article I wrote a couple of months back on how VMWare can deliver this type of infrastructure now. nice to see it’s being “productized” and being explained as a concept to the world, I see Scott’s point and I also hope that people do realise it’s the underlying virtualization tech they are focusing on not some overarching end-end GoogleOS that does everything - although the clever bit is building management frameworks to allow another vendor to do this type of integration.
Read the vCloud page here and overview of the virtual data centre stuff here
VMWorld Week
September 15, 2008
Well, it starts a bit later today in the US, I went last year and it was a very useful and educational week, my only gripe was about scale - there were too many people and the place was too small, crazy queues for every session.
It seems they’ve moved to somewhere much bigger this year and I hear the attendance is up on 14k people from 10k last year.
I couldn’t make it this year, but I am going to Microsoft Tech-Ed - I’ve been to both of these a couple of times in the last few years and in my opinion they’re brilliant value for money. It costs about £1.5k GBP +expenses to go for a week.
Yes, it’s away from home and there plenty of opportunities to jolly it up after work hours but, to put it in context a normal 1 week technical training course on VMWare or Microsoft stuff in the UK costs upwards of £2-3k. I find most courses frustratingly slow and plodding and they focus in a narrow set of a products functionality and only ever at a high level, never really drilling down into the intimate details of a product as courses are delivered by trainers who are divorced from the technology and delivering a training package.
Whereas with VMWorld or Tech-Ed you can drive your own schedule; you can pick from various deep technical or high-level sessions across a wide range of products and tech.
There is always a good attendance from technical members of the product and engineering teams and partners, over the years I’ve had lots of in-depth discussions with the people who wrote the code and have gained far more understanding than I could ever get from a training course.
Tech-Ed, VMWorld are the only way to get up to speed with their current products, if I were to put it into numbers I’d say a training course could give you maybe 5% of what you would get out of Tech-Ed/VMWorld - unless your day job has a very narrow focus to one task and one product which has been around for a while. If you’re a consultant or Architect tasked with making and implementing technology decisions there is no argument - best money you (or your employer) will ever spend.
So, for those of us that couldn’t be here tonight
here are my round up of links to the best “virtual event” coverage
Eric Sloof http://www.ntpro.nl/blog/
Scott Lowe http://blog.scottlowe.org/
VMWorld site http://vmworld.com/vmworld/index.jspa
Enjoy!
Edited for appalling spelling!
Mapping a drive to a VSS Snapshot & General DFS-R woes
September 14, 2008
Microsoft’s volume snapshot service is pretty handy right? quick hardware independent snaps of a file system - all free and out of the box, well it’s now officially saved my bacon…. whilst it’s a bit klunky (more on this in a bit) it was damned useful.
I had a pain of a problem to deal with this weekend, helping out a friend doing some server re-organising (plan was to migrate these guys from VMWare Server 1.x to ESXi - but didn’t get that far due to some other Windows issues that took all of our time as we checked everything was ok before the move)
Firstly, if you use DFS-R (as comes with Win2003 R2) never, ever, ever, ever use the “distributed file system” applet to administer DFS, we needed to add a new replica of a large DFS-R set to another server and because (in our defence) the server was a fresh R2 install, we forgot to install the newer DFS-R components via control panel, but original DFS was still installed by default and we were in a hurry (read: not paying attention) we used the “Distributed File System” applet to add a new target, and followed the wizard which actually re-created the DFS volume (note to self - pay more attention when clicking!) from scratch.
It proceeded to delete all the contents of all the DFS shares and moved them to a folder called NtFrs_PreExisting___See_EventLog and started afresh, that wouldn’t be so bad except for some inexplicable reason it then purged the contents of that folder from all replicas so we had no quick cut & paste file copy solution.
This was not going to be a fun weekend.
So, basically it was our (my) fault - but it was compounded by some weird corruption in one of the directories that looked like it had been there a while that meant recovery wasn’t going to be straightforward.
The data Backup was about 24hrs older than the last VSS snapshot on the central file server (hub & spoke replication topology) so as we now had a flat, deleted DFS volume with no data (thanks!) we decided to try and revert to the most recent VSS snapshot for the relevant directories.
But no dice, it just threw an error - can’t copy, I can view the files and see the contents and can drag and drop one or two a time, but any more and it would throw an error.
Not good, I can only assume that this was because of some logical corruption within the file system as there was one whole directory tree I couldn’t access (more on how I recovered this later).. there were over 60k files so I wasn’t going to do that by hand - so a command line was in order as at least XCopy can ignore errors etc. and just pull out the good data.
I found these excellent articles here and here and documentation here but some of them were more geared towards taking a snapshot and extracting data in-situ rather than from a persistent snapshot like you get with VSS.
so, none of them worked for me ; and even a lot of hacking with Vshadow and MOUNTVOL I couldn’t get the VSS Snap to mount at all and time was short
I did discover the following though, if you view a snapshot using the Previous Versions tab (remember this only works if you browse for files to restore via UNC path) it opens the snap in Explorer, but you can’t map a drive to it or run a command line copy against it…. or can’t you ![]()
When you open it in explorer this way it does create a sort of hidden temporary share - easiest way I found to expose the name of the share was to try and zip a file in the explorer session that is looking at the snapshot using WinZip, if you follow the wizard at some point it will expose a UNC path like \\SERVERNAME@GMT-DD-MM-YY-{GUID} if you can cut & paste that you can then map a network drive to it
NET USE * \\servername@gmt-dd-mm-yy-{guid}
And you can then run xcopy etc against that mapped drive to copy out all the good data - in reality we used SyncBackSE - which is great for complex file copies and we already had it installed.
All of these Windows servers were installed as VM’s in VMWare Server(s), so it actually made our lives a lot easier as we could quickly clone a known-broken server as-is (do no further harm) and then spin it up disconnected from the network to recover data using this method and also undeleted files using Get Data Back NTFS etc. and then use that data to re-seed the DFS-R volume - but much easier than if it were a physical box and at no real risk of making things worse.
So, in conclusion this was human error, rather than a 100% technical problem and should have been better planned and prevented by maintenance and a better recovery plan- but here it is, with the solution we found to get things back in all its gory details… and mainly as a footnote so I don’t make the DFS mistake again and in my defence this is a shoe-string charity operation rather than a blue-chip org with significant money and time to invest in such efforts.
This solution worked for us, but you need to have your own tried & tested solution - don’t rely on this as far as I can tell it’s unsupported, use at your own risk!
Microsoft now Officially support many of their products under ESX 3.5u2
September 5, 2008
As noted here and here, VMWare have had ESX 3.5u2 certified under Microsoft’s SVVP programme, this is excellent news and will knock down one of the long standing barriers to greater adoption of virtualisation as I wrote about here - support.
Most notably for me this means blessed support of Exchange 2007sp1 running under ESX!
Excellent work to get this done so quickly - MS only announced the SVVP programme a short while ago.
Official list of MS products supported under VMWare is here.
Free VMWare Disaster Recovery Solution Book
August 31, 2008
VMWare have made an excellent free book available online here. it goes into a lot of detail around the various DR scenarios that you can use VMWare for; even P2V DR and has lots of example configurations with various vendor’s server & storage equipment.
Some really good technical documentation coming out of VMWare & it’s partners recently like the Cisco doc.
Problem using Photosynth in Firefox?
August 29, 2008
I’ve been playing with Photosynth since the first demo was available on the web; it’s a very cool visualisation project from Microsoft Live Labs (info here) and it’s recently gone ‘live’.
It also works under Firefox which is great as I’m a keen FF user, but since the recent updates I’ve not been able to use it under FF, it kept looping round and asking me to install the plug-in.
I also noted that the version I downloaded earlier in the week was 0.2Mb smaller than the build I downloaded today, so assume there have been some bugfixes or a bad build.
After some fiddling, this turned out to be because I had an older version of the plug-in which must have had some problem, I had to disable the older version and it then ran fine, steps to do so are below;
And choose to disable the older version of the plug-in (1.1.0.602) leaving 1.1.10683 enabled.
Then try again, no restart required (in my case anyway) and it works perfectly
Hope that helps someone else.
VMWare Workstation 6.5 Release Candidate Build 110068
August 28, 2008
There is a new build available for VMWare Workstation, I’ve installed it on my Vista laptop; definitley seems a lot faster and unity is pretty slick now at screen refreshes.
Flawless uninstall/reinstall as per usual VMWare standards… it’s almost there!
Unity icon has now changed to a rather nasty pinkish colour ![]()
and
Exchange 2007 Automated Install & Documentation Template Resources
August 21, 2008
The Exchange team Blog (EHLO) has a pointer to some good resources for building an automated Exchange 2007 installation here and here
it also has some templates for your server build documentation for Exchange servers, always better to start with something than start from scratch!
Automation is one of those great things in Microsoft products, almost all of the products support automated installation, but often unless you are setting up hundreds of them the time invested to get it up and working far exceeds the time it would take to deploy so any pre-build resources and guides are an excellent idea.
Install automation can ensure you have repeatable results - this is especially handy where you are factoring in a non-P2V disaster recovery situation or where you have labs/demo environments or are trusting local IT staff to deploy and manage enterprise applications in a distributed environment.
And you thought your ESX lab at home was big..
August 7, 2008
Chad has an interesting article and set of photos here about the joint Cisco/EMC/VMWare lab they maintain to test v.large implementations.
Excellent stuff, makes any of my labs pale into insignificance, especially my garage geek temple.
I definitely agree with Chad that they should publish the details of solutions that didn’t scale too well as well as those that did; if only for the allies (EMC, VMWare, Cisco)
to get feedback on if the market wants those kind of solutions that didn’t work; or at least to show where there is room for improvement to focus dev/R&D effort - but validated.
11/8 Links fixed
Hey, I Broke Photosynth
August 3, 2008
Lol, more sites should have error messages like this - this would be far more entertaining (but maybe less useful) than a PSOD or BSOD ![]()
vinf.net at 50k Hits and 8 Months.
July 27, 2008
Well over the weekend this blog turned over 50,000 visits since it started in November 2007 whilst I was on a break at Briforum 2007 in Amsterdam, so lots of thanks to everyone who has been reading, this blog is currently averaging 500 views/day which considering I just started it as a repository for my own useful work tidbits is quite amazing to me.
I’ve got a couple of interesting posts in the pipeline around unattended ESX installations and a step by step to build this under VMWare Workstation and my experiences with Platespin PowerConvert - particularly how it maps into my mini/dedicated cloud architectures to deliver a totally flexible and easy to manage infrastructure through the physical to physical conversion process (P2P) and the normal V2P/P2V features.
Similarly, if there is anything you’d like to see - comment here with your suggestions!
Happy reading
Vista Mobility Centre
July 27, 2008
Ironically, I’d never actually seen this screen before.. Windows Key - X and it pops up the following screen so I can get one place to find the Dell extensions and the MS normal control panel applets in one place that are relevant to “mobility”.
James O’Neil’s post on where Microsoft went wrong with Vista for the tip, maybe thats one of the areas ![]()
For the record my laptop flies with Vista, and I agree with James’s point about suspend rather than shutdown reboot with suspend/resume it’s ready in < 5sec .. so why continually shutdown etc?
I hardly ever reboot my laptop other than to (un)install some software and suspend/resume works flawlessly, (unless I try to do it with my laptop’s built in 3G cell modem connected to Vodafone - as it will fail 1/2 way though and slowly cook in my laptop bag - but that’s a driver issue I assume rather than the OS).
as Eileen Brown discusses here I also frequently use MSCONFIG.EXE to keep the startup crapware free and the services stripped down to bare minimum…although I think Vista should police this a bit better.
VMWare aims for the Clouds
July 26, 2008
Interesting post by Dave Ohara here; looks like VMWare are gearing up for some big cloud-related product announcements at VMWorld in September.
This folds nicely into my previous post about how VMWare can enable you to build your own clouds
Looking forward to September.
ESX3i for Free
July 24, 2008
VMWare ESXi (aka ESX 3i) is about to be available free, pricing kicks in 28th July and the attached doc shows an overview of the features in each edition as you step up.
Basic principal is you can start with ESX3i for free (rather than full ESX @$1k), then add licence keys to enable production features like VMotion, HA etc.
It’s useful for dev/PoC projects which could then move to production later on by adding licences but with a reduced upfront cost. It avoids having to use and migrate from the free Windows/Linux version of VMWare Server when moving into a production class system and this gives a further one-up on Microsoft’s Hyper-V release a couple of weeks ago.
You should note that ESX3i is currently a bit more limited than the normal base ESX installation as there is no service console so no ability to install host based HPSIM/backup/etc. agents. That said, it’s been speculated that the next major release of full–blown ESX (4.x) will move to this model as well.
ESX3i is available from some HW manufacturers as embedded boot from flash in specific server models or is a downloadable installer with a small disk footprint (c.32Mb).
I have to wonder if the name change is a bit OTT - VMWare ESXi said fast in an English accent is“VMWaresexy”? ![]()
Excellent Set of Resources for VMWare HA
July 15, 2008
Free EMC Celerra for your Home/Lab
July 9, 2008
Virtualgeek has an interesting post here about a freely downloadable VM version of their Celerra product, including an HA version. This is an excellent idea for testing and lab setups, and a powerful tool in your VM Lab arsenal alongside other offerings like Xtravirt Virtual SAN and OpenFiler.
I’ve been saying for a while that companies that make embedded h/w devices and appliances should try to offer versions of the software running their devices as VM’s so people can get them into lab/test environments quickly, most tech folk would rather download and play with something now, rather than have to book and take delivery of an eval with sales drones (apologies to any readers who work in sales) and pre-sales professional services, evaluation criteria etc. if your product is good it’s going to get recommended, no smoke and mirrors required.
As such VM appliances are an excellent pre-sales/eval tool, rather than stopping people buying products. Heck, they could even licence the VM versions directly for production use (as Zeus do with their ZXTM products); this is a very flexible approach and something that is important if you get into clouds as an internal or external service provider - the more you standardise on commodity hardware with a clever software layer the more you can recycle, reuse and redeploy without being tied into specific vendor hardware etc.
Most “appliances” in-use today are actually low-end PC motherboards with some clever software in a sealed box - for example I really like the Juniper SA range of SSL VPN appliances, I recently helped out with a problem on one which was caused by a failed HDD - if you hook up the console interface its a commodity PC motherboard in a sealed case running a proprietary secure OS - as it’s all intel based, no reason it couldn’t also run as a VM (SLL accelerator h/w can be turned off in the software so there can’t be any hard dependency on any SSL accelerator cards inside the sealed box) - adopting VM’s for these appliances provides the same (maybe even better) level of standard {virtual} hardware that appliance vendors need to make their devices reliable/serviceable.
Another example, the firmware that is embedded in the HP Virtual Connect modules I wrote about a while back runs under VMWare Workstation, HP have an internal use version for engineers to do some development and testing against, sadly they won’t redistribute it as far as I am aware.
PSOD - Purple Screen of Death
July 8, 2008Just incase you ever wondered what it looks like here is a screendump..
this is the VMWare equivalent of Microsoft’s BSOD (Blue Screen of Death)
I got this whilst running ESX 3.5 under VMWare Workstation 6.5 build 99530, it happened because I was trying to boot my ESX installation from a SCSI hard disk - which it didn’t like - I assume because of driver support, swapped for an IDE one and it worked fine…
update - actually the VM had 384Mb of RAM allocated and that’s what actually stopped it from booting.. upped to 1024Mb and it runs fine.
Its the first time I’ve seen one - all the production ESX boxes I’ve worked with have always been rock-solid (touch wood)
I’m preparing a blog post about unattended installations of ESX when I hit this, in case you were wondering.
![[image]](http://mowser.com/img?url=http%3A%2F%2Fbuttons.googlesyndication.com%2Ffusion%2Fadd.gif)



![[image]](http://mowser.com/img?url=http%3A%2F%2Fwww.microsoft.com%2Femea%2Fteched2008%2Fimages%2Fdownloads%2Fbbut%2FTechEd_EMEA_100_BeThere_ITPro.jpg)
