17th Sept update: I’ve been contacted directly by EMC, and they say they’ll work through this with us. Sounds promising. There’s been a lot of coverage on the topic. I’ve provided additional links at the end of the post.The funniest comment I’ve read so far is “More like Xtrem uh-oh”.
16th Sept update: here’s an official response from Chad Sakac http://virtualgeek.typepad.com/virtual_geek/2014/09/on-disruptive-upgrades.html
While at VMworld last month, I was networking with attendees when I mentioned my current employer purchased an XtremIO half X-Brick for a VDI project.
To clarify, firmware 3.0 has NOT been released, but is scheduled for release at the end of September, beginning of October. The upgrade process will require all data to be moved off the array, as all data will be wiped during the upgrade process. The new firmware includes performance benefits and inline compression.
Updated:
For more info, the topic has been reported and debated in the comments on the following websites:
The Register – XtremIO firmware upgrade will wipe data
IT News – Extreme upgrade pain for XtremIO customers
Chad Sakac – On disruptive upgrades
Silicon Angle – EMC will wipe user data with XtremIO firmware 3.0 upgrade
Michael Webster – Data destructive storage firmware upgrade in 2014 surely not
Vaughn Stewart – Have a few days to spare we need to upgrade the XtremIO
SolidFire – The Advantages of a Shared Nothing Architecture for Truly Non-Disruptive Upgrades
Chris M Evans – EMC XtremIO Destructive Upgrade Demonstrates Architecture Matters
Silicon Angle – Gartner: Flash array startups ranked ahead of EMC, HP and IBM
Nigel Poulten – XtremIO Craps on EMC Badge
Plenty of other vendors have reached out, stepping on EMC so they can be the successor. If we’re interested, we’ll contact you.
The Odd Angry Shot 
You should talk to the guys from Nutanix and see if they can help you with a sweet replacement deal.
There are plenty of options out there. The simple fact is EMC should make good. How? I don't know. You should double check for other gotchas though. And don't pay for anything like services from the integrator hat sold you the lemon. Good luck.
This will be the second, and possibly even the third, time a full data evacuation will have been required with XtremIO firmware upgrades. Keeping all of that metadata in memory has consequences – it increases coupling. It also highlights how pressured EMC has been to push XtremIO early in its history (which had no code written until 2009, and no customers until late 2012).
Here is a great November 2013 YouTube video from EMC, promising “disruptive upgrades are never required” with XtremIO : [ https://www.youtube.com/watch?v=-uTkO758Wxw ] (XtremIO High Availability Deep Dive) . Eventually every product, after several years, requires some type of disruption, but seriously… this wasnt even a year ago, and the previous upgrade in 2013 was already a full evacuation.
Note: I just realized the above comments did not include my identity from Twitter. The 10:50pm and 10:55pm Sep 14 comments are from myself, Mark Kulacz (https://twitter.com/markkulacz). I am an employee of NetApp Corp, and my comments do not reflect the opinion of my employer.
I just want to thank you for bringing this issue to light. I first heard about it some months back, and was under the impression that it was, at least at that time, NDA/futures stuff that couldn't be commented on publicly.
I'm hoping EMC really steps up here and, if the GA code will still require full evacuation, is free and loose with the loaner hardware to get customers through this awkward situation. The big concern here is that I think we've heard “this is the last disruptive upgrade” a couple times now.
In this day and age having to wipe data off to do an upgrade is totally unacceptable. Especially when you have mission critical workloads like you do.
Storage should cater to the applications not the other way around. Manageability of the system should be a key tenant and something they clearly missed the ball on hear. Hopefully they help you out to make this it as painful.
Take a look at cohodata (www.cohodata.com) as they have an interesting solution that elevates the issues you are dealing with.
Word is that the XtremIO de-dupe block size is being doubled from 4k to 8k (i.e. fixed block sizes) with XIOS 3.0, to reduce the total amount of metadata required. While the new compression capability will be great for e.g. database workloads, if your environment is VDI, you may actually lose a significant amount of your current de-dupe efficiency. It's clear that 3.0 is a major re-write, so I would treat it as essentially “version zero” code and be very cautious about adopting it too quickly. If you consider;
– the regular need for complete, fully destructive/disruptive updates,
– the inability of different EFD sizes/types to co-exist in a cluster (how's that going to work over time?)
– a complete re-architecture of the block size
– the inability to grow an X-Brick to a cluster without a disruption when adding IFB fabrics
– the lack of many basic storage array functions (e.g. replication, QoS)
it's clear that XtremIO is far from being a finished platform. I also wonder if eMLC was actually a viable choice medium-long term? Maybe Betamax re-visited?
If you want non disruptive upgrade today, scale out, thin provisioning, data compression, data de-duplication, full API integration, no SPOF for true 24/7/365 running http://www.solidfire.com
Coming from the leader in De-Dup technology (DataDomain), when you double the de-dup block size – you will decrease the duplication rate massively! I hope EMC is promising that you will see the same disk savings with compression and DeDup. If not – I would start asking for my money back or free storage upgrades like Pure. Sounds like 3.0 is not worth it!
Disclosure – EMCer here (was trying to post earlier)
I've done a detailed blog post with architectural reasons, details, forward-looking comments, and more here: http://virtualgeek.typepad.com/virtual_geek/2014/09/on-disruptive-upgrades.html
It's always fun to see the competitive vendors all pile on – particularly when several are going through big disruptive migrations of their own 🙂 This is indeed something that plagues ALL (yes, ALL) persistence architectures. If you disagree, read my post, and then disagree.
To all the happy XtremIO customers, we stand by you (and will help you through the upgrade along with our partners), this upgrade adds new stuff, but if you don't want the new stuff, 2.4 is completely supported.
I welcome any and all feedback on the post, but if people want additional info, its there openly, transparently, and publicly.
It's still be marketed that way check their website, even knowing that this is not true. I appreciate a guy like Chad trying to be honest and forthright, but all the while EMC marketing is taking away any shred of credibility he may try to muster. I am wondering if this would be considered false advertising at this point? It is an insult those companies who deliver enterprise class firmware upgrades, and a better architecture.
From their website:
Uptime & Non-Disruptive Upgrades: XtremIO eliminates the need for planned downtime by providing non-disruptive software and firmware upgrades to ensure 7×24 continuous operations.
EMC was amazing in helping us transition to 3.0 from 2.4
They sent another full brick XTREMIO unit to temporarily transition data from the 2.4 production unit. Once the data was migrated between units, the upgrade to 3.0 on the production unit went super smooth. We transitioned the data back to the production unit, removed the EMC demo unit and voila. Happy and running on firmware 3.0. Thanks EMC!!!
That's great to hear EMC looked after you, and the process wasn't that bad.
Thanks for the feedback.
Your video went private…do you still have it for viewing?
Funny pic was good fun https://web.archive.org/web/20140926121548/http://www.theoddangryshot.com/2014/09/xtremio-gotcha.html