Storage Nation

Last night, IDC released their storage market share analysis for what happened in Q2.  Some things remained the same, other parts seem to be changing. And if you watch this market as closely as I do, it's worth reviewing some of the more interesting bits. What You Need To Know For many years, IDC has published the most authoritative numbers on storage hardware and software sales.  While no methodology is perfect, I've come to view IDC's numbers as absolutely essential to anyone in the storage business. EMC doesn't give IDC access to any privileged information, they have to figure things out from published reports.  Generally speaking, IDC's estimates of EMC's business are usually within a few points (plus or minus) of our own.

As I sit back and contemplate the last few weeks, I keep coming to the same conclusion.  The market has clearly expressed its strong interest in all things cloud-like, and just about every technology vendor on the planet — large and small — is frantically repositioning themselves just as quickly as possible. Whatever "tipping point" we all were waiting for, it's clearly happened.  Game on. And I think this rapid shift has caught many in the IT industry by surprise: technology vendors, system integrators, consultants — few people are really interested in IT as usual.  Everyone wants to talk about the cloud.

Every so often, a well-understood category in IT becomes completely up-for-grabs in terms of answering the question: what's next?  Clearly, how we think about enterprise desktops and delivering end-user computing is now very much in play. The many announcements coming from VMworld only underscores this point

I know, there's a LOT to read and digest coming out of VMworld these days. As an occasionally proliferate blogger myself, I have to hand it to Chad — he's turned loose a veritable supernova of meaty and significant technology-oriented posts in the last few days.  I'm impressed, and I don't impress easily.  I know how much work is behind each and every one of these posts. If you have a moment, please check these out: vCloud Director and UIM VPLEX, Long Distance VM Teleportation, and a great offer ..

With VMworld in San Francisco this week, it's only fitting that Michael Haag is on the Hotspot discussing 3PAR's support for server virtualization . If you are at VMworld this year, please stop by our booth, #313, to see what all the commotion is about and why 3PAR storage is so popular for cloud computing .

Lots of activity at VMworld this week, plus the predictable flurry of vendor announcements.

The ongoing battle for 3Par by HP & Dell tells us much more about the state of the IT Industry than just the desires of two companies to acquire some interesting storage tech.  It signals an acceptance that storage is a key feature in the future direction of the IT industry – more important than networking and almost as important as the virtualisation platform itself. This may seem like a bold statement to make, however we need to look forward to where the industry is headed.  First of all, vendors want us to buy their unified hardware stacks; it represents that move back to a consolidated architecture that kept one vendor dominant in the mainframe days – IBM.  “No-one gets fired for buying IBM” the saying goes (or used to go), demonstrating how IBM was seen as the data centre supplier for all things computing in the 70’s and 80’s.  Of course we know that politics within organisations and the cost of IBM hardware eventually broke the monopoly, but the status quo worked well for many companies for many years.

This is a series of post discussing storage array architectures.  Previous posts: Choosing Between Monolithic and Modular Architectures – Part I In the first post, I discussed the shared storage model architectures typified by what we sometimes think of as Enterprise arrays, but I’ve called monolithic.  This term harks back to the mainframe days of large single computers (see Wikipedia definition ), hence it’s use to describe storage arrays with a large single cache.  In the last 10 years we have seen a move away from the single shared cache to a distributed cache architecture built from multiple storage engines or nodes, each with independent processing capability but sharing a fast network interconnect.  Probably the most well known implementations of this technology have come from 3Par (InServ), IBM (XIV) and EMC (VMAX).  Let’s have a look at these architectures in more detail. EMC VMAX The VMAX architecture consists of one to eight VMAX engines (storage nodes) connected together by what is described as the Virtual Matrix Architecture.  Each engine acts as a storage array in its own right, with front-end host port connectivity, back-end disk directors, cache (which presumably is mirrored internally) and processors.  The VMAX engines connect together using the Matrix Interface Board Enclosure (MIBE), which are duplicated for redundancy.  The virtual matrix enables inter-engine memory access, which is required to provide connectivity when the host access port isn’t on the same engine as the data.  There are two diagrams in the gallery at the end of this post, one showing the logical view of the interconnected engines and the second showing how back-end disk enclosures are dedicated to each engine. What’s not clear from the documentation is how the virtual matrix architecture operates, other than being based on the RapidIO.  I’m not sure if VMAX engines have direct access to the cache in other engines or whether the processor of connected engines is required.  In addition, can an engine access cache in another engine purely to manage throughput of the local host and disk connections? I’m not entirely sure.

Two bits of news, oddly correlated. First, there's EMC's recent SPEC benchmark posting, where a single Intel-based Celerra data mover absolutely *smokes* every other NAS device out there.

A while back, I wrote a rather skeptical post reacting to a press article about Pfizer's use of Amazon.   There are some lessons to be learned from this experience:   #1 — Don't always believe what you read online from an industry reporter, and   #2 — Before being critical, do your homework.   I made both mistakes.  But, wonderfully, I recently had a chance to talk to the principal behind the story — Mike Miller — and found the reality to be far more fascinating