Monthly Archives: June 2012

Technology trends: Buy into realities, not hype

Call it irrational exuberance.  Call it hype.  Call it whatever you want, but understand that just because a big technology trend dominates the media doesn’t mean it’s The Right Thing for you or your company to embrace.  Not wholesale, anyway.

For example, consider just a few of the trends sweeping the industry, particularly those that are finding their way into job specifications.  HTML5, NoSQL (e.g., MongoDB), cloud computing, Hadoop, etc.  Spend a few minutes on TechCrunch and you’ll start to feel that YOU MUST BUY INTO THESE RIGHT NOW!

And, in some cases, you should.

But not always.  If you’re building a cloud application, for example, you’re likely going to want the scale-out capabilities of a NoSQL database like MongoDB.  But Oracle has a good point arguing that you wouldn’t want to build a checking application for a bank with NoSQL technology.   SQL has its place, and NoSQL has its place.  It just happens to be dominant for new school applications, which may not be the kind you’re developing.

Or consider Hadoop, which has dramatically lowered the (economic) bar to data mining/analytics.  Hadoop is fantastic technology, but it’s batch-oriented.  If you need real-time analytics, you’re likely going to want to couple Storm with Hadoop, as we do here at Nodeable.  Or maybe you should embrace Red Hat’s JBoss Data Grid 6, which “as an in-memory, key-value store…is much more optimized to handle the operations that Hadoop simply can’t: transactions like the kind found in e-commerce and financial trading systems.”

Does this mean you dump Hadoop and swap it for Data Grid or Storm?  Of course not.  But it does mean that developers need to look beyond the hype to determine what is the best tool for a particular job.

The same thing holds true in mobile, where HTML5 promised to be the end to mobile’s fragmentation problem.  Instead, it turns out native apps dominate the smartphone space, while content-friendly tablets are much more likely to be friendly to HTML5.

The list goes on.  Some swear by Node.js, but it’s best for server-side app development, and not a panacea, according to Nodeable CEO Dave Rosenberg.  Cloud?  You probably shouldn’t choose private or public, but both, declares Citrix’s Peder Ulander.  Etc. etc.

Each of these technologies is trending because it solves real needs in novel, useful ways.  But this doesn’t mean they’re right for you.  Of course, one of the great things about cloud and open source and other megatrends like these is that they tend to skew open, such that you can try before you buy.  As a vendor, this is a huge boon, as I’d much rather customers buy what they need and are happy, rather than getting duped into buying hype that doesn’t fit their needs.

That’s the old world: buy into the hype and regret is later.  The new world lets you regret your decision right away. :-)

Hadoop and Storm are shifting the industry toward Big Data-enabled cloud applications

Dave and I were fortunate to attend a Churchill Club event on Hadoop Tuesday night.  Hadoop sits at the center of the burgeoning Big Data universe, and so one might be tempted to conclude that it’s basically a finished product.  Not so, said the esteemed panel, which included representatives from Cloudera, Facebook, Metamarkets, MapR, and Oracle.  In fact, arguably the biggest opportunity in Hadoop isn’t Hadoop at all: it’s the cloud applications built on top of Hadoop.

Dave summarized the panel discussion on CNET, and highlights Cloudera CEO Mike Olson’s call to arms for Hadoop-based applications.  It’s something Olson has said before, including here on this blog, but it was particularly poignant against the backdrop of a deep, engaging discussion about Hadoop’s pros (powerful, open source) and cons (batch-oriented, complex, somewhat inefficient).

And it’s why I think Nodeable is a sign of the times.

We’re an application that depends upon Hadoop.  But we’re also a technology that improves Hadoop by front-ending it with Storm.  Hadoop is powerful but limited to batch-oriented processing of data.  Storm actually crunches data in real-time, in the stream.  The combination of the two is potent, and something that we only discovered while building out our application to ingest systems data and extrapolate insights via in-stream data analytics.

In the near future the back-end data processing via Storm and Hadoop will be managed behind the scenes by cloud applications, as Workday co-CEO Aneel Bhusri tweeted from the Churchill Club event.  For now, companies like Nodeable are helping to bridge the divide between complex infrastructure and simplified applications.

Tagged , , ,

Public vs private clouds: A matter of technology, politics, or culture

Is “hybrid cloud” or “private cloud” simply ways of saying that a company isn’t ready to fully embrace the “real” cloud? Cloudscaling co-founder Randy Bias arguesthat cloud computing requires a fundamentally different approach to sourcing and managing infrastructure, a point echoed by Amazon, which questions the very possibility of private cloud computing. There are surely different ways to embrace the cloud, some more advanced than others.

But the real question is whether an organization is culturally ready to embrace the cloud. If so, the necessary infrastructure follows and, importantly, it’s not necessarily always going to look like Amazon. As Mark Thiele writes:

For a legacy IT organization to adopt cloud solutions without significant organizational realignment and improved business participation, the benefits would largely be wasted. It’s akin to thinking you can put a modern 500-horse power engine in a 1970’s economy car and get all the same performance and protection characteristics you would enjoy in a 2012 model year luxury sedan.

In fact, the introduction of cloud without organizational improvements would likely increase enterprise risk and potentially cost. The real opportunity of a cloud operating model comes from the alignment of technical solutions, people, and process.

In other words, cloud isn’t something for IT to hatch in seclusion from the business side of the enterprise. Cloud is, in an ideal world, truly a function of what the business needs.

We’re starting to see this play out in the rise of DevOps, but ultimately the integration of the enterprise across functions will go even deeper. Cloud computing should demolish the walls IT has put up to protect its turf (and sanity). IT will need to work hand-in-hand with the business to build out the right cloud tools for a particular job, whether public, private, or a hybrid of the two.

Andy Jassy, senior vice president of Amazon Web Services (AWS), dismisses the notion of private clouds altogether:

If you look deep into what [private cloud vendors] are offering, you will see that it’s basically an internal data center that is virtualized and has some management tools. Organizations that have private cloud systems will have missed out on all the advantages and benefits of going into the cloud.

But this is easily said by the vendor best-positioned to capitalize on public cloud computing. Amazon doesn’t need to worry about a potpourri of hardware and software choices, built up over years. Bias argues that this is one of the great strengths of AWS and, indeed, of all big web companies like Google and Facebook that have been able to build their clouds from the ground up.

Within the average enterprise, however, years or decades of legacy hardware and software choices must be balanced against the new imperative of the cloud. And so they consider the cloud for resource bursting or carve out a private cloud for new applications. Will they run as efficiently as Amazon? Almost certainly not. But that’s not really the goal, is it?

IT can play an essential role in helping the business to rationalize its existing assets and complement them with cloud resources. I suspect one area that can help bridge the gap between IT and the business is better tools to express what is happening in cloud systems, and what this means for the business.

At Nodeable, we’re trying to build monitoring tools that go beyond mere reporting of what’s happening to express why things are happening, and how these cloud systems impact the business. One of the key reasons for our Twitter-like interface is that we want the system to be approachable to non-technical users. Because, frankly, cloud systems shouldn’t be isolated to IT folks.

The cloud has the potential to democratize IT, and bring the business into the IT conversation. Part of this cultural shift can be complemented by the right tools, tools that don’t drown users in arcane minutiae but instead present insights into how things are working, and why. This is the recipe for cloud success, and it’s something we as an industry are just now starting to figure out.

Tagged , , ,

IBM embraces the DevOps counterculture

When The Man embraces a counterculture movement like DevOps, does that mean it no longer counts as counterculture? We’re about to see because IBM is serious about DevOps, and not as some cheap way to co-opt a hippie-tech buzzword and make itself cool.  Yes, IBM, that enterprise technology vendor that in many ways epitomizes everything that the DevOps movement was set up to escape.

Until this week, I hadn’t realized just how serious IBM was about DevOps.  But on Tuesday I was fortunate to spend some time talking with IBM’s Bill Higgins.  As we talked, I started searching the web for more information on IBM’s involvement, and found it…everywhere.  Yes, there were the obligatory conference talks, but there was also smart discussion about how to pull off DevOps within traditional enterprise IT.

And a whole IBM blog devoted to the topic of DevOps.  Imagine that!

Yes, it just started.  But it’s great to see such a trusted enterprise brand do more than merely slap the DevOps label on a tired, old product line, hoping that customers won’t notice.  I’m sure IBM is doing that, too, but not Higgins and his team.  It sounds like there’s a very real, concerted effort to embrace DevOps within IBM and within its customer base.

I don’t know where this leaves the counterculture.  But I think it means DevOps is more than some passing fad.  And that maybe, just maybe, IBM is shrewdly embracing the counterculture again, just as it did with Linux and open source years ago.  That bet paid off big time for Big Blue.  I imagine its bet on DevOps will do the same.

UPDATE: Donnie Berkholz, part of Redmonk’s awesome analyst team, attended IBM’s Pulse conference earlier this year, and praised IBM for being out in front of its stodgy peers in terms of DevOps and other important trends:

IBM’s people really get it. They understand trends that are happening at the frontlines of tech today in startups and in open-source development. IBM is way out in front on enabling DevOps in big enterprises, and the teams working on DevOps inside Tivoli as well as Rational (which builds tools for developers) are outstanding. A lot of my experience with enterprises is that they’re slow-moving and often lagging trends by years, to the point where it’s nearly laughable, but in this case IBM is definitely a front-runner.

Tagged ,

Cloud computing may be the final nail in traditional IT’s coffin

The gods could be crazy, or they simply may not like IT very much.  Over the past decade, trend after trend has arisen to give power back to developers to get their work done, and away from the bureaucratic IT staff that want to manage that work.  IT, however, has the potential to claim a very valuable role in the changing enterprise, but requires a new mindset and mission.

In a new research report (executive summary available for free), Gartner articulates this shift away from IT-as-king to IT-as-facilitator, and how the cloud fosters the trend:

In 2010, organizations were compelled to consume IT services from external cloud providers to achieve their business, budget, and IT goals. But organizations realize that external cloud computing is not a panacea. They still need internal data centers to house critical applications and data. However, the use of external cloud providers has conditioned organizations to expect IT resources — whether internal or external — that are offered in an on-demand, self-service manner. Therefore, IT organizations are forced to offer IT services by using the same consumption model or otherwise risk extinction.

Poor IT.  First it had to deal with the rise of open source, and now cloud.  Both trends have forced IT to loosen its stranglehold on the software, hardware, and services used with the enterprise.  All of the arguments that failed against open source are also failing to stem the tide of cloud computing.

And rightly so.

But none of this means that IT is dead.  It just means, as Gartner points out, that IT’s role needs to change.  For example, DevOps is a very real phenomenon, but I suspect few organizations will have the know-how or brazen courage to take the Netflix route and embrace DevOps completely.  The trick is to give developers more flexibility without imposing on them the burden of setting up and managing all infrastructure themselves.  Yes, some will want precisely this.  But most just want greater influence over the tools they use.

They’re not going to get this from OpenView or any of the legacy tools from legacy vendors.  They’re just not going to blend private and public cloud resources, host their code on GitHub, and be bothered with clunky old management tools.  It’s not going to happen.

So IT needs to redefine its new role.  And it needs to get new tools for doing so.  Or it’s going to evaporate into obsolescence.

Follow

Get every new post delivered to your Inbox.

Join 53 other followers

%d bloggers like this: