IBM Cloud Authors: Yeshim Deniz, Liz McMillan, Pat Romanski, Elizabeth White, Karthick Viswanathan

Related Topics: @CloudExpo, Microservices Expo

@CloudExpo: Article

Hybrid Clouds – More Hype Than Happen, More Talk Than Tech

What will it take to deliver on the promise of hybrid clouds?

Cloud Computing on Ulitzer

I had a great conversation with a well-respected colleague of mine today. We discussed what it will take to deliver on the promise of hybrid clouds. We both agreed that a significant amount of intelligence needs to be added to the current architecture of Cloud Computing in order to even begin to deliver on the promise of making a hybrid cloud a reality. My colleague seems to think it will take the industry another decade to really make these technologies as ubiquitous as IP and the Internet itself. I'm of the opinion that we can get there faster if the industry collaboratively focuses on some of the major hurdles.

The Hybrid Cloud
A hybrid cloud is one in which a workload can theoretically move seamlessly between a  private cloud and a public cloud. Hybrid clouds offer the panacea that you can have protected workloads internally, capacity-driven workloads in an on-demand public cloud, and the ability to shift some of those workloads between the two, depending on requirements.

For the last few years, from about 2008 on, various individuals and organizations have been purporting the benefits of a hybrid cloud architecture. On paper, hybrid clouds look wonderful. But there is a disconnect between the paper diagram and the reality of the situation.

It appears as though many of the supposed cloud experts involved in the mass hysteria of hybrid clouds have yet to dig deeply into the technical limitations of modern workload portability. While the concept of a hybrid cloud, and the ability to shift workloads from one datacenter to another sounds fantastic, there is a significant gap between the architecture of the existing technology and the business requirements.

The Missing Links
An exhaustive list of all the obstacles involved in hybrid clouds is not our intention. Generally speaking, there are successful implementations of both private and public clouds already. Yet, at this time, the major obstacle of bridging the two into a hybrid cloud is workload mobility.

Workload mobility is what allows the two cloud types to talk to each other, for lack of a better term. Workload mobility can be accomplished in several different ways. A workload can be migrated offline or online, it can be the entire operating system and application stack, or it could be just the application. A single workload may include multiple instances of operating systems and applications or it may be a single entity.

Which aspects of  workload mobility get implemented on a cloud-by-cloud basis are left up to the designers and owners of each cloud. Regardless of the implementation details, the private cloud must have a means of offloading a workload to a public cloud and/or vice versa. The case may also exist for workload mobility between two public clouds. It is generally taken for granted in many hybrid cloud architectural designs that this capability already exists, but the technology to deliver workload mobility in today's hybrid cloud is actually quite limited.

To some extent, workload mobility does exist. But the existing workload mobility was designed to be utilized within a single datacenter, or within a single network. Hybrid clouds require that a workload, usually a virtual machine itself, move outside the datacenter, usually over a WAN to another datacenter. While this sort of workload mobility can be accomplished on a limited basis today, the existing technology is not designed to support commonplace and well-managed mobility of workloads across the WAN.

For the purpose of this article, the workload is assumed to include access to the data that the workload requires. Every aspect of shifting the workload from one location, or one cloud, to another, should include the same qualifications for the workload's respective data. To effectively accomplish every day workload mobility across the WAN, there are several aspects of workload mobility that must be addressed:

  • Workload delivery guarantee - not just a simple Ack (Acknowledgement Packet)
  • Workload mobility Quality of Service (QoS)
  • Workload Security & Compliance

Workload Delivery Guarantee
Delivery guarantee does not just refer to the successful move of a workload, the ability to fail back if the move is unsuccessful, or the ability to acknowledge its success. Workload delivery guarantee requires that there is some method of planning ahead, before the workload migration begins, to ensure the timely arrival of the workload. In the interest of time, it also requires that there be a predetermined time frame for the workload to arrive at its new destination. Since this time frame should be predetermined, it infers that the workload should be made aware of its Estimated Time of Migration (ETM). Additionally, based on the time estimate, the workload should have the opportunity to act accordingly, prepare itself, prior to the activation of the migration process.

Workload Mobility QoS
The Quality of Service aspect of workload mobility is tied closely to the delivery guarantee. QoS is a method of organizing the priority of network traffic, and it is required at the workload level in the same way that network QoS is necessary at the packet level. Without some means of determining the priority of workloads during migration, it would be very difficult to offer any sort of ETM prior to or during the actual migration process.

It is also important to bear in mind that workload mobility QoS is not directly attributed to the relative importance of the workload that's migrating, although that may often be the case. For example, the QoS level assigned to the migration of a particular workload may be higher or lower than the processor priority, or uptime priority assigned to the workload itself.

Workload Security & Compliance
Security and compliance are becoming increasingly important as more regulatory bodies scrutinize how business is done with respect to technology. Contrary to what some technology purists seem to believe, almost every business has some sort of regulatory restrictions on it. This includes PCI Compliance for credit card and retail transactions and financial compliance for every business that files its taxes or keeps its records electronically. To claim that security and compliance are only issues for major financial, federal, or health related industries just shows a lack of business acumen on the part of some technologists.

Having established the necessity for compliance with hundreds of regulatory bodies, what has not been clearly established are methods of ensuring compliance during workload migrations from one cloud to another.

What Needs To Be Done
The industry really needs to collaborate to address the above issues, and several others. Workload mobility is the cornerstone of hybrid clouds, and right now, that capability is extremely limited at best.

The most obvious work needs to be done at the network layer. This includes integration with the virtualization layer, as the virtualization layer is almost always a critical component of workload mobility. Above that, there is optional work to be done at the operating system and application layers, to further facilitate the transparency of migrating workloads inter-cloud.

The enhancements required at the network layer are the most critical at this juncture. The current level of network awareness for workload mobility is akin to an aviation system that only has local air traffic control, and no communication between cities. Planes would take off and land in whatever order they are ready to go or arrive. At some point, too many planes would be waiting to arrive at a single city because no planning was done ahead of time, and they start to run out of gas in the air, or have to request priority clearance to land in front of other planes that were expecting to be on the ground shortly. Most of the time, things would get sorted out, every now and then, we'd lose a plane. But even when things worked out, it would not provide any sort of reliable flight times.

The need to increase the integration with the virtualization layer is a natural extension of the network layer. In the above analogy, air traffic control needs to be able to communicate to the plane its expected departure and arrival times before it leaves the gate. There also needs to be a means of ensuring that those times remain accurate, and a method of notifying the plane once it has taken off if there is an emergency that requires it to take action. There is no guarantee that the primary, intended server or network connection will be available from start to finish.

The extra mile is integration with operating systems and applications. This provides the ability to not only update the wrapper that holds the workload, but also the application performing the work and the operating system supporting it (though I conjecture we are not far off from those becoming integrated, as well). This is the equivalent of the plane's captain being able to communicate with the flight crew and the passengers in the cabin. Everyone can prepare for how long the flight will be, and can be updated if there are any changes to their status.

The issues surrounding security and compliance will need to be addressed at all the layers of existing architectural models. Most systems have traditionally been designed to be held in a secured environment, with the onus of security placed on exogenous utilities and appliances. That paradigm has to shift some, as the workloads themselves will need to maintain a state of security during migration. Depending on the implementation, that state of security can optionally be maintained when not migrating, adding to the overall benefits of the additional architecture. Much like wearing your seatbelt in the plane while it is still parked at the gate.

In the coming years, we will undoubtedly be hearing from some of the industry leaders, and probably some emerging ones, about technologies they are developing to address these needs. Currently hybrid clouds trail the airline industry in their ability to transport workloads effectively. With proper consideration and collaboration hybrid clouds may offer the equivalent of commercial flights to the moon in the next several years. It is safe to assume that there are many unforeseen needs that will arise along the way and that will create entirely new markets for Cloud Computing technologies.

More Stories By Bill Bauman

Bill Bauman, WW Cloud & Virtualization Solution Architect at Red Hat, is an expert on Cloud Computing, Virtualization and scalable systems. He has 17 years of IT experience in everything from programming to processor debugging and complex systems architecture. Follow Bill @ http://billbauman.com.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by FinTechEXPO. ICOHOLDER give you detailed information and help the community to invest in the trusty projects. Miami Blockchain Event by FinTechEXPO has opened its Call for Papers. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to info@dxworldexpo.com. Miami Blockchain Event by FinTechEXPO also offers s...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
As IoT continues to increase momentum, so does the associated risk. Secure Device Lifecycle Management (DLM) is ranked as one of the most important technology areas of IoT. Driving this trend is the realization that secure support for IoT devices provides companies the ability to deliver high-quality, reliable, secure offerings faster, create new revenue streams, and reduce support costs, all while building a competitive advantage in their markets. In this session, we will use customer use cases...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
The IoT Will Grow: In what might be the most obvious prediction of the decade, the IoT will continue to expand next year, with more and more devices coming online every single day. What isn’t so obvious about this prediction: where that growth will occur. The retail, healthcare, and industrial/supply chain industries will likely see the greatest growth. Forrester Research has predicted the IoT will become “the backbone” of customer value as it continues to grow. It is no surprise that retail is ...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
DXWorldEXPO LLC announced today that "Miami Blockchain Event by FinTechEXPO" has announced that its Call for Papers is now open. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to info@dxworldexpo.com. Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expe...