Living On The Edge: The Shift Toward Cloud Disaggregation

We’ve seen over the last several years the explosive value brought to the market of cloud computing, and the ever-growing shift toward establishing centralized data centers to support all scales of business processing. The cloud infrastructure of today has provided an extremely effective and economical platform for flexing with the persistent need for increased storage and computing for businesses. With the rapid growth of data, comes the corresponding growth for the need to process that data. Up until now, the modern paradigm has been to have the swift and agile ability to grow one’s data center to handle that growing need for processing power. Virtualized Data Centers and Cloud infrastructures have been foundational tools.

However, with the Internet of Things (IoT) and the forthcoming explosion of “everything connected”, we are seeing that the centralized Cloud infrastructure, on its own, will not be a silver bullet. These mobile devices, which ironically enough, we continue to call “phones”, continue to evolve, providing an ever-growing range of capabilities and a burgeoning power to compute and process. Homes, offices, public buildings, and automobiles are now collecting and generating huge amounts of data, which as we walk by with our phones, or drive by in our automobiles, we’ll have the need and expectation for a much more complete, and almost inherent, interaction. And this is where the current cloud model falls short.

As this explosion of connected data and IoT grows, and interactions between things need to almost mimic human-nature, the basic paradigm shifts from a need to scale, to a need for speed. The importance of latency in these types of “connected” interactions becomes paramount. And here is where we see bringing cloud capabilities closer to the consumer – closer to “the Edge” – as a developing model.

At OpenNebula Systems, we’ve focused, over the last decade, to bring a simple, yet flexible and comprehensive, Virtual Data Center and Cloud Management solution to the market – in OpenNebula. And as the demands have developed, and user needs have changed, we have continued to innovate.  Within the last month, we have released the first version of a prototype solution with cloud disaggregation capabilities. This is the first step in our focus to integrate edge computing, while ultimately maintaining an integrated experience of cloud orchestration and resource management.

With this prototype, we have carried out a simple, but illustrative, use case, demonstrating the value that can be achieved by being able to “disaggregate” one’s cloud infrastructure – (for now, we have introduced support for both Packet and AWS EC2 bare-metal containers) – and bringing it closer to the user.

We assumed that a fictitious company, ACME Corporation, was located in Sacramento, California, where we instantiated an OpenNebula node, to emulate an on-premise private cloud for the company. The case here begins with ACME realizing that it is getting a lot of system traffic, not only within the California region, but also from users in France. And with OpenNebula and the newly introduced Host Provisioning capabilities, ACME Corporation can now:

  • deploy new physical hosts on selected bare-metal cloud providers
  • install and configure them as KVM hypervisors
  • and add them into existing OpenNebula clusters as an independent host.

all within minutes.

In terms of Host Provisioning, for this exercise, we utilized bare-metal containers from Packet.  Here we deployed and configured two separate edge nodes – one in Los Angeles, California, and the other in Marseilles, France.

Edge Node / Location Deployment time Configuration time
Node 1 – Los Angeles, CA 5 minutes 3 minutes
Node 2 – Marseilles, France 5 minutes 7 minutes

Essentially, within a period of 8 minutes and 12 minutes, respectively, we were able to deploy and install two physical hosts on a physical, bare-metal container, and configure each of them as KVM hypervisors.

Then, the next step was to deploy a Virtual Machine.  In this case, we utilized Alpine Linux virtual router appliances with a physical size of 71 MiB. (Deployment time takes into account the total time between the deploy order and the VM entering running state, without taking into account the initial image transfer time, which is required only the first time the VM is deployed on a new location.)

Edge Node / Location Deployment time Image transfer time
Node 1 – Los Angeles, CA 1 seconds 3 seconds
Node 2 – Marseilles, France 9 seconds 15 seconds

So, within a matter of a few minutes, ACME Corporation was able to deploy two separate virtual nodes – all controlled within the single, centrally-managed OpenNebula private cloud. And here is where the “rubber meets the road”. We then measured the latency across the nodes:

We measured latencies for the following situations to demonstrate the centralized cloud use case:

Use Case Infrastructure arrangement Latency
User in Los Angeles, CA Between the user and the on-premise cloud (node in Sacramento, CA) 12 milliseconds
User in Marseille, France Between the user and the on-premise cloud (node in Sacramento, CA) 174 milliseconds

We then measured latencies for the following disaggregated cloud infrastructure:

Use Case Infrastructure arrangement Latency
User in Los Angeles, CA Between the user and the edge (node in Los Angeles, CA) 9 milliseconds
User in Marseille, France Between the user and the edge (node in Marseille, France) 10 milliseconds
User in Paris, France Between the user and the edge (node in Marseille, France) 12 milliseconds

The result it simple. By utilizing OpenNebula’s capability to easily provision a separate, fully functional node on a bare-metal container, such as Packet, that is geographically closer to the end-user, one can achieve a significant improvement in latency. In this case, ACME Corporation was able to reduce the latency for the user in France from 174 milliseconds to 10 milliseconds. And in the world with increased focus on connected data, gaming, and IoT, this will be more and more critical.

While this OpenNebula Host Provisioning prototype is an initial step in our focused development in Edge Computing and Disaggregated Clouds, OpenNebula Systems is also heavily involved in building out similar capability in its collaboration with the telecommunications giant, Telefónica, and their Central Office Re-architected as a Datacenter (CORD) initiative, called “OnLife”.  Read here for additional details about Telefónica’s “OnLife” initiative.

Stay connected with developments at OpenNebula Systems. Don’t forget to join our Newsletter, or reach out to me directly (mabdou@opennebula.systems) for any questions or suggestions. We maintain and nurture a strong Community of Users, and we’d love to hear your feedback and insight.

Initial Release of Host Provisioning Prototype

Recently, we have shared with you our vision with the disaggregated cloud approach in the blog post A Sneak Preview of the Upcoming Features for Cloud Disaggregation.  Today we are very happy to announce the initial release of the Host Provision prototype, which provides the capability to deploy new physical hosts on selected bare-metal cloud providers, to install and configure them as KVM hypervisors, and to add them into existing OpenNebula clusters as an independent host.

Everything included in a single run of the new command “oneprovision”!

For the initial release, we support the Packet Host and Amazon EC2 (i3.metal instance type) bare-metal providers. The tool is distributed as an operating system package for RHEL/CentOS 7, Debian 9, Ubuntu 16.04 and 18.04, or the source code archive. The package should be installed on your OpenNebula front-end and used under the privileges of user oneadmin.

Source code and packages are ready to download from our GitHub repository.

Detailed documentation which covers how to install, use or customize the tooling is available here.

Last, but not least – it’s all open source!

We would love to hear all your comments, suggestions or help with the problems you may experience.  Please use our community forum to get in touch with us.

OpenNebula Community and Customer Success Manager Introduction

Hello OpenNebula Community.

I want to take a brief moment to introduce myself, as I have recently joined the OpenNebula project and I will be working very closely with you.  My name is Michael Abdou, and I am the new Community and Customer Success Manager at OpenNebula. I am extremely thrilled and eager to join this Community, and to have the opportunity to help foster a dynamic and collaborative environment, and to be a part of this effort to bring value and innovation to the marketplace.  I have worked most of my career in the United States for a Fortune 100 Insurance company in the IT Delivery space. I initially started out as a BI developer, and later moved into the management track, leading various teams across Development, Analysis, and Quality Assurance. In the last few years, a lot of my focus began to shift from the “conventional, mainstream” technologies and delivery to a more courageous eye on the innovative and emerging technologies – in my case, helping to make the transition to Big Data architecture, as well as developing Platform as a Service (PaaS) solutions.

A main focus of my job here at OpenNebula will be to help foster an environment of pride and passion about our project, to make sure that everyone has a practical and convenient channel to contribute, to promote and cultivate our spirit of collaboration, and to keep our focus on the growth and success of the OpenNebula project always within sight.  I am here to support you, the Community, and to make sure we all have an exceptional user experience. What I ask of you is that you continue to be curious and open-minded. Share your experiences and insights. In the long run, this will only help our Community to grow. If you have any questions, concerns, or suggestions, please always feel free to reach out to me.

I really look forward to working together with you.

Best regards,
Michael


NTS to Sponsor OpenNebulaConf 2018

OpenNebula Conf 2018 is getting closer and we would like to announce NTS Netzwerk Telekom Service AG as new Platinum Sponsor.

If you want to participate in OpenNebulaConf and meet NTS and other OpenNebula users and partners, remember that early bird registration with 20% discount is available until September 15th. Also, if your company is interested in sponsoring OpenNebulaConf 2018 there are still slots.

About NTS Captain (Cloud Automation Platform)

In conventional IT departments, workload and complexity are constantly on the increase. However, the respective IT resources are not growing at the same pace. As a result, very often problems such as inefficiency, long waiting times, missing standards and a decentralized management occur. Our new product NTS Captain enables IT departments to present itself as an internal service provider and thus to deal with queries in a fast and efficient way.

With the help of NTS Captain, NTS customers are changing their IT organizations into agile internal infrastructure providers which deliver answers to new challenges such as DevOps. In this way, customer have a much tighter grip on their IT. NTS Captain is based on OpenNebula and can be integrated into the existing VMware environment as a self-service platform without any issues.

About NTS

No matter where you are on your way into the Cloud, NTS as a professional consultant will be able to make the right choice for your Cloud strategies! We gladly support you with our expertise when implementing Cloud strategies and we offer comprehensive advice along the entire value chain. We develop individual Cloud strategies and by using “Cloud methodology” synergies are created that make our customers more powerful; thanks to a versatile IT infrastructure on-premises in the private Cloud or in the public Cloud.

Agenda of TechDay Santa Clara CA – 30AUG18

We are organizing a TechDay in Santa Clara, CA, on the 30th of August hosted by Hitachi Vantara.

 

 

 

This event is a great chance to meet and share knowledge among cloud enthusiasts.

As usual we will have an OpenNebula hands-on tutorial in the morning and some talks in the afternoon by cloud experts from Hitachi and OpenNebula Systems.

Due to the limited availability of seats, early registration is strongly recommended to ensure your participation.

See you in Santa Clara!

 

Agenda of TechDay Frankfurt – 26SEP18

We are organizing a TechDay on the 26th of September in Frabkfurt in collaboration with our friends from LINBIT.

 

 

 

 

 

This event is a great chance to meet and share knowledge among cloud enthusiasts.

As usual we will have an OpenNebula hands-on tutorial in the morning and some talks in the afternoon by cloud experts from LINBIT, Mellanox, Canonical and 24th Technology.

Make sure you register soon as possible because the seats are almost gone!.

See you in Frankfurt!

 

TechDay Frankfurt Hosted by LINBIT – 26SEPT18

We are glad to announce that our friends from LINBIT will organize the first OpenNebula TechDay in Frankfurt.

As usual in this TechDay you will be able to enjoy a full experience around cloud and open source projects. There will be talks and presentations from experienced people working with LINBIT and OpenNebula.

Yes! A 4 hour long Hands-on tutorial will be conducted by OpenNebula experts so that the attendees are able to see in action and manage their own private  cloud!

 

Check the following links for registration and agenda information:

 

TechDay Santa Clara CA Hosted by Hitachi – 30AUG18

We are very happy to bring you another TechDay, this time in Santa Clara, California. This TechDay will take place the 30th of August and will be hosted by Hitachi Vantara.

 

The event will be held at Hitachi’s headquarters, an ideal space for you to come and listen to cloud experts and their experiences using OpenNebula. Don’t forget that this is a free event in which attendees will be able to take a hands-on workshop where they will learn to create, install and manage your own private cloud.

See you in Santa Clara!

OpenNebulaConf 2018 – Vey Early Bird Prices End May 15th. Don’t Miss Out!

If you’re interested in coming to OpenNebulaConf 2018 in Amsterdam, you still have one week, until May 15h, to save 40% off full price passes. After then, ticket prices will go up, and we really don’t want you to miss out!

Register NOW before the prices increase!. Please register asap, seats are limited!.

Hope to see you all in Amsterdam at OpenNebulaConf!

TechDay in Sofia, 14 May 2018, Hosted by StorPool

The 14th of May we are organizing a TechDay in Sofia, Bulgaria in collaboration with our friends from Storpool.

 

 

 

This event is a great chance to meet and share knowledge among cloud enthusiasts.

As usual we will have a hands-on tutorial in the morning and some talks in the afternoon:

10:00 – 13:00: Hands-on Tutorial

Diego del Corral

OpenNebula Developer

This hands-on tutorial will give an overview of how OpenNebula is used to build and operate private clouds. The attendees will build, configure and operate their own OpenNebula cloud.

14:00 – 14:20: StorPool and OpenNebula

Transforming the private cloud  in 2018.

Boyan Krosnov

Chief of Product of StorPool

This session will include an update from StorPool, in terms of new features in OpenNebula and the StorPool-OpenNebula integration.

We will also provide examples of what kinds of workloads we see our customers run on StorPool/OpenNebula and the typical implementation for each use-case.
14:20 – 14:40: A glance at OpenNebula 5.6.

Ruben S.Montero

Chief Architect at OpenNebula

This talk will be all about OpenNebula 5.6. and its main changes and new features.

 

14:40 – 15:00Success Story: How Inoreader Migrated From Bare-metal Servers to OpenNebula + StorPool

Yordan Yordanov

CEO Innologica/Inoreader

Yordan has more than a decade of experience working with scalable enterprise systems, especially in the Telco segment. In 2013 he founded the company called Innologica with the mission of developing Next-Gen OSS and BSS solutions. Yordan started a side project called Inoreader back then, which quickly turned into a leading platform for content consumption and is now a core product of the company.

15:00 – 18:00:  Open Space

This is a session for attendees to gather and discuss passionate questions, burning ideas, features, integrations or any topic of their choice, in an informal and tech-friendly environment, with other passionate and interested people.

Make sure you register soon as the seats are almost gone! There will be a live stream of the event so stay tuned for more information.

See you in Sofia!