4.12 Features: Virtual Data Center Redesign

In this post I’ll share with you one of the new 4.12 features we are working on: Virtual Data Centers. Well, it’s not entirely new, because OpenNebula already had VDCs, but we have redesigned them to be more powerful.

Let’s start refreshing what Clusters and VDCs are:

  • Cluster: Group of physical resources (Hosts, Virtual Networks and Datastores) that share common characteristics or configurations. For example, you can have the “kvm” and “vmware” Clusters, or “kvm-ceph” and “kvm-gluster”.
  • Virtual Data Center (VDC): Defines a assignment of one or several Groups to a pool of Physical Resources. This pool of Physical Resources consists of resources from one or several Clusters that could belong to different Zones, or public external clouds for hybrid cloud computing.

The following image shows three VDCs (in blue, red and green) and the resources assigned to three Groups. As you can see, the red VDC assigns the Human Resources Group to resources from two different Zones (individual data centers), and a public cloud provider.

vdc_organization

In OpenNebula 4.6 the terms Virtual Data Center (VDC) and Resource Providers were introduced. A Resource Provider was not a separate entity, it was the way we called a Cluster assigned to a Group. The term VDC was used to name a Group with Resource Providers (Clusters) assigned, but was not a separate entity either.

Starting with OpenNebula 4.12, VDCs are a new kind of OpenNebula resource with its own ID, name, etc. and the term Resource Provider disappears. Making VDCs a separate resource has several advantages over the previous Group/VDC concept.

Now that VDCs are a separate entity, they can have one or more Groups added to them. This gives the Cloud Admin greater resource assignment flexibility. For example, you may have the Group Web Development added to the ‘low-performance’ VDC, and Big Data to the ‘high-performance’ VDC. If the Web Development requirements change for a few days, the Group can be additionally added to the ‘high-performance’ VDC. In previous versions, this single operation would require you to write down which resources were added to the Group, to undo it later.

create_vdc

From the resource assignment perspective, the new VDC approach allows to create more advanced scenarios. In previous versions, the Group’s Resource Providers were whole Clusters. This had some limitations, since Clusters define the topology of your physical infrastructure in a fixed way. The Admin could not assign arbitrary resources to a Group, he had to choose from those fixed Clusters.

The new VDCs contain a list of Clusters, just like before, but they can also have individual Hosts, Virtual Networks, and Datastores. This means that a VDC can create logical groups of physical resources, that don’t have to resemble the real configuration of the physical infrastructure.

For example, you may have one ceph Datastore and 10 Hosts inside a Cluster, and now you can assign one individual Host to a VDC whereas before you had to assign the whole Cluster, or create smaller Clusters. The latter option was not very practical, because Datastores can only be in one Cluster at a time, so you would need to split your storage between the Clusters.

We are quite pleased with how everything fits together, and this is because the requirements for this improvement of the VDC model came from our users. Hopefully you’ll find it useful too, we are looking forward to your feedback.

New OpenNebula Maintenance Relase 4.10.2

A new maintenance release for OpenNebula 4.10 is available. There are several fixes and improvements since 4.10.1 and upgrade is recommended. Some of the changes are as follows:

For a more exhaustive list you can check the issue tracker.

You can download the packages from the following URL or use the package repositories to update your OpenNebula installation:

http://opennebula.org/software/

Make sure you backup your configuration and happy upgrading!

OpenNebulaConf 2015: Oct 20-22 in Barcelona

Following last year’s successful event, we are happy to announce that the third annual OpenNebula Cloud Conference will take place on October 20-22 at Barceló Sants Hotel in Barcelona.

Screen Shot 2015-01-13 at 5.31.06 PM

This new edition of the OpenNebula Conference will be a great opportunity to share experiences and meet people with expertise and interest in OpenNebula. OpenNebula Conferences serve as a meeting point of cloud users, developers, administrators, integrators and researchers, featuring talks with experiences and use cases. They also include tutorials, lightning talks, and hacking sessions that provide an opportunity to discuss burning ideas, and meet face to face to discuss development.

The third OpenNebulaConf will open its Call for Presentations in a few days, stay tuned for content updates.

And remember… OpenNebulaConfs are vendor-neutral events focused on real-world practices and how to successfully implement open source in your cloud.

We look forward to seeing you in Barcelona!

2015 OpenNebula Events Plan

We have events in schedule already for 2015. If you have any questions on OpenNebula events, please contact us at events@opennebula.org

Thanks you for your support!

Industry Events

We are sponsoring and prepping for the next two industry events:

  • Cloud Expo Europe in London, 11-12 March 2015, where we will be present in one of the corners of the Open Cloud Park in the exhibit hall with our partners CloudWeavers and ViApps. We will also have a kiosk there to demo the new vOneCloud.
  • VMworld Europe in Barcelona, 13-15 October 2015, where we will have a booth to demo the VMware support in OpenNebula and the new vOneCloud.

Open Cloud Community Events

You can help us spread our word. Speaking at a technical conference is an excellent way to share your experiences and participate in the community. We can provide different types of support, like review your talk or promote it through our blog and social instruments. You can use any material available at this site.

We strongly encourage you to submit talks for all open cloud community events. Join our community discuss mailing list if you are interested in speaking about OpenNebula. The latest presentations are available at the OpenNebula SlideShare account.

We are planning to participate in the following events (CFP is open for some of them):

OpenNebulaConf 2015

In a few weeks we will announce the date and venue for our anual community conference. Stay tuned!.

Cloud TechDays

We are organizing the 2015 schedule of TechDays, send us an email or send it to the community discuss mailing list if you are interested in hosting a TechDay event. We also look forward to proposals to create a user group in your area.

OpenNebula Training

We have just published the schedule for 2015 public classes at OpenNebula Headquarters. Please contact us if your would like to request training near you.

OpenNebula 2014: Year in Review

It’s been a fully packed year in the OpenNebula project and in the cloud computing field. The community is as healthy as ever and is driving your favourite Cloud Management Platform (CMP) to its consolidation as a real, enterprise-ready and open source alternative to transform datacenters into private clouds.

OpenNebula is really vendor-neutral, there is no hype, just a focus on real-life needs, developing the best technology, and serving our users. We think it is important to clearly state what “open”, “simple”, “scalable”, and “flexible” mean for us. Mostly because, as you well know, terms like “open-” and “open-source” are used by many vendors as a marketing tool to lock you into their own version or distribution of a hyped open-source software.

Why

We are also proud of being counted among the Cloud Computing pioneers. These two papers present the original internal design and architecture of the Eucalyptus and OpenNebula cloud management platforms, the very first two open source CMPs.

With 2014 coming quickly to a close, we’d like to review what this year has meant for the OpenNebula project. You have all the details about the great progress that we have seen for the OpenNebula project in our monthly newsletters.

Solving Real Needs in Innovative Ways

Three major releases were published during this past 2014: 4.6 Carina, 4.8 Lemon Slice and 4.10 Fox Fur. Moreover, three maintenance versions were released to fix bugs and polish features. Several maintenance versions of AppMarket were also released.

One of the most relevant features introduced by 4.6 Carina was the ability to create Federations of several OpenNebula instances, and their subsequent partition into Virtual Datacenters, by bounding a group of users to a set of hardware resources: the OpenNebula provisioning model is now considered mature. Also, Carina brought a new Cloud View Portal and support for OVA imports directly to an OpenNebula cloud.

The focus of 4.8 Lemon Slice was simplicity, with several improvements to the Cloud View portal (an important key in the provisioning model) like the addition of the VDC Admin View, based as well on the simplicity designs of the self service portal. The hybrid model was also extended with support for IBM SoftLayer and Microsoft Azure public clouds, and changes in the OneFlow and OneGate made possible sharing service information among VMs. Virtual Networks underwent a thorough redesign: definitions are no longer restricted to the fixed and ranged model, but rather they can include any combination of ranges to accommodate any address distribution.

4.10 Fox Fur was the latest major release of 2014, and it was a very special one, since it featured a little revolution in shape of vCenter support. It is the first OpenNebula release that allows to automatically import an existing infrastructure, since the new vCenter drivers allow to import Clusters and Virtual Machines from a vCenter installation, significantly smoothing the set up curve. Also, Fox Fur introduced an integrated tab in Sunstone to access OpenNebula Systems support and login token functionality.

We would like to thank to all code contributors and sponsors, and especially to Produban, BlackBerry and Echelon for funding several features this last year through the Fund a Feature program. We look forward to your contributions to code development!.

The New vOneCloud

4.10 Fox Fur brought VMware vCenter support to OpenNebula, and it was the seed for a new product by the OpenNebula Team: vOneCloud, a virtual appliance for vSphere that transforms an existing vCenter deployment into an automated, self-service private cloud in a few minutes. The appliance is based on OpenNebula, every component is fully open-source and has been certified to work in enterprise environments.

vOneCloud exposes a multi-tenant, cloud-like provisioning layer, including features like virtual data centers, self-service portal, or hybrid cloud computing to connect in-house vCenter infrastructures with public clouds. vOneCloud seamlessly integrates with running vCenter virtualized infrastructures, leveraging advanced features such as vMotion, HA or DRS scheduling provided by the VMware vSphere product family.

2014 saw the first stable release of vOneCloud, which we believe is going to transform the way numerous VMware-based data centers perform their IT processes.

Interesting right? Try it out, it takes very little time and it is not intrusive. We look forward to your feedback!.

A Vibrant Community of Users

We’ve been rapidly growing our vibrant community of users who are supportive, engaged, and opinionated about the direction of OpenNebula ever since. Many of them have contributed new integrations with other platform components in the data center like IBM Storwize V7000 SANsalt-cloudInfiniband (SR-IOV devices)Bacula, Chef Kitchen.NET API, Nodejs, Cloud-init,  Ansible or The Foreman – just to name a few.

We are proud to confirm that the number of downloads from our repositories continue doubling each year. There are tens of thousands of deployments around the globe and OpenNebula is parked in some of the biggest organizations out there including Industry and Research leaders. This year we performed a new Cloud Architecture Survey to know about the types of OpenNebula cloud deployments and their main architectural components.

We would like to thank all our users! It is out of scope to name all new users, but we want to give a wholeheartedly warm welcome to those new users that shared their experiences through our blog: Runtastic, Avalon, China Mobile, Rentalia and BIT.nl. If you are using OpenNebula, we want to hear from you! We look forward to having more details about your deployment and experiences!. You are very welcome to contribute your integrations and experiences by writing a post in our blog or submitting your integration to the OpenNebula Add-on Catalog.

Spreading the Word

Our biggest event in 2014 was undoubtedly the OpenNebula Conf! Held in Berlin, and organized by Netways, at early December.  It featured lots of very interesting users: RedHat, Runtastic, Deloitte… Check out the videos and, more importantly, the amazing feedback gathered by the team from the OpenNebula users. This is what makes OpenNebula unique, it’s down-to-earth, user-driven model.

This year the team was very busy spreading the OpenNebula word in several events. Important events with OpenNebula representation were CeBIT 2014, FLOSS UK 2014, several CentOS Dojos (like for instance this one in Brussels, jointly with Fosdem 2014), CloudScape VI, Cloud Expo Europe, Future Internet Assembly, Closer 2014, EGI Community Forum, GigaOM StructureHostingConLOADays and many, many more! We want everyone at least to have the chance to know about what we think is the easiest to use, most powerful and definitely most enterprise ready open source CMP!.

A series of events crafted by OpenNebula are the OpenNebula TechDays. Probably the most relevant ones this year happened in both US coasts: Florida and San Francisco hosted by TransUnion|TLOxp and Hyve Solutions. Other relevant TechDays took place in Europe: Timisoara by CloudBase and Unified Post, Santiago by Agasol, Ede by BIT.nl, Barcelona by CSUC, Almendralejo by CENATIC… and much more to come in this 2015!.

We want to thank all organizations that hosted a TechDay in 2014 for their amazing hospitality and making these events a success. We are organizing the schedule of TechDays for future months, send us an email or send it to the community discuss mailing list if you are interested in hosting a TechDay event. We also look forward to proposals to create a user group in your area.

***

We think it is impossible to stress too much or too often the importance of our community. THANK you all (users, developers, integrators, cloud architects, all of you!) for helping us building a great cloud management platform that solves real world problems.

We’d also like to take this opportunity to wish you happiness and prosperity in 2015 to you and your loved ones!.

On behalf of the OpenNebula Project.

OpenNebula Newsletter – December 2014

We want to keep you up-to-date with the main news and the latest information about OpenNebula and what you can expect in the following months.

Technology

The OpenNebula team is preparing a new maintenance release for Fox Fur. OpenNebula 4.10.2 will come with several bugfixes, the complete list can be consulted here. There are several affected components, ranging from drivers to the OpenNebula core as well as new Sunstone views.

Also a new feature related to the newly introduced vCenter support will be present in this new version, the ability to manage and import vCenter Networks as OpenNebula Virtual Networks, supporting IPv4, IPv6 and Ethernet address ranges. This also means that attach and detach network interface cards is possible for vCenter VMs. We would like to thank Echelon for making this feature possible through the Fund a Feature program.

vcenter_create

The team (which never rests ;) ) is also working in awesome new features for the next stable release, 4.12, like this nifty SPICE support for accessing your VMs.

This month was specially important for the OpenNebula project due to the release of the first stable release of vOneCloud 1.0, a CentOS Linux virtual appliance for vSphere that contains all required OpenNebula services optimized to work on existing VMware vCenter deployments, allowing to deploy an enterprise-ready OpenNebula cloud in just a few minutes. vOneCloud is for companies that want to create a self-service cloud environment on top of their VMware infrastructure, turning infrastructures managed by already familiar VMware tools such as vSphere and vCenter Operations Manager into automated, self-service private clouds where the provisioning, elasticity and multi-tenancy cloud features are offered by OpenNebula.

Community

Our community is a healthy, vibrant and supporting, as we re discovered in this year OpenNebula Conference (read below for more details).

To name but a few, OpenNebula has recently received a new shinny addon to support the IBM Storwize V7000 SAN. This is really valuable to the OpenNebula project since it is very difficult to support any piece of hardware from the datacenter, but with the help of our community we are getting at least the important bit. Thanks for your effort!

Words of encouragement are also very welcome in the workaholics team of OpenNebula. Specially words like these which perfectly capture the philosophy that drives the OpenNebula project.

Outreach

We held the second edition of the OpenNebula Conference this past month in Berlin, Germany. A very important result of the Conference was the amazing feedback received from the important actors in this field, ie, the OpenNebula users. We wanted to summarize the requested features and comments since for us this feedback is the main driver for the following roadmaps. This is what being a user driven project mean.

You can also find in this post a summary of our experiences in the conference, as well as the videos, presentations and photos. The conference was a great success, with many interesting speakers sharing their experiences with OpenNebula. As this tweet perfectly captures it, this is the general feedback from the Conference:

#opennebulaconf my phrase of the event: @runtastic “i’m not a developer and i use @opennebula because its works!! Simple and clear!!”

We have events in schedule already for early next week, like this RedIris multi-video session with presentations around the use of OpenNebula (Disclaimer: In Spanish). We are prepping as well for the next Cloud Expo in London, next March 2015, where we will be present in one of the corners of the Open Cloud Park (of course!) with our partners CloudWeavers and ViApps, and we would also like to invite you to join us in the upcoming FOSDEM’15. Moreover, the OpenNebula project will be represented in the next VMworld Europe to be held in Barcelona next 13th-15th of October 2015.

We have upcoming TechDays in future months, if you are interested in OpenNebula you can check the project page. Send us an email or send it to the community discuss mailing list if you are interested in hosting a TechDay event.

Remember that you can see slides and resources from past events in our Events page. We have also created a Slideshare account where you can see the slides from some of our recent presentations.

First Stable Release of vOneCloud to Easily Build Private Clouds on VMware vSphere

OpenNebula Systems announced today the first stable release of vOneCloud, a virtual appliance for vSphere that transforms an existing VMware vCenter deployment into an automated, self-service private cloud in a few minutes. The appliance is based on OpenNebula, every component is fully open-source and has been certified to work in enterprise environments. vOneCloud is commercially supported by OpenNebula Systems.

vOneCloud exposes a multi-tenant, cloud-like provisioning layer, including features like virtual data centers, self-service portal, or hybrid cloud computing to connect in-house vCenter infrastructures with public clouds. Using this appliance, companies that do not want to abandon their investment in VMware and retool the entire stack can keep VMware management tools, procedures and workflows. vOneCloud seamlessly integrates with running vCenter virtualized infrastructures, leveraging advanced features such as vMotion, HA or DRS scheduling provided by the VMware vSphere product family.

An additional advantage of this new product is the strategic path to openness as companies move beyond virtualization toward a private cloud. vOneCloud can leverage existing VMware infrastructure, protecting IT investments, and at the same time gradually integrate other open-source hypervisors, therefore avoiding future vendor lock-in and strengthening the negotiating position of the company.

vOneCloud is free to download and use, and is very simple to install and update, with minimal configuration required, as well as non-intrusive, requiring no changes to the existing infrastructure management tools in the datacenter.

Videos from OpenNebulaConf 2014

Last week we celebrated the OpenNebulaConf 2014, an event where the community comes together to share their experiences and new ideas around OpenNebula. If you were there, go ahead and take a look at the photos in the conference page to check if we caught a flattering pic of you.

The OpenNebulaConf 2014 was a great event, and certainly our speakers deserve most of the credit for it. Thank you for sharing your expertise!

If you missed the conference, now you have a chance to listen to the talks in our YouTube channel, and download the slides from the slideshare account. Enjoy.

 

Technical Notes from OpenNebulaConf 2014

One of the best things about getting together for the conference is that our community always comes with plenty of new ideas and useful feedback to shape the project’s roadmap.

This year’s OpenNebulaConf was full of interesting talks with lots of thoughtful feedback, but we also had many productive discussions in the hacking session, the coffee breaks, and the evening get-togethers.

In this post we will try to summarize the main requests we gathered during the OpenNebulaConf. Feel free to join the discussion in the development portal or in the mailing lists.

And remember, you are always welcome to add new tickets, don’t be shy! We appreciate it when you open new requests, it’s always better to develop with real needs and use cases in mind.

Finally, I would like to take this opportunity to thank all of you for showing up in Berlin and making the conference awesome. See you next year!

 

Resource Management


New Integrations


Quotas & Accounting


Administration


Authentication & Authorization


Sunstone