Time flies, and we are approaching the end of another successful year at OpenNebula!. We’ve had a lot to celebrate around here during 2012, including our fifth anniversary. We took that opportunity to look back at how the project has grown in the last five years. We are extremely happy with the organic growth of the project. It’s five years old, it’s parked in some of the biggest organizations out there, and that all happened without any investment in marketing, just offering the most innovative and flexible open-source solution for data center virtualization and enterprise cloud management. An active and engaged community, along with our focus on solving real user needs in innovative ways and the involvement of the users in a fully vendor-agnostic project, constitute, in our view, the OpenNebula’s recipe to success.

As 2012 draws to and end, we’d like to review what this year has meant for the OpenNebula project and give you a peek at what you can expect from us in 2013. You have all the details about the great progress that we have seen for the OpenNebula project in our monthly newsletters.

Technology

During 2012, we have worked very hard to continue delivering the open-source industry standard to build and manage enterprise clouds, providing sysadmins and devops with an enterprise-grade data center virtualization platform that adapts to the underlying processes and models for computing, storage, security, monitoring, and networking. The Project has released 4 updates of the software: 3.2, 3.4, 3.6  and 3.8  within a rapid release cycle aimed at accelerating the transfer of innovation to the market. These new releases have incorporated full support for VMware, a whole slew of new computing, storage, network, user, accounting and security management features in the core, and many improvements to Sunstone, Self-service, oZones, and the AWS and OCCI interfaces. Thanks to this innovation, OpenNebula brings the highest levels of flexibility, stability, scalability and functionality for virtualized data centers and enterprise clouds in the open-source domain.

The roadmap of these releases was completely driven by users needs with features that meet real demands, and not features that resulted from an agreement between IT vendors planning to create their own proprietary cloud solution. Most of the OpenNebula contributors are users of the software, mostly sysadmins and devops, that have developed new innovative features from their production environments. We want to give a big two thumbs up to Research in Motion, Logica, China Mobile, STAKI LPDS, Terradue 2.0, CloudWeavers, Clemson University, Vilnius University, Akamai, Atos, FermiLab, and many other community members for their amazing contributions to OpenNebula. During 2012, we have tried to keep updated the list of people that have contributed to OpenNebula during the last five yearsSend us an email if we forgot to include your name on the list.

We also announced the release of the new OpenNebula Marketplace, an online catalog where individuals and organizations can quickly distribute and deploy virtual appliances ready-to-run on OpenNebula clouds. Any user of an OpenNebula cloud can find and deploy virtual appliances in a single click. The OpenNebula marketplace is also of interest to software developer looking to quickly distribute a new appliance, making it available to all OpenNebula deployments worldwide. OpenNebula is fully integrated with the new OpenNebula Marketplace. Any user of an OpenNebula cloud can very easily find and deploy virtual appliances through familiar tools like the Sunstone GUI or the OpenNebula CLI.

Additionally, a set of  contextualization packages have been developed to aid in the contextualization of guest images by OpenNebula, smoothing the process of preparing images to be used in an OpenNebula cloud. We have also extended the mechanisms offered to try out OpenNebula. The Project now provides several Sanboxes with OpenNebula 3.8 preinstalled for VirtualBoxKVMVMware ESX and Amazon EC2, and simple how-to guides for CentOS and VMware, and for CentOS and KVM.

It is also worth emphasizing the aspects that makes OpenNebula the platform of choice for the enterprise cloud: it is a production-ready software, easy to integrate with third party tools, and with unique features for the management of enterprise clouds. In 2012, C12G announced several releases of the OpenNebulaPro distribution: 3.2, 3.4, 3.6  and 3.8, and the brand-new OpenNebulaApps suite, a suite of tools for users and administrators of OpenNebula to simplify and optimize cloud application management. OpenNebulaPro provides the rapid innovation of open-source, with the stability and long-term production support of commercial software. C12G also announced new training sessions and jumpstart packages.

2013 will bring important changes in the Release Strategy and Quality Assurance Process of the project that will make OpenNebula even more enterprise-ready and community-friendly.  All of the benefits of the OpenNebulaPro distribution, as a more stable and certified distribution of OpenNebula, will be incorporated into OpenNebula and so publicly available for the community.

The Team is now focused on the upcoming 4.0 release that will bring many new features which will come in very handy for the day to day enterprise cloud management, including improvements in SunStone facelift and usability, enhancements in the core with audit trails or new states in the the virtual machine lifecycle, or support for disk snapshots and RBD block devices.

Community

Many people and organizations have contributed in different ways to the project, from the expertise and dedication of our core committers and hundreds of contributors to the valuable feedback of our thousands of users.  Some of our users and contributors have reached us with valuable testimonials, expressing their opinion of OpenNebula and the reasons of their choice over other cloud manager platforms. These testimonials include opinions by industry and research leaders like China Mobile, Dell, IBM, Logica, FermiLab, CERN, European Space Agency and SARA. We are looking forward to hearing from you!.

During 2012, we have seen a truly remarkable growth in the number of organizations and projects using OpenNebula, and many leading companies and research centers were added to our list of featured users: CITEC, LibreIT, Tokyo Institute of Technology, CloudWeavers, IBERGRID, MeghaCloud, NineLab, ISMB , RENKEI, BrainPowered, Dell, Liberologico, Impetus, OnGrid, Payoda, Cerit-CS, BAIDU, RJMetrics, RUR, MIMOS… Send us an email if  you would like to see your organization or project on the list of featured users.

An interesting study was published by C12G Labs, resulting from a survey among 820 users with a running OpenNebula cloud. The results stated that  43% of the deployments are in industry and 17% in research centers, KVM at 42% and VMware at 27% are the dominant hypervisors, and Ubuntu at 31% and CentOS at 26% are the most widely used linux distributions for OpenNebula clouds.

“Because it simply works” was the most frequent answer to the question “Why would you recommend OpenNebula to a colleague?” that we made to our users in a short survey that tells us how we are doing. Other frequent answers were “Because it is easy to install, maintain and update” or  “Because it is easy to customize”. “Rich functionality and stability” and “support for VMware” are also frequently mentioned by the survey respondents.

Several new components have been contributed to the OpenNebula ecosystemCarina, CLUES,  a new version of Hyper-V drivers (result of our collaboration with Microsoft), Green Cloud SchedulerOnenoxOpenVZ drivers, Contrail’s Virtual Execution Platformone-ovz-driver, and a new OpenNebula driver in Deltacloud. We would like to highlight RIM’s contribution of Carina. The Carina project was motivated by the need to speed up the deployment of services onto the OpenNebula private cloud at RIM, it is a successful attempt to standardize the process for automating multi-VM deployments and setting auto-scaling and availability management policies in the cloud. We are looking forward to other upcoming contributions, like the components that China Mobile is developing for its Big Cloud Elastic Computing System. Regarding implementation of standards, new versions of rOCCI have been released to provide OpenNebula with a fully compliant OGF OCCI API.

Thanks also to our community, OpenNebula is now part of the repositories of the main Linux distributions: OpenSUSEFedoraDebianUbuntu and CentOS. Moreover, there is a new book on OpenNebula and people from many organizations like Puppet Labs, IBM, China Mobile and RIM, or projects like FutureGrid have contributed new guides and experiences to our blog. One of the benefits of having a truly international community is that several users have been able to contribute partial and complete translations of OpenNebula’s user-facing interfaces. We started using Transifex to help us manage these translations, we also want to give a big thumbs up to our community for the translation efforts. Sunstone and Self-service are available in 9 different languages, and more are underway, making a total of 17!.

We also want to highlight a very special mention of OpenNebula by Neelie Kroes, VP of the European Commission and Comissioner for Digital Agenda, during a talk about how the EU is supporting Open ICT systems, namely open-source, open-procurement, and open-data.

In the coming year, we will continue our collaboration  with other communities and will launch new initiatives to support our wide community of users and developers, and the ecosystem of open-source components and innovative projects being created around OpenNebula.

Outreach

OpenNebula presented 20 keynotes, invited talks and tutorials in the main international events in cloud computing including CloudScapeFOSDEMOpen Source DatacenterLinuxTagNASA AmesRootCamp BerlinMatchmaking in the CloudCloudOpenFrOSConLibre Software MeetingBeLUGGigaOM Structure:Europe, or LinuxCon Europe. C12G Labs started a series of Webinars focused on different aspects and possible deployments achieved by OpenNebula. Moreover, here’s been a lot of coverage in the media of OpenNebula during 2012. We created a page to keep track of the OpenNebula apparitions in the press.

* * *

If OpenNebula has become such a successful open source project is thanks to its awesome community of users and contributors. We would like to thank all the people and organizations who have contributed to OpenNebula by being active with the discussions, answering user questions, or providing patches for bugfixes, features and documentation. We appreciate your feedback and welcome your comments on all issues. The team will be monitoring this post for the next weeks or so and will try and answer all the questions we can.

Thanks for continuing to spread the word and stay tuned because we are announcing important changes in our release cycle and processes to make OpenNebula even more enterprise-ready and community-fiendly.

We’d also like to take this opportunity to wish you health, happiness and prosperity in 2013 to you and your loved ones!.

On behalf of the OpenNebula Project.

Neelie Kroes, European Commissioner for Digital Agenda, presented today at the Open Source Conference 2012 the three ways the European Union (EU) is supporting Open ICT systems, namely open-source, open-procurement, and open-data. Mrs. Kroes outlines the huge benefits of open-source and open-standards, the several hundred-million-euro benefits per year of Open ICT systems for the public sector alone, and how the EU is using open source solutions itself.

Mrs. Kroes made reference to OpenNebula as flagship of European open-source cloud innovation supported by EU investments that is laying the basis for interoperable data centers.

Since we started the OpenNebula project in 2005, we have helped many organizations develop value by building innovative cloud services and solutions to meet their user and customer needs in new ways or to meet new market needs. OpenNebula is playing an important role in driving and supporting the transition to cloud computing, and in accelerating the pace of innovation on the datacenter side.

Let make the most out of it!

Work done by China Mobile in the Big Cloud Elastic Computing System

The aim of this post is to describe a new OpenNebula LXC driver (OneLXC) developed by China Mobile to allow the management of hosts and the deployment of lxc domains in OpenNebula using the LXC hypervisor.

Features

OneLXC mainly consists of two components:

  • IM_MAD: a series of remote scripts that are able to monitor the remote hosts
  • VMM_MAD: a series of remote scripts to manage lxc domains.

OneLXC is very similar with kvm driver because libvirt can support kvm and lxc. They both use virsh command to monitoring hosts and operating virtual machines.

Currently OneLXC supports some simple functions as follows:

  • monitoring host information, for example, cpu and memory
  • deploy/delete/monitoring(poll) lxc domains and their info

Developing Enviroment

  • three host machines with ubuntu 12.04 operating system(amd64
  • opennebula-3.2.1
  • libvirt-0.9.8
  • lxc-0.7.5

How to install and use OneLXC Driver?

To install the OneLXC driver run the “install.sh” script provided. This script will copy the necessary files into the OpenNebula installation tree alongside OpenNebula itself.

Driver Configuration

In order to enable the OneLXC driver, it is necessary to modify “oned.conf” accordingly. This is achieved by setting the IM_MAD and VM_MAD options as follows:

#-------------------------------------------------------------------------------
# LXC Information Driver Manager Configuration
# -r number of retries when monitoring a host
# -t number of threads, i.e. number of hosts monitored at the same time
#-------------------------------------------------------------------------------
IM_MAD = [
name = "im_lxc",
executable = "one_im_ssh",
arguments = "-r 0 -t 15 lxc" ]

#-------------------------------------------------------------------------------
VM_MAD = [
name = "vmm_lxc",
executable = "one_vmm_exec",
arguments = "-t 15 -r 0 lxc",
default = "vmm_exec/vmm_exec_lxc.conf",
type = "lxc" ]
#-------------------------------------------------------------------------------

The name of the driver needs to be provided at the time of adding a new host to OpenNebula. For example, we can use command “onehost create” and “onehost list” to create and show the hosts.

After adding hosts, we can use onevm create and onevm show <vm_id> to deploy a lxc domain and show its informations, for  example as follows:

Driver files

The OneLXC driver package contains the following files. Note that they are referenced using $ONE_LOCATION as the base directory, therefore meaning a self-contained installation of OpenNebula.

  • $ONE_LOCATION/etc/vmm_exec/vmm_exec_lxc.conf: Configuration file to define the default values for the LXC domain definitions.
  • $ONE_LOCATION/var/remotes/vmm/lxc/: Scripts used to perform the operations on the lxc domains. These files are called “remotes”, meaning they are copied to the remote hosts and executed there.
  • $ONE_LOCATION/var/remotes/im/lxc.d/: Scripts used to fetch information from the remote hosts (memory, cpu use…). These scripts are copied to the remote hosts and executed there.
  • oned.conf: Example OpenNebula configuration file with the LXC drivers enabled.

Source files

  • src/vmm/LibVirtDriverLXC.cc: The libvirt driver to generate the lxc domain’s deployment configuration file.

Image files

Different from kvm and xen image file, the lxc domain’s image actually is a directory called “rootfs”. For the sake of transfering easily, we compress it, copy it to the target host and decompress it again in the destination. Note: the file permission of  /usr/bin/sudo of lxc domain must be 4755.Otherwise, it can not use root privilege to execute command in lxc domain.

Virtual Machine’s Configuration file

NAME = lxc_2
CPU = 1
MEMORY = 1024
VCPU = 2

DISK = [
source = "/opt/nebula/images/lxc.tar.gz"
]

Bugs and problems

  • There is a synchronous problem between the “cancel” operation and “tm_delete.sh” for OneLXC driver.
  • OneLXC driver cann’t implement “reboot”, “shutdown” and “restart” operations because maybe libvirt or LXC doesn’t support.
  • How to generate the lxc “config” file in “rootfs” directory dynamically? Because each lxc domain has different image file path.
  • perhaps there are a lot of bugs but could not find them

Source Code Download

Because lxc driver function is not perfect,I will submit the code later. If someone want it now, you can download the draft version from here:

https://github.com/cmri/opennebula-3.2.1-lxc.git

C12G Labs has just announced the availability of the OpenNebula Sandbox for Amazon EC2. OpenNebula is a widely-deployed open-source management solution for enterprise data center virtualization and private cloud computing that implements the Amazon EC2 interface. With the new Sandbox you can deploy in a single click an AWS-compatible OpenNebula nested cloud on Amazon EC2, where you can launch virtual machines within an Amazon instance.

The OpenNebula Sandbox is a CentOS 6.3 virtual machine appliance with a pre-configured automated installation of OpenNebula 3.8, a virtualization node using emulation (QEMU) ready to execute virtual machines, and prepared images to offer a feature rich cloud experience. Users are able to log into the OpenNebula cloud, monitor the managed resources, and launch instances of virtual machines without the hassle of configuring a physical infrastructure.

The Sandbox provides a fast and easy way for cloud trainers to teach OpenNebula, for cloud builders and operators to evaluate OpenNebula, and for developers to test their integrations against a real controlled OpenNebula environment. It is not intended for production environments due to the overhead in the hardware emulation. However the OpenNebula innovative functionality for cloudbursting opens the possibility of using the OpenNebula Sandbox as an Amazon-hosted broker to orchestrate and aggregate different Amazon availability zones.

OpenNebula Sandbox is part of a new program created by C12G Labs that aims to provide different tools and guides to eliminate the challenges of implementing a small-scale OpenNebula cloud for development, testing or integration. The Sandbox is also available for VirtualBox, KVM, and VMware.

Here’s our monthly newsletter with the main news from the last month, including what you can expect in the coming months. We are very proud of our toddler (OpenNebula) arriving at the mature age of five years. Congrats!

Technology

The OpenNebula team is setting the engine to full throttle for the upcoming 4.0 version. There is a set of new cool features that will ensure that the best functionality is present in your favorite cloud management platform. This release is focused on usability, an important effort is being made to ensure that the user experience is as smooth and productive as possible.

On of the mains efforts is focused on giving a facelift to the Sunstone GUI, with a complete revamp of the user dialogs, as well as new options like embedded SSH connections to the virtual machines. Moreover, the command line interface is also undergoing several changes to make them easier to use.

The OpenNebula daemon and the orbiting components are also being scrutinized to produce better logging, so the user and the cloud admin can figure out what is going on in their virtual and physical infrastructure. This will be used as well to offer an audit trail feature.

Another important feature that will be introduced in the upcoming 4.0 release is the ability to create disk snapshots, which comes in very handy for the day to day service management. Other number of improvements are on the oven, like the ability to handle RBD block devices.

It is worth mentioning the new methods to try out OpenNebula, like the Sandboxes with OpenNebula 3.8 preinstalled (for VirtualBox, KVM and VMware  ESX, and an upcoming Amazon EC2 AMI), and the ongoing effort to develop simple how-to guides.

C12G Labs released OpenNebula 3.8 Pro, the enterprise edition of its widely-deployed open-source management solution for enterprise data center virtualization and private cloud computing. OpenNebulaPro integrates the most recent stable version of OpenNebula (3.8) with bugfixes, performance, and scalability patches developed by the community and by C12G for its customers and partners. OpenNebula 3.8 (codename Twin Jet), released one month ago, enhances its AWS and OCCI API implementations and provides a tighter integration with VMware and KVM.

C12G also released the first stable release of the OpenNebulaApps, a suite of tools for users and administrators of OpenNebula to simplify and optimize cloud application management. OpenNebulaApps provides a service management layer on top of OpenNebula by configuring the software stack in the applications, managing multi-tiered applications, providing configurable services from a catalog, and building your own private market to distribute applications across several OpenNebula instances. Cloud applications consist of complex software stacks, OpenNebulaApps helps to manage their life-cycle and contributes to significantly reduce the time needed to build, distribute, and deploy cloud applications.

Community

New contributions form this month from our vibrant community includes a new post explaining how to use OpenNebula and ZFS. Also, folks at SZTAKI have contributed an amazing patch to provide full iSCSI support, we would like to send a big two thumps up to them for this. Same people at SZTAKI have contributed a new appliance to the OpenNebula Marketplace as well as ATA-over-Ethernet drivers. We would like to highlight the talk given by Giovanni Toraldo in the Develer workshop.

We know that there are a high number of infrastructures being cloudify thanks to the use of OpenNebula, but we want to devote some lines to this rural school pilot program for its aim, it closeness and philosophy.

OpenNebula ecosystem keeps growing, we want to give a special mention to Hedera and its great service manager Kanopya. Also, we want to mention the release of new version (0.88) of CLUES,  an energy management system for High Performance Computing (HPC) Clusters and Cloud infrastructures.

It is worth mentioning that, as part of FOSDEM (one of the most important european events in the open source arena), the OSS Cloud IaaS projects (OpenNebula, Eucalyptus, OpenStack, CloudStack) are organizing a Cloud devroom. This Cloud devroom, will be an excellent opportunity to promote your solutions with OpenNebula, share your experiences operating/building/designing a Cloud with OpenNebula at your company or institution,  meet some of the OpenNebula developers, and discuss with others about OSS Cloud technologies.

Outreach

This past month a number of events were participated by OpenNebula members:

During the following months, members of the OpenNebula team will be speaking in the following events:
  • FOSDEM 2013, Brussels, Belgium, February 2 and 3, 2013

If you will be attending any of these events and want to meet with a member of the OpenNebula team, drop us a line at contact@opennebula.org. Remember that you can see slides and resources from past events in our Events page. We have also created a Slideshare account where you can see the slides from some of our recent presentations.

Last week I had the opportunity to introduce OpenNebula to the Berlin Linux User Group (BeLUG). BeLUG is an association for the defense and promotion of Free Software. They meet regularly and hold presentation of open-source related projects and technologies, as well as helping both experienced and recent Linux users to solve their problems and make a better use of Linux.

It was a pleasure to introduce OpenNebula and discuss with BeLUG members about many of its features. Thanks a lot for the invitation and the great interest!

Picture from the end of the presentation!

OpenNebula is in its way to be included in the official CentOS repos. The packages are already in the ‘testing’ repo, and we need some feedback to move them to the official repos.
To make it more fun for everybody we will send an OpenNebula T-Shirt and some stickers to the 10 best feedbacks we receive by next monday!
Some guidelines:
Good luck!

In the last month we’ve been preparing a set of sandboxes, aimed to lower the barrier for people willing to try out OpenNebula. In order to complement this, we’ve just published a new quick start guide describing the steps needed to set-up a pilot cloud in as little time as possible.

This first guide is oriented to achieve a cloud formed by a cloud front-end containing OpenNebula based on CentOS, and at least one virtualization host based on VMware ESX hypervisor. The guide describes step by step how to set up the infrastructure (from the hardware and software standpoint) and install and configure OpenNebula to achieve a pilot cloud, with the ability to launch virtual machines and access them via VNC. Also, next steps are recommended to extend the pilot cloud.

Please let us know if you have any feedback about the guide, we would love to improve it and show how to build an OpenNebula cloud based on VMware ESX hypervisors as easy a process as possible.

“Federated Cloud Computing – The OpenNebula Experience” is the title of our keynote at the GARR 2012 Workshop on Distributed Computing and Storage. Given the scope of the workshop and the activity of GARR in the operation of the national high-speed telecommunication network for Research, the talk mostly focused on private cloud computing to support Science and High Performance Computing environments, the different architectures to federate cloud infrastructures, the existing challenges for cloud interoperability, and our vision for the future of existing Grid infrastructures.