HPC in the Cloud has just published an article with a description of the progress made in the implementation of the CERN IaaS cloud. Rubén S. Montero, our Chief Architect, shares insights about managing CERN’s infrastructure. At the heart of the IaaS cloud CERN has implemented is OpenNebula, which is starting to serve as the management layer in production following extensive prototyping and testing. Montero describes the project’s evolution and current status.

Hi everyone!  Welcome to my first post of hopefully many.  My name is John Dewey.  I am a Lead Software Engineer in AT&T’s Cloud Team, and currently maintain releases of the OCA RubyGem along with other gems.  I wanted to announce the availability of the OCCI Client RubyGem.  This gem was built against version 5 of the OGF OCCI API Specification.

For information on how to use the gem, please reference the documentation.

I would also like to thank Josh and Javier for their peer-review and assistance.

C12G Labs announced today the creation of specialized support services to customers and partners in specific application domains, such as the High Performance Computing, Hosting and Telecom industries. HPCcloud.com is the first of these new support service programs targeted to specific business or industry domains that has been created to give expert advice on OpenNebula to organizations using computer clusters to solve advanced computation problems.

The RESERVOIR project is organizing an OpenNebula training session in Brussels on January 27-28, 2011. The training will be given by CETIC and the DSA-Research.org group at UCM and will take place in the IBM Meeting Room at Digitaleurope.

RESERVOIR is an IBM-led joint research initiative of 13 European partners to develop technologies that help automate the fluctuating demand for IT resources in a cloud computing environment. To pave the way to adoption of cloud technology by businesses, the RESERVOIR project has integrated a set of virtualization and cloud management tools. The training will focus on OpenNebula, a core component of the RESERVOIR framework. The training will show how to build and use your own private, hybrid and public cloud infrastructure with OpenNebula by covering all the management aspects: installation, configuration and administration. The course includes hands-on exercises to be performed using attendee’s laptops.

This event is free of charge, but you must register by sending an e-mail to reservoir@cetic.be as attendance is restricted to 30 persons.

We are happy to announce that OpenNebula 2.0.1 will be included in the upcoming release of Ubuntu 11.04 (Natty Narwhal)! In fact, if you are using the Natty repositories, the OpenNebula 2.0.1 packages are already available there.

Although OpenNebula 1.2 has been available in Ubuntu since Jaunty, it hasn’t been updated to newer versions. The Ubuntu package has now been updated to OpenNebula 2.0.1 thanks to Damien Raude-Morvan, who is managing an Alioth project that resulted in an OpenNebula Debian package, which was then merged into Ubuntu.

We would like to thank Damien again for his efforts and also the Ubuntu MOTU’s who have helped us with the merge!

C12G Labs has published four use cases describing how OpenNebula can be used to build private and hybrid clouds in different domains:

This year has seen some great progress for the OpenNebula project, with the release of the most advanced and flexible enterprise-ready cloud management tool, and the continued growth of an active and engaged open-source community. As 2010 draws to and end, we’d like to review what this year has meant for the OpenNebula project and give you a peek at what you can expect from us in 2011.

Orion Release

After a first Beta release in July, the stable version of OpenNebula 2.0 was available for download in October. OpenNebula 2.0 marked the end of a large and laborious release cycle and an important milestone for the project in terms of functionality, maturity and community engagement. Besides many exciting new features for your Cloud and an improved scalability and robustness, this release also marked the start of a new add-on section for high-quality, third-party open-source components. OpenNebula 2.0 is targeted at production environments, including integration, management, scalability, security and accounting features that many enterprise IT shops need for private and hybrid cloud adoption. We’re delighted with the response from our community. Besides the huge spike in downloads, we have received many congratulations over email and Twitter from many of our users, specially those who are deploying OpenNebula in very large infrastructures

OpenNebula Quality Assurance

As part of the OpenNebula Orion release in October we also opened our internal QA & testing  procedures to the community.

OpenNebula QA is the part of the OpenNebula project which covers all testing of the software that makes up an OpenNebula release. Its goal is to assure the stability and quality of the OpenNebula releases and updates. Testing & QA of a cloud management tool was particularly challenging as it requires to verify the integration of multiple software components, from different hypervisors and storage architectures to operating systems and DB backends

Innovative, Groundbreaking Projects in Cloud Computing

During 2010, we were very happy to announce that OpenNebula is being enhanced in several flagship international projects in cloud computing, such as StratusLab, aimed at bringing cloud and virtualization to grid computing infrastructures; BonFIRE, aimed at designing, building and operating a multi-site cloud-based facility to support research across applications, services and systems targeting services research community on Future Internet; and 4CaaSt, aimed at creating an advanced PaaS Cloud platform which supports the optimized and elastic hosting of Internet-scale multi-tier applications.

These collaborations with world-leading industrial and academic organisations in cloud computing consolidated OpenNebula’s position at the cutting edge of cloud computing technology worldwide. We have also continued our  collaboration with the most demanding users of cloud computing management tools that are using OpenNebula to manage several tens of thousands of virtual machines.

Community

This is a very good opportunity to acknowledge our active and engaged community, if OpenNebula has gotten so far, it is in no small measure due to the many users and organizations in our community who have actively contributed to the project.

In February, we created a new OpenNebula.org site, a new place for the community to share resources, contribute developments and discuss about components and solutions around OpenNebula. We defined the different ways to contribute, from using the technology and spreading the word to contributing fixes and developing new functionality. We also established the OpenNebula Ecosystem in order to promote the different tools, extensions and plug-ins that are available to complement OpenNebula from a wide variety of projects, companies, and research centers. Many new useful components by leading companies and research groups have been added to the ecosystem catalog.

The first edition of the OpenNebula Technology Days took place in Madrid in July. The event was attended by several partners that actively use OpenNebula as their core toolkit to build clouds. All in all, it turned out to be a successful and very formative event.

This year OpenNebula was selected as a Google Summer of Code (GSoC) mentoring organization. We were very excited about this great opportunity to work with very talented and motivated students. During the summer, our students were part of our community and had the opportunity to learn the basics of virtualization, cloud computing and OpenNebula.

During 2010, OpenNebula presented 30 keynotes, invited talks and tutorials in the main international events in cloud computing in 15 different countries. We have also continued and started collaborations with the main open source efforts and standards bodies.

In May 2010, C12G Labs was created to provide the professional integration, certification and technical support that many enterprise IT shops require for internal adoption. OpenNebula.org is a project now managed by C12G Labs. This did not and will not change any of the objectives and core values of the project. C12G contributes to the long term sustainability of the project and is committed to maintain a fully open source technology and to enlarge the OpenNebula community .

About 2011

In line with our aim to develop the most-advanced, highly-scalable and adaptable software toolkit for cloud computing management, we are working hard on new features that will be available in the following months. Several exciting features are in our short term roadmap: an operations network to simplify the management of OpenNebula cloud instances, fault tolerance functionality to maximize uptime in your cloud, enhanced management of images and templates, new security functionality, enhanced support for federation of data centers and support for multi-tier architectures. Our goal is to get stable releases out more often so users can see progress more often, and our current plan is to have a three-month release cycle. These releases will concentrate on a new “big” feature and a collection of bug fixes and minor features. As a whole we think this will give a greatly improved user experience.

In few days we will also announce the second edition of the OpenNebula Technology Days that will be organized in Brussels at the end of January, our participation in new large innovative projects, and our collaboration with leading IT companies in open-source and innovation in cloud computing management.

**   *   *

If OpenNebula has become such a successful open source project, it is largely thanks in no small part to its community. We really appreciate your help in maintain OpenNebula’s position as the leading and most advanced open-source technology to build cloud infrastructures. As always, we appreciate our users feedback and welcome your comments on everything. The team will be monitoring this post for the next weeks or so and will try and answer all the questions we can.

We’d also like to take this opportunity to wish you health, happiness and prosperity in 2011 to you and your loved ones!

On behalf of the OpenNebula project.

A couple of months ago our friends at Cfengine presented a brief overview of the possibilities of a Cfengine-managed OpenNebula setup at the Large Installation System Administration (LISA) conference in San Jose. The Cfengine team presented how Cfengine may be used on both the physical and virtual sides of an OpenNebula-based cloud. More specifically, they presented how Cfengine can be used to install and configure the physical infrastructure in an OpenNebula cloud, followed by the launch and configuration of generic virtual machine images that will run on top of that OpenNebula infrastructure.

In a recent news article, Cfengine has announced that its Orion Cloud Pack, which was originally conceived to make the use of the Amazon EC2 Cloud simple for users of Cfengine, is also working on OpenNebula cloud instances.

In July 2010 the StratusLab project conducted two surveys to collect requirements for the StratusLab cloud distribution and to understand the existing experience with virtualization/cloud technologies in Europe. Funded through the European Union Seventh Framework Programme (FP7), StratusLab is a two year project aimed to successfully integrate ‘cloud computing’ technologies into ‘grid’ infrastructures.
The survey results are presented in project deliverable D2.1 Review of the Use of Cloud and Virtualization Technologies in Grid Infrastructures. The project conducted two online surveys, one aimed at system administrators and the other at users.  Over two-thirds of sysadmins, and over three-quarters of users surveyed intend to use cloud.  Perhaps more surprisingly, over one third of both groups are already using cloud technologies right now. The most popular public clouds are Amazon Web Services and Google App Engine, while OpenNebula is the most popular open source tool for cloud computing management.
The StratusLab surveys have identified certain trends and requirements for cloud technologies among the Grid community that will be addressed to provide the first full cloud solution for grid and cluster computing.  The StratusLab project aims to produce a toolkit to cloud-enable Grid infrastructures based on OpenNebula. The first version of its cloud computing distribution was released few weeks ago.

I am happy to announce first release of the Python OCA bindings. These bindings wrap OpenNebula’s XML-RPC methods in the Python objects, which allows developers to interact with OpenNebula in a more pythonic way.

The package is available on pypi so if you want to try it just run:

$ easy_install oca

Or download the code from github and install it by running:

$ python setup.py install

Here is an example that shows how you can add new host using Python bindings:

[python]
#!/usr/bin/env python

client = oca.Client(‘user:password’, ‘http:12.12.12.12:2633/RPC2’)
new_host_id = oca.Host.allocate(client, ‘host_name’, ‘im_xen’, ‘vmm_xen’, ‘tm_nfs’)
hostpool = oca.HostPool(client)
hostpool.info()
for i in hostpool:
if i.id == new_host_id:
host = i
break
print host.name, host.str_state
[/python]

For more details how to use Python OCA read the documentation

Try it and share your thoughts, any feedback is welcome.