OpenNebula 4.6 RC Released!

The OpenNebula project is proud to announce the availability of OpenNebula 4.6 RC (Carina). This release brings many new features and stabilizes features that were introduced in previous versions.

OpenNebula 4.6 introduces important improvements in several areas. The provisioning model has been greatly simplify by supplementing user groups with resource providers. This extended model, the Virtual Data Center, offers an integrated and comprehensive framework for resource allocation and isolation.

Another important new feature has taken place in the OpenNebula core. It has undergone a minor re-design of its internal data model to allow federation of OpenNebula daemons. With OpenNebula Carina your users can access resource providers from multiple data-centers in a federated way.

provisioning-full

With Carina the OpenNebula team has started a journey to deliver a more intuitive and simpler provisioning experience for users. Our goal is level the final user usability with the system administration and operation ones. First, the Sunstone graphical interface has been tweaked to help the user workflows. It has also been improved in order to support the new Marketplace version, which makes even easier for a user to get a virtual application up and running.

Finally, some other areas has received the attention of the OpenNebula developers, like for example a better Gluster support through libgfapi, improved access to large pools pagination, or optionally limit the resources exposed by a host, among many others are included in Carina.

As usual OpenNebula releases are named after a Nebula. The Carina Nebula (NGC 3372) is one of the largest nebulae the sky. It can only be seen from the southern hemisphere, in the Carina constellation.

Thanks the community members and users who have contributed to this software release by being active with the discussions, answering user questions, or providing patches for bugfixes, features and documentation.

The new features for VDCs, Federations and OVA support in the Marketplace introduced in OpenNebula 4.6 were funded by Produban in the context of the Fund a Feature Program.

Relevant Links

oneInsight: A 2D-Load Visualization Addon for OpenNebula-Managed Hosts

I’m pleased to announce oneInsight, a visualization addon for OpenNebula that allows users to have at-a-glance, an insight of the load of managed hosts. It provides various kinds of load mappings, that currently include the following metrics:

  • CPU used by OpenNebula-managed virtual machines;
  • Memory used by managed virtual machines;
  • Effective CPU used by all system processes, including processes outside of managed virtual machines;
  • Effective memory used by all system processes.

Here is a screenshot showing an overview of CPU used.

Screenshot of oneInsight

Benefits

oneInsight enables many benefits, as well for cloud operators than for business managers:

  • Provides a simple and comprehensible load charting that allows you to have at-a-glance an accurate insight on how servers are loaded, so to let you plan migrations and capacity upgrading if necessary;
  • Provides, via tooltip and popup, details about each server in zero or one click;
  • High class visualization that saves you from command line output;
  • Lightweight HTML/Javascript stack that can be deployed on any server within your IT infrastructure, just need a valid OpenNebula user account and a network access to OpenNebula server.

How oneInsight Works

oneInsight works out-of-the-box on the vast majority of Linux operating systems, subject to have the following tools installed:

  • curl command line interface
  • The Bash interpreter
  • The cron time-based job scheduler
  • A Web server like Apache and nginx, even the python SimpleHTTPServer module just works fine

Read the documentation to get started.

What Next & Contributions

oneInsight is a new project, and there is a lot of things concerning data visualization in OpenNebula. Contributors are welcome, we apply the Github Pull Request model for contributions in code and documentation. Stay tuned.

OpenNebula Newsletter – March 2014

We want to let you know about what we are up to with the main news from the last month regarding the OpenNebula project, including what you can expect in the following months.

Technology

With OpenNebula 4.6 Beta released, the team is working full throttle ironing out wrinkles: fixing bugs, polishing the interface, prepping the documentation, updating related components and applications, etc. It is a lot of work, but we want our users to experience a migration as smooth as possible.

One of the main contributions of this new release is a big boost to the provisioning model. Besides the Sunstone interface facelift, including tweaks to help the user workflow, there has been a number of provisioning ideas developed in this release. For instance, Sunstone integration with marketplace has also been improved in order to support the new AppMarket version, which makes even easier for a user to get a virtual application up and running. Moreover, the provisioning model has been greatly simplify by supplementing user groups with resource providers. This extended model, the Virtual Data Center, offers an integrated and comprehensive framework for resource allocation and isolation.

The latest addition to the provisioning model improvement is the new provisioning view for cloud end users. This view ensures a minimal and utterly simple portal to consume cloud resources. All the clutter is out of the way to make the experience as pleasant as possible. Give it a spin!

BjrE8KmIcAE93TN

The other significant features that will be present in OpenNebula 4.6 includes the ability to achieve a federation using OpenNebulas (yes, plural is coming!) at different datacenters. Check out the screencast on partitioning clouds with vDCs to get a feel on this new functionality. Also, 4.6 will feature the ability to import OVAs into OpenNebula via AppMarket, and will be a complete translation and import of all the resources defined in the OVA: disks, capacity, network, etc. Other aspects that are being revisited are storage backends, virtual networking, datastore, image and VM management and Sunstone. You can find a comprehensive list here.

BjwMuNPIMAA68Wm

Some of the above features have been sponsored by Produban in the context of the Fund a Feature program.
Another technology contribution by OpenNebula members is summarise in this post about integrating puppet and OpenNebula: Automatic configuration of VMs with Puppet. Moreover, integration with GlusterFS (a distributed filesystem with replica and storage distribution features that come really handy for virtualization), was also addressed in the Native GlusterFS Image Access for KVM Drivers post.

Community

This month the community was as engaged as ever. We would like to give a big “thank you” to all the OpenNebula users that gave as feedback about the beta version of OpenNebula 4.6. The final release will be more robust due to you!

Our friends at BIT (this month they hosted the very first OpenNebula TechDay, check the Outreach section of this newsletter ;) ) wrote a very long and flattering (cheers!) post stating their experiences with OpenNebula. We would like to highlight in this newsletter the following excerpt:

The OpenNebula way of developing software is open, and user focused, The “voice” of the community really matters. The cliche “software made with and for the community” really applies here. If users get (positive) feedback about their input they feel appreciated and be more “connected” to the project. The “atmosphere” on the mailing list is friendly and open. No flame wars, or negativism here, so it keeps users “in” instead of pushing them away.

So we blush! We are glad that our users feel this atmosphere, which is the main driver of the OpenNebula project ;)

Folks at CloudWeavers build this slick portable DC based on OpenNebula. Awesomely pretty!

Outreach

As usual, first things first, this year’s OpenNebula Conference will be held in Berlin as well, 2-4 of December, 2014. If you want to repeat or find out how it is for yourself, save the date!

Following last month series of comparing OpenNebula with other similar projects, we published a new post comparing the balance between user base and community in both the OpenStack and OpenNebula projects. Check it out, it is an interesting read.

We are setting up a number of OpenNebula TechDays around the world. These events are designed to learn about OpenNebula with a hands-on cloud installation and operation workshop, and presentations from community members and users. If you are interested in hosting or sponsoring one, let us know!. The first TechDay happened in Ede, Netherlands, and was hosted by BIT, a dutch internet service provider. You can read about the aftermath here.

tutorial-ede

There will be two OpenNebula TechDays in the upcoming months in the USA, covering both the east and the west coast. The one in Florida will take place in Boca Raton the 19th of June, hosted by TransUnion, whereas the west coast will be covered by the Bay Area Techday the 24th of June, hosted by Hyve, which includes an exciting tour around the manufacturing plant of Facebook production racks.

This month, the OpenNebula team participated in the Cloud Expo Europe 2014. As part of the Open Cloud Forum sessions about open source cloud solutions, there was an OpenNebula tutorial. Also, OpenNebula was present at the biggest IT fair in the world, the CeBIT 2014, were we hanged out the Netways booth. Our partners, Netways, represented OpenNebula in the FLOSS UK 2014.

And, last but not least, our project director travelled to Greece for the Future Internet Assembly 2014, with a presentation aiming to show how OpenNebula is driving innovation in cloud computing, impacting the adoption of private cloud, and enabling business in the cloud.

The following events are happening this month, with the participation of an OpenNebula team member:

During the following months, members of the OpenNebula team will be speaking in the following events:

Remember that you can see slides and resources from past events in our Events page. We have also created a Slideshare account where you can see the slides from some of our recent presentations.

There are still available seats for the LOADays in Belgium, register now!.

Build Your OpenNebula Cloud Day at LOADays

Next Monday April 7th a completely free Build Your OpenNebula Cloud Day will take place in Antwerp, Belgium:

Agenda

  • 09:30 – 13:30: OpenNebula Tutorial (Jaime Melis)
  • 13:30 – 14:30: LUNCH
  • 14:30 – 17:30: OpenNebula Cloud Image Creation/Hack Session
  • 17:30 – 18:00: CLOSING

Attendees will build a virtualised two-node OpenNebula Cloud environment based on CentOS using VirtualBox and take it home. In the afternoon we will do a practical session on the process of creating images, contextualization and best-practices.

Register to this event using this link:
http://load2014opennebuladay.eventbrite.com

OpenNebula Talk at LOADays

OpenNebula will participate in the LOADays event that will be held this weekend, the 5th & 6th April in Antwerp, Belgium, with a talk about OpenNebula, about the new and exciting features of the last releases (featuring a live demo, of course) that will take place on Sunday, April 6th at 17h00.

It’s a great event that you shouldn’t miss, with a strong emphasis on Linux and Unix sysadmins, and people interested in Free Open-Source Software in general. We guarantee plenty of interesting conversations, top-quality talks and a lot of fun.

loadays

Looking forward to seeing you there!

Wrap-up of the OpenNebula TechDay in Ede, NL

Yesterday the first OpenNebula TechDay took place. And it has been a wonderful experience. Seeing such an involved community, with so many great stories, such determined feedback, great conversations and a really friendly environment made us all participants feel greatly satisfied with the event.

tutorial-ede

ruben-ede

ander-ede

 

Presentations

We would like to thank all the speakers and all the attendees, we are sincerely looking forward to hear more stories from them. We would also like to send a heartfelt thank you to the host and sponsor of the event: BIT.nl, which besides being an amazing hosting company that likes to do things well (which makes sense since they are using OpenNebula), have made the event run extremly smoothly and really well organized, special thanks to Stefan Kooman and Bart Vrancken!

Looking forward to meeting you in the next editions of the OpenNebula Technology Days!

About How OpenNebula is Enabling Business in the Cloud

This week we gave an invited talk in the open-source cloud session at Future Internet Assembly 2014. Its aim was to show how OpenNebula is driving innovation in cloud computing, impacting the adoption of private cloud, and enabling business in the cloud.

We covered the following scenarios:

  • First, most organizations adopt cloud to optimize their IT investment, to improve existing services or to support new business and service models. In this scenario, OpenNebula lowers the barriers for new organizations to build their private cloud.
  • Second, many organizations like the fact that open source allows great customization to meet individual requirements. They can build a differentiated cloud service to meet customers needs or to offer new cloud provision models for a specific market segment or geography.
  • Third, open-source also encourages and supports innovation in the development of new cloud products. We have seen many examples of how its use lowers the barriers for new ICT players to create their own cloud offerings.

We wanted to present experiences from users, so we included some details about how OpenNebula is being used by four Europe companies. Big thanks to Armin Deliomini (Runtastic), Stefan Kooman (BIT.nl), Carlo Daffara (CloudWeabers) and Bernd Erk (Netways)!.
IMAG0432

OpenNebula at FLOSSUK 2014 – Brighton

FLOSSUK 2014The yearly spring meeting of the FLOSS UK takes place in Brighton this year. The venue in the Old Ship Hotel in Brighton is typical british and about 100 meters away from the ocean. Independent from the lovely countryside i have the chance to take about our way from manual configured XEN-Instanes to a fully fledged OpenNebula-Cloud. Using OpenNebula for years know, is a big advantage for us and helps us a lot in our daily business.

There was a lot of activity in the OpenNebula Project the last year, so i have much things to talk about. Native GlusterFS Support, improved Network and Storage Drivers are just a few examples about that. If you are in Brighton or have a chance to come over please join my talk tomorrow.

I talked to several people yesterday and many of them gave OpenNebula a shot after listening to my last years talk about it. There is nothing better i think :-)

Automatic configuration of VMs with Puppet

OpenNebula contextualization is a system that writes VM configuration parameters into a CDROM image and a package installed in the VMs that is able to configure the system using this data. By default comes with scripts to set the network configuration (IP, DNS), hostname, allowed ssh keys, etc. You can even easily create your own version of the packages with new scripts that configure other parts of the system as stated in the documentation. Still, if you don’t want to create you own context packages you can specify scripts to be started at boot time. In this post we will provide an example on how to use this system to prepare the machine to be configured with Puppet but these tips are useful for any other CMS.

The requisites for this example are:

  • An already installed Puppet master in a network reachable by your VMs
  • CentOS 6.x base image with context package >= 4.4 and internet connection

To make the VM be configured as soon as the Puppet agent is started you can change /etc/puppet/puppet.conf in the Puppet master machine and set autosign = true in main section (remember to restart the daemon). This way you wont need to sign the certificates manually:

[main]
autosign = true

In case you are not using autosign you should use the puppet cert command to sign new host certificates and wait until the Puppet agent in those nodes wakes up again. By default they do it every 30 minutes.

The installation and configuration of Puppet agent in the nodes can be done with the aforementioned init scripts. We can add this script to the files datastore. I’ve called it puppet_centos:

#!/bin/bash

PUPPET_MASTER_NAME=puppet.opennebula.org
PUPPET_MASTER_IP=10.0.0.2

if [ -z "$NODE_NAME" ]; then
    NODE_NAME=$(hostname)
fi

# Add node to /etc/hosts
echo "$ETH0_IP    $NODE_NAME" >> /etc/hosts

# Add puppet server to /etc/hosts
echo "$PUPPET_MASTER_IP    $PUPPET_MASTER_NAME" >> /etc/hosts

# Install puppetlabs repo (for latest packages)
rpm -ivh https://yum.puppetlabs.com/el/6/products/x86_64/puppetlabs-release-6-7.noarch.rpm

# Install puppet agent package
yum install -y puppet

cat << EOF > /etc/puppet/puppet.conf
[main]
vardir = /var/lib/puppet
logdir = /var/log/puppet
rundir = /var/run/puppet
ssldir = \$vardir/ssl

[agent]
pluginsync      = true
report          = true
ignoreschedules = true
daemon          = false
ca_server       = $PUPPET_MASTER_NAME
certname        = $NODE_NAME
environment     = production
server          = $PUPPET_MASTER_NAME
EOF

# Enable puppet agent
puppet resource service puppet ensure=running enable=true

Make sure you change Puppet master IP and name.

Now in the template for the new VM you will have to add some bits in the context section:

  • puppet_centos script in files (FILES_DS) section
  • set the “init scripts” value to puppet_centos
    puppet-context-files
  • add a new variable called NODE_NAME set to $NAME-$VMID. This way the node name for the VM will be the same as the OpenNebula VM name.
    puppet-context-custom-vars

If you are using the command line the context section will be something similar to this:

CONTEXT=[
  FILES_DS="$FILE[IMAGE=puppet_centos]",
  INIT_SCRIPTS="puppet_centos",
  NETWORK="YES",
  NODE_NAME="$NAME-$VMID",
  SSH_PUBLIC_KEY="$USER[SSH_PUBLIC_KEY]" ]

Now we have most of the bits needed to do the automatic configuration of the VMs after boot. It is only needed to add configuration to the nodes.

Since we are working with Virtual Machines we won’t know beforehand the name/IP of the new VMs that we can refer to when selecting the role of each one. To overcome this limitation, and taking advantage of OpenNebula name generation, we can define the node names in Puppet master with regular expressions so we can tell the roll of these VMs. For example, in /etc/puppet/manifests/site.pp we can define this node:

node /^www-\d+/ {
    include apache
}

Now when instantiating the template we can provide the name www. OpenNebula will add the VM ID to the certname so we will have www-15, www-16 and www-17, for example. All these node names will match the regular expression and install apache.

puppet-instantiate

In case you are using the command line you can use this line, changing centos_template by the name or ID of your template and 3 by the number of VMs you want to instantiate:

$ onetemplate instantiate centos_template -m 3 --name www

Experiences at CeBIT 2014

Last week we participated at CeBIT 2014. In the unlikely case you are not familiar with CeBIT, it is the world’s largest and most international computer expo (wikipedia’s words, not ours ;) ). We were demoing the latest features in OpenNebula 4.6, as well as hanging around the booth of the active and community engaged Netways, we would like to thank them for the support. We’ve also featured a talk in the Open Source Park, about the history of the OpenNebula project.

cebit


All in all, a very good experience. CeBIT is a very interesting place to meet with people who are looking for what you offer, so if you are planning to attend next year and need for an outstanding Cloud Management Platform (aka OpenNebula), see you in Hannover!

OpenNebula 4.6 Beta Released!

The OpenNebula project is proud to announce the availability of OpenNebula 4.6 Beta (Carina). This release brings many new features and stabilizes features that were introduced in previous versions.

OpenNebula 4.6 introduces important improvements in several areas. The provisioning model has been greatly simplify by supplementing user groups with resource providers. This extended model, the Virtual Data Center, offers an integrated and comprehensive framework for resource allocation and isolation.

Another important new feature has taken place in the OpenNebula core. It has undergone a minor re-design of its internal data model to allow federation of OpenNebula daemons. With OpenNebula Carina your users can access resource providers from multiple data-centers in a federated way.

With Carina the OpenNebula team has started a journey to deliver a more intuitive and simpler provisioning experience for users. Our goal is level the final user usability with the system administration and operation ones. First, the Sunstone graphical interface has been tweaked to help the user workflows. It has also been improved in order to support the new Marketplace version, which makes even easier for a user to get a virtual application up and running.

Finally, some other areas has received the attention of the OpenNebula developers, like for example a better `Gluster <gluster_ds>` support through libgfapi, improved access to large pools pagination, or optionally limit the resources exposed by a host, among many others are included in Carina.

As usual OpenNebula releases are named after a Nebula. The Carina Nebula (NGC 3372) is one of the largest nebulae the sky. It can only be seen from the southern hemisphere, in the Carina constellation.

Thanks the community members and users who have contributed to this software release by being active with the discussions, answering user questions, or providing patches for bugfixes, features and documentation.

The new features for VDCs, Federations and OVA support in the Marketplace introduced in OpenNebula 4.6 were funded by Produban in the context of the Fund a Feature Program.

Relevant Links

Screen Shot 2014-03-17 at 18.26.14