New DRBD Manage add-on for Highly Available storage

DRBD backed storage is now integrated into OpenNebula with the new DRBD Manage addon.

DRBD provides transparent, real-time replication of block devices without the need for specialty hardware. DRBD Manage is an administrative tool which facilitates easy Logical Volume Management (LVM) and configuration files for multi-node DRBD clusters.

With the DRBD Manage driver, create each new image for your virtual infrastructure as a DRBD volume. Volumes intelligently balance the load on your storage nodes. Alternatively, assign volumes to the specific nodes that you want in use. This is a simple scale-out storage solution, supporting the capability to add new nodes to your storage cluster at any time. This, combined with the flexibility of LVM, allows DRBD to keep up with your ever-increasing storage requirements.

DRBD 9 and DRBD Manage allow transferring Images to Virtualization hosts via the DRBD Transport protocol. This allows images to be available nearly instantly on host nodes without requiring them to have storage space available.

Below is a diagram showing a simple OpenNebula cluster using the DRBD Manage Driver. This cluster has a Front End, two storage nodes, and a single virtualization host. The host has two images attached to it via DRBD Transport. Both images are deployed to double redundancy and are being replicated in real time across both storage nodes. This means that the failure of a single storage node will not disrupt IO on the host. All nodes have a local copy of DRBD Manage’s control volume.

opennebula-diskless

Features

  • Data redundancy
  • Automatic fail-overs if a storage node fails
  • Database and high I/O application compatible
  • Transfers images over the network with DRBD Transport
  • Quickly attaches images to VMs
  • Fast image clones

Maintenance Release – OpenNebula Great A’Tuin 4.14.2

The OpenNebula team is proud to announce a new maintenance release of OpenNebula 4.14.2 Great A’Tuin. This release comes with several bug fixes found after the 4.14 release. These bug fixes covers different OpenNebula components like the Cloud View self service portal, Sunstone web interface, OpenNebula Core and several drivers (VM, IM, Network, Auth), as well as with the OneGate component. Check the full list of bug fixes in the development portal.

Besides the bug fixes mentioned above, 4.14.2 includes several improvements:

If you haven’t had the chance so far to try OpenNebula 4.14, now is the time to download and install OpenNebula 4.14.2 Great A’Tuin. The team have also updated the Sanboxes if you want to take Great A’Tuin for a test drive.

As as highlight, find below a screencast describing the new import feature that allows importing VMs running in public cloud providers, vCenter, XEN and KVM environments to be managed through OpenNebula.

The team is working on a new version of the Marketplace compatible with 4.14.2, as well as a new set of context packages.

Relevant Links

OpenNebula 4.14 ‘Great A’Tuin’ is Out!

The OpenNebula team is pleased to announce the immediate availability of the final version of OpenNebula 4.14, codename Great A’Tuin. One of the main focus of this release has been the Sunstone interface, which has been completely refactored for maintenance and performance reasons. Expect major improvements in Sunstone from now on. Also, we are sure you will like the subtle changes in the look and feel.

Screenshot from 2015-09-25 13-01-56

To support HPC oriented infrastructures based on OpenNebula, 4.14 enables the consumption of raw GPU devices existing on a physical host from a Virtual Machine. There is no overcommitment possible nor sharing of GPU devices among different Virtual Machines, so a new type of consumable has been defined in OpenNebula and taken into account by the scheduler. VMs can now request a GPU, and if OpenNebula finds one free resource of type GPU available, it will set up the VM with PCI passthrough access to the GPU resource, enabling applications to get the performance boost of the direct access to a GPU card.

OpenNebula users managing vCenter infrastructures will also benefit from this upgrade. The workflow of the VM importing feature has been greatly improved through Sunstone, making it easier to import your existing workload into OpenNebula. Moreover, 4.14 adds the possibility to instruct OpenNebula whether or not it should save the disks, protect your users against accidental data lost! Last, but not least, a contextualisation improvement now allows to directly pass scripts to be executed in boot time to vCenter VMs, increasing the flexibility in VM customisation from OpenNebula in vCenter.

Also new in 4.14 is the ability to create and maintain a tree of VM disks snapshots. Now VM disks can be reverted to a previous state at any given time, and they are preserved in the image if it is persistent in the image datastore. For instance, you can attach a disk to a VM, create a snapshot, detach it and attach it to a new VM, and revert to a previous state. Very handy, for instance, to keep a working history of datablocks that can contain dockerized applications.

Other very interesting new features made their into 4.14. A non-exhaustive list follows (check the full list of changes in the development portal):

  • image resizing on boot time
  • ability to save VMs into VM Templates for later use
  • better state management of VMs
  • flexible context definition of network attributes
  • ability to import running VMs not launched by OpenNebula from all the supported hypervisors (including the hybrid ones, for instance now it is possible to manage through OpenNebula Azure, SoftLayer and EC2 VMs launched through their respective management portals)
  • the possibility to cold attach disks and network interfaces to powered off machines (which complement the hot attach functionality)
  • improvements in accounting to keep track of disk usage
  • better logging in several areas
  • the ability to pass scripts to VMs for guest OS customization

This is a stable release and so a recommended update. It incorporates important improvement since 4.12 and several bug fixes since 4.14 Beta2. Be sure to check the compatibility and upgrade guides. We invite you to download it and to check the QuickStart guides, as well as to browse the documentation, which has also been properly updated. If you want to take OpenNebula 4.14 for a quick test drive, take a look at the different SandBoxes.

Several organizations have sponsored the project through the Fund a Feature Program:

The OpenNebula project would like to thank these organizations and the community members and users who have contributed to this software release by being active with the discussions, answering user questions, or providing patches for bugfixes, features and documentation.

Relevant Links

Maintenance Release – OpenNebula Cotton Candy 4.12.1

The OpenNebula team is proud to announce a new maintenance release of OpenNebula 4.12.1 Cotton Candy. This release comes with several bug fixes found after the 4.12 release. These bug fixes covers different OpenNebula components, like for instance the scheduler, the Cloud View self service portal, Sunstone web interface, OpenNebula Core and several drivers (VM, Auth, Network). Check the full list of bug fixes in the development portal.

Besides the bug fixes mentioned above, 4.12.1 includes several improvements:

If you haven’t had the chance so far to try OpenNebula 4.12, now is the time to download and install OpenNebula 4.12.1 Cotton Candy. As as highlight, find below the newly showback feature, which enables the generation of cost reports that can be integrated with chargeback and billing platforms:

Barcelona Opennebula User Group

Skyline-Barcelona211

As you know, the community of OpenNebula is an important pillar for the project. Opennebula community through the distribution lists and forums can express their questions, requests, or contribute with new ideas to the developers. This information is very useful and can contribute by helping other users or develop new features.

However, OpenNebula project thought in User Groups too. The OpenNebula User Groups are local communities, where users can discuss or share information and experiences in a more direct way across ‘town’. Getting a closer diffusion, and joining people who want to collaborate with the project.

Also, remember that this year (2015) the Opennebula annual conference travels from Berlin to Barcelona, ​​the ‘smartcity’ that will be the meeting point where developers, users, administrators, researchers, … can share experiences, case studies, etc.

bcn_conference

For these reasons, some cloudadmins of Barcelona area have decided to create the Barcelona OpenNebula User Group. This group aims to be a small-scale community where we can discuss and find common objectives that support the project. We have created a website and a Google group where we will inform about first steps and work together in common goals.

In addition, and inside ONEBCN usergroup official presentations tour we will be next 5th of May on sudoers, a sysadmins group that meets regularly at the North Campus of the UPC.

It is a totally open group, so you are welcome!  First members of the Group:

Oriol Martí gabriel-verdejo-380x303 Angel Galindo Muñoz Xavier Peralta Ramos Jordi Guijarro Juan José Fuentes Miguel Ángel Flores Alex Vaqué

Some interesting links:

Cloudadmins Community Blog – http://www.cloudadmins.org

OneBCN Google Group – https://groups.google.com/forum/embed/?place=forum%2Fopennebula-barcelona-usergroup

Sudoers Barcelona – http://sudoers-barcelona.wikia.com/wiki/Sudoers_Barcelona_Wiki

OpenNebula 4.12 Cotton Candy is Out!

The OpenNebula team is pleased to announce the immediate availability of the final version of OpenNebula 4.12, codename Cotton Candy. This release ships with several improvements in different subsystems and components. For the first time, OpenNebula will be able to generate cost reports that can be integrated with chargeback and billing platforms, and also presented to both the administrators and the end users. Each VM Template defined by the Cloud administrator can define a cost per cpu and per memory per hour.

vdcadmin_vdc_showback

Starting with Cotton Candy, Virtual Datacenters are a new kind of OpenNebula resource with its own ID, name, etc. and the term Resource Provider disappears. Making VDCs a separate resource has several advantages over the previous Group/VDC concept, since they can have one or more Groups added to them. This gives the Cloud Admin greater resource assignment flexibility.

In addition to the well known VNC support in Sunstone, OpenNebula 4.12 includes support to interact with Virtual Machines using the SPICE protocol. This feature can be enabled for any Virtual Machine just checking the option in the input/output section of the Template creation form.

Networking has been vastly improved in 4.12, with the addition of Security Groups, allowing administrators to define the firewall rules and apply them to the Virtual Machines. Also, Virtual Extensible LAN (VXLAN) is a network virtualization technology aimed to solve large cloud deployments problems, encapsulating Ethernet frames within UDP packets, and thus solving the 4096 VLAN limit problem. Cotton Candy is fully capable of managing VXLANs using the linux kernel integration.

Important new features related to the newly introduced vCenter support are available in OpenNebula 4.12: the ability to import running VMs and networks, including the attach/detach NIC functionality, a new cloud view tailored for vCenter, VM contextualization support and reacquire VM Templates with their logo and description.

Finally, several improvements are scattered across every other OpenNebula component: the possibility to flush and disable a system datastore, improvements in Sunstone for better user workflow, and many other bugfixes that stabilized features introduced in Fox Fur.

As usual OpenNebula releases are named after a Nebula. The Cotton Candy Nebula (IRAS 17150-3224) is located in the constellation of Ara.

This is a stable release and so a recommended update. It incorporate important improvement since 4.10 and several bug fixes since 4.12 Beta. Be sure to check the compatibility and upgrade guides. We invite you to download it and to check the QuickStart guides, as well as to browse the documentation, which has also been properly updated.

Security Groups were funded by BlackBerry, and network extensions to the vCenter driver by Echelon, in the context of the Fund a Feature Program.

Thanks the community members and users who have contributed to this software release by being active with the discussions, answering user questions, or providing patches for bugfixes, features and documentation.

More information

First day of OpenNebula Conf

…or the day before the Conf – depending on how you count.

We started the day early to get from the NETWAYS headquarter in Nuremberg to the conference hotel Berlin. Our friends from OpenNebula were already there and we could make all preparations for the workshops very smoothly. There was even enough time to take a snack.
Exactly at 2:00 pm (just like expected when dealing with pettifogging Germans) the workshops started. The next thing we looked forward to is dinner. :)

IMG_0599

The day after the actual conference will and will be officially opened with Ignacio M. Llorente kick off “State and Future of OpenNebula”. We also looked forward to David Lutterkort talking about what an enchanting match Puppet and OpenNebula are.

Another great keynote will be delivered by Carlo Daffara, showing us why disaster recovery is really important and how can you take care of it using OpenNebula.

The early afternoon will then be filled with lightening talks curated Daniel Molina until it was time for lunch. These talks included presentations about Docker and OpenNebula, a very interesting topic approached differently by OpenNebula users.

Late afternoon (or pre evening event time slot, as we call it) will start with another highlight: Armin Deliomini will tell us how Runtastic switched from commercial products to Open Source only. Now, about one year later, he will give us an insight to the Status Quo where the private infrastructure for more than 40 000 000 registered users for Runtastic is implemented.

Also the talks of Jose Angel Diaz (CENATIC), Jordi Guijarro (CSUC) Tino Vazquez (OpenNebula) and many more will sweeten the time until the evening event finally starts. This year we will be at the restaurant “Alte Meierei”.

And then we just have to wake up once again, until the next Conf day, with even more highlights starts. :)