Sponsorship Opportunities for OpenNebulaConf 2018

This year, the OpenNebula Conf will take place at the city of Amsterdam from November 12th to 13th and we want you to be part of our team of sponsors and profit from OpenNebulaConf’s popularity as a supporter of the event!

In the last editions of OpenNebulaConf, we offered fully packed days of hands-on deployment and operations tutorials, developer working sessions, networking sessions and talks covering OpenNebula case studies and more. We enjoyed presentations from notable OpenNebula users and industry leaders like Akamai, Produban – Santander Bank, CentOS, Runtastic, Puppet Labs, Cloudweavers, RedHat, Deutsche Post, Unity Technologies, BlackBerry, Rental, Citrix, LRZ, FermiLab, Harvard, Trivago and European Space Agency. The international attendees were open source interested and known as a highly networked target group which acts as a multiplier.

What you will get becoming a sponsor

Having a presence at OpenNebulaConf 2018 is a great way to get your company in front of the OpenNebula community. There are three available levels of sponsorship: Platinum, Gold, and Silver. The table below shows the cost of each sponsorship package and what is included.


 Do you have further questions?
Have a look at the OpenNebula Conf web page or write us an email

Thank you for your interest in sponsoring OpenNebulaConf 2018!

 

OpenNebula Public Training for 2018

OpenNebula Systems has published the schedule for public classes in 2018 for the OpenNebula Introductory Tutorial.

The introductory tutorial is a beginner level course designed to introduce IT professionals to OpenNebula. The course covers the process of installing, configuring and operating enterprise clouds and virtualized data centers using OpenNebula. This course helps anyone who wants to set up a small scale OpenNebula test environment to gain experience working with OpenNebula. Students will be able to learn cloud architecture design, planning and installation, a general understanding of technical and business capabilities of an OpenNebula cloud, and basic configuration and usage of its main components.

The course is available remotely over the internet, given by instructors in an interactive, virtual environment, and featuring exactly the same contents and hands-on labs as an on-site training. The course fee includes one OpenNebula Certification exam registration to be used just after the course.

30865855072_0c3944bde1_z

You can contact OpenNebula Systems if your would like to request private training.

Pyone: Python bindings for OpenNebula

Why Pyone?

After years running my own private cloud home and at my startup company, I decided to start privazio. Privazio is a data-center class private cloud targeting residential users and small companies with a special focus on privacy. Privazio is currently under development.

OpenNebula is a fantastic cloud management platform that incorporates the one key feature that Privazio requires most: simplicity. OpenNebula has also a pretty reasonable entry-level hardware requirements. OpenNebula is then the ideal foundation for Privazio.

It would be great to take simplicity further by providing an Ansible module to manage OpenNebula. Any other functionality provided by Privazio will also be managed through Ansible making everything fit together nicely.

In order to develop an Ansible module we need a robust Python API for OpenNebula. This is not an easy task considering that OpenNebula is constantly being improved and its interfaces are likely to evolve.

Introducing Pyone

Pyone is a Python API for OpenNebula developed with two key goals in mind: Maintainability and Completeness.

OpenNebula provides a robust XML-RPC API for which XML Schema Definition (XSD) files are distributed.

Pyone uses the Schema Definition files to auto-generate the Python Bydings with PyXB.

On the other hand, OpenNebula’s XML-RPC API is consistent in the way in which calls are made, data is returned and errors are triggered. This allows for Pyone to subclass Python’s xmlrpc.ServerProxy class implementing all OpenNebula peculiarities in one go: authentication, error conditions, special data types, etc.

By auto-generating the bindings and subclassing the proxy object maintainability and completeness should be achieved. In theory future OpenNebula releases would only require updating the XSD files and regenerating the bindings.

Furthermore, making client calls and navigating the results match 100% the provided Open Nebula XML-RPC documentation.

Client code created with Pyone looks like this:

import pyone

one = pyone.OneServer("http://one/RPC2", session="oneadmin:onepass" )
hostpool = one.hostpool.info()
host = hostpool.HOST[0]
id = host.ID

one.vm.update(1,{
  'TEMPLATE': {
  'NAME': 'abc',
  'MEMORY': '1024',
  'ATT1': 'value1'
  }
}, 1)

What is next?

PyOne will completed and matured while developing an OpenNebula module for Ansible.

If you feel like contributing, please checkout Pyone in Github!

 

OpenNebula Ecosystem: Help to Design and Build your Cloud

Connecting users and providers of services and technology

The OpenNebula Project is excited to announce the creation of a new Ecosystem area in the project web site. The OpenNebula provider ecosystem consists of  service and technology companies that can help you design, integrate, deploy and operate the best cloud architecture for your workload, processes and IT infrastructure environment.

Because no two data centers are the same and infrastructure environments are diverse, OpenNebula partners are focused on your success, helping you take full advantage of all the benefits that OpenNebula has to offer and achieve your business objectives.

  • Services Providers offer integration and consulting services around OpenNebula products. They are professional services firms that help customers of all sizes design, architect, build, migrate, and manage their OpenNebula cloud. Services Partners include Consulting Companies, System Integrators, Strategic Consultancies, Agencies, Managed Cloud Service Providers, and Value-Added Resellers. They can be large consulting companies as well as smaller, specialized firms with market or geographic focus.
  • Technology Providers provide software solutions, products or services that complement OpenNebula to build and operate a cloud infrastructure. They include Independent Software Vendors and Platform Infrastructure Providers that have validated their products with OpenNebula.

Services offered by our partners complement the OpenNebula Systems support subscriptions,

You can apply to the OpenNebula Partnership Program  to be included in the provider ecosystem.

OpenNebula in VMworld 2018 US and Europe

This 2018 the OpenNebula team will run a booth again in both editions of VMworld. We will showcase the latest version of your favourite Cloud Management Platform, as well as the latest version of vOneCloud, both with the wealth of new features that are currently a work in progress.

If you’ll be around Las Vegas or Barcelona on the following dates, save them and come round the OpenNebula booth!

  • VMworld 2018 US, August 26-30, Las Vegas, Mandalay Bay Hotel & Convention Center
  • VMworld 2018 Europe, November 5-8, Barcelona, Fira Gran Via

We will keep you posted about pending details, like for instance the number and location of the booths.

See you in Las Vegas or in Barcelona, or in both!

OpenNebula Newsletter – January 2018

OpenNebula has entered 2018 stronger than ever. January has been a month for planning and discussing OpenNebula’s roadmap. Here you have a brief summary of OpenNebula’s progress in this first month of the year. Pay special attention to the outreach section, OpenNebulaConf2018 is confirmed!

Technology

Good news for our beloved users, OpenNebula 5.4.6 is here! This release brings a lot of bug fixes and some new functionalities.

Recent news regarding to Meltdown and Spectre vulnerabilities put OpenNebula team to work hard trying to alleviate performance issues. Well, do not worry, fortunately we came up with a solution. Now you will be able to specify your host’s CPU model so that KVM virtual machines can improve their performance and security. How does this work? You can find more technical details on this link

Some bugs have been also fixed on this release:

  • The network topology now works as a charm with networks with over a thousand machines.
    You can see how we managed to do so here.
  • As some of you requested, we have also include new commands to onedb on the CLI. These new commands will be extremely useful for recovery purposes, like for example, adjusting the showback.
    • update-history
    • show-history

Of course these are just some examples, for the full list of features and fixes you can always visit our documentation.

The team has rev the engines for the next major release, OpenNebula 5.6. Stay tuned for exciting new features!

Community

We are having a very intense year kickoff, this means, great news for and from our community!

OpenNebula team wants to welcome OneHost Cloud. They announced recently via Twitter, OneHost is migrating from OpenStack to OpenNebula.

We have chosen Opennebula to build our new cloud platform which will provide increased performance and simplicity for our current and future customers.

We recommend reading this article where the reasons for this change are listed and explained. It was amazing to find out that before making this turn, OneHost Cloud consulted experts on cloud:

after consulting many experts in the cloud arena we have felt comfortable implementing such platform to replace our current VMware and Openstack cloud

An enlightening tutorial was made by our colleagues from Pandora FMS. In this tutorial you will learn how to do the monitoring of your cloud using OpenNebula, along with other useful tips.

NodeWeaver team has released, for all of you, their LizardFS drivers for OpenNebula. This is a great chance to try out this amazing storage technology. To install this new drivers you can follow the guide on the github repository.

Another amazing addon was developed by a member of our community, Kristián Feldsam. With this addon you will be able to make backups of your qcow2 images inside OpenNebula. Read the post for more information

Cheering news coming from Virtuozzo. They have added support for OpenNebula. Now users will be able to manage their Virtuozzo Hyperconverged Infrastructure through OpenNebula. All the benefits of this synergy are described in this excellent post, written by, Stanislav Khalup, program manager at Virtuozzo.

As announced in our forum, one of our most experienced users, Rafael del Valle, has created PyOne, which is a fantastic implementation of OpenNebula’s XLM-RPC bindings in Python. If you are interested in seeing how this works check this link.

Also this month, Valentina Zaccolo from the National Institute of Nuclear Physics in collaboration with INDIGO DataCloud, has published a very interesting post related to the implementation of a Fair Share Scheduler for OpenNebula. We already heard about it in our last OpenNebulaConf, but do not worry if you couldn’t assist, this article is very explanatory and easygoing.

Our team is very excited to see these type of contributions which not only help OpenNebula, but all the users of the community. If you feel like you can help our community anyhow, do not hesitate to contact team or post directly in our forum.

Outreach

OpenNebula goes to the Netherlands! One more year we are doing the OpenNebulaConf2018 and this year it will take place in Amsterdam, one of the most modern cities in Europe. We are very excited about it because we will be presenting OpenNebula 5.6 with all its new amazing features and probably we’ll be scooping some characteristics of OpenNebula 5.8.

Countdown is on, the date chosen for this OpenNebulaConf2018 is November the 12-13, you can’t miss the chance to come and enjoy our hands-on tutorials and listen to our community speakers which will talk about why they are in love with OpenNebula.

A quick reminder for all of you that have not attend past OpenNebulaConfs. If you are interested in coming to OpenNebulaConf2018 and want to see previous events, check this link and have a look at the videos, pictures, talks, tutorials, etc.

We will be updating this information in our OpenNebulaConf official website. In a few days we will also publish the TechDay and training schedule for 2018, stay tuned!

New Maintenance Release: OpenNebula 5.4.6

The OpenNebula team is pleased to announce the availability of OpenNebula 5.4.6, a new maintenance release of the 5.4.x series.This version fixes multiple bugs and add some minor features, specially relevant the possibility to setting the CPU model to alleviate the performance penalties of Meltdown OS fixes.

Check the release notes for the complete set of changes.

Relevant Links

FaSS – Fair Share Scheduler for OpenNebula

Do you operate a small Cloud infrastructure and need to optimise the centre occupancy? Then FaSS, a Fair Share Scheduler for OpenNebula (ONE), will address your issues!

FaSS is a product of the INDIGO-DataCloud project and has been developed to boost small Cloud infrastructures, like those used for scientific computing, which often operate in a saturated regime: a condition that constrains the free auto-scaling of applications. In those cases, tenants typically pay a priori for a fraction of the overall resources and are assigned a fixed quota accordingly. Nevertheless, they might want to be able to exceed their quota and to profit from additional resources temporarily left unused by other tenants. Within this business model, one definitely needs an advanced scheduling strategy.

What FaSS does is to satisfy resource requests according to an algorithm that prioritises tasks according to

  • an initial weight;
  • the historical resource usage of the project.
Software design

The software was designed to be as little intrusive as possible in the ONE code, and interacts with ONE exclusively through its XML-RPC interface. Additionally, the native ONE scheduler is preserved for matching requests to available resources.

FaSS is composed of five functional components: the Priority Manager (PM), a set of fair-share algorithms, Terminator, the XML-RPC interface and the database.

  • The PM is the main module. It periodically requests the list of pending Virtual Machines (VMs) to ONE and re-calculates the priorities in the queue by interacting with an algorithm module of choice.
  • The default algorithm in FaSS v 1 is Slurm’s MultiFactor.
  • Terminator runs asynchronously with respect to the PM. It is responsible for removing from the queue VMs in pending state for too long, as well as terminating, suspending or powering-off running VMs after a configurable Time-to-Live.
  • The XML-RPC server of FaSS intercepts the calls from the First-In-First-Out scheduler of ONE and sends back the reordered VMs queue.
  • FaSS database is InfluxDB. It stores the initial and recalculated VM priorities and some additional information for accounting purposes. No information already present in the ONE DB is duplicated in FaSS.

How can I install FaSS?

Please find the detailed instructions in GitHub.

The only prerequisites are:

  • To install ONE (versions above 5.4 operate with FaSS above v1.2, if you run a previous version of ONE you need FaSS v1.1 or before);
  • To install InfluxDB and create fassdb.

All the other requested packages are installed automatically with the rpm.

You can then install FaSS as root user:
$ cd /tmp/
$ git clone https://github.com/indigo-dc/one-fass
$ cd one-fass
$ cd rpms
$ yum localinstall one-fass-service-v1.3-1.3.x86_64.rpm

The last step is to adjust the configuration file of the ONE scheduler, to allow it to point at the FaSS endpoint instead in:
/etc/one/sched.conf
change:
ONE_XMLRPC = "http://localhost:2633/RPC2"
to:
ONE_XMLRPC = "http://localhost:2637/RPC2"

Is it difficult to use?

Not at all! A detailed usage description can be found in GitHub.

  1. Edit the initial shares for every user:
    $ cd /tmp/one-fass/etc
    and edit the file:
    shares.conf
  1. Start FaSS:
    systemctl start fass

Now FaSS is ready and working!

Additional features

There are few additional features that allow you to keep your Cloud infrastructure clean:

  • You can set your VMs to be dynamic and be terminated after a specific Time-to-Live instantiating with:
    $ onetemplate instantiate <yourtemplateid> --raw static_vm=0
  • Instead of terminating your VMs they can be powered-off, suspended or rebooted changing the action to be performed in:
    /one-fass/etc/fassd.conf
What’s next?

We are implementing several new features in FaSS, for example the possibility of setting the Time-to-Live per user. We are also planning to test several new algorithms. So stay tuned!

Mitigating Meltdown Performance Penalty

We are sure you are aware of the various OS patching going on to mitigate the Meltdown and Spectre security flaws.

If all your hypervisors support PCID, you can activate this for all your new VMs setting the following in your `/etc/one/vmm_exec/vmm_exec_kvm.conf` file (and restarting OpenNebula afterwards):

RAW = “<cpu mode=’host-passthrough’></cpu>”

Note that this may impair live migrations of VMs between hypervisors with heterogeneous CPUs.

The OpenNebula team is working towards an easier way to define this option on a per-VM basis, as well as support from the scheduler to pick compatible hypervisors. This will be available to the community shortly through a public maintenance release (5.4.6).

New Image Backup Addon for Cloud qcow2 Images

FeldHost™ Delivers new addon “Image Backup” – Tool for backuping your cloud qcow2 images

FeldHost™ is pleased to introduce a new OpenNebula addon Image Backup, which allows you to backup qcow2 images in your cloud. Script is written in NodeJS and has the following options:

  • Backup all qcow2 images
  • Backup only specific image
  • Dry run for testing purposes
  • Option to backup deployments

Benefits

  • Live snapshots with FS freeze if guest agent is enabled
  • Automatically backups new images
  • Backups also image snapshots
  • Backups deployment files
  • Easy restore – Creates backup directory tree identical with datastores

How it works?

Read the documentation to get started.

Usage example

Install dependecies, clone git repo and copy sample config:

yum install epel-release
yum install nodejs npm

OR

apt-get install nodejs
git clone https://github.com/OpenNebula/addon-image-backup.git ~/one-image-backup
cd ~/one-image-backup 
npm install
cp config.sample.js config.js

Configure by following the manual.

vi config.js

Test and verify using dry run and verbose options.
List of options.

./one-image-backup.js -dvD

Setup cron:

vi /etc/cron.d/one-image-backup

MAILTO=your@email.tld
# Run every Saturday on 01:00
00 1 * * Sat user /path/to/one-image-backup/backup.sh

What Next & Contributions

Image Backup is a new project, and there are some things to improve. Contributors are welcome, we apply the Github Pull Request model for contributions in code and documentation. Stay tuned.