New Support Services Coverage by OpenNebula Systems

OpenNebula Systems has announced an extension of its support services aimed at those OpenNebula users in production environments based on KVM that need to support the whole stack. Hence, support can be extended to include the Operating System of the virtualization nodes and the controller (which can be CentOS and/or Ubuntu), the hypervisor (libvirt and KVM), networking technologies as VXLAN/VLAN 802.1Q and Ceph as storage backend.

The supported components are part of the Open Cloud Reference Architecture, created by OpenNebula Systems from the collective information and experiences from hundreds of users and cloud client engagements. This reference documents software products, configurations, and requirements of infrastructure platforms recommended for a smooth OpenNebula installation.

This new support coverage is offered as an Add-on over the traditional OpenNebula support.

 

OpenNebulaConf 2016: Call for Speakers Open

Screen Shot 2015-12-21 at 3.36.51 PM

 

As you may already know, this year OpenNebulaConf is taking place in Barcelona again, on October 25-27. Everybody who wants to join as a speaker can now propose a talk via the online form at:

We are looking for content that is appropriate for people who are brand new to OpenNebula, experts, and everything in between. First Time Submitting?. Don’t Feel Intimidated. We know that the Cloud and open source community can be very intimidating for anybody who is interested in participating. We strongly encourage first-time speakers to submit talks.

If you are a OpenNebula practitioner, user, architect, devop, admin or developer and have something to share, we welcome your submission. Suggested topics will include:

– Latest developments in OpenNebula
– Research using OpenNebula
– User experiences and case studies using OpenNebula
– Best practices and tools
– Integration with other cloud, virtualization and data center components
– Any other topics that you feel are relevant to developers, users, researchers and other members of the community

Need inspiration?

Need help with or suggestions for your presentation? We’ve got lots of ideas and are happy to discuss your talk ideas before you submit them. Just reach out to us!

Schedule

The agenda will include a one-day pre-conference (October 25) with tutorials and hacking session, and a two-day conference (October 26 and 27) with keynotes, regular sessions, lightning talks and open sessions.

Benefits

Speakers will receive free admission, which includes:

– Attendance at all conference presentations
– Attendance at pre-conference tutorials and hacking sessions
– Coffee break during the morning and afternoon breaks
– Lunch on both conference days
– Dinner event on the first conference day
– Tapas dinner on the pre-conference day
– WiFi access

… and the opportunity to address a large audience of talented and influential cloud and open-source experts!

Guidelines

Deadline is April 29th 2016. Speaker selection notifications will go out no later than May 6, 2016 at 11:59PM CET.

Each presentation slot will be approximately 20 minutes long. Subsequently to each presentation a question and answer session is scheduled with the audience. The agenda will also include some lightning talks and some open sessions, too. You can also submit panels, laboratories or multi-presenter proposals.

If you want to get an idea of the past OpenNebulaConf sessions, including talks from companies such as CentOS, Runtastic, Puppet Labs, Cloudweavers, RedHat, Produban, Unity, Deutsche Post, please check our Youtube channel or download the presentations from our SlideShare account

We are looking forward to your talks!

Docker Swarm with OpenNebula

Following our series of posts about OpenNebula and Docker, we would like to showcase the use of Docker Swarm with OpenNebula.

Docker Swarm is native clustering for Docker. With Docker Swarm you can aggregate a group of Docker Engines (running as Virtual Machines in OpenNebula in our case) into a single Virtual Docker Host. Docker Swarm delivers many advantages, like scheduling, high availability, etc.

We continue with our approach of using Docker Machine with the OpenNebula Driver plugin, in order to deploy Docker Engines easily and seamlessly. Please make sure to follow the previous post, in order to have a fully functional Docker Machine working with OpenNebula.

As displayed in the following image, Docker Swarm will make a cluster out of a collection of Docker Engine VMs deployed in OpenNebula with Docker Machine:

docker-swarm-opennebula

Docker Swarm makes use of a Discovery Service in order to implement the cluster communication and discovery. The Docker project provides a hosted discovery service, which is appropriate for testing use cases, however, in our case, we will use Docker Machine to deploy an instance of Consul, in particular this Docker container for Consul.

NOTE: This guide is specific for KVM, if you would like to try this plugin out with the vCenter hypervisor, or with vOneCloud, there are a few small differences, so make sure you read this: Docker Machine OpenNebula plugin with vCenter. In particular you will need to use the option –opennebula-template-* instead of –opennebula-image-*.

The first step is to deploy it using Docker Machine:


$ docker-machine create -d opennebula --opennebula-network-name private --opennebula-image-name boot2docker --opennebula-b2d-size 10240 consul
$ docker $(docker-machine config consul) run -d -p "8500:8500" -h "consul" progrium/consul -server -bootstrap
$ CONSUL_IP=$(docker-machine ip consul)

Once it’s deployed, we can deploy the Swarm master:

$ docker-machine create -d opennebula --opennebula-network-name private --opennebula-image-name boot2docker --opennebula-b2d-size 10240 --swarm --swarm-master --swarm-discovery="consul://$CONSUL_IP:8500" --engine-opt cluster-store=consul://$CONSUL_IP:8500 --engine-opt cluster-advertise="eth0:2376" swarm-master

And now deploy swarm nodes:

$ docker-machine create -d opennebula --opennebula-network-name private --opennebula-image-name boot2docker --opennebula-b2d-size 10240 --swarm --swarm-discovery="consul://$CONSUL_IP:8500"--engine-opt cluster-store=consul://$CONSUL_IP:8500 --engine-opt cluster-advertise="eth0:2376" swarm-node-01

You can repeat this for as many nodes as you want.

Finally, we can connect to the swarm like this:

$ eval $(docker-machine env --swarm swarm-master)
$ docker info
Containers: 3
Running: 3
Paused: 0
Stopped: 0
Images: 2
Server Version: swarm/1.1.2
Role: primary
Strategy: spread
Filters: health, port, dependency, affinity, constraint
Nodes: 2
swarm-master: 10.3.4.29:2376
└ Status: Healthy
└ Containers: 2
└ Reserved CPUs: 0 / 1
└ Reserved Memory: 0 B / 1.021 GiB
└ Labels: executiondriver=native-0.2, kernelversion=4.1.18-boot2docker, operatingsystem=Boot2Docker 1.10.2 (TCL 6.4.1); master : 611be10 - Tue Feb 23 00:06:40 UTC 2016, provider=opennebula, storagedriver=aufs
└ Error: (none)
└ UpdatedAt: 2016-02-29T16:08:41Z
swarm-node-01: 10.3.4.30:2376
└ Status: Healthy
└ Containers: 1
└ Reserved CPUs: 0 / 1
└ Reserved Memory: 0 B / 1.021 GiB
└ Labels: executiondriver=native-0.2, kernelversion=4.1.18-boot2docker, operatingsystem=Boot2Docker 1.10.2 (TCL 6.4.1); master : 611be10 - Tue Feb 23 00:06:40 UTC 2016, provider=opennebula, storagedriver=aufs
└ Error: (none)
└ UpdatedAt: 2016-02-29T16:08:12Z
Plugins:
Volume:
Network:
Kernel Version: 4.1.18-boot2docker
Operating System: linux
Architecture: amd64
CPUs: 2
Total Memory: 2.043 GiB
Name: swarm-master

The options cluster-store and cluster-advertise are necessary to create multi-host networks with overlay driver within a swarm cluster.

Once the swarm cluster is running, we can create a network with the overlay driver

$ docker network create --driver overlay --subnet=10.0.1.0/24 overlay_net

and then we check if the network is running

$ docker network ls

In order to test the network, we can run an nginx server on the swarm-master

$ docker run -itd --name=web --net=overlay_net --env="constraint:node==swarm-master" nginx

and get the contents of the nginx server’s home page from a container deployed on another cluster node

docker run -it --rm --net=overlay_net --env="constraint:node==swarm-node-01" busybox wget -O- http://web

As you can see, thanks to the Docker Machine OpenNebula Driver plugin, you can deploy a real, production ready swarm in a matter of minutes.

In the next post, we will show you how to use OneFlow to provide your Docker Swarm with automatic elasticity. Stay tuned!

OpenNebula Newsletter – February 2016

Latest developments, events and future plans for the upcoming months from the OpenNebula project. Read this newsletter to keep up to date with your favorite Cloud Management Platform.

You might be interested in taking a look at the sponsorship opportunities for the next OpenNebula Conf 2016, due in October in Barcelona. Also it may be of your interest the projected OpenNebula TechDays for this year. Upcoming TechDays in March and April will be held in Madrid, Dallas and Toronto.

Technology

The OpenNebula team keeps working in OpenNebula 5.0, the next major upgrade that will incorporate a wealth of new features, keeping a smooth upgrade path. And no, this is no easy task folks. But we will make it happen.

OpenNebula 5.0 is a revolution around the corner. In a few weeks, a beta version will come out featuring the following highlights:

  • revamped Marketplace, now a first class citizen in OpenNebula, to import/export images to and from any datastore (including the new vCenter datastores)
  • vCenter storage management, including datastore selection and disk hotplug, a full integration with the new Marketplace functionality. Share VMDKs among OpenNebula instances!
  • fully integrated virtual router management (including default and transparent HA for routers). Link virtual networks together using a robust HA router, that will come out of the box in OpenNebula

5.0 will also feature a myriad of interface changes, including an extension of the Cloud View available operations, to iron out the wrinkles in the user experience and a long list of other features.

As you may have noticed, interest in Docker is surging. We see OpenNebula as the perfect IaaS support for Docker, and as such our strategy regarding integration of Docker ecosystem within OpenNebula is to follow a “container as a service” approach. This is containers within VMs, not replace KVM/ESX with containers to ensure we maintain strong multi-tenancy. First we want to integrate OpenNebula with Docker-Machine to be able to build a container environment within your cloud. This feature is very advanced, as you can see in blog post. The second step would be to integrate tightly with Docker Swarm to be able to create Swarms using the OneFlow component.

docker_arch

Community

Lots of exciting things are happening in the OpenNebula community. Collaborations, contributions, and yes! even praise. Let’s review the highlights.

LINBIT has developed a new set of drivers to give OpenNebula support for the excellent DRBD functionality. Check an informative demo in this video.

A new release of the Perl binding for the OpenNebula Cloud API (OCA) is also worth noting if Perl is your sysadmin scripting language of choice. No excuse to make all the chores automatically in your cloud infrastructure now!

A freshly brewed integration of OpenNebula with professional VDI platform has been announced by UDS Enterprise, to be available in the upcoming 2.0 release of their software.

Our friends at NodeWeavers never stop. Take a look at their new family addition. Cute is an understatement, and since it is based on OpenNebula, powerful another one.

World wide adoption of OpenNebula is a fact. If more proof is needed, this is an excellent one. OpenNebula has been translated to the Persian language! Check this out.

Overall, we are very proud of the OpenNebula community. OpenNebula won’t be half as good without you guys, keep it up!

Outreach

The next OpenNebula Conference in Barcelona in October 2016 has already been announced . If you are willing to attend and can save now the date you can take advantage of a 40% discount in your Conf tickets. More information is available from the event site. The Conf has already its first sponsor with StorPool. Welcome! Learn about the different sponsorship opportunities in the Conference web page. If you want to understand what all the OpenNebula Conference fuzz is about, check the last Conference material (talks, slides,pictures).

Two OpenNebula TechDays, from this year’s scheduled ones have already been hosted. The first on was the TechDay in Kuala Lumpur, at MIMOS, where we learned about the wide OpenNebula ecosystem that is fostering in Malaysia. We want to thank all the people at MIMOS who received us for making this possible. The second TechDay happened in Sofia, Bulgaria, hosted by StorPool. We also want to thank StorPool for the magnificent hosting and the excellent local promotion, which yielded an excellent number of attendees.

CcD9x9tUcAAWPuS

If you are interested in participating in (or hosting) any of these TechDays agenda let us know. The next TechDay will happen this month hosted by Rentalia, and it will be held in Madrid, Spain.

The Swiss Open Systems User Group would be gathering next 16th of June to discuss Cloud Computing. If you are around and want to learn more about Clouds and OpenNebula, drop by.

You may be interested in OpenNebula Systems training plans for 2016 for Europe and US. These courses are designed to train cloud administrators to properly operate an OpenNebula infrastructure. Please contact us if your would like to request training near you.

Members of the OpenNebula team will be present in the following events in upcoming months:

  • VMworld 2016 US, August 28 – September 1, Las Vegas (Mandalay Bay Hotel & Convention Center), Nevada, US.
  • VMworld 2016 Europe, October 17 – 20, Barcelona (Fira Barcelona Gran Via), Spain.

Remember that you can see slides and resources from past events in our Events page. We have also created a Slideshare account where you can see the slides from some of our recent presentations.

Docker-Machine OpenNebula Plugin

Ever since the last post about Docker Machine things have evolved quite a bit, and we would like to keep you up to date!

Docker-Machine has changed its plugin architecture, and we have since then adapted to this new architecture and registered the OpenNebula plugin.

It’s very easy to install OpenNebula support for Docker Machine. You will need to have a fully working OpenNebula cloud, and it must be accessible from your client machine, you can use ONE_AUTH and ONE_XMLRPC to connect to OpenNebula. Read more here: OpenNebula Shell Environment.

NOTE: This guide is specific for KVM, if you would like to try this plugin out with the vCenter hypervisor, or with vOneCloud, there are a few small differences, so make sure you read this: Docker Machine OpenNebula plugin with vCenter. In particular you will need to use the option –opennebula-template-* instead of –opennebula-image-*.

You will also need to download a Boot2Docker image, don’t worry, we’ve got that covered! We have uploaded two images to the official OpenNebula MarketPlace prepared to be used as Docker Engine machines:

You can download either of those two images into your OpenNebula instance and use them for Docker Machine. Or, you can prepare your own image, using your favourite distribution, as long as it’s supported by Docker Machine and it has the latest OpenNebula Contextualization packages.

The following diagram visualizes how we are going connect from a local computer, the docker client, to a docker engine deployed in a provider: OpenNebula in our case.

docker_arch

Once the requirements have been fulfilled, let’s go ahead with this simple installation:

  • Step 1: Install Docker Machine in your client machine.
  • Step 2: Follow these instructions to build the driver again in the client machine. In a nutshell you will need to do the following:

    $ go get github.com/OpenNebula/docker-machine-opennebula
    $ cd $GOPATH/src/github.com/OpenNebula/docker-machine-opennebula
    $ make build
    $ make install

    However, for any clarifications, please make sure to read the Docker Machine OpenNebula Driver plugin guide.

Once you have installed it, you will be able to use Docker-Machine with OpenNebula as your backend:


$ docker-machine create --driver opennebula --opennebula-network-name private --opennebula-image-name boot2docker --opennebula-data-size 10240 mydockerengine
$ eval $(docker-machine env mydockerengine)

As simple as that! This will start a new VM in OpenNebula, and it will be your new Docker Engine!

I would like to personally thank Marco Mancini for doing the new plugin integration and helping devising and designing this integration!

This is not the last you’ll hear from us. We will publish soon a guide on how to use Docker Machine to deploy Docker Swarm using OpenNebula as the backend. We also have some more surprises involving OneFlow. Stay tuned!

And now, go try it out and have fun!

Upcoming Cloud TechDays Madrid and Dublin

Today we are announcing that we have just opened the call for speakers and registration to the following Cloud TechDays:

Send us an email at events@opennebula.org if you are interested in speaking at one of the TechDays and register as soon as possible if you are interested in participating, seats are limited!.

logo_rentalia

trinity-common-use

If you missed our last posts, these are the OpenNebula Cloud Tech Days that we have already announced for 2016:

For more information on past events, please visit the Cloud Technology Days page

TechDays

Please send us an email at events@opennebula.org if you are interested in hosting a TechDays event.

We look forward to your answers!

StorPool to Sponsor OpenNebulaConf 2016

OpenNebula Conf 2016 is getting closer and we would like to share with you the first Platinum Sponsor,  StorPool Storage. You can meet them in the booths area during the coffee and lunch breaks. If your company/project is interested in sponsoring OpenNebulaConf 2016 there are still slots available.

StorPool is intelligent storage software that runs on standard servers and builds scalable, high-performance storage system out of those servers. It focuses on the block-level storage and excels at it. OpenNebula is the preferred cloud management system for StorPool. It is simple, yet powerful and works very well.  StorPool is already integrated with OpenNebula. The integration is performed as a new datastore driver in OpenNebula. With StorPool, OpenNebula clouds get exceptional storage bandwidth, IOPS and low latency. This allows provisioning more VMs per host which increases utilization and ROI. Combining both products also allows for seamless scalability in capacity and performance as well as increased reliability.

At the event StorPool will demonstrate the joint solution, answer any questions and will help customers to improve the design of their cloud.  If you want to participate in OpenNebula Conf and meet StorPool and other OpenNebula users, remember that you are still in time for getting a good price deal for tickets.

About StorPool Storage

StorPool is block-level storage software. It has advanced fully-distributed architecture and is arguably the fastest and most efficient block-storage software on the market today. StorPool is incredibly flexible and can be deployed in both converged setups (on compute nodes, alongside VMs and applications) or on separate storage nodes. More about StorPool at www.storpool.com or info@storpool.com

promoBanner2016

StorPool Storage Hosting the First OpenNebula TechDay in Bulgaria on February 25th

StorPool Storage is going to host the first OpenNebula event ever organized in Bulgaria. On February 25th OpenNebula and StorPool are joining forces for a special one-day community event full of useful workshops and presentations all focused on how to take the most out of your private cloud. Jaime Melis, co-founder of OpenNebula, is coming to Sofia for a hands-on tutorial on how to create and manage your own OpenNebula cloud.  The event is targeted at systems admins, cloud architects, system integrators, devops architects, solutions architects, data center admins, community members and non-members from Bulgaria and the region.

When: 25 February 2016
Time: 10am – 6 pm EET
Venue: Vivacom Art Hall
Address: 4 Gurko Street, Sofia 1000

Free Registration here. Seats are limited.

Call for speakers: Email events@opennebula.org to become one of them, you are invited to share cloud use cases and deployment experiences, introduce new integrations and ecosystem developments, or describe other related cloud open-source projects and tools.

StorPool Storage is looking forward to welcoming anyone interested in building their own OpenNebula cloud in Sofia! See you all soon!

About StorPool

StorPool integrated with OpenNebula in March 2015. Deploying OpenNebula for cloud management and StorPool for block storage any company can now enjoy an efficient IT infrastructure; more details: here. Hostings like METANET are already successfully using the combined solution. StorPool assisted METANET with designing and bringing up many details of the service such as backup and in improving behaviour of the cloud management system.

OpenNebula Newsletter – January 2016

Check this Newsletter to find out the what kept us busy this month: latest developments, events and future plans for the upcoming months.

We are starting this 2016 willing to share with the OpenNebula community another chapter of excellent cloud management. If you, as we do, like planning ahead check the sponsorship opportunities for the next OpenNebula Conf 2016, due in October in Barcelona. Take a look also to the projected OpenNebula TechDays for this year.

Technology

The OpenNebula team, after the release of a new maintenance release for Great A’Tuin, the 4.14.2, is working around the clock on the next upgrade of OpenNebula, v5.0.
This new version will come packed with features and interface changes to iron out the wrinkles in the user experience, to make the experience managing and using an OpenNebula cloud even smoother. vCenter storage management (you are right, including datastore selection and disk hotplug), fully integrated virtual router management (including default and transparent HA for routers), marketplace datastore to easily import/export images to other OpenNebula clouds (we think this is a badass feature), Cloud View improvements, and a long list of other features. As a teaser see this blog entry about resource tagging in Sunstone to keep VMs, networks, images and templates perfectly organized.

Results from the last survey, aimed to understand the use of OpenNebula by the community, has been analyzed and published in the blog. After a careful filter, 190 organizations were chosen as a representative sample of the community. The main changes with respect to the last, 2014 survey are (read a more extensive report here):

  • OpenNebula shows its increasing maturity, with 73% of deployments in production compared to 62% reported in our previous survey.
  • Growth in North America has accelerated, now representing 30% of responses, up from 20%.
  • KVM provides the majority of OpenNebula support, growing from 48% to 79%.
  • There is a high rate of adoption in VMware environments from 28% to 37%.
  • Ubuntu grows from 36% to 40% and Debian falls from 33% to 22% as OS to build the cloud.
  • The use of the EC2 cloud API decreases from 25% to 10%.
  • The use of Ceph has grown considerably from 17% to 40%

Community

The OpenNebula community never sleeps! Well, that may be an overstatement, but certainly when they don’t they contribute to the common knowledge as well as come up with cool integrations to enhance the already mighty power of OpenNebula clouds. Floating IPs for OpenNebula can be easily achieved now thanks to this nifty tool developed OpenNebula clouds, developed by the same authors as CloudVAMP and Docker drivers.

Billing is crucial for VPS providers, which will greatly benefit from this provisioning module for Blesta which can be plugged into OpenNebula infrastructures.
It is crucial for an open source project such as your favourite cloud management platform to receive its users feedback. As you may heard from us before (once or twice), our roadmap is defined using our knowledge of our user and community developer needs. This is why it is so important messages like this one, with very useful feedback to be taken into account in future OpenNebula releases. Thanks, keep up the good work!

Outreach

Recently after our last OpenNebula Conference (talks, slides,pictures), the next, 2016 edition have been announced!. We know it is hard to plan that much in advance, but if you are willing to attend and can save now the date you can take advantage of a huge 40% discount in your Conf tickets. More information is available from the event site.

Screen Shot 2015-12-21 at 3.36.51 PM

 

Remember our December newsletter? We said you should stay tuned for the OpenNebula TechDay schedule in 2016. If you did then you already know about the quite a few already scheduled TechDays around the world for this year, to which we promptly added others in US. The OpenNebula Cloud TechDays are full day events to learn about OpenNebula with a hands-on cloud installation and operation workshop, and presentations from community members and users. TechDays hosts have an important role, and that is the local promotion of the event to gather OpenNebula enthusiasts in this technical event. If you are interested in participating in (or hosting) any of these TechDays agenda let us know.

TechDays

OpenNebula was spoken of in the Journée interministérielle du libre 2016 in France, country which recommends OpenNebula in their open source software reference list. Rubén S. Montero, our chief architect, gave an interesting interview to DatacenterDynamics magazine, check it out.
OpenNebula Systems also announced this month its training plans for 2016 for Europe and US. These courses are designed to train cloud administrators to properly operate an OpenNebula infrastructure. Please contact us if your would like to request training near you.
Members of the OpenNebula team will be present in the following events in upcoming months:

  • VMworld 2016 US, August 28 – September 1, Las Vegas (Mandalay Bay Hotel & Convention Center), Nevada, US.
  • VMworld 2016 Europe, October 17 – 20, Barcelona (Fira Barcelona Gran Via), Spain.

Remember that you can see slides and resources from past events in our Events page. We have also created a Slideshare account where you can see the slides from some of our recent presentations.

Upcoming Cloud TechDays Cambridge USA and Toronto CA

Last week we opened the call for speakers and registration to the OpenNebula Cloud TechDays in Kuala Lumpur (Malaysia), Sofia (Bulgaria), Dallas (TX, USA), Ede (The Netherlands) and Nuremberg (Germany). Today we are announcing that we just opened the call for speakers and registration to the following Cloud TechDays:

Send us an email at events@opennebula.org if you are interested in speaking at one of the TechDays and register as soon as possible if you are interested in participating, seats are limited!.

For more information on past events, please visit the Cloud Technology Days page

Please send us an email at events@opennebula.org if you are interested in hosting a TechDays event.

We look forward to your answers!