This edition of the CentOS Dojo has been very intense. Besides being crowded with very interesting people and great conversations (as it’s customary in all Dojos) the hackathon went even better than we would have hoped. The following items were achieved:
- CloudInit 0.7.4 100% supported by OpenNebula and CentOS . Big thanks to Sam Kottler for providing that package and assisting us with the process.
- Initial set of systemd scripts for OpenNebula developed, will be published as soon as CentOS 7 is out.
- OpenNebula-node-xen package developed. It will be added to the CentOS packages very shortly. Thanks to the Xen guys and to Johnny Hughes for his assistance with the kickstart file.
We also had the chance to meet new OpenNebula users, which as usual provide great feedback and exciting comments. It is also worthy of mention the conversation we had with John Mark from the GlusterFS project, who besides providing excellent ideas and recommendations for Gluster, will work with us very shortly in an announcement!
The Fosdem has also been very exciting: interesting conversations around Cloud, interoperability, OpenNebula demos, storage solutions and new projects using OpenNebula that wil be announced very soon!
Stand by for a bunch of exciting announcements that have blossomed these past days!
February 3rd, 2014. The OpenNebula team is pleased to announce a beta release of AppMarket 2.0. This release includes important features that are a direct result of feedback from production deployments.
This release extends the AppMarket functionality by adding a new set of features that enables the management and processing of OVA files. A new component AppMarket Worker is introduced, which handles the OVA package treatment (download, unpack, OVF parsing) and image format conversion. This release also features a new API and a new AppMarket interface via Sunstone.
What’s New in AppMarket 2.0 Beta
In the following list you can check the highlights of AppMarket 2.0 Beta:
- Multi-image Appliances: AppMarket Appliances can now have multiple disks, which creates new possibilities to upload and register more complex and feature complete Appliances.
- Sunstone Import: users will be able to import registered Appliances to OpenNebula via Sunstone by using pre-filled Image and Template creation forms.
- Sunstone Views: two new Sunstone views: an AppMarket *admin* view, that allows full control of the AppMarket, and a *user* view, that allows end users to import registered appliances.
A new horizontally-scalable component that subscribes to the AppMarket and executes jobs. It enhances the AppMarket functionality by adding:
- OVA processing: If a URL to an OVA package is supplied, the AppMarket will be able completely process it and integrate it to its repository. This involves: downloading and unpacking of the OVA package, parsing of the OVF file and creating a corresponding OpenNebula template.
- Format conversion: appliances registered in a specific format, can be converted to a new format.
- Extensibility: All the operations described above are implemented within the framework of an extensible driver engine, which allows further customization and integration by the administrators.
These new features will be only available interacting with AppMarket from an OpenNebula 4.6 deployment. If you want to test them before OpenNebula 4.6 is released, you can use the master branch of OpenNebula.
The new features introduced in the AppMarket 2.0 were funded by Produban in the context of the Fund a Feature Program.
We are dwelling deep into 2014 now, we want to let you know about what we are up to in this new year with the main news from the last month regarding the OpenNebula project, including what you can expect in the following months.
The OpenNebula team is currently carefully crafting the next release of OpenNebula. As 4.6 is in the oven, we want to share with you some of the new features we are implementing for this new release. Probably the most stunning highlight would be the deprecation of the oZones component, with all its features being now implemented directly in OpenNebula, being them in the core or in Sunstone. This is a twofold process.
First, the VDC functionality is being assimilated within groups. Administrators would have the ability to assign Resource Providers (clusters, in essence) to certain groups, so its members will only have access to the resources defined in a certain cluster (or clusters). This feature will come with the ability to define an administrator group, with members able to create users within the regular group. Permissions of the regular and administrator group can be finely tuned at the time of creation.
The second aspect of oZones that is being embedded into OpenNebula is zone management. An OpenNebula Zone is basically an OpenNebula instance. We are taking this management a step further in this release, with the ability to set up a OpenNebula federation. This federation will be at the user and permission level, and will allow users to log in into their local Sunstones and being redirected to another zone if they are in a group with a Resource Provider added from that zone. Pretty neat, right?
Another cool feature that will be present in 4.6 is the ability to import OVAs into OpenNebula. The functionality is being implemented in AppMarket, and will be a complete translation and import of all the resources defined in the OVA: disks, capacity, network… even with the ability to change the disks format. There are a myriad of bug fixes and other minor features being worked upon as well. Other aspects that are being revisited are storage backends, virtual networking, datastore and image management, VM management and Sunstone. You can find a comprehensive list here.
The OpenNebula community is relentless. During this few days of 2014, we have received a good deal of feedback in the mailing list which was very useful to define our roadmap. Check out the feedback in case you want to help defined the roadmap of future releases, OpenNebula’s features are driven by its users needs, which ensures its wide functionality and also working quality.
The addon catalog has a new neighbour: VDC store – caching storage infrastructure, by Gareth Bult. This module provides an interface to VDC-Store which is an alternative storage infrastructure for OpenNebula, providing a shared platform with support for local SSD caching, replication, live migration, snapshots and compression. There is also an ongoing integration between OpenNebula and IBM’s Softlayer. This is good news for OpenNebula users interested in building a hybrid cloud to extend their private data center with Softlayer resources.
We are also glad to know that OpenNebula is widely used in Spain. This kind of contradicts the otherwise universal truth: “The shoemaker’s son always goes barefoot.” It is very interested to know as well, via Carlo Daffara, that “Half the real estates agencies of Italy use back end services powered by @opennebula”. He says, and he indeed knows.
OpenNebula web page has been completely redefined, in order to make it more community oriented (and, of course, more visually appealing!). The documentation has been also migrated to a sphinx, and the code uploaded to a public repository on GitHub, easing community contributions to a key component of OpenNebula. There are other contributions (like this networking hack) which makes our community awesome. Lots of kudos to you, keep up the good work, we will hold on tight to our end!
First things first, next year’s OpenNebula Conference will be held in Berlin as well, 2-4 of December, 2014. If you want to repeat or find out how it is for yourself, save the date! We are setting up a number of OpenNebula TechDays around the world. These events are designed to learn about OpenNebula with a hands-on cloud installation and operation workshop, and presentations from community members and users. If you are interested in hosting or sponsoring one, let us know!. Stay tuned for the first TechDays announcement, it’s happening soon. The following event is happening today, with the participation of an OpenNebula team member:
- CentOS Dojo/Fosdem 2014, Brussels, Jan 31, 2014
During the following months, members of the OpenNebula team will be speaking in the following events:
- CloudScape VI, Brussels, Feb 25 , 2014
- Cloud Expo Europe, London, Feb 26, 2014
- Future Internet Assembly, Athens, Mar 18, 2014
- CeBIT 2014, Hannover, Mar 10-14, 2014
- Closer 2014, Barcelona, Apr 3-4, 2014
- EGI Community Forum, Helsinki, May 19, 2014
- GigaOM Structure, San Francisco, Jun 18, 2014
Besides our annual OpenNebula Conference, we are planning to organize Technology Day events in multiple cities globally.
The OpenNebula TechDays are full day events to learn about OpenNebula with a hands-on cloud installation and operation workshop, and presentations from community members and users that will focus on:
- Sharing cloud use cases and deployment experiences
- Introducing new integrations and ecosystem developments
- Describing other related cloud open-source projects and tools
The OpenNebula TechDay events are targeted at Cloud Architects, Data Center Admins, Systems Admins, Systems Integrators, DevOps Architects, and Solutions Architect.
In the shorter term we would like to organize TechDays in USA (East and West coasts) and Europe.
Please send us an email at firstname.lastname@example.org if you are interested in hosting a TechDays event or in providing support.
We look forward to your answers,
Last week, after receving a good amount of feedback, we’ve been planning the new features for OpenNebula 4.6. The primary focus for the next release is two-fold: federation and usability.
Federation of OpenNebula datacenters. oZones will undergo a major re-design (basically we are going to get rid of it ;)… and move its functionality to oned and Sunstone. This way, OpenNebula Zones will become a first-class citizens and it will be quite easy to federate your OpenNebula deployments. Virtual Data Centers, VDCs, will be also greatly improved: we are sure that they will prove to be a very useful tool to ease the multi-tenancy aspects of federated as well as stand-alone OpenNebula installations.
General usability improvements. In this area, there will not be radical new features in OpenNebula but rather minor adjustments to its current functionality. In particular, to highlight some of the new features:
- Storage Backends, support for RDB fomat 2 and improved support for GlusterFS.
- Virtual Networking, new operations to ease the update and management of virtual networks, as well as a clearer organization of IP assigment (including MAC-IP assigments and IP reservations).
- Datastores and Images, new operations to easily re-size and move/clone images.
- VM Management. New functions to simplify VM operation, provide attach/dettach operations on both running and non running VMs, or instantiate a template to a persistent VM.
- Sunstone, we will continue to polish its functionality and also, it will expose new dialogs for the new features (e.g. zone selector for users, resource providers for user groups…)
The OpenNebula Team would like to thank the community for this awesome list of feature requests. Even though not all the requests made it for 4.6., we are very excited to work on a release with a roadmap completely defined with functionality requested by OpenNebula users.
OpenNebula will be part of a very special event during the CentOS Dojo, a hackathon called CentOS in the Cloud, where we will focus in creating, testing and releasing CentOS Cloud images among many other things as part of a more general effort of making an even better OpenNebula experience in CentOS.
If you are interested in deploying production-ready private or public clouds in minutes with fully functional working images, you should definitely drop by this event. It’s going to be fun and exciting!
On saturday morning, you will also be able to meet us at the CentOS table. We will have a computer with us and we will be happy to run some demos, and show off all the things we’ve accomplished so far.
OpenNebula and CentOS already make an amazing couple, and it’s only going to get even better!
It’s been an amazing year in cloud computing in general and in OpenNebula in particular. We are excited to keep the momentum going. The number of downloads, users, and contributors has continued doubling each year and we have been able to offer more than we ever thought possible. Moreover, 2013 was a landmark year for our project with the celebration of the first ever OpenNebula conference.
With 2013 coming quickly to a close, we’d like to review what this year has meant for the OpenNebula project and give you a peek at what you can expect from us in 2014. You have all the details about the great progress that we have seen for the OpenNebula project in our monthly newsletters.
During 2013, we have worked very hard to continue delivering the most solid, powerful and flexible open-source management platform to build and manage Enterprise Clouds. We have continued focusing on solving real user needs in innovative ways with the involvement of the users in a really vendor-agnostic project. Our project has released 3 updates of the software: 4.0 Eagle, 4.2 Flame and 4.4 Retina, and 5 maintenance releases within a rapid release cycle aimed at accelerating the transfer of innovation to the market. The roadmap of these releases was completely driven by users needs with features that meet real demands, and not features that resulted from an agreement between IT vendors planning to create their own proprietary cloud solution.
A significant number of cool new features were included in OpenNebula: a highly-scalable monitoring system, an enhanced EC2/EBS implementation, an extended cloud bursting functionality, storage load balancing, multiple group support, multiple system datastore support, high availability, a revamped Sunstone with a new cloud view, multi-VM application management with auto-scaling, a whole new set of operations for VMs like system and disk snapshoting and dynamic capacity re-sizing, programmable VM actions, IPv6… There are some new drivers also, like Ceph, as well as many improvements for VMware, KVM and Xen.
After the Christmas break, we will organize a IRC meeting to discuss the requests for new features and for extending existing features. This valuable input will be used to create the short-term roadmap for OpenNebula 4.6 (due in March 2014).
The mechanisms offered to try out OpenNebula have been extended. Besides the existing Sandboxes with OpenNebula preinstalled (for VirtualBox, KVM, VMware ESX and Amazon EC2), an effort was carried out to develop simple how-to guides describing the step-by-step process to deploy OpenNebula in the most common linux and hypervisor combinations. Currently there are guides for CentOS/Xen, CentOS/VMware, CentOS/KVM and Ubuntu/KVM. In order to ease the installation of OpenNebula, we have also created package repositories for CentOS, Ubuntu, Debian and openSUSE to make the installation and upgrade even easier.
Moreover, the documentation system has been changed from DokuWiki to Sphinx, and it is now backed in Github. This allows to improve readability, create better PDF guides, and improve collaboration. We know that the documentation is as important as the code, so we want the community to be involved, guaranteeing its high quality.
We prepared two articles to briefly describe our view and experience about the different types of cloud models, how the main open-source cloud management platforms (namely Eucalyptus, CloudStack, OpenStack and OpenNebula) are targeting their needs, and the different perspectives of openness. We also had an invited post comparing the simplicity of OpenNebula with that of the Russian Soyuz. We completely agree, it is important to stay in focus to deliver a quality product. Way to go!
Many people and organizations have contributed in different ways, from the expertise and dedication of our core committers and hundreds of contributors to the valuable feedback of our thousands of users. Contributors are users of the software, like CentOS, ChinaMobile, Cisco, Deutsch Post, Blackberry, Produban, FermiLab, Akamai…, who are willing to contribute new innovative features from their production environments. During 2013, we have received great contributions: Linux Containers (LXC) drivers, Clustered Xen Manager (CXM) drivers, econe metadata server, Rex.io plugin, Ceph drivers, LVM shared drivers, NetApp filers driver, InfiniBand support, VirtualBox drivers, perl binding for OpenNebula’s native xmlrpc interface, OpenNebula over SSD disks, OpenNebula Puppet module…
We welcomed new partners like NetWays, Inovex, LMD, viApps and Terradue, who are providing value-added integration and consulting services around OpenNebula. These new partnerships underpin the confidence of these companies have in OpenNebula and C12G Labs.
Besides, this year marked the creation of multiple OpenNebula User Groups in Germany, France, Italy, USA, Spain, Hungary, Cuba, Egypt…
Last, and not least, the new OpenNebula add-ons program was born as well this last november. Not being mature enough to be included in OpenNebula, these new add-ons would now have support for their enhancement and coordinated development to avoid redundant work. This initiative has been well received by the community, we are glad you liked it, we are looking forward for your contributions.
We are very proud to have contributed to the European Roadmap for Cloud Technologies under H2020, and for the attention OpenNebula gets by the European Commission: “OpenNebula has played an important role in driving and supporting the transition to cloud computing and thus accelerating the pace of innovation in Europe”
During the year, members of the OpenNebula team or people deeply familiar with the technology spoke in many events: FOSDEM, CeBIT, FlossUK, Linux Open Admin Days, LinuxTag, CentOS Dojo, OSDC, Irish Free Software Organisation, Xen Hackathon, ISC Cloud’13, Ceph Community Day, EGI Technical Forum, Cloud Interoperability Week, CentOS Dojo, Bucharest, Cloud Interoperability Guide and EGI Technical Forum, Jornadas Técnicas RedIris…
Awesome speakers render awesome talks, like the ones held at the OpenNebulaConf 2013. If you want to remember the great ambience of the conference, or if you haven’t got a chance to attend, here is your opportunity to (re)visit the knowledge shared in the conference in the form of recordings of the keynotes and talks. Also, you can check out the presentations of the speakers if you want to consult a particular detail that you do not quite remember. And, to make the experience even more immersive, scout through the conference pictures. Next year’s OpenNebula Conference will be held in Berlin as well, 2-4 of December, 2014. If you want to repeat or find out how it is for yourself, save the date!.
Last month C12G hosted the CentOS Dojo in its HQ in Madrid. It started with a OpenNebula tutorial, given the previous day, and it displayed an array of very interesting talks, covering technical aspects related to OpenNebula and CentOS. Thanks a lot to the attendees to help render such a productive event!
During 2013, a series of public training courses on OpenNebula Fundamentals, aimed to cloud administrators and operators, was given by members of the OpenNebula Team in the C12G headquarters in Madrid. The courses covered the process of installing, configuring and operating private and hybrid clouds using OpenNebula. Additionally the programs briefly addressed the integration of OpenNebula with other components in the data center. If you are interested in future public training courses, please check the C12G training web page.
Looking back, it is inspiring the distance that we have come together since our first release of OpenNebula six years ago. And that is nothing compared to what is planned for the future. We are looking forward to another year of great running memories.
Reached this point, we want to give a huge THANKS! to our community. No, seriously guys, you rock big time. OpenNebula wouldn’t be nearly as good as it is today without all of you.
We’d also like to take this opportunity to wish you health, happiness and prosperity in 2014 to you and your loved ones!.
On behalf of the OpenNebula Project.
Christmas is just around the corner, and we wanted to wish you happy holidays, as well as let you know about the main news from the last month regarding the OpenNebula project, including what you can expect in the coming months.
This last month was OpenNebula’s 6th anniversary. It’s good to know that after the long way, your favourite cloud platform has evolved and turn into a mature and proven solution.
After two beta versions and one release candidate, where OpenNebula underwent all the tests defined in the release process, OpenNebula 4.4 Retina was released.
A significant number of cool new features were included in the end in OpenNebula 4.4. Retina. Probably the feature with the biggest impact on OpenNebula scalability is the new monitoring driver, which changes the traditional polling mechanism for a pushing one. This enables OpenNebula to monitor 25,000 VMs every two minutes! Check out more details here.
Another area that underwent significant improvements in the cloud bursting model, which in OpenNebula is tied to transparency to both end users and cloud administrators to use and maintain the cloud bursting functionality. Cloud bursting drivers have been vastly improved, the underlying technology being shifted from using Amazon API Toos to the new AWS SDK for Ruby. Functionality is also richer i, with support to define EBS optimized VMs, to define VM tagging, etc. Read more here.
The EC2 interface offered by OpenNebula to deploy public clouds has also been enhanced in OpenNebula 4.4 Retina. For instance, instance types are based on OpenNebula templates instead of files, EBS support has been extended, etc. More details in the blog.
Probably one of the most interesting feature for cloud administrators present in OpenNebula Retina is the ability to use multiple system datastores with storage load balancing. This allows to add a second backend to start deploying new VMs when the system datastore is running out of space. Details in this post.
And last, but not least, the multiple groups functionality is also present in OpenNebula 4.4 Retina, with the introduction of secondary groups. These work in similar way to unix groups: users have a primary group and optionally several secondary groups.
The team is now working to define the roadmap for OpenNebula 4.6. Stay tuned for new features!
An interesting post was contributed by Gareth Bult, and it is a compulsory read for anyone interested in running OpenNebula over SSD disks. An interesting alternative was suggested, to “cache your storage on a local SSD, but hold your working copy on a remote server, or indeed servers.”
An amazing contribution by Deutsch Post in the form of an opennebula puppet module was published also last month in Github. This module allows to install and manage your OpenNebula cloud using the puppet platform.
We want to highlight the excellent contribution made by Terradue, in the form of an OpenNebula add-on. The jclouds4one driver implements new capacities for hybrid Cloud Computing, expanding OpenNebula’s support for Cloud Bursting, with the ability to work with a variety of up to 30 cloud providers & cloud software stacks, including Amazon, Azure, GoGrid, Ninefold, OpenStack, Rackspace, and vCloud. More information on this post created in our blog by the Terradue folks.
Moreover, the documentation system has been changed from DokuWiki to Sphinx, and it is now backed in Github. This allows to improve readability, create better PDF guides, and improve collaboration (via fork & pull request). We know that the documentation is as important as the code, so we want the community to be involved, guaranteeing its high quality.
Awesome speakers render awesome talks, like the ones held at the OpenNebulaConf 2013 last September in Berlin. If you want to remember the great ambience of the conference, or if you haven’t got a chance to attend, here is your opportunity to (re)visit the knowledge shared in the conference in the form of recordings of the keynotes and talks. Also, you can check out the presentations of the speakers if you want to consult a particular detail that you do not quite remember. And, to make the experience even more immersive, scout through the conference pictures.
Last month C12G hosted the CentOS Dojo in its HQ in Madrid. It started with a OpenNebula tutorial given the previous day, and it displayed an array of very interesting talks, covering technical aspects related to OpenNebula and CentOS. Thanks a lot to the attendees to help render such a productive event!
Next year’s OpenNebula Conference will be held in Berlin as well, 2-4 of December, 2014. If you want to repeat or find out how it is for yourself, save the date!
This last month, a series of public training courses on OpenNebula Fundamentals, aimed to cloud administrators and operators, was given by members of the OpenNebula Team in the C12G headquarters in Madrid. The courses covered the process of installing, configuring and operating private, public and hybrid clouds using OpenNebula. Additionally the programs briefly addressed the integration of OpenNebula with other components in the data center. If you are interested in future public training courses, please check the C12G training web page.
This introduces a bunch of exciting advantages:
- Improved reability
- Easier to search
- Restructuring guides and creating new pages can be done by anyone
- PDF guides
- and of course… it’s now easier to collaborate (you know the drill: fork and pull request!)
Help yourself to the new documentation:
Get the PDF guides:
OpenNebula PDF Guides
And start watching this project:
GitHub – OpenNebula / docs