Current cloud infrastructures are mostly homogeneous, centrally managed and made available to the end user through the three standard delivery models: IaaS, PaaS and SaaS. As clouds increase in size and as machines of different types are added to the infrastructure in order to maximize performance and power efficiency, heterogeneous clouds are being created. However, exploiting different architectures poses significant challenges. We propose a novel cloud management and delivery architecture based on the principles of self-organisation and self-management that shifts the deployment and optimisation effort from the consumer to the software stack running on the cloud infrastructure. The goal of the project is to address this inefficient use of resources and consequently to deliver savings to the cloud provider and the cloud consumer in terms of reduced power consumption and improved service delivery, with hyperscale systems particularly in mind. The CloudLightning solution will be demonstrated in the three application domains - (i) genome processing, (ii) oil and gas exploration, and (iii) ray tracing.
