News
EVOLVE: Return on Investment
EVOLVE project is now more than halfway through, most of the infrastructure is up and running. The current status of the infrastructure encompasses hardware and software innovations. EVOLVE platform has to be considered as an infrastructure with hardware and its associated middle-are plus the surrounding environment of job management and orchestration. Our heterogeneous platform is now advanced enough in time to take profit from the portability investment made by the use case developers. It is the right time for the community to collect the fruits of the endeavours.
The expected improvements are manifold, speed-up obviously, scalability and easiness of deployment as well. The new workflow engine based on a PoC integration of Slurm with Kubernetes allows to deploy even complex pipelines with tightly synchronized stages (e.g MPI component). The notebook approach simplifies the development of new features and a performance dashboard helps the application developers to navigate through the complexity of performance optimization.
Future infrastructure improvements include an advanced node local storage, a more robust integration of Slurm with Kubernetes and a more cost-effective resource management.
EVOLVE project includes an array of 7 pilot applications. These pilots are diverse enough, either due to their technical origin such as HPC, Big Data, Cloud or by the requirements and the way they are stressing the infrastructure. For instance, the data management or parallelization model varied from one application to the other. Each of these pilot applications validates the overall vision of EVOLVE and furthermore bears itself significant scientific results in its field. The results can have direct impact on the European citizens with improved security, better mobility, or optimized agriculture.
The current edition of our newsletter details the obtained results and the overcome challenges for each of the pilot. These pilot applications have reached different maturity in term of implementation thus each one will tell a slightly different story. An excellent reason to read them all HERE.