OpenMOLE

Post date: May 6, 2013 3:44:56 PM

A workflow system for massively distributed executions

Romain Reuillon, Institut des Systemes Complexes, paris, France

Workflow is a formalism to describe processes by linking tasks with one-another. OpenMOLE (Open MOdeL Experiment) is a FOSS (Free and Open Sources Software) workflow system for massively distributed computing. It emphasizes on the easy integration of home-brewed software components and on transparent scaling from a single computer up to a worldwide grid execution. It makes it possible for the users to design reusable scalable workflows.

OpenMOLE is based on a blackbox approach to embed components based on very different technologies: java / scala / C / C++ / fortran / scilab / octave / netlogo / R... Once a software component is embedded in the platform, it can be launched many times using data-parallelism. OpenMOLE automatically distributes the numerous executions of it on distributed environments, such as a cluster or even on the 100,000+ cores available on the European computing grid (EGI). The platform takes care of software installation, files transfers, job failures, and renders the distributed execution entirely transparent for the user.