HiPEAC

Workflow Management Software Engineer (RE2)

Context And Mission

In the framework of the Earth-Sciences department, the candidate will substantially improve the efficiency and productivity of numerical weather and climate simulations on high-performance computing platforms by supporting the end-to-end workflows of global Earth system modeling in HPC environments.

This will be obtained by improving and supporting: the development and operation of modeling workflows on state-of-the-art supercomputer systems, and the usability of these models and tools throughout the European HPC ecosystem.

The candidate will develop solutions for cross-cutting HPC challenges, in particular in the weather and climate domain, and help to develop existing workflow orchestration software.

Key Duties

Coordinate the BSC activities related to the technical development, testing, improvements, and documentation of the Autosubmit workflow engine. Contribute to the Autosubmit development strategy by analyzing the user needs and learning from the benefits and disadvantages of the most used workflow. tools in the Earth Sciences domain. Identify priorities, find gaps in the plan, and contribute to the short and medium-term strategy to ensure objectives are met. Contribute to the convergence and efficiency of the different workflows running in the department. Support the users inside and outside the BSC center by adding new features to the existing and new tools. Maintain the operational deployment on different HPC platforms. Maintain the software in Git and deploy it to the HPC module and to the PyPi repository, publishing both source code updates and documentation. Facilitate the adoption of the solutions developed through workshops and seminars in and out of the department. Disseminate the results obtained through peer-review publications and presentations at conferences.

Requirements

Education Having a Bachelor in Computer Science or related discipline. Having a Master’s degree will be valued. Essential Knowledge and Professional Experience Excellent development skills in Python 3 and OOP, and experience with UNIX/LINUX environments and scripting languages (bash, …) Experience writing and maintaining tests (unit, functional, …) Additional Knowledge and Professional Experience Experience in version control in a collaborative environment, including SVN or Git Previous experience in scientific Python packages (Python Numpy, Scipy, …) will be valued Previous experience in a scientific area related to the research position will be appreciated Previous experience with workflow management solutions will be highly valued. Good documentation skills, applied to software code documentation for other developers, and also general documentation for users. Fluency in English Competences Capacity to interact and build strong relations with both Earth and Computer scientists Excellent problem-solving skills with a proactive approach Willingness and capacity to learn about new technologies and procedures Capacity to work and communicate in an international and interdisciplinary working environment Excellent written and verbal communication skills Ability to take initiative, prioritize and work under set deadlines and under pressure Ability to work both independently and within a team


About

Barcelona Supercomputing Center (BSC) logo

Barcelona Supercomputing Center (BSC)

Also known as: BSC

The Barcelona Supercomputing Center (BSC-CNS) is Spain's national supercomputing hub, advancing research in high-performance computing and fostering innovation across various scientific disciplines.


Summary

The Barcelona Supercomputing Center seeks a Workflow Management Software Engineer to enhance numerical weather and climate simulations on HPC platforms, focusing on workflow development, usability, and collaboration.