Context And Mission
The Earth Sciences department from the Barcelona Supercomputing Center curates and manages a data archive of close to 8PB of data from observations, models, reanalyses, and derived products, based on external sources or generated in the department. Scientists from different scientific groups rely on this shared data archive curated by the Data and Diagnostics Team (DDT, composed of around 20 members), which is in charge, among other activities, of downloading, standardizing, checking, and curating the data into standardized netcdf format fitting the community standards and the requirements from the tools developed by the group.
The successful candidate will join the Data and Diagnostics Team to elaborate a long-term strategy on the data archiving and ingestion pipelines, elaborating the strategy based on the state-of-the-art analysis tools, storage formats (Zarr, for example), the requirements from the users of the department (AI-readiness, compression, operationalization,…) and the strategy used in institutions similar to the BSC, including travels to the corresponding institutions to gain in-depth understanding of their strategy.
The successful candidate will be in charge of proposing possible reconversion of the current data archive preserving compatibility with the existing tools and data pipelines, while she/he will collaborate with other members of the team to implement the new data ingestion/curation pipelines.
Key Duties
Design a strategy for the long-term evolution of the NetCDF data archive of the Earth Sciences department Investigate with internal users and external institutions the needs and existing landscape for Earth data storage
Requirements
Education Having a Master’s degree in Computer Science, Data Science, Physics, or a related discipline Essential Knowledge and Professional Experience at least 3 to 5 years experience in a Earth Sciences data environment Competences Data management in a Linux-based environment Earth data formats and tools Python Communication skills to get the requirements from the users High performance computing environments Management of high data volumes (~PB)
Conditions
The position will be located at BSC within the Earth Sciences Department We offer a full-time contract (35h/week), a good working environment, a highly stimulating environment with state-of-the-art infrastructure, flexible working hours, extensive training plan, restaurant tickets, private health insurance, support to the relocation procedures Duration: Open-ended contract due to technical and scientific activities linked to the project and budget duration Holidays: 22 days of holidays + 6 personal days + 24th and 31st of December per our collective agreement Salary: we offer a competitive salary commensurate with the qualifications and experience of the candidate and according to the cost of living in Barcelona Starting date: as soon as possible
