Software Engineer (HPC Sustainability)
Full-Time
Job Description
About the team
EMBL-EBI’s HPC infrastructure underpins world-leading bioinformatics research, operating large-scale compute clusters on behalf of scientific users across the institute. The HPC sub team sits within IT and Technical Services (ITS) and is responsible for the reliability, operation, and ongoing development of these clusters and their supporting tooling.
Your role
Your role is embedded within that HPC sub team, reporting to the HPC Lead. You will combine hands-on backend development with a meaningful sustainability mission: improving how EBI measures, reports, and reduces the environmental impact of its scientific computing. A significant part of your work involves a close collaboration with the Green Algorithms team at the University of Cambridge – an internationally recognised open source project for quantifying the carbon footprint of research computing and to align EBI’s tooling with the global GA ecosystem and contribute to the E-SCOUT international trial. Beyond this collaboration, you will contribute to the broader HPC sustainability agenda at EBI, including improving energy and carbon reporting, supporting user facing tooling, and helping establish best practices for sustainable HPC operations.
This is a technically demanding role for someone who is equally comfortable working independently in a production codebase and collaborating across organisational boundaries.
Key Responsibilities
- Develop and maintain Python based backend services that process HPC job telemetry and compute per job energy consumption and carbon footprint metrics.
- Contribute to the Green Algorithms open source project, working in close collaboration with the Cambridge GA team to integrate EBI’s real time job monitoring capabilities into the shared GA codebase.
- Work with time series databases to ensure efficient storage, aggregation, and retrieval of large scale HPC telemetry data.
- Extend and improve carbon and energy reporting tooling, including alignment with established methodologies (e.g., regional carbon intensity, memory energy, GPU utilisation weighting).
- Support the development of Grafana based dashboards that give HPC users and stakeholders visibility into the environmental impact of their workloads.
- Contribute to wider HPC sustainability initiatives within EBI, including documentation, user guidance, and participation in the E-SCOUT international trial.
- Produce clear technical documentation and actively share knowledge within the team.
You have
- Strong experience writing production-grade Python, with a focus on data pipelines, concurrent processing, and clean, maintainable code. This is a backend data engineering role, not web API development.
- Solid experience with PostgreSQL and time-series data management. Familiarity with TimescaleDB including continuous aggregates is an advantage, as is comfort with both psycopg2 and psycopg3.
- Working knowledge of Apache Kafka as a message broker: consumer groups, offset management, and event-driven pipeline design. Kafka is a core component of EBI’s real time job monitoring system.
- Confidence working with pandas DataFrames for data transformation, aggregation, and analysis used extensively in the Green Algorithms codebase.
- Proficient with Git, pytest, ruff, and Poetry. Able to contribute effectively to a collaborative open-source environment with CI/CD pipelines.
- Proficiency in agentic coding and AI-assisted development tools (e.g., Claude Code, GitHub Copilot, Cursor, or similar) to accelerate development within a well-structured codebase.
- Strong written and verbal communication skills. Able to work across two independent teams (EBI and Cambridge), translate technical trade-offs into clearproposals, and build consensus with stakeholders from different organisational backgrounds.
You may also have
- Prior experience contributing to open-source projects, including code review, documentation, and working within established.
- Experience building or modifying Grafana dashboards programmatically.
- Genuine interest in green computing and the environmental impact of scientific infrastructure.
How to Apply
Benefits and Contract Information- Hybrid working arrangements
- Generous time off: 30 days annual leave per year, in addition to eight bank holidays
- Campus life: Free shuttle bus to and from work, on-site library, subsidised on-site gym and cafeteria, casual dress code, extensive sports and social club activities (on campus and remotely)
- Family benefits: On-site nursery, 10 days child sick leave and holiday clubs on campus
- Salary: UK Equivalent £53,219 (gross).
- Contract type: Supernumerary - this contract type will be required to pay class 3 National Insurance Contributions (approximately £18.40 a week, please check UK HMRC website).
- Contract duration: This position is a 6 month temporary contract.
- International applicants: We recruit internationally and successful candidates are offered visa exemptions. Read more on our page for international applicants.
- Diversity and inclusion: At EMBL-EBI, we strongly believe that inclusive and diverse teams benefit from higher levels of innovation and creative thought. We encourage applications from women, LGBTQ+ and individuals from all nationalities.
- Job location: This role is based in Hinxton, near Cambridge, UK. You will be required to relocate if you are based overseas.
- How to apply: To apply please submit a cover letter and a CV through our online system before the closing date 30/09/2026
