Big Data Software Engineer (BE-CSS-IDE-2026-176-GRAP)
CERN
Geneva, Switzerland
Posted
Join the BE-CSS-IDE section and help shape how CERN stores and serves data from the High-Luminosity Large Hadron Collider (HL-LHC).
NXCALS, the CERN accelerator archival system, holds many years of data from CERN's particle accelerators: magnet and powering signals, beam instrumentation, cryogenics, and machine protection and post-mortem data. Accelerator operators, equipment experts and beam physicists use it every day to run the machine, diagnose faults and study performance.
Your work will focus on the needs of the HL-LHC. You will help keep NXCALS fast, reliable and scalable as particle accelerator data volumes grow and the machine moves toward the High-Luminosity LHC era. You will work on a real production system alongside experienced engineers, with plenty of opportunities to learn and take ownership.
Your responsibilities:
- Contribute to the development of NXCALS core components, focusing on HL-LHC use cases: ingestion pipelines (ETL), metadata services, data compaction, data extraction and APIs.
- Improve the performance and reliability of data access for LHC operations, machine protection analyses and commissioning activities.
- Work with accelerator users in the CERN Control Centre and equipment groups to understand their needs and help them build applications and analyses on NXCALS.
- Help evaluate big-data technologies (such as HDFS, Apache Ozone or ClickHouse) and their fit for future HL-LHC data requirements.
- Follow modern engineering practices in a team that values code quality, testing and automation.
Your profile:
- Solid experience in Java development; familiarity with the Spring ecosystem is an advantage.
- Experience with, or strong interest in, big-data technologies such as Hadoop, HDFS, HBase, ClickHouse, Apache Spark or Kafka.
- Working knowledge of Python; experience with PySpark is a plus.
- Familiarity with software quality practices, CI/CD and DevOps.
- Curiosity about particle accelerators and enthusiasm for working with diverse user communities.
Skills:
- Java.
- Spring ecosystem (advantage).
- Hadoop, HDFS, HBase, ClickHouse.
- Apache Spark, Kafka.
- Python, PySpark (plus).
- Software quality practices.
- CI/CD, DevOps.
- Spoken and written English or French, with a commitment to learn the basics of the other language.
Eligibility criteria:
- You are a national of a CERN Member or Associate Member State.
- You have a professional background in Software Engineering (or a related field) and have either:
- a Master's degree with 2 to 6 years of post-graduation professional experience;
- or a PhD with no more than 3 years of post-graduation professional experience.
- You have never had a CERN fellow or graduate contract before.