Senior Engineer - Software Engineering
Job Description
The role
Cboe Clear Europe is a systemically important financial institution, providing post-trade services to stock exchanges, multilateral trading facilities, other equities trading platforms and for OTC equities trades. Headquartered in Amsterdam, we service trading platforms and we have clearing participants with headquarters in 14 jurisdictions in Europe, North America and Asia. We are a relatively small and very dynamic organisation, with an international and progressive culture and a focus on collaboration and teamwork.
Throughout the day our systems run critical processes that consume large amounts of data. Market prices feed our risk engine to compute margin calls, and the same flows drive settlement instructions and a wide range of regulatory and customer reports. The Data Engineering team owns these pipelines and the scheduling that drives them.
We are looking for a Senior Data Engineer to lead the next step: modernising and improving our data engineering and job scheduling, and consolidating our scheduling and processing technologies onto one standard stack. That stack is built on Apache Airflow and Python, running on Kubernetes. You will help decide what the target looks like, migrate jobs onto it, and retire what we no longer need.
We are pioneering how AI can best be used across the software development lifecycle and IT operations, and AI is built into how we design, build, test and run our systems. In this role you will learn fast and build AI skills that put you well ahead of the average engineer. More on that below.
You will work in a small, senior team of data engineers alongside database experts, backend engineers, business analysts and QA engineers, and report to the Director of Software Engineering.
Engineering with AI
We invest seriously in AI, because it is a large part of how a team our size runs a systemically important platform.
- A generous token budget for every engineer, so cost never stands between you and a good idea.
- Agentic tools in daily use. Claude Code and similar tools support coding, code review, testing, documentation and operational work, not side experiments.
- Room to shape how we work. You will help define our prompts, skills, guardrails and standards, not just follow them.
- A head start on your career. Few engineers get to work this deeply with AI in a regulated, production-critical environment.
Key responsibilities
- Modernise and consolidate job scheduling. Map how our batch and data jobs are scheduled and processed today, help define the target architecture, and move jobs onto a single standard platform built on Airflow and Kubernetes. Retire the technologies we no longer need.
- Build and own Airflow pipelines. Design, write and run DAGs for price data, risk inputs, settlement and reporting flows, with clear SLAs, dependencies, retries and alerting.
- Write production-grade Python. Build tested, typed and well-structured Python for pipeline logic, custom operators, hooks and shared libraries that other engineers can reuse.
- Run workloads on Kubernetes. Deploy and operate Airflow and pipeline jobs on Kubernetes using containers, Helm and CI/CD, and troubleshoot them when things go wrong.
- Deliver with AI assistance. Use Claude Code daily to write, refactor, test and document code, and help set sensible standards and guardrails for how the team uses it.
- Guard data quality. Implement monitoring and alerting on data quality issues, so problems are caught before they reach the risk engine, settlement or a regulatory report.
- Realise business and regulatory change. With your fellow data engineers, deliver changes for topics such as historical price data, regulatory and customer reporting.
- Support the people around you. Help business analysts, database experts and our operations colleagues whenever they need your expertise, and share what you know with other engineers.
Your knowledge and experience
- You are a seasoned data engineer, used to building, running and troubleshooting data pipelines for business-critical systems.
- Solid production experience with Apache Airflow: DAG design, scheduling, backfills, sensors, dynamic tasks and custom operators.
- Strong, idiomatic Python, with testing (pytest), packaging and type hints as everyday habits.
- Hands-on experience deploying and debugging containerised workloads on Kubernetes, with Docker and Helm.
- Practical fluency with AI-assisted development: you already use Claude Code or a similar coding agent, and you know where it helps and where its output needs careful review.
- Experience migrating or consolidating jobs from one scheduling or processing platform to another, without disrupting the business.
- Good SQL and data modelling skills.
- Prior experience in a regulated environment such as the financial industry.
- Strong communication skills in English; although we are mostly located in Amsterdam, our workforce comes from very diverse backgrounds so English is our main language. Dutch is not required.
- A bachelor's or master's degree in a relevant field, or equivalent practical experience.
You will really stand out with
- Knowledge of post-trade, clearing or CCP operations, or market data more broadly.
- Experience running Airflow at scale on Kubernetes (KubernetesExecutor, KubernetesPodOperator, the official Helm chart).
- PySpark, and exposure to reporting platforms such as Snowflake.
- Experience with enterprise job schedulers and moving workloads off them.
- Building tooling that extends AI coding agents, such as Claude Code skills, hooks or MCP servers.
- Experience creating lasting change on a topic like Data Governance or Data Quality Management.
- Observability tooling such as Prometheus, Grafana or OpenLineage.
Personal characteristics
- Team player.
- Willing to take on tasks and responsibilities outside your areas of expertise and comfort zone – at our size, this role requires it.
- Not afraid to bring bad news; you prefer honest transparency over telling people what they want to hear.
- Pragmatic: you simplify where you can and leave systems easier to run than you found them.
- Hard worker with high quality standards.
- Flexible and enthusiastic “can do” attitude.
About Cboe Clear Europe
Cboe Clear Europe is a central counterparty providing post-trade services to stock exchanges, multilateral trading facilities, other equities trading platforms and for OTC equities trades. Headquartered in Amsterdam, we are a systemically important financial institution that is managed efficiently. Cboe Clear Europe was acquired by Cboe Global Markets in July 2020 and together we are shaping our future. We also collaborate with teams across the Cboe group to share components and align on tooling and technology choices – which means good work done here can be reused by Cboe teams across the globe.
Our offer
- A challenging job within an ambitious international organisation which operates at the heart of the European financial market infrastructure.
- The opportunity to be part of a team of highly driven professionals within a friendly and fast-paced environment.
- Excellent training and development opportunities.
- We work together from our Amsterdam (Zuidas) office four days a week, with one day from home – and we are pragmatic about that when life occasionally needs it to be otherwise. Being in the same room most of the week is a deliberate choice: it is a large part of how a team this small moves this quickly.
- Our compensation program, made up of salary and bonus, is highly competitive.
- In addition the company offers a premium free pension plan and a variety of benefits such as paid lunch at the office, travel allowance, work from home allowance, etc.
Cboe Clear Europe key values: Ownership, Collaboration and Entrepreneurial spirit
Any communication from Cboe regarding this position will only come from a Cboe recruiter who has a @cboe.com email or via LinkedIn Recruiter. Cboe does not use any other third party communication tools for recruiting purposes.
Required Skills
Required Languages
🇬🇧 English