Sr. Data Engineer

A leading global provider of market infrastructure is seeking a Senior Data Engineer to join their expanding Data & Analytics division in Madrid. This is an exceptional opportunity to become a foundational member of a new hub, where your expertise will directly shape the future of high-performing engineering functions.

What you'll do:

• Design, build, and maintain efficient batch and streaming data pipelines using technologies such as Apache Airflow, Apache Kafka, and Apache Flink to support both real-time market data processing and large-scale batch operations.
• Develop scalable data warehousing solutions leveraging modern platforms like Snowflake to ensure seamless storage, retrieval, and analysis of vast datasets.
• Architect and manage resilient cloud-based infrastructure on AWS or GCP to guarantee high availability, scalability, and operational efficiency for all data services.
• Enhance and optimise CI/CD pipelines using tools such as Jenkins and GitLab to streamline development workflows, testing procedures, and deployment cycles.
• Monitor the health and performance of data applications, pipelines, and databases by utilising observability tools including Prometheus, Grafana, and CloudWatch for proactive issue resolution.
• Collaborate closely with stakeholders across technical and business domains to deliver reliable data services that enable analytical product development and informed decision-making.
• Contribute actively in agile ceremonies such as stand-ups, sprint planning sessions, and retrospectives to align priorities with delivery goals within the engineering team.
• Support the implementation of best practices in data engineering by sharing knowledge with colleagues and participating in code reviews to uphold quality standards.
• Troubleshoot complex issues related to data integrity, system performance, or infrastructure reliability while ensuring compliance with regulatory requirements.
• Continuously seek opportunities for process improvement by evaluating emerging technologies or methodologies that can enhance the overall effectiveness of the data engineering function.

What you bring:

• Demonstrated professional experience in data engineering or a closely related field with proven ability to deliver scalable solutions in production environments.
• Proficiency in Python programming (including frameworks such as Pandas, Dask, or PySpark) alongside strong SQL skills for effective manipulation of large datasets.
• Hands-on experience building API-driven data platforms using technologies like FastAPI to facilitate seamless integration between systems.
• Extensive background working with AWS cloud services (or GCP), Snowflake for data warehousing needs, Kubernetes for container orchestration, and Airflow for workflow management.
• Solid understanding of monitoring and alerting systems such as Prometheus, Grafana, or CloudWatch to ensure system reliability and rapid incident response.
• Expertise in ETL processes as well as event streaming architectures utilising tools like Kafka or Flink for real-time analytics applications.
• Comfortable operating within Linux environments using command-line tools for system administration tasks or troubleshooting purposes.
• Excellent communication skills enabling effective collaboration across both technical teams and business stakeholders within an agile framework.
• Bachelor’s degree in Computer Science, Engineering, Mathematics or another relevant technical discipline providing strong theoretical foundations.

What's next:

If you are ready to take your career in data engineering to new heights within a globally respected organisation committed to inclusion and excellence—this is your moment!

Apply today by clicking on the link provided; seize this opportunity to join an inspiring team where your contributions will shape the future of market data analytics.