For one of my best clients global leader in the insurance sector, I am currently and urgently looking for a Senior Data Engineer to be based in Madrid and report to Amsterdam:

📑 Key requirements:

✔ Min experience of 4 years as big data engineer in middle to large companies
✔ Hadoop, Cloudera Data Platform, Spark, and Databricks
✔ Azure, Azure data engineering, Azure data services and modern data warehouses within Azure.
✔ Data modelling, ETL techniques and frameworks, APIs
✔ Fluent English

The project💼:

As a Senior Big Data Engineer you are responsible for the data content and applications within the IFRS17 big data platform. The current Big Data Platform is on Hadoop (to be migrated to Cloudera Data Platform and Cloud technology in 2023) with Informatica Big Data for the ETL (to be migrated to PySQL and PySpark in 2023). The majority of the data streams is fully automated in the IFSR17 Chain.

- Perform and develop end-2-end additional ingestions of new source data in the data platform
- Implement data mappings for the IFRS17 contract data
- Conduct GDPR analysis on data on new ingestions and new use cases, and advise the Security Architect on outcomes
- Monitor the data loads and the jobs running within the big data platform and maintain the interfaces with the Big Data platform
- Keep the documentation up-to-date on the data catalogue, the Data architecture, Data flow diagrams and Data Lineage amongst others

Offer💰:

-> Perm contract, full time
-> Attractive salary + bonus + package
-> Remote 80%, on site 20% / per trimester
-> A dynamic, international and challenging work environment

If you are interested, please don't hesitate to send me your CV (English version) and/or write me to have more information about the vacancy.

Thank you and regards,