Freelance Data Engineer (PySpark & AWS)

Freelance Data Engineer – PySpark & AWS Location: Spain Contract: Freelance / Autónomo Project Duration: Long-term engagement Work Model: Hybrid / Remote, depending on project requirements Availability: Immediate or short notice preferred Project Overview We are looking for an experienced Freelance Data Engineer with strong expertise in PySpark and AWS to join a long-term data engineering project within a dynamic, technology-driven environment. The successful candidate will contribute to the design, development, and optimization of scalable data pipelines and cloud-based data processing solutions, supporting the efficient integration, transformation, and exploitation of large volumes of data. This is an excellent opportunity for a hands-on professional seeking a stable, long-term collaboration within a technically challenging environment. Key Responsibilities * Design, develop, and maintain scalable data pipelines using PySpark and Python. * Build and optimize data processing workflows within the AWS cloud ecosystem. * Develop ETL/ELT processes to integrate, transform, and validate data from multiple sources. * Work with large datasets, ensuring data quality, performance, scalability, and reliability. * Optimize Spark jobs and distributed data processing workloads. * Collaborate with Data Engineers, Data Architects, Data Scientists, and other technical stakeholders. * Contribute to data architecture improvements, best practices, and continuous optimization. * Ensure code quality, documentation, testing, and adherence to engineering standards. Required Experience * Proven experience as a Data Engineer in complex data environments. * Strong hands-on expertise in PySpark, Apache Spark, and Python. * Solid experience with AWS data services, such as Amazon S3, AWS Glue, EMR, Lambda, or Athena. * Experience building and maintaining ETL/ELT pipelines and processing large volumes of data. * Strong SQL skills and experience working with structured and semi-structured data. * Understanding of data lake and cloud data architecture concepts. * Experience with Git, CI/CD, and automated testing practices. * Ability to work independently in a freelance capacity and collaborate effectively with distributed teams.

Nice to Have

• Experience with AWS Step Functions, Redshift, or other AWS analytics services.

• Knowledge of Terraform or Infrastructure as Code.

• Experience with Databricks or modern data lakehouse architectures.

• Familiarity with data governance, monitoring, and observability practices.

What the Project Offers

• Long-term freelance engagement in Spain.

• Opportunity to contribute to large-scale cloud data engineering initiatives.

• Collaboration with experienced technical teams.

• Competitive daily rate, depending on experience and expertise.

• Flexible working arrangements, depending on project needs.

Interested? If you are an experienced Data Engineer with strong PySpark and AWS expertise and are looking for your next long-term freelance project, we would be happy to discuss the opportunity with you.