Jobid: 3197638496 (0.11)
Overview
As a Data Engineer II at Adyen, you will build and maintain high-quality data pipelines on our Big Data Platform to support business insights. You’ll collaborate with data scientists, analysts, and product teams to craft scalable data solutions and ensure data accuracy and reliability. You will promote best practices in data governance, testing, and performance optimization, delivering timely data for stakeholders. This role combines hands-on engineering with mentorship, contributing to a data-centric culture. The opportunity centers on shaping data infrastructure at scale to empower product and business decisions.
Verantwoordelijkheden
- Collaborate with stakeholders to understand requirements and design effective data solutions
- Design, develop, deploy, and operate production ELT pipelines and data architectures
- Promote data governance, validation, testing, and discoverability; mentor others
- Ensure data and code quality with testing and monitoring (e.g., Pytest)
- Identify and resolve performance bottlenecks; optimize Spark-based pipelines and queries
Belangrijkste vereisten
- 3+ years as a Data Engineer or similar role
- Strong understanding of software and data engineering practices
- Proficient in Python, PySpark, Airflow, Hadoop, Spark, Kafka, SQL, Git
- Clear communicator
- Self-starter
- Innovator
- Python
- PySpark
- Airflow
Deel deze vacature: