Personal details
Natalia P.
Based in: 🇧🇷 Brazil
Timezone: Amsterdam (UTC+2)
Summary
I am a Senior Data Engineer with experience in Apache Beam, Spark, Python, Kotlin/Java, and more. I have led teams, migrated AWS accounts, designed data pipelines, and implemented cost-effective solutions. I have also worked on recruitment analytics, built data warehouses, and mentored engineers.
Work Experience
Senior data engineer
Brenntag | Jul 2023 - Present
Python
Terraform
Spark SQL
- Led a team of three data engineers, fostering a collaborative environment focused on sharing knowledge and implementing best practices in data engineering.
- Planned and executed an AWS account migration using Terraform, prioritizing security and compliance requirements. This involved migrating infrastructure and data while ensuring adherence to industry standards and regulations.
- Designed and managed data pipelines using AWS Glue to support various analytical and machine learning use cases, including pricing optimization and churn prediction.
Senior data engineer
Bol.com | Apr 2021 - Jun 2023
Python
Kotlin
Apache Beam
Apache Airflow
Google Dataflow
DBT
- Implemented a real-time bot detection solution using Apache Flink, resulting in cost savings and improved data quality for users. Managed multiple stakeholders to ensure organization-wide benefits.
- Lowered the entry barrier to the webshop's behavioral data by developing generic and user-friendly aggregations. Additionally, implemented a browser plugin for quick visualization of slot performance.
- Redesigned and implemented a cost-effective backup process, resulting in annual savings of over 30k. Converted the process into a reusable Airflow DAG, making it available to other teams.
- Developed Gitlab CI/CD templates, simplifying deployments across multiple projects and reducing development time
Education
Universidade Federal Fluminense
Bachelor's degree・Computer Science
Jan 2013 - Jul 2017