Personal details

André S. - Remote data engineer

André S.

Data Engineer
Based in: 🇧🇷 Brazil
Timezone: Brasilia (UTC-3)

Summary

I am a Data Engineer with over eight years of experience with data engineering and have worked since 2006 with databases. I started working with AWS in 2012 and always kept this provider as a focus, but I had also worked with GCP and Azure before. I built data pipelines with several architectures and tools for different purposes and companies' industries.

Work Experience

Data Engineer
Factored | Feb 2023 - Present
Python
Apache Kafka
Kubernetes
Terraform
Airflow
Apache Flink
Helm

Working in factored, I was placed in one of its clients as a DataOps Engineer in a platform team. This client has several data streaming services running and several databases. Some pipelines run over 50 million messages per second. In this client, my team and I are responsible for creating the platform for other teams to use.

Data Science Engineer
Proxet | Mar 2022 - Feb 2023
Python
Pandas

Main Projects: Swiftline

  • Create Python-driven pipelines to bring data from different sources and create analysis on top of those pipelines.
  • At this level of the project, no other tool or cloud was used. Only pure python with pandas and several other libs to create both the pipeline and all the analysis.