Personal details
Guilherme P.
Summary
Data Engineer & AWS Certified Solution Architect. Holds a BSc degree in Electrical and Computer Engineering from UFMG. Interested in cloud computing, big data technologies and helping companies to get business value from their data.
Work Experience
∙ Design and implement data architectures on AWS to efficiently process and store large volumes of data from US residential IoT devices including thermostats and door locks.
∙ Design, construct, and oversee a data pipeline responsible for capturing data changes (CDC) from numerous Postgres databases and transferring them to Snowflake through AWS DMS and S3, while ensuring ongoing maintenance.
∙ Utilize technologies such as dbt, Snowflake, Terraform, AWS Lambdas, DMS, Glue, GitHub actiosn and AWS ECS Fargate to build scalable and fault-tolerant data pipelines.
∙ Maintained and improved the Iti Itaú data platform on AWS.
∙ Built data pipelines to process, enhance, and store real-time JSON events generated by multiple microservices.
∙ Created data pipelines for real-time credit analysis.
∙ Utilized Python, PySpark, Terraform, AWS S3, AWS EMR, AWS Lambda, AWS Athena, AWS Kinesis, and AWS Glue in this role.