Personal details
Rodolfo C.
Summary
- Python for ETL processes using Google Cloud with Cloud Functions and Dataflow processes, Cloud Build, Bigquery, BigTable, Bitbucket, Apache Airflow,Apache Beam
- Experience in analysis, construction / maintenance of ETL processes with Talend Open Studio for Big Data
(Using Relational and NoSQL databases with Cloud infrastructure like Azure, AWS and GCP)
- Working with Diferent Databases like PostreSQL, Redshift,Oracle,BigQuery
- Data modeling with Relational and NoSQL databases (MongoDB, Cassandra, ScylaDB, DynamoDB, BigTable)
- Experience in gathering requirements and customer needs
- Assisting the client in the integration projects between Legacy systems for DataLake
- Working with Talend Open Studio for Data Integration AWS Cloud and SQL Database
Technical skills
Work Experience
- Acting as Technical Leader in the Data Engineering Chapter, designing integration solutions from different data sources for the company's DataLake using 100% Google Cloud Platform
- Design Solutions for Integrations usind GCP services and Tools
- Creating Frameworks and Patterns to develop and acelerate the development of pipelines.
- Using Airflow and Apache Beam with Dataflow to orchestrate and ingest data in Datalake (Bigquery)Acting as Technical Leader in the Data Engineering Chapter, designing integration solutions from different data sources for the company's DataLake using 100% Google Cloud Platform - Design Solutions for Integrations usind GCP services and Tools - Creating Frameworks and Patterns to develop and acelerate the development of pipelines. - Using Airflow and Apache Beam with Dataflow to orchestrate and ingest data in Datalake (Bigquery) - Skills: Google Cloud Platform (GCP) · Python (Programming Language) · GCP · SQL · Python · ETL (Extração, transformação e carregamento) · Apache Airflow · Dataproc · Google BigQuery · BigTable · Google Cloud Dataflow · Integração · Gestão de projetos · Gestão de TI · Modelagem de dados · Oracle · Java · NoSQL
- Acting as a Data Engineer performing different types of integrations with different systems and data source types, mainly data related to CRM such as SalesForce and supporting the other Squad Data Engineers.Acting as a Data Engineer performing different types of integrations with different systems and data source types, mainly data related to CRM such as SalesForce and supporting the other Squad Data Engineers.
- Skills: Python (Programming Language) · SQL · Python · ETL (Extração, transformação e carregamento) · Microsoft SQL Server · Integração · Oracle · Java · Amazon Web Services · Talend Open Studio