Personal details
Sebastian G.
Summary
Computer and Systems Engineer from Cúcuta, Colombia. passionate about software engineering, software architecture and data processing through scalable and cost effective data pipelines.
Was able to grow alongside Chiper's data architecture, starting alone as a Data Engineer Junior and becoming Data Engineering Manager in charge of a young team that is able to probide valuable and clean information at scale, looking for the right solutions for the specific big data problem.
Technical skills
Work Experience
Designed a scalable Data Engineering team structure and architecture able to manage different data requirements across the company and its three countries of operation (Colombia, Mexico and Brazil), always working under a measurable SLAs agreed with the stakeholders.
Tasks:
- Team guidance and mentoring.
- Understand and collect stakeholder's requirements.
- Design and implement a data workflows architecture to be able to handle different processes with data, like BI analytics reports and ML models data preprocessing.
- Proposed Architecture:
Orchestrator: Apache Airflow
Batch Data Ingestion: Dataproc (Spark), Delta Lake + GCS
Data Warehouse: Bigquery
Data Transformation: DBT