Senior Data Engineer based on a combination of my strong background and advanced technical skills. With over 6 years of hands-on experience in data engineering, I have demonstrated my ability to design, implement, and optimize ETL/ELT pipelines that align with business/customer requests
. Worked with GCP(Bigquery,PubSub, GCS, Dataproc, Cloudbuild, CloudRun)
. Used Airflow to schedule ETL pipelines.
. Used SQL, DBT and Pyspark dataframes to transform the data.
. Used Terraform for infra management.
. Used Python in lots of cases, Docker to make my app containerized.
. Worked with Snowflake as a Cloud Datawarehouse