Senior Data Engineer
Demandbase | Apr 2020 - Present
Python
Scala
Google BigQuery
Apache Spark
Kubernetes
Terraform
Apache Airflow
AWS (Amazon Web Services)
Senior Data Engineer working on data ingestion and processing
Software Development Engineer 2, Data Platform
Stackline | Aug 2018 - Apr 2020
Scala
Elasticsearch
Apache Spark
Amazon Redshift
Kubernetes
Terraform
Apache Airflow
AWS (Amazon Web Services)
Data Platform software engineer working Apache Spark ETL pipelines to transform raw web scraping and third party data to our internal data model then loading to Elasticsearch.