Data Engineer in Cloud technologies, experience with Amazon Web Services and Microsoft Azure.
Python programming, PySpark and SparkSQL in Azure Databricks and EMR. Git version control.
SQL Server database administrator and T-SQL development. Power BI dashboards and paginated reports.
Relational and dimensional modeling, Business Intelligence and Data Warehousing.
Experience in consulting for implementation of systems, PMBOK and SCRUM / Agile methodologies.
Start of Data Engineering area in ClearSale International using Azure Cloud.
Creation of analytical report database using Azure SQL Database to decrease dependency of the transactional database.
Development of Azure Data Lake storage gen2, data pipeline orchestration with Azure Synapse Analytics, ELT using SparkSQL and Azure Databricks, and Data Warehousing processes using serverless infra in Synapse Workspace.
Development of the Data Lake structure on AWS, standardization of nomenclatures, definition of the data pipeline with orchestration via Airflow. Ingestion, transformation, consumption of data for predictive modeling and dashboards.
Creation of automated deployment pipelines using Azure Devops artifacts and GIT version control.
Part of Financial Tribe in a squad using Scaled Agile Framework (SAFe) methodologies.