Personal details
Arpit S.
Timezone: New Delhi (UTC+5.5)
Summary
I mainly play with data, infrastructure, devops, linux. I started my career about two years ago with building backends, writing APIs. After an year I moved to data engineering role. As for my devops side I mainly handled on premise deployments, scaling the applications to thousands of users, monitoring and alerting infrastructure for production systems. At my main role as a data engineer I handle the data ingestion and workflow management (data pipelines). Aside from all this I have explored and contributed to many open source projects. I also open sourced one of our (me and my friend) projects and it got over 500 stars on GitHub
Technical skills
Work Experience
Data Engineer
SocialCops | Jun 2018 - Present
Nginx
Workflow
Big Data
Grafana
Airflow
Data Ingestion
Data Pipelines
I mainly handle data pipelines infrastrucutre and on-premise deployments.
Data Engineering Intern
SocialCops | Jan 2018 - Jun 2018
Python
MongoDB
Flask
Amazon S3
Pandas
Celery
Data Modelling
Data Warehouse
Data parsing
My responsibilities includes data parsing, building data pipelines, web APIs and back-end development
Personal Projects
2016
Python
OpenCV
Image Processing
Computer Vision
In this project we have worked on the problem of human detection,face detection, face recognition and tracking an individual. Our project is capable of detecting a human and its face in a given video and storing Local Binary Pattern Histogram (LBPH) features of the detected faces. LBPH features are the key points extracted from an image which is used to recognize and categorize images. Once a human is detected in video, we have tracked that person assigning him a label. We have used the stored LBPH features of individuals to recognize them in any other videos.
2017
Python
Django
Information Retrieval
Data Modelling
MobileCloudIR is a distributed system which stores whole Wikipedia dump in different smartphones. Users can query and get the related articles. This system includes an Android application and a coordinator web server running in local network