- Building and managing solutions for phData customers - Working on Hadoop, Apache Spark, Impala, Apache Kudu, StreamSets, Spring-Hbase-Boot, Kerberos, Docker, ansible, Cloudera, Java, Scala, C++

Solutions Engineer

Third Eye Consulting Services & Solutions LLC, Provides Big Data analytics solutions that can be easily customized to the customer’s specific business needs and seamlessly integrated into their existing infrastructure. -- Online retail analytics -- Digital advertisements analytics -- Traffic Data analytics I have worked on multiple BigData projects with different clients like Intel, Hortonworks, GridGain, Microsoft Technologies used : Apache Spark, Hadoop, MapReduce, Storm, Kafka, HDFS, Hbase,Hive, Shark, BigQuery, Spring Data, Cassandra, Social Media Data, Amazon Web Services, Rackspace, Google Cloud

Senior Big Data Consultant

* Flow design for click stream data * Installation of Storm and Kafka on multi-node cluster * Written Kafka Rest API to collect events from front-end * Written Storm topology to accept the events from Kafka producer and emit into Cassandra DB * Written Junit test cases for Storm Topology.

Big Data Consultant

- Design and development of software for Bioinformatics, Next Generation Sequencing (NGS) in Hadoop MapReduce framework, MangoDB using Amazon S3, Amazon EC2, Amazon Elastic MapReduce(EMR). - Developed Hadoop MapReduce program to perform custom Quality Check on genomic data. Novel features of the program included capability to handle file-format/sequencing-machine errors, automatic detection of base-line PHRED score and being platform agnostic (Illumina, 454 Roche, Complete Genomics, ABI Solid input format data). - Developed a Hadoop MapReduce program to perform sequence alignment on sequencing data. The MapReduce program implements algorithms such as Borrows-Wheeler Transform (BWT), Ferragina- Manzini Index (FMI), Smith-Waterman dynamic programming algorithm using Hadoop distributed cache. - Configured and ran all MapReduce programs on 20-30 node cluster (Amazon EC2 spot instances) with Apache Hadoop-1.4.0 to handle 600GB/sample of NGS genomics data. - Configured a 20-30 node (Amazon EC2 spot Instance) Hadoop cluster to transfer the data from Amazon S3 to HDFS and HDFS to Amazon S3 and also to direct input and output to the Hadoop MapReduce framework. - Successfully ran all Hadoop MapReduce programs on Amazon Elastic MapReduce framework by using Amazon S3 for Input and Output. - Developed java RESTfull webservices to upload data from local to Amazon S3, listing S3 objects and file manipulation operations. - Developed MapReduce programs to perform Quality Check, Sequence Alignment, SNP calling, SV/CNV detection on single-end/paired-end NGS data. - Designed and transmitted a RDBMS(SQL) Database to NOSQL MangoDB Database.

Big Data Developer

-Implemented Java Hbase MapReduce paradigm to load raw seismic and sensor data onto Hbase database on a 4 node Hadoop cluster. -Developed RESTfull web service application to fetch values from Hbase to UI in XML and JSON Response format. -Scripted separately in Hive and Pig to aggregate multiple drilling parameter values for downstream processing on a 4 node cluster. -Programmed in Java MapReduce to port Indexed data from Hbase to Solr search engine -Implemented cross-connection settings between Hive and Hbase. -Installed and configured Hadoop 1.X, Hive, pig, Hbase on a 4 node local cluster. -Customized OpenLayers maps to display KML information stored in Habse database to display oil well Information such as geo-location data.

Personal details

Sandish H.

Summary

Technical skills

Work Experience