Lim H.

Collaborate with blockchain researchers to transform proof-of-concept projects into finalized metrics. Build and optimize data pipelines in Databricks to perform data transformation, feature engineering, and metric generation, ensuring seamless synchronization of final outputs to the production database. Design interactive dashboards in Databricks to facilitate effective communication with stakeholders, enabling streamlined review and validation of metrics. Engineering contributor of MiCA sustainability indicators. (Link to the datasheet: https://lnkd.in/eMC_ygfn)

Completed 100+ web scraping and external data sourcing projects for lead generation and competitor analysis purposes. Designed and executed data unification and deduplication initiatives utilizing tools such as BigQuery, Airflow, and Postgresql to ensure data accuracy and consistency across platforms. Integrated web scrapers into Airflow as a DAG to enable regular data refreshing on a fixed cadence, contributing to streamlined data workflows and improved operational efficiency. Configured and implemented data integration protocols, including API and webhook setups, to seamlessly incorporate information from diverse third-party cloud systems into a centralized data lake or BigQuery infrastructure. Engineered and deployed Kafka connectors to enable real-time data streaming from Postgres databases to BigQuery, facilitating seamless and continuous data flow between the systems. Collaborated with a multinational data team to provide technical consultancy, merge request (MR) review, and knowledge sharing, fostering a collaborative and supportive working environment. Leveraging cutting-edge technologies such as OpenAI GPT, Zapier, Customer.io, Respond.io, and others, I took a proactive approach to automate lead outreach business operations. This strategic implementation resulted in significant reductions in latency and enabled the recruitment team to optimize their efforts in the outreach process. Utilizing RPA (UiPath) to proficiently design and orchestrate robots for automating repetitive processes within HubSpot.