Software Engineer, Data Engineering

Who is Recruiting from Scratch:

Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire. We work with companies funded by the best investors including Sequoia Capital, Lightspeed Ventures, Tiger Global Management, A16Z, Accel, DFJ, and more.

If you are a fit, the team will reach out to you about this role or any others that may be a fit for our clients.

Our Client

Our client is building the developer platform to bring the benefits of blockchain to the world. Today, as the leading blockchain developer platform, we power over $22 billion in transactions for millions of people in 99% of countries globally. Our mission is to provide developers with the fundamental building blocks they need to create the blockchain products and services of the future.

The client team draws from decades of deep expertise in massively scalable infrastructure, AI, and blockchain from leading institutions including Google, Microsoft, Facebook, Stanford, and MIT.

Backed by Stanford University, Coinbase, the Chairman of Google, Charles Schwab, and the executives of global organizations . Our client has been featured in Bloomberg , TechCrunch , Wired , and numerous other media outlets.They have recently raised an $80M round and looking to expand and help companies build in Web3!

The Opportunity

Data Infrastructure is the foundation on which all of the client's products are built. As an engineer focused on data engineering, you'll be working with one of the most sophisticated and high-throughput distributed systems in the blockchain world. You'll focus on architecting and building new systems as well as improving existing ones for a platform that supports millions of users globally.

Responsibilities

• Maintain batch pipelines that power our production serving systems
• Set up frameworks and tools to help team members create and debug pipelines by themselves
• Track data quality and latency, and set up monitors and alerts to ensure smooth operation
• Build production DAG workflows for batch data processing and storage
• Aggregate logs from multiple regions and multiple clouds
• Design and implement our next-generation data warehouse that aggregates internal and third-party data sources

What We're Looking For

• BS (or higher) degree in Computer Science or similar
• 4+ years experience in a software engineering discipline, with at least 2+ years experience in data engineering or data infrastructure
• (Bonus) Experience in low-latency, streaming data architectures
• (Bonus) Prior experience in Airflow/Spark/ELK Stack