Senior Data Engineer (Clickhouse Certified/AWS) - FT Freelance - Worldwide

Role Overview

We are looking for a skilled Clickhouse Certified Developer with basic Python experience to enhance our data infrastructure. Your primary objective will be to optimize current database schemas, set up efficient data storage solutions, deploy systems to AWS, and configure reliable data ingestion pipelines.

Responsibilities

• Optimize existing Clickhouse schemas by utilizing core data types, implementing compression techniques, and configuring custom indexes and bloom filters.
• Establish cold storage solutions for historical data on S3, incorporating a query node and a minimal Clickhouse Keeper-based architecture.
• Deploy Clickhouse solutions to AWS, ensuring robust metrics, monitoring, and simple maintenance tools for the deployment.
• Configure a data ingestion pipeline using Kafka or integrate with existing Python-based tooling.

Required Skills

• Certification in Clickhouse development.
• Basic experience in Python programming.
• Proficiency in optimizing database schemas and understanding of core data types, compression, and indexing.
• Experience with AWS deployment and cloud-based architecture.
• Familiarity with metrics and monitoring tools for system maintenance.

Nice to Have

• Experience with Kafka for data ingestion.
• Familiarity with cloud storage solutions like S3.
• Understanding of data pipeline configuration and integration.