Kafka Connect Data Engineer

Job Title : Kafka Connect Data Engineer

Experience : 5 Years

Work Mode : Remote

Budget : ₹70,000 per month

About the Role

We are looking for a highly skilled Kafka Connect Data Engineer with strong hands-on experience in data ingestion frameworks to help design and implement the Bronze Layer of our data platform.

You will work closely with our Data Platform and Analytics teams to build scalable, reliable, and high-performance ingestion pipelines from diverse data sources into cloud-based storage systems.

Key Responsibilities

Design, develop, and maintain ingestion pipelines using Kafka Connect and Debezium for real-time and batch integrations.

Build ingestion solutions from MySQL and PostgreSQL into AWS S3 , Google Cloud Storage (GCS) , and BigQuery .

Implement best practices in data modeling, schema evolution, and partitioning for Bronze Layer architecture.

Manage, monitor, and optimize Kafka Connect clusters and connectors for scalability and reliability.

Collaborate with teams to analyze source systems and define downstream data needs.

Optimize ingestion workflows for performance and cost efficiency .

Create automation and deployment scripts using Python and cloud-native tools.

Explore emerging data lake technologies like Apache Hudi and Apache Iceberg .

✅ Required Skills & Qualifications

Minimum 2+ years as a Data Engineer or similar role.

Strong hands-on experience with Apache Kafka and Kafka Connect (source & sink connectors).

Experience with Debezium for CDC (Change Data Capture).

Expertise in MySQL and PostgreSQL .

Working knowledge of AWS S3 , GCP BigQuery , and GCS .

Proficient in Python for scripting and automation.

Understanding of data lake architectures , ETL / ELT pipelines, data quality, and observability.

✨ Good to Have

Experience with Docker / Kubernetes .

Familiarity with orchestration tools like Airflow or Dagster .

Knowledge of IaC tools such as Terraform or CloudFormation.

Exposure to Apache Hudi or Apache Iceberg (highly preferred).

How to apply send your cv on priyanka.jadhav@philodesigntech.com