Talent.com
Kafka Connect Data Engineer
Kafka Connect Data EngineerPhilodesign Technologies Inc • Erode, IN
No longer accepting applications
Kafka Connect Data Engineer

Kafka Connect Data Engineer

Philodesign Technologies Inc • Erode, IN
1 day ago
Job description

Job Title : Kafka Connect Data Engineer

Experience : 5 Years

Work Mode : Remote

Budget : ₹70,000 per month

🔍 About the Role

We are looking for a highly skilled Kafka Connect Data Engineer with strong hands-on experience in data ingestion frameworks to help design and implement the Bronze Layer of our data platform.

You will work closely with our Data Platform and Analytics teams to build scalable, reliable, and high-performance ingestion pipelines from diverse data sources into cloud-based storage systems.

🛠 Key Responsibilities

  • Design, develop, and maintain ingestion pipelines using Kafka Connect and Debezium for real-time and batch integrations.
  • Build ingestion solutions from MySQL and PostgreSQL into AWS S3 , Google Cloud Storage (GCS) , and BigQuery .
  • Implement best practices in data modeling, schema evolution, and partitioning for Bronze Layer architecture.
  • Manage, monitor, and optimize Kafka Connect clusters and connectors for scalability and reliability.
  • Collaborate with teams to analyze source systems and define downstream data needs.
  • Optimize ingestion workflows for performance and cost efficiency .
  • Create automation and deployment scripts using Python and cloud-native tools.
  • Explore emerging data lake technologies like Apache Hudi and Apache Iceberg .

✅ Required Skills & Qualifications

  • Minimum 2+ years as a Data Engineer or similar role.
  • Strong hands-on experience with Apache Kafka and Kafka Connect (source & sink connectors).
  • Experience with Debezium for CDC (Change Data Capture).
  • Expertise in MySQL and PostgreSQL .
  • Working knowledge of AWS S3 , GCP BigQuery , and GCS .
  • Proficient in Python for scripting and automation.
  • Understanding of data lake architectures , ETL / ELT pipelines, data quality, and observability.
  • ✨ Good to Have

  • Experience with Docker / Kubernetes .
  • Familiarity with orchestration tools like Airflow or Dagster .
  • Knowledge of IaC tools such as Terraform or CloudFormation.
  • Exposure to Apache Hudi or Apache Iceberg (highly preferred).
  • How to apply send your cv on priyanka.jadhav@philodesigntech.com

    Create a job alert for this search

    Data Engineer • Erode, IN

    Related jobs
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Tiruppur, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 7 days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Salem,Tamil Nadu, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • Tiruppur, IN
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Salem,Tamil Nadu, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 21 days ago • Promoted
    Palantir Data Engineer

    Palantir Data Engineer

    SageBeans RPO • Erode, IN
    Location : Remote work in India.Experience and skills required for the Palantir Forward Deployed Engineer, Palantir FDE.Python, SQL and optionally Java / Scala. Code repositories, Pipeline Builder, Cod...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Tiruppur, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Tiruppur, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Erode, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 13 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Tiruppur, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • Salem,Tamil Nadu, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 14 days ago • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek Consulting • Erode, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Erode, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Salem,Tamil Nadu, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Tiruppur, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 5 days ago • Promoted
    Data Support Engineer ( Azure, Databricks )

    Data Support Engineer ( Azure, Databricks )

    Kumaran Systems • Tiruppur, IN
    We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Tiruppur, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Erode, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Grassdoor • Salem,Tamil Nadu, IN
    At Grassdoor Logistics Technologies, we are redefining the landscape of Cannabis commerce by.Unified Operations Center which provides seamless, technology-driven solutions.Our platform is built to ...Show more
    Last updated: 5 hours ago • Promoted • New!