Talent.com
Kafka Connect Data Engineer
Kafka Connect Data EngineerPhilodesign Technologies IncΒ β€’Β guwahati, assam, in
Kafka Connect Data Engineer

Kafka Connect Data Engineer

Philodesign Technologies IncΒ β€’Β guwahati, assam, in
11 hours ago
Job description

Job Title : Kafka Connect Data Engineer

Experience : 5 Years

Work Mode : Remote

Budget : β‚Ή70,000 per month

πŸ” About the Role

We are looking for a highly skilled Kafka Connect Data Engineer with strong hands-on experience in data ingestion frameworks to help design and implement the Bronze Layer of our data platform.

You will work closely with our Data Platform and Analytics teams to build scalable, reliable, and high-performance ingestion pipelines from diverse data sources into cloud-based storage systems.

πŸ›  Key Responsibilities

  • Design, develop, and maintain ingestion pipelines using Kafka Connect and Debezium for real-time and batch integrations.
  • Build ingestion solutions from MySQL and PostgreSQL into AWS S3 , Google Cloud Storage (GCS) , and BigQuery .
  • Implement best practices in data modeling, schema evolution, and partitioning for Bronze Layer architecture.
  • Manage, monitor, and optimize Kafka Connect clusters and connectors for scalability and reliability.
  • Collaborate with teams to analyze source systems and define downstream data needs.
  • Optimize ingestion workflows for performance and cost efficiency .
  • Create automation and deployment scripts using Python and cloud-native tools.
  • Explore emerging data lake technologies like Apache Hudi and Apache Iceberg .

βœ… Required Skills & Qualifications

  • Minimum 2+ years as a Data Engineer or similar role.
  • Strong hands-on experience with Apache Kafka and Kafka Connect (source & sink connectors).
  • Experience with Debezium for CDC (Change Data Capture).
  • Expertise in MySQL and PostgreSQL .
  • Working knowledge of AWS S3 , GCP BigQuery , and GCS .
  • Proficient in Python for scripting and automation.
  • Understanding of data lake architectures , ETL / ELT pipelines, data quality, and observability.
  • ✨ Good to Have

  • Experience with Docker / Kubernetes .
  • Familiarity with orchestration tools like Airflow or Dagster .
  • Knowledge of IaC tools such as Terraform or CloudFormation.
  • Exposure to Apache Hudi or Apache Iceberg (highly preferred).
  • How to apply send your cv on priyanka.jadhav@philodesigntech.com

    Create a job alert for this search

    Data Engineer β€’ guwahati, assam, in

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    MastekΒ β€’Β guwahati, assam, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 30+ days agoΒ β€’Β Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    KonectaΒ β€’Β guwahati, assam, in
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 1 day agoΒ β€’Β Promoted
    Data Engineer

    Data Engineer

    KisshtΒ β€’Β Guwahati, Assam, India
    We are looking for a highly motivated and passionate Junior Data Engineer to join our growing data team.This role is perfect for fresh graduates or early-career professionals who have strong analyt...Show more
    Last updated: 4 hours agoΒ β€’Β PromotedΒ β€’Β New!
    Lead Data Engineer

    Lead Data Engineer

    AlgonomyΒ β€’Β Guwahati, Assam, India
    Designation : Lead / Principal Software Engineer Experience : 12+ Years Location : Bangalore Education : B.Tech / Masters At Algonomy, we believe the future of our economy is Algorithmic, where busi...Show more
    Last updated: 4 hours agoΒ β€’Β PromotedΒ β€’Β New!
    Data Engineer – AWS

    Data Engineer – AWS

    RecruinΒ β€’Β Guwahati, Assam, India
    Only Immediate Joinees Responsibilities : Skills – AWS, DE, Airflow Key Responsibilities Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, K...Show more
    Last updated: 4 hours agoΒ β€’Β PromotedΒ β€’Β New!
    GCP Data Engineer

    GCP Data Engineer

    Xsell ResourcesΒ β€’Β guwahati, assam, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 19 days agoΒ β€’Β Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesΒ β€’Β guwahati, assam, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 29 days agoΒ β€’Β Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    LuxoftΒ β€’Β guwahati, assam, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 11 hours agoΒ β€’Β PromotedΒ β€’Β New!
    Data Engineer

    Data Engineer

    System Soft TechnologiesΒ β€’Β guwahati, assam, in
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 11 hours agoΒ β€’Β PromotedΒ β€’Β New!
    Data Engineer

    Data Engineer

    TIGI HRΒ β€’Β Guwahati, Assam, India
    Data Engineer Experience : 4–6 Years Location : Ahmedabad We’re looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and systems. The ideal candidate will have...Show more
    Last updated: 30+ days agoΒ β€’Β Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European CareersΒ β€’Β guwahati, assam, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 6 days agoΒ β€’Β Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt LtdΒ β€’Β Guwahati, Assam, India
    Role : Data Engineer Experience : 6–12 years Location : Remote Engagement : Contract (4–6 Months) Work Type : Remote About the Role We are seeking an experienced Data Engineer to support data mo...Show more
    Last updated: 4 days agoΒ β€’Β Promoted
    ETL Data Engineer

    ETL Data Engineer

    BPMLinksΒ β€’Β Guwahati, Assam, India
    Overview : In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and ...Show more
    Last updated: 30+ days agoΒ β€’Β Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live ConnectionsΒ β€’Β guwahati, assam, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days agoΒ β€’Β Promoted
    Senior Data Engineer

    Senior Data Engineer

    K&K TalentsΒ β€’Β guwahati, assam, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 1 day agoΒ β€’Β Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live ConnectionsΒ β€’Β guwahati, assam, in
    Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
    Last updated: 10 days agoΒ β€’Β Promoted
    Databricks Engineer

    Databricks Engineer

    DataE2E TechnologiesΒ β€’Β guwahati, assam, in
    We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with. You will collaborate with cross-functional teams to create robust dat...Show more
    Last updated: 30+ days agoΒ β€’Β Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AIΒ β€’Β Guwahati, Assam, India
    Company Description DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technolo...Show more
    Last updated: 1 day agoΒ β€’Β Promoted