Talent.com
No longer accepting applications
New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

E-Solutionsvapi, gujarat, in
3 days ago
Job description

Job Title : Apache Kafka Data Engineer

Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune)

Employment : Permanent

Start Date : Immediate

Must Have Skills :

  • Streaming and Batch Data ingestion
  • Confluent Kafka connectors usage for CDC (Change Data Capture)
  • Databricks and Delta Live Tables
  • PySpark processing
  • Data load review- partial, duplicates etc
  • Cloud Platforms : Azure

Job Description-

  • 5+ years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks.
  • Hands-on expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub.
  • Experience creating producers, consumers and topics and integrating them into downstream processing.
  • Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMS.
  • Experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption.
  • Proficiency in programming languages such as Python, Scala or Java and solid knowledge of SQL for data manipulation and transformation.
  • Cloud platform expertise. Experience with Azure or AWS services for data storage, compute and orchestration (e.g., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).
  • Data modelling and warehousing. Knowledge of data Lakehouse architectures, Delta Lake, partitioning strategies and performance
  • Version control and DevOps. Familiarity with Git and CI / CD pipelines; ability to automate deployment and manage infrastructure as code.
  • Ability to work with cross functional teams and articulate complex technical concepts to nontechnical stakeholders.
  • Create a job alert for this search

    Immediate Joiner • vapi, gujarat, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    JIT Global Infosystems Pvt. Ltd.vapi, gujarat, in
    Applications, Analytics, and Consulting services to clients worldwide.By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance.Our ex...Show moreLast updated: 1 day ago
    • Promoted
    Snowflake + DBT Engineer

    Snowflake + DBT Engineer

    MindBrainvapi, gujarat, in
    Location : Pune — Remote / Hybrid.We are looking for a highly experienced Snowflake + DBT Engineer to architect, build, and optimize modern cloud data platforms. The ideal candidate should have deep ex...Show moreLast updated: 1 day ago
    • Promoted
    Senior Java Backend Engineer

    Senior Java Backend Engineer

    Rrootshell Technologiiss Pvt Ltdvapi, gujarat, in
    Rrootshell Technologiiss Pvt Ltd.This is for FULL -TIME role and Work From Home Opportunity.Hiring : Senior Software Backend Engineer (Java). Java backed development experience.Strong understanding o...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Alp Consulting Ltd.vapi, gujarat, in
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesvapi, gujarat, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    URGENT HIRING / Senior GenAI Engineer / Immediate - 15 days preferred

    URGENT HIRING / Senior GenAI Engineer / Immediate - 15 days preferred

    Senzcraftvapi, gujarat, in
    Founded by IIM Bangalore and IEST Shibpur Alumni, Senzcraft is a hyper-automation company.Senzcraft vision is to Radically Simplify Today's Work. And Design Business Process For The Future.Using int...Show moreLast updated: 1 day ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Groupvapi, gujarat, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesvapi, gujarat, in
    Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    MerilVapi, Gujarat, India
    Experience Required : Minimum 1–2 Years.We are seeking a skilled and motivated Data Engineer to join our growing technology team. You’ll work with diverse data types and modern data platforms to desi...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    COVET IT INCvapi, gujarat, in
    Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: less than 1 hour ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy Servicesvapi, gujarat, in
    Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL. Good Knowledge of Data Brick lakehouse and Azure ...Show moreLast updated: 1 day ago
    • Promoted
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancyvapi, gujarat, in
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 1 day ago
    • Promoted
    Python Backend Engineer

    Python Backend Engineer

    Info Origin Inc.vapi, gujarat, in
    As our Python Backend Engineer, you will own and evolve the backend architecture for a large-scale analytical platform that processes massive datasets and serves thousands of concurrent users inrea...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Kafka Engineer

    Kafka Engineer

    EXLvapi, India
    We are looking for a skilled Kafka Engineer.The ideal candidate will have strong expertise in.Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing ...Show moreLast updated: 17 hours ago
    • Promoted
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.comvapi, gujarat, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show moreLast updated: 1 day ago
    • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careersvapi, gujarat, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Incvapi, gujarat, in
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show moreLast updated: 1 day ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastravapi, gujarat, in
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 4 days ago