Talent.com
New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

E-Solutionsbangalore, karnataka, in
2 days ago
Job description

Job Title : Apache Kafka Data Engineer

Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune)

Employment : Permanent

Start Date : Immediate

Must Have Skills :

  • Streaming and Batch Data ingestion
  • Confluent Kafka connectors usage for CDC (Change Data Capture)
  • Databricks and Delta Live Tables
  • PySpark processing
  • Data load review- partial, duplicates etc
  • Cloud Platforms : Azure

Job Description-

  • 5+ years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks.
  • Hands-on expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub.
  • Experience creating producers, consumers and topics and integrating them into downstream processing.
  • Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMS.
  • Experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption.
  • Proficiency in programming languages such as Python, Scala or Java and solid knowledge of SQL for data manipulation and transformation.
  • Cloud platform expertise. Experience with Azure or AWS services for data storage, compute and orchestration (e.g., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).
  • Data modelling and warehousing. Knowledge of data Lakehouse architectures, Delta Lake, partitioning strategies and performance
  • Version control and DevOps. Familiarity with Git and CI / CD pipelines; ability to automate deployment and manage infrastructure as code.
  • Ability to work with cross functional teams and articulate complex technical concepts to nontechnical stakeholders.
  • Create a job alert for this search

    Immediate Joiner • bangalore, karnataka, in

    Related jobs
    • Promoted
    Databricks Data Engineer- PAN India- Immediate joiners

    Databricks Data Engineer- PAN India- Immediate joiners

    Tredence Inc.bangalore, karnataka, in
    Experience- 6 years to 8 years of total IT Experience.Job location- Bengaluru, Chennai, Pune, Gurugram, Kolkata.In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Syna...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer (Architect) - Pan India

    Senior Azure Data Engineer (Architect) - Pan India

    GenpactBengaluru, Karnataka, India
    We are seeking an experienced Azure Data & Analytics Architect with a strong background in delivery and excellent communication skills. The ideal candidate will have experience and a proven track re...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    TruecallerBengaluru, Karnataka, India
    Hello, Truecaller is calling you from Bangalore, India! Ready to pick up?.Our goal is to make communication smarter, safer, and more efficient, while building trust across the world.With our roots ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Product Owner – Immediate Joiners | Locations : Bangalore, Pune, Noida, Hyderabad

    Product Owner – Immediate Joiners | Locations : Bangalore, Pune, Noida, Hyderabad

    Happiest Minds TechnologiesBengaluru, IN
    Product Owner (Looking Immediate joiner).Location : Bangalore / Pune / Noida / Hyderabad.The Product Owner is a strategic leadership position accountable for shaping, prioritizing, and managing the ...Show moreLast updated: 15 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tredence Inc.Bengaluru, Karnataka, India
    Location - Bangalore, Pune, Kolkata, Chennai, Gurgaon.Bachelor's and / or master’s degree in computer science or equivalent experience. IT experience and 3+ years' experience in Data warehouse / ETL pro...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Migration Lead - PAN India Location (Only Immedaite to 25 days Joiner Apply)

    Azure Migration Lead - PAN India Location (Only Immedaite to 25 days Joiner Apply)

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Total Exp : 10 to 15 Years Relevant Experience : Minimum 10 Years in Azure Core / Migration Location : PAN India We are looking for an experienced Azure Migration Lead to drive large-scale on-pr...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intelliashosur, tamil nadu, in
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
    • Promoted
    Data Solution Architect(immediate joiners only) (10+yrs Exp candidates only)

    Data Solution Architect(immediate joiners only) (10+yrs Exp candidates only)

    Tata Consultancy ServicesBengaluru, Karnataka, India
    TCS is hiring for skill Data Solution Architect at TCS PAN INDIA LOCATION.Design and manage ETL pipelines on cloud platforms (preference for AWS). Utilize tools like Airflow to orchestrate tasks and...Show moreLast updated: 4 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show moreLast updated: 30+ days ago
    • Promoted
    Ai Engineer(immediate joiners only)(10+ yrs exp candidates only)

    Ai Engineer(immediate joiners only)(10+ yrs exp candidates only)

    Tata Consultancy ServicesBengaluru, Karnataka, India
    TCS is hiring for skill Ai Engineer At TCS PAN INDIA location.Strong programming skills in Python.Expertise in machine learning is a must. In depth knowledge of various machine learning models and t...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer [T500-21405]

    Senior Data Engineer [T500-21405]

    ADMBengaluru, Karnataka, India
    We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show moreLast updated: 9 days ago
    • Promoted
    Flutter Developer | Immediate Joiner

    Flutter Developer | Immediate Joiner

    5paisaBengaluru, Karnataka, India
    India's fintech revolution, offering a comprehensive digital platform for retail investors and traders.With a commitment to democratizing financial services, 5paisa provides a suite of products inc...Show moreLast updated: 17 days ago
    • Promoted
    Need Immediate Joiner (Minimum 6-8 Years exp.)- Informatica Metadata Consultant (EDC / CDGC) @ Pan India

    Need Immediate Joiner (Minimum 6-8 Years exp.)- Informatica Metadata Consultant (EDC / CDGC) @ Pan India

    E-Solutionsbangalore, karnataka, in
    Job Title : Informatica Metadata Consultant (EDC / CDGC).Hands-on experience using Informatica's Enterprise Data Catalog (EDC) and Cloud Data Governance and Catalog (CDGC). Fair understanding of Infor...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    QuantiphiBengaluru, Karnataka, India
    Senior Data Engineer (GCP Cloud).Mumbai, Bangalore, Trivandrum (Hybrid Only).Bachelor’s degree in Computer Science or similar field or equivalent work experience. Data Warehousing, Data Engineering ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer(Databricks, Datafactory) Immediate joiners

    Azure Data Engineer(Databricks, Datafactory) Immediate joiners

    Tata Consultancy ServicesBengaluru, Karnataka, India
    SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,Databricks.Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BI.Experience with...Show moreLast updated: 17 days ago
    • Promoted
    SDV Architecture and Middleware SME (Immediate Joiner)

    SDV Architecture and Middleware SME (Immediate Joiner)

    PEM Technologies Pvt LtdBengaluru, Karnataka, India
    PEM Technologies Pvt Ltd is a specialist consultancy of system architects, AI / ML engineers, and embedded software experts, supporting leading Tier-1s and OEMs with cutting-edge automotive intellige...Show moreLast updated: 17 days ago
    • Promoted
    Senior Python Developer – 8+ Years | Any UST Location | Immediate Joiner

    Senior Python Developer – 8+ Years | Any UST Location | Immediate Joiner

    USTBengaluru, Karnataka, India
    CCTC | ECTC | Notice Period | Location Preference.Act fast for immediate attention! ⏳📩.Design, develop, and maintain high-performance applications using. Collaborate with teams to implement.Collabo...Show moreLast updated: 30+ days ago
    • Promoted
    New Application : Need Immediate Joiner (5+Years Exp.)- Apache Kafka Data Engineer @ Pan India

    New Application : Need Immediate Joiner (5+Years Exp.)- Apache Kafka Data Engineer @ Pan India

    E-SolutionsBengaluru, Republic Of India, IN
    Job Title : Apache Kafka Data Engineer.Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune).Streaming and Batch Data ingestion. Confluent Kafka connectors usage for CDC (Change...Show moreLast updated: 2 days ago