Talent.com
No longer accepting applications
New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

E-Solutionsaurangabad, maharashtra, in
2 days ago
Job description

Job Title : Apache Kafka Data Engineer

Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune)

Employment : Permanent

Start Date : Immediate

Must Have Skills :

  • Streaming and Batch Data ingestion
  • Confluent Kafka connectors usage for CDC (Change Data Capture)
  • Databricks and Delta Live Tables
  • PySpark processing
  • Data load review- partial, duplicates etc
  • Cloud Platforms : Azure

Job Description-

  • 5+ years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks.
  • Hands-on expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub.
  • Experience creating producers, consumers and topics and integrating them into downstream processing.
  • Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMS.
  • Experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption.
  • Proficiency in programming languages such as Python, Scala or Java and solid knowledge of SQL for data manipulation and transformation.
  • Cloud platform expertise. Experience with Azure or AWS services for data storage, compute and orchestration (e.g., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).
  • Data modelling and warehousing. Knowledge of data Lakehouse architectures, Delta Lake, partitioning strategies and performance
  • Version control and DevOps. Familiarity with Git and CI / CD pipelines; ability to automate deployment and manage infrastructure as code.
  • Ability to work with cross functional teams and articulate complex technical concepts to nontechnical stakeholders.
  • Create a job alert for this search

    Immediate Joiner • aurangabad, maharashtra, in

    Related jobs
    • Promoted
    • New!
    Data Engineers with AIML experience (4 to 8yrs) Bangalore / Hyderabad-Preferred Immediate joiners

    Data Engineers with AIML experience (4 to 8yrs) Bangalore / Hyderabad-Preferred Immediate joiners

    Anlage Infotech (India) P LtdAurangabad, IN
    Hiring for Data Engineers with experience on AIML / Gen AI concepts for product manufacturing based company.Managing data pipelines / jobs. Add new potential data sources.Required Skills and Qualifica...Show moreLast updated: 15 hours ago
    • Promoted
    Backend API Integration Engineer | Immediate Joiner |

    Backend API Integration Engineer | Immediate Joiner |

    Zimetricsaurangabad, maharashtra, in
    The role involves designing, building, and maintaining scalable backend services and API integrations across enterprise systems and cloud platforms, using. JWT, SAML, and SSO integrations.MuleSoft, ...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    URGENT HIRING / Senior GenAI Engineer / Immediate - 15 days preferred

    URGENT HIRING / Senior GenAI Engineer / Immediate - 15 days preferred

    SenzcraftAurangabad, IN
    Founded by IIM Bangalore and IEST Shibpur Alumni, Senzcraft is a hyper-automation company.Senzcraft vision is to Radically Simplify Today's Work. And Design Business Process For The Future.Using int...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    LEAD DATA ENGINEER

    LEAD DATA ENGINEER

    Prophecy TechnologiesAurangabad, IN
    We’re Hiring : LEAD DATA ENGINEER.Notice Period : Immediate to 30 Days.Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse.Develop ETL / ELT work...Show moreLast updated: 15 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesaurangabad, maharashtra, in
    TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services). Strong expertise in Azure Data Engineering & ETL Co...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellify SolutionsAurangabad, IN
    Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 7 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tech MahindraAurangabad, IN
    Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme ServicesAurangabad, IN
    Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    TEKsystemsAurangabad, IN
    Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications. Hands-on experience with ETL pipeline development, schema desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Ubique SystemsAurangabad, IN
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsAurangabad, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr. Java Developer (Immediate Joiner Only)

    Sr. Java Developer (Immediate Joiner Only)

    Repro India Limitedaurangabad, maharashtra, in
    Bachelor’s or Master’s degree in Computer Science, Information Technology or equivalent.Strong hands-on experience in Core Java (Java 8+), Java EE / J2EE, OOP, multi threading, collections, generics,...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Kafka Engineer

    Kafka Engineer

    EXLAurangabad, IN
    We are looking for a skilled Kafka Engineer.The ideal candidate will have strong expertise in.Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing ...Show moreLast updated: 15 hours ago
    • Promoted
    Python Backend Developer (Immediate joiner)

    Python Backend Developer (Immediate joiner)

    Origins AI : Helping you build and scaleAurangabad, IN
    We are a tech-first company solving real-world problems with clean code, thoughtful design, and fast iterations.Our team is lean, product-driven, and obsessed with delivering value through scalable...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasAurangabad, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Product Owner – Immediate Joiners | Locations : Bangalore, Pune, Noida, Hyderabad

    Product Owner – Immediate Joiners | Locations : Bangalore, Pune, Noida, Hyderabad

    Happiest Minds TechnologiesAurangabad, IN
    Product Owner (Looking Immediate joiner).Location : Bangalore / Pune / Noida / Hyderabad.The Product Owner is a strategic leadership position accountable for shaping, prioritizing, and managing the ...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    JIT Global Infosystems Pvt. Ltd.Aurangabad, IN
    Applications, Analytics, and Consulting services to clients worldwide.By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance.Our ex...Show moreLast updated: 15 hours ago
    • Promoted
    Azure Databricks+Pyspark

    Azure Databricks+Pyspark

    Tata Consultancy ServicesAurangabad, IN
    TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 16 days ago