No longer accepting applications

New Application : Need Immediate Joiner (5+Years Exp.)- Apache Kafka Data Engineer @ Pan India

E-SolutionsKozhikode, Republic Of India, IN

3 days ago

Job description

Job Title : Apache Kafka Data Engineer

Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune)

Employment : Permanent

Start Date : Immediate

Must Have Skills :

Streaming and Batch Data ingestion
Confluent Kafka connectors usage for CDC (Change Data Capture)
Databricks and Delta Live Tables
PySpark processing
Data load review- partial, duplicates etc
Cloud Platforms : Azure

Job Description-

5+ years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks.

Hands-on expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub.

Experience creating producers, consumers and topics and integrating them into downstream processing.

Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMS.

Experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption.

Proficiency in programming languages such as Python, Scala or Java and solid knowledge of SQL for data manipulation and transformation.

Cloud platform expertise. Experience with Azure or AWS services for data storage, compute and orchestration (e.G., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).

Data modelling and warehousing. Knowledge of data Lakehouse architectures, Delta Lake, partitioning strategies and performance

Version control and DevOps. Familiarity with Git and CI / CD pipelines;

ability to automate deployment and manage infrastructure as code.

Ability to work with cross functional teams and articulate complex technical concepts to nontechnical stakeholders.

Create a job alert for this search

Immediate Joiner • Kozhikode, Republic Of India, IN

Related jobs

Promoted

Senior Data Platform Engineer

Black Dog LabsKozhikode, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

GCP Data Engineer

Xsell ResourcesMalappuram, IN

Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 16 days ago

Promoted

Senior Data Engineer

IntelliasMalappuram, IN

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 17 days ago

Promoted

Python Backend Developer (Immediate joiner)

Origins AI : Helping you build and scaleMalappuram, IN

We are a tech-first company solving real-world problems with clean code, thoughtful design, and fast iterations.Our team is lean, product-driven, and obsessed with delivering value through scalable...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Intellify SolutionsMalappuram, IN

Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 8 days ago

Promoted

Azure Databricks+Pyspark

Tata Consultancy ServicesMalappuram, IN

TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 17 days ago

Promoted

Platform Engineer – Java / BigData / Kubernetes

SyntasaKozhikode, IN

Platform Engineer – Java / BigData / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportunity to contribute t...Show moreLast updated: 27 days ago

Promoted

Data Engineer

DigitalzoneMalappuram, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago

Promoted

Data Engineer

Tata Consultancy ServicesKozhikode, IN

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago

Promoted

Azure Data Engineer

K&K Talents - IndiaMalappuram, IN

This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent. We are seeking an experienced Data Engineer with strong...Show moreLast updated: 30+ days ago

Promoted

Platform Engineer – Python / Databricks / Notebooks / Kubernetes

SyntasaKozhikode, IN

Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 27 days ago

Promoted

Azure Data Engineer

Tech MahindraMalappuram, IN

Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show moreLast updated: 2 days ago

Promoted

Palantir Data Engineer

SageBeans RPOKozhikode, IN

Location : Remote work in India.Experience and skills required for the Palantir Forward Deployed Engineer, Palantir FDE.Python, SQL and optionally Java / Scala. Code repositories, Pipeline Builder, Cod...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

MindlanceMalappuram, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

SAIVA AIMalappuram, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Sikich IndiaMalappuram, IN

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago

Promoted
New!

AWS Data Engineer

COVET IT INCKozhikode, IN

Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: less than 1 hour ago

Promoted

URGENT HIRING / Senior GenAI Engineer / Immediate - 15 days preferred

SenzcraftMalappuram, IN

Founded by IIM Bangalore and IEST Shibpur Alumni, Senzcraft is a hyper-automation company.Senzcraft vision is to Radically Simplify Today's Work. And Design Business Process For The Future.Using int...Show moreLast updated: 1 day ago