New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

E-Solutionsbangalore, India

2 days ago

Job description

Job Title : Apache Kafka Data Engineer

Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune)

Employment : Permanent

Start Date : Immediate

Must Have Skills :

Streaming and Batch Data ingestion
Confluent Kafka connectors usage for CDC (Change Data Capture)
Databricks and Delta Live Tables
PySpark processing
Data load review- partial, duplicates etc
Cloud Platforms : Azure

Job Description-

5+ years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks.

Hands-on expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub.

Experience creating producers, consumers and topics and integrating them into downstream processing.

Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMS.

Experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption.

Proficiency in programming languages such as Python, Scala or Java and solid knowledge of SQL for data manipulation and transformation.

Cloud platform expertise. Experience with Azure or AWS services for data storage, compute and orchestration (e.g., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).

Data modelling and warehousing. Knowledge of data Lakehouse architectures, Delta Lake, partitioning strategies and performance

Version control and DevOps. Familiarity with Git and CI / CD pipelines; ability to automate deployment and manage infrastructure as code.

Ability to work with cross functional teams and articulate complex technical concepts to nontechnical stakeholders.

Create a job alert for this search

Immediate Joiner • bangalore, India

Related jobs

Promoted
New!

Product Owner – Immediate Joiners | Locations : Bangalore, Pune, Noida, Hyderabad

Happiest Minds TechnologiesBengaluru, Karnataka, India

Product Owner (Looking Immediate joiner).Location : Bangalore / Pune / Noida / Hyderabad.The Product Owner is a strategic leadership position accountable for shaping, prioritizing, and managing the ...Show moreLast updated: 14 hours ago

Promoted

Senior Azure Data Engineer (Architect) - Pan India

GenpactBengaluru, Karnataka, India

We are seeking an experienced Azure Data & Analytics Architect with a strong background in delivery and excellent communication skills. The ideal candidate will have experience and a proven track re...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Intellify SolutionsBengaluru, IN

Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 9 days ago

Promoted

Senior Data Engineer

TruecallerBengaluru, Karnataka, India

Hello, Truecaller is calling you from Bangalore, India! Ready to pick up?.Our goal is to make communication smarter, safer, and more efficient, while building trust across the world.With our roots ...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

AscendionBengaluru, Karnataka, India

We’re Hiring – GCP BigQuery Developers! ☁️| Immediate Joiners Only Are you passionate about building scalable data solutions and working with cutting-edge cloud technologies? Join our Data Engine...Show moreLast updated: 15 days ago

Promoted

SAAS Technical (7-10 years)-PAN India-Only Immediate joiners!!!

Anlage Infotech (India) P LtdBengaluru, Karnataka, India

Hi, Greetings for the day, Urgently looking out for candidates for SAAS Technical Consultant role for PAN India Location-PAN India Years of experience-7-10 Years • • • Only looking out for Immed...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

Intelliashosur, tamil nadu, in

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 18 days ago

Promoted

Data Solution Architect(immediate joiners only) (10+yrs Exp candidates only)

Tata Consultancy ServicesBengaluru, Karnataka, India

TCS is hiring for skill Data Solution Architect at TCS PAN INDIA LOCATION.Design and manage ETL pipelines on cloud platforms (preference for AWS). Utilize tools like Airflow to orchestrate tasks and...Show moreLast updated: 6 days ago

Promoted

Ai Engineer(immediate joiners only)(10+ yrs exp candidates only)

Tata Consultancy ServicesBengaluru, Karnataka, India

TCS is hiring for skill Ai Engineer At TCS PAN INDIA location.Strong programming skills in Python.Expertise in machine learning is a must. In depth knowledge of various machine learning models and t...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer [T500-21405]

ADMBengaluru, Karnataka, India

We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show moreLast updated: 10 days ago

Promoted

New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

E-Solutionsbangalore, karnataka, in

Job Title : Apache Kafka Data Engineer.Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune).Streaming and Batch Data ingestion. Confluent Kafka connectors usage for CDC (Change...Show moreLast updated: 3 days ago

Promoted

Flutter Developer | Immediate Joiner

5paisaBengaluru, Karnataka, India

India's fintech revolution, offering a comprehensive digital platform for retail investors and traders.With a commitment to democratizing financial services, 5paisa provides a suite of products inc...Show moreLast updated: 18 days ago

Promoted

Need Immediate Joiner (Minimum 6-8 Years exp.)- Informatica Metadata Consultant (EDC / CDGC) @ Pan India

E-SolutionsBengaluru, Karnataka, India

Job Title : Informatica Metadata Consultant (EDC / CDGC).Hands-on experience using Informatica's Enterprise Data Catalog (EDC) and Cloud Data Governance and Catalog (CDGC). Fair understanding of Infor...Show moreLast updated: 5 days ago

Promoted

Need Immediate Joiner (Minimum 6-8 Years exp.)- Informatica Metadata Consultant (EDC / CDGC) @ Pan I

E-SolutionsBengaluru, Karnataka, India

Job Title : Informatica Metadata Consultant (EDC / CDGC) Location : Pan India Experience : 5+ Years Employment Type : Permanent Metadata Engineer : • Hands-on experience using Informatica's Enterprise D...Show moreLast updated: 4 days ago

Promoted

Azure Data Engineer(Databricks, Datafactory) Immediate joiners

Tata Consultancy ServicesBengaluru, Karnataka, India

SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,Databricks.Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BI.Experience with...Show moreLast updated: 18 days ago

Promoted

SDV Architecture and Middleware SME (Immediate Joiner)

PEM Technologies Pvt LtdBengaluru, Karnataka, India

PEM Technologies Pvt Ltd is a specialist consultancy of system architects, AI / ML engineers, and embedded software experts, supporting leading Tier-1s and OEMs with cutting-edge automotive intellige...Show moreLast updated: 18 days ago

Promoted

Senior Data Engineer

QuantiphiBengaluru, Karnataka, India

Role : Senior Data Engineer Experience Level : 4 to 7 Years Work location : Mumbai, Bangalore, Trivandrum Required Skills : • Bachelor’s degree in Computer Science or similar field or equivalent work ...Show moreLast updated: 30+ days ago

Promoted

Databricks Data Engineer- PAN India- Immediate joiners

Tredence Inc.Bengaluru, Karnataka, India

Experience- 5 years to 8 years of total IT Experience.Job location- Bengaluru, Chennai, Pune, Gurugram, Kolkata.In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Syna...Show moreLast updated: 30+ days ago