New Application : Need Immediate Joiner (5+Years Exp.)- Apache Kafka Data Engineer @ Pan India

E-SolutionsBengaluru, Republic Of India, IN

2 days ago

Job description

Job Title : Apache Kafka Data Engineer

Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune)

Employment : Permanent

Start Date : Immediate

Must Have Skills :

Streaming and Batch Data ingestion
Confluent Kafka connectors usage for CDC (Change Data Capture)
Databricks and Delta Live Tables
PySpark processing
Data load review- partial, duplicates etc
Cloud Platforms : Azure

Job Description-

5+ years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks.

Hands-on expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub.

Experience creating producers, consumers and topics and integrating them into downstream processing.

Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMS.

Experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption.

Proficiency in programming languages such as Python, Scala or Java and solid knowledge of SQL for data manipulation and transformation.

Cloud platform expertise. Experience with Azure or AWS services for data storage, compute and orchestration (e.G., ADLS, S3, Azure Data Factory, AWS Glue, Airflow, DBX, DLT).

Data modelling and warehousing. Knowledge of data Lakehouse architectures, Delta Lake, partitioning strategies and performance

Version control and DevOps. Familiarity with Git and CI / CD pipelines;

ability to automate deployment and manage infrastructure as code.

Ability to work with cross functional teams and articulate complex technical concepts to nontechnical stakeholders.

Create a job alert for this search

Immediate Joiner • Bengaluru, Republic Of India, IN

Related jobs

Promoted

Senior Data Engineer

TruecallerBengaluru, Karnataka, India

Hello, Truecaller is calling you from Bangalore, India! Ready to pick up?.Our goal is to make communication smarter, safer, and more efficient, while building trust across the world.With our roots ...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Intellify SolutionsBengaluru, IN

Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show moreLast updated: 8 days ago

Promoted

Senior Data Engineer

Tata Consultancy ServicesBengaluru, India

Required Technical Skill Set : Senior Data Engineer.Desired Experience Range : 7 - 12 yrs.Notice Period : Immediate to 90Days only. Location of Requirement : Bangalore.We are currently planning to do a...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Tredence Inc.Bengaluru, Karnataka, India

Location - Bangalore, Pune, Kolkata, Chennai, Gurgaon.Bachelor's and / or master’s degree in computer science or equivalent experience. IT experience and 3+ years' experience in Data warehouse / ETL pro...Show moreLast updated: 30+ days ago

Promoted

Azure Migration Lead - PAN India Location (Only Immedaite to 25 days Joiner Apply)

Tata Consultancy ServicesBengaluru, Karnataka, India

Total Exp : 10 to 15 Years Relevant Experience : Minimum 10 Years in Azure Core / Migration Location : PAN India We are looking for an experienced Azure Migration Lead to drive large-scale on-pr...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

Intelliashosur, tamil nadu, in

Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 17 days ago

Promoted

GCP Senior Data Engineer

Tata Consultancy ServicesBengaluru, Karnataka, India

Role- GCP Senior Data Engineer.Location- Hyderabad, Chennai, Bangalore, Kolkata, Mumbai.Data Integration, orchestration mechanism, ability to design BI solutions using Cloud Store, Big Query, Cloud...Show moreLast updated: 13 days ago

Promoted

Data Solution Architect(immediate joiners only) (10+yrs Exp candidates only)

Tata Consultancy ServicesBengaluru, Karnataka, India

TCS is hiring for skill Data Solution Architect at TCS PAN INDIA LOCATION.Design and manage ETL pipelines on cloud platforms (preference for AWS). Utilize tools like Airflow to orchestrate tasks and...Show moreLast updated: 5 days ago

Promoted

Product Owner – Immediate Joiners | Locations : Bangalore, Pune, Noida, Hyderabad

Happiest Minds TechnologiesBangalore, IN

Product Owner (Looking Immediate joiner).Location : Bangalore / Pune / Noida / Hyderabad.The Product Owner is a strategic leadership position accountable for shaping, prioritizing, and managing the ...Show moreLast updated: 1 day ago

Promoted

Ai Engineer(immediate joiners only)(10+ yrs exp candidates only)

Tata Consultancy ServicesBengaluru, Karnataka, India

TCS is hiring for skill Ai Engineer At TCS PAN INDIA location.Strong programming skills in Python.Expertise in machine learning is a must. In depth knowledge of various machine learning models and t...Show moreLast updated: 5 days ago

Promoted

Senior Data Engineer [T500-21405]

ADMBengaluru, Karnataka, India

We are one of the world’s largest nutrition companies and a global leader in human and animal nutrition.We unlock the power of nature to provide nourishing quality of life by transforming crops int...Show moreLast updated: 10 days ago

Promoted

New application : Need Immediate Joiner (5+Years exp.)- Apache Kafka Data Engineer @ Pan India

E-Solutionsbangalore, karnataka, in

Job Title : Apache Kafka Data Engineer.Location : Pan India (Bengalure, Chennai, Hyderabad, Gurugram, Mumbai, Pune).Streaming and Batch Data ingestion. Confluent Kafka connectors usage for CDC (Change...Show moreLast updated: 3 days ago

Promoted

Databricks Data Engineer- PAN India- Immediate joiners

Tredence Inc.Bengaluru, Karnataka, India

MUST HAVE Experience- 6 years to 8 years of total IT Experience Job location- Bengaluru, Chennai, Pune, Gurugram, Kolkata • In-depth technical knowledge of tools like Azure Data Factory, Databric...Show moreLast updated: 30+ days ago

Promoted

Flutter Developer | Immediate Joiner

5paisaBengaluru, Karnataka, India

India's fintech revolution, offering a comprehensive digital platform for retail investors and traders.With a commitment to democratizing financial services, 5paisa provides a suite of products inc...Show moreLast updated: 17 days ago

Promoted

Need Immediate Joiner (Minimum 6-8 Years exp.)- Informatica Metadata Consultant (EDC / CDGC) @ Pan India

E-Solutionsbangalore, karnataka, in

Job Title : Informatica Metadata Consultant (EDC / CDGC).Hands-on experience using Informatica's Enterprise Data Catalog (EDC) and Cloud Data Governance and Catalog (CDGC). Fair understanding of Infor...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

QuantiphiBengaluru, Karnataka, India

Senior Data Engineer (GCP Cloud).Mumbai, Bangalore, Trivandrum (Hybrid Only).Bachelor’s degree in Computer Science or similar field or equivalent work experience. Data Warehousing, Data Engineering ...Show moreLast updated: 30+ days ago

Promoted

Azure Data Engineer(Databricks, Datafactory) Immediate joiners

Tata Consultancy ServicesBengaluru, Karnataka, India

SQL(Azure), Data Vault, Azure Data Factory, Blob Storage, Azure Synapse, Pipelines, Delta Lake,Databricks.Python, Apache Spark, MS Fabric (Trained Knowledge or experience), Power BI.Experience with...Show moreLast updated: 17 days ago

Promoted

SDV Architecture and Middleware SME (Immediate Joiner)

PEM Technologies Pvt LtdBengaluru, Karnataka, India

PEM Technologies Pvt Ltd is a specialist consultancy of system architects, AI / ML engineers, and embedded software experts, supporting leading Tier-1s and OEMs with cutting-edge automotive intellige...Show moreLast updated: 17 days ago