This job offer is not available in your country.

Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

DautomChennai, IN

2 days ago

Job type

Remote

Job description

Job Description : Data Engineer (Big Data / Kafka)

We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.

Key Details :

Role : Data Engineer
Industry : Banking (Financial Services)
Work Location : Remote (India)
Contract Duration : 6 months initial contract (with a strong likelihood of extension to long-term)
Notice Period : 30 days or less
Note : This role is for professionals seeking a contract engagement, not for freelancers or independent contractors.

Key Responsibilities :

Technical Execution : Design, write, and tune complex data processing jobs using Java, MapReduce, Hive, and Spark.

Team Leadership & Management : Lead and mentor a team of data engineers (including full-time associates and vendor partners), ensuring project prioritization aligns with business needs. Remain hands-on with code and architecture.

Big Data Ecosystem Management : Work extensively across the Hadoop stack (HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL stores (e.g., Cassandra).

Data Modeling & BI : Design and build dimensional data models. Manage the business intelligence function, developing high-quality dashboards using industry best practices.

Data Integrity & Deployment : Analyze source data integrity and lead the deployment and auditing of data models and attributes for accuracy.

Stream Processing : Develop and maintain solutions using stream-processing systems like Spark-Streaming.

SQL & Performance Tuning : Demonstrate proficiency in writing and performance-tuning advanced SQL queries.

Required Skills & Qualifications :

Experience : 6-10+ years of proven experience as a Big Data Engineer.

Big Data Frameworks : In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.

Programming & Scripting : Strong expertise in Java. Experience with object-oriented / object function scripting languages like Python and Scala.

Querying Tools : Good knowledge of Big Data querying tools such as Pig, Hive, and Impala.

Databases : Experience with both relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).

Streaming Tech : Hands-on experience with stream-processing systems like Spark-Streaming or Storm.

Data Modeling : Proven experience in designing and building dimensional data models.

Leadership : Demonstrated experience leading a Backend / Distributed Data Systems team while remaining technically hands-on.

Preferred Skills (Pluses) :

Experience with Azure cloud services.

Knowledge of data science and machine learning tools and technologies.

Experience in the Financial Services / Banking industry.

Personal Attributes :

Able to effectively plan, organize, and own deliverables.

Strong interpersonal and communication skills.

Ability to solve complex networking, data, and software issues.

A collaborative team player who builds and maintains cooperative work relationships.

Create a job alert for this search

Big Data Engineer • Chennai, IN

Related jobs

Promoted

Data Engineer

Tata Consultancy ServicesChennai, Tamil Nadu, India

TCS is hiring for GCP data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Bengaluru / Chennai / Gurgaon. Skills Required - GCP BigQuery, Python.Hands-on experience in the ...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer – Snowflake & Python (Remote, India or EU)

Az-Tec TalentChennai, IN

Remote

Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 13 days ago

Promoted

Snowflake Data Engineer

Impactron Globalchennai, tamil nadu, in

We’re seeking a Snowflake Data Engineer / Sr Data Engineer passionate about building scalable, cloud-native data solutions using Snowflake, dbt, and modern ETL frameworks.You will design, implement...Show moreLast updated: 4 days ago

Promoted

Data Engineer - Matillion

TeamWare SolutionsChennai

Job Description : Key Responsibilities : - ETL Development & Optimiz...Show moreLast updated: 30+ days ago

Promoted

GCP Data Engineer

EXLChennai, IN

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 4 days ago

Promoted

GCP Data Engineer

Tata Consultancy ServicesChennai, Tamil Nadu, India

Chennai / Hyderabd / Bangalore / Pune / Gurgoan / Noida / NCR.Years of experience in IT industry in Planning, deploying, and configuring GCP based solutions. Mandatory to have knowledge of Big Data A...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

EXLChennai, Tamil Nadu, India

Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

Saransh Incchennai, tamil nadu, in

Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

InfogainChennai, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer - Big Data / Kafka

SMARTWORK IT SERVICESChennai

Position : Senior Data Engineer (ETL / Big Data / Streaming) Experience : 810 years Location : Onsite Hybder...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

SuperOpsChennai, Tamil Nadu, India

We are looking for a Data Engineer to design, build, and maintain scalable data infrastructure that powers analytics, reporting, and AI-driven initiatives. You will work with modern columnar databas...Show moreLast updated: 30+ days ago

Promoted

GCP Data Engineer

TEKsystemsChennai, IN

We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 27 days ago

Promoted

Data Engineer

Xebiachennai, tamil nadu, in

We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 24 days ago

Promoted

Freelance Data Engineer

upGradChennai, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 2 days ago

Promoted

Data Engineer

KaarTechChennai, Tamil Nadu, India

Data Pipeline Development : Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs. Data Integration : Integrate data from multiple sources and ens...Show moreLast updated: 12 days ago

Promoted

Data Engineer

V2Softchennai, tamil nadu, in

Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 4 days ago

Promoted

Data Engineer

IntraEdgeChennai, Tamil Nadu, India

Onsite / Hybrid (as applicable).We are looking for a highly skilled and motivated.The ideal candidate will have strong expertise in. DBT, Snowflake, CI / CD pipelines.This role requires individuals wi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

KeasisChennai, IN

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 4 days ago