This job offer is not available in your country.

Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

DautomAurangabad, IN

1 day ago

Job type

Remote

Job description

Job Description : Data Engineer (Big Data / Kafka)

We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.

Key Details :

Role : Data Engineer
Industry : Banking (Financial Services)
Work Location : Remote (India)
Contract Duration : 6 months initial contract (with a strong likelihood of extension to long-term)
Notice Period : 30 days or less
Note : This role is for professionals seeking a contract engagement, not for freelancers or independent contractors.

Key Responsibilities :

Technical Execution : Design, write, and tune complex data processing jobs using Java, MapReduce, Hive, and Spark.

Team Leadership & Management : Lead and mentor a team of data engineers (including full-time associates and vendor partners), ensuring project prioritization aligns with business needs. Remain hands-on with code and architecture.

Big Data Ecosystem Management : Work extensively across the Hadoop stack (HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL stores (e.g., Cassandra).

Data Modeling & BI : Design and build dimensional data models. Manage the business intelligence function, developing high-quality dashboards using industry best practices.

Data Integrity & Deployment : Analyze source data integrity and lead the deployment and auditing of data models and attributes for accuracy.

Stream Processing : Develop and maintain solutions using stream-processing systems like Spark-Streaming.

SQL & Performance Tuning : Demonstrate proficiency in writing and performance-tuning advanced SQL queries.

Required Skills & Qualifications :

Experience : 6-10+ years of proven experience as a Big Data Engineer.

Big Data Frameworks : In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.

Programming & Scripting : Strong expertise in Java. Experience with object-oriented / object function scripting languages like Python and Scala.

Querying Tools : Good knowledge of Big Data querying tools such as Pig, Hive, and Impala.

Databases : Experience with both relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).

Streaming Tech : Hands-on experience with stream-processing systems like Spark-Streaming or Storm.

Data Modeling : Proven experience in designing and building dimensional data models.

Leadership : Demonstrated experience leading a Backend / Distributed Data Systems team while remaining technically hands-on.

Preferred Skills (Pluses) :

Experience with Azure cloud services.

Knowledge of data science and machine learning tools and technologies.

Experience in the Financial Services / Banking industry.

Personal Attributes :

Able to effectively plan, organize, and own deliverables.

Strong interpersonal and communication skills.

Ability to solve complex networking, data, and software issues.

A collaborative team player who builds and maintains cooperative work relationships.

Create a job alert for this search

Big Data Engineer • Aurangabad, IN

Related jobs

Promoted

Data Engineer

Xebiaaurangabad, maharashtra, in

We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 22 days ago

Promoted

GCP Data Engineer

EXLAurangabad, IN

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 2 days ago

Promoted

Lead Data Engineer

Eucloid Data SolutionsAurangabad, IN

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 25 days ago

Promoted

Senior Data Engineer

InfogainAurangabad, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

V2Softaurangabad, maharashtra, in

Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 2 days ago

Promoted

Data Engineer

Magma ConsultancyAurangabad, IN

Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 1 day ago

Promoted

Data Engineer

AAA GlobalAurangabad, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 2 days ago

Promoted

Freelance Data Engineer

upGradAurangabad, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 1 day ago

Promoted

Data Engineer

Kumaran SystemsAurangabad, IN

Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 25 days ago

Promoted

Senior Data Engineer – Snowflake & Python (Remote, India or EU)

Az-Tec TalentAurangabad, IN

Remote

Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 11 days ago

Promoted

Senior Data Engineer

Saransh Incaurangabad, maharashtra, in

Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 2 days ago

Promoted

Data Engineer

Vriba SolutionsAurangabad, IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 13 days ago

Promoted

Snowflake Data Engineer

Radiant Systems IncAurangabad, IN

Position : Snowflake Data Engineer.Need Strong Experience on Snowflake & SQL, ADF (Azure Data Factory), Microsoft MDS (Master Data Service). We are seeking a highly skilled and self-driven Data Engin...Show moreLast updated: 2 days ago

Promoted

Snowflake Data Engineer

Impactron Globalaurangabad, maharashtra, in

We’re seeking a Snowflake Data Engineer / Sr Data Engineer passionate about building scalable, cloud-native data solutions using Snowflake, dbt, and modern ETL frameworks.You will design, implement...Show moreLast updated: 2 days ago

Promoted

Data Engineer

KeasisAurangabad, IN

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 2 days ago

Promoted

GCP Data Engineer

TEKsystemsAurangabad, IN

We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 25 days ago

Promoted

Data Engineer

Manuh TechnologiesAurangabad, IN

S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response Informaticsaurangabad, maharashtra, in

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 13 days ago