This job offer is not available in your country.

Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

DautomMysore, IN

3 days ago

Job type

Remote

Job description

Job Description : Data Engineer (Big Data / Kafka)

We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.

Key Details :

Role : Data Engineer
Industry : Banking (Financial Services)
Work Location : Remote (India)
Contract Duration : 6 months initial contract (with a strong likelihood of extension to long-term)
Notice Period : 30 days or less
Note : This role is for professionals seeking a contract engagement, not for freelancers or independent contractors.

Key Responsibilities :

Technical Execution : Design, write, and tune complex data processing jobs using Java, MapReduce, Hive, and Spark.

Team Leadership & Management : Lead and mentor a team of data engineers (including full-time associates and vendor partners), ensuring project prioritization aligns with business needs. Remain hands-on with code and architecture.

Big Data Ecosystem Management : Work extensively across the Hadoop stack (HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL stores (e.g., Cassandra).

Data Modeling & BI : Design and build dimensional data models. Manage the business intelligence function, developing high-quality dashboards using industry best practices.

Data Integrity & Deployment : Analyze source data integrity and lead the deployment and auditing of data models and attributes for accuracy.

Stream Processing : Develop and maintain solutions using stream-processing systems like Spark-Streaming.

SQL & Performance Tuning : Demonstrate proficiency in writing and performance-tuning advanced SQL queries.

Required Skills & Qualifications :

Experience : 6-10+ years of proven experience as a Big Data Engineer.

Big Data Frameworks : In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.

Programming & Scripting : Strong expertise in Java. Experience with object-oriented / object function scripting languages like Python and Scala.

Querying Tools : Good knowledge of Big Data querying tools such as Pig, Hive, and Impala.

Databases : Experience with both relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).

Streaming Tech : Hands-on experience with stream-processing systems like Spark-Streaming or Storm.

Data Modeling : Proven experience in designing and building dimensional data models.

Leadership : Demonstrated experience leading a Backend / Distributed Data Systems team while remaining technically hands-on.

Preferred Skills (Pluses) :

Experience with Azure cloud services.

Knowledge of data science and machine learning tools and technologies.

Experience in the Financial Services / Banking industry.

Personal Attributes :

Able to effectively plan, organize, and own deliverables.

Strong interpersonal and communication skills.

Ability to solve complex networking, data, and software issues.

A collaborative team player who builds and maintains cooperative work relationships.

Create a job alert for this search

Big Data Engineer • Mysore, IN

Related jobs

Promoted

Freelance Data Engineer

upGradMysore, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 3 days ago

Promoted

Data Engineer

KeasisMysore, IN

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 4 days ago

Promoted

GCP Data Engineer

EXLMysore, IN

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 4 days ago

Promoted

Data Engineer

AAA GlobalMysore, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 4 days ago

Promoted

Data Engineer

Jade Business Services (JBS)Mysore, IN

Data Engineer (AI Knowledge Base Platform).The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generatio...Show moreLast updated: 30+ days ago

Promoted

Data Engineer_Immediate Joiners

VXI Global SolutionsMysore, IN

VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 4 days ago

Promoted

SAP Data Engineer (Datasphere)

KPG99 INCMysore, IN

Duration : 12-month contract with extensions.Candidates' Core Skillset Must Be : .SAP ABAP, HANA / AMDP / CDS, SOAP / OData / Rest API’s etc.Show moreLast updated: 2 days ago

Promoted

GCP Data Engineer

TEKsystemsMysore, IN

We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 27 days ago

Promoted

Data Engineer

Manuh TechnologiesMysore, IN

S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

EveriseMysore, IN

Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 26 days ago

Promoted

Data Engineer

Digivance SolutionsMysore, IN

Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR.Collaborate with business and technology stakeholders to understand current and future data requirements. Design, build, and maintain reliable,...Show moreLast updated: 24 days ago

Promoted

Data Engineer

XebiaMysore, IN

We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 25 days ago

Promoted

Senior Data Engineer

InfogainMysore, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted
New!

Data Engineer

OWOWMysore, IN

Data Architecture & Infrastructure (40%) .Design and implement a multi-database architecture (MongoDB, Redis, Milvus, Neo4j, BigQuery) . Build scalable data pipelines for real-time conversation proc...Show moreLast updated: 7 hours ago

Promoted

Big Data Developer

BayOne SolutionsMysore, IN

We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 4 days ago

Promoted

Data Engineer

TalogyMysore, IN

This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response InformaticsMysore, IN

We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 4 days ago

Promoted

Data Engineer

Insight GlobalMysore, IN

REQUIRED SKILLS AND EXPERIENCE.Years of experience as a Data Engineer.Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow. Strong SQL experience (NoSQL, SQL, Postgres).Experience leading...Show moreLast updated: 30+ days ago