No longer accepting applications

Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

DautomCoimbatore, IN

13 days ago

Job type

Remote

Job description

Job Description : Data Engineer (Big Data / Kafka)

We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.

Key Details :

Role : Data Engineer
Industry : Banking (Financial Services)
Work Location : Remote (India)
Contract Duration : 6 months initial contract (with a strong likelihood of extension to long-term)
Notice Period : 30 days or less
Note : This role is for professionals seeking a contract engagement, not for freelancers or independent contractors.

Key Responsibilities :

Technical Execution : Design, write, and tune complex data processing jobs using Java, MapReduce, Hive, and Spark.

Team Leadership & Management : Lead and mentor a team of data engineers (including full-time associates and vendor partners), ensuring project prioritization aligns with business needs. Remain hands-on with code and architecture.

Big Data Ecosystem Management : Work extensively across the Hadoop stack (HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL stores (e.g., Cassandra).

Data Modeling & BI : Design and build dimensional data models. Manage the business intelligence function, developing high-quality dashboards using industry best practices.

Data Integrity & Deployment : Analyze source data integrity and lead the deployment and auditing of data models and attributes for accuracy.

Stream Processing : Develop and maintain solutions using stream-processing systems like Spark-Streaming.

SQL & Performance Tuning : Demonstrate proficiency in writing and performance-tuning advanced SQL queries.

Required Skills & Qualifications :

Experience : 6-10+ years of proven experience as a Big Data Engineer.

Big Data Frameworks : In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.

Programming & Scripting : Strong expertise in Java. Experience with object-oriented / object function scripting languages like Python and Scala.

Querying Tools : Good knowledge of Big Data querying tools such as Pig, Hive, and Impala.

Databases : Experience with both relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).

Streaming Tech : Hands-on experience with stream-processing systems like Spark-Streaming or Storm.

Data Modeling : Proven experience in designing and building dimensional data models.

Leadership : Demonstrated experience leading a Backend / Distributed Data Systems team while remaining technically hands-on.

Preferred Skills (Pluses) :

Experience with Azure cloud services.

Knowledge of data science and machine learning tools and technologies.

Experience in the Financial Services / Banking industry.

Personal Attributes :

Able to effectively plan, organize, and own deliverables.

Strong interpersonal and communication skills.

Ability to solve complex networking, data, and software issues.

A collaborative team player who builds and maintains cooperative work relationships.

Create a job alert for this search

Big Data Engineer • Coimbatore, IN

Related jobs

Promoted

Freelance Data Engineer

upGradPalakkad, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 13 days ago

Promoted

Data Engineer

Randstad EnterpriseCoimbatore, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

GCP Data Engineer

EXLCoimbatore, IN

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 15 days ago

Promoted

Data Engineer

AAA GlobalCoimbatore, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 15 days ago

Promoted

Data Engineer

NAF Technology IndiaCoimbatore, Tamil Nadu, India

Do you love a Challenge? Are you Passionate about technology? Are you customer obsessed? Looking to innovate? Join NAF Tech! New American Funding (NAF) is a mortgage lender offering an array of loa...Show moreLast updated: 13 days ago

Promoted

Senior Data Engineer

SAIVA AICoimbatore, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Backend and Data Pipeline Engineer

JRD SystemsTiruppur, IN

Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeTiruppur, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted

Data Engineer_Immediate Joiners

VXI Global SolutionsTiruppur, IN

VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 15 days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsTiruppur, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RevXCoimbatore, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Sikich IndiaTiruppur, IN

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Insight GlobalTiruppur, IN

REQUIRED SKILLS AND EXPERIENCE.Years of experience as a Data Engineer.Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow. Strong SQL experience (NoSQL, SQL, Postgres).Experience leading...Show moreLast updated: 30+ days ago

Promoted

Python AWS Data Engineer

Digitrix Software LLPCoimbatore, IN

Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago

Promoted

Cloud Data Engineer

LemongrassPalakkad, IN

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response InformaticsPalakkad, IN

We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 15 days ago

Promoted

Data Engineer

VeraxionCoimbatore, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 5 days ago

Promoted

Data Engineer

Kline + CompanyPalakkad, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 30+ days ago