This job offer is not available in your country.

Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

DautomTirupati, IN

2 days ago

Job type

Remote

Job description

Job Description : Data Engineer (Big Data / Kafka)

We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for a major project in the Banking sector.

Key Details :

Role : Data Engineer
Industry : Banking (Financial Services)
Work Location : Remote (India)
Contract Duration : 6 months initial contract (with a strong likelihood of extension to long-term)
Notice Period : 30 days or less
Note : This role is for professionals seeking a contract engagement, not for freelancers or independent contractors.

Key Responsibilities :

Technical Execution : Design, write, and tune complex data processing jobs using Java, MapReduce, Hive, and Spark.

Team Leadership & Management : Lead and mentor a team of data engineers (including full-time associates and vendor partners), ensuring project prioritization aligns with business needs. Remain hands-on with code and architecture.

Big Data Ecosystem Management : Work extensively across the Hadoop stack (HDFS, Pig, Hive, HBase, Flume, Sqoop) and NoSQL stores (e.g., Cassandra).

Data Modeling & BI : Design and build dimensional data models. Manage the business intelligence function, developing high-quality dashboards using industry best practices.

Data Integrity & Deployment : Analyze source data integrity and lead the deployment and auditing of data models and attributes for accuracy.

Stream Processing : Develop and maintain solutions using stream-processing systems like Spark-Streaming.

SQL & Performance Tuning : Demonstrate proficiency in writing and performance-tuning advanced SQL queries.

Required Skills & Qualifications :

Experience : 6-10+ years of proven experience as a Big Data Engineer.

Big Data Frameworks : In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.

Programming & Scripting : Strong expertise in Java. Experience with object-oriented / object function scripting languages like Python and Scala.

Querying Tools : Good knowledge of Big Data querying tools such as Pig, Hive, and Impala.

Databases : Experience with both relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).

Streaming Tech : Hands-on experience with stream-processing systems like Spark-Streaming or Storm.

Data Modeling : Proven experience in designing and building dimensional data models.

Leadership : Demonstrated experience leading a Backend / Distributed Data Systems team while remaining technically hands-on.

Preferred Skills (Pluses) :

Experience with Azure cloud services.

Knowledge of data science and machine learning tools and technologies.

Experience in the Financial Services / Banking industry.

Personal Attributes :

Able to effectively plan, organize, and own deliverables.

Strong interpersonal and communication skills.

Ability to solve complex networking, data, and software issues.

A collaborative team player who builds and maintains cooperative work relationships.

Create a job alert for this search

Big Data Engineer • Tirupati, IN

Related jobs

Promoted

Data Engineer

Magma ConsultancyTirupati, IN

Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 2 days ago

Promoted

Cloud Data Engineer

LemongrassTirupati, IN

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

AAA GlobalTirupati, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 4 days ago

Promoted

Data Engineer

XebiaTirupati, IN

We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 24 days ago

Promoted

Freelance Data Engineer

upGradTirupati, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 2 days ago

Promoted

Data Engineer

Insight GlobalTirupati, IN

REQUIRED SKILLS AND EXPERIENCE.Years of experience as a Data Engineer.Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow. Strong SQL experience (NoSQL, SQL, Postgres).Experience leading...Show moreLast updated: 30+ days ago

Promoted

Data Engineer_Immediate Joiners

VXI Global SolutionsTirupati, IN

VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 4 days ago

Promoted

GCP Data Engineer

TEKsystemsTirupati, IN

We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 26 days ago

Promoted

Data Engineer

Response InformaticsTirupati, IN

We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer – Snowflake & Python (Remote, India or EU)

Az-Tec TalentTirupati, IN

Remote

Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 12 days ago

Promoted

Data Engineer

Manuh TechnologiesTirupati, IN

S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Eucloid Data SolutionsTirupati, IN

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 26 days ago

Promoted

Big Data Developer

BayOne SolutionsTirupati, IN

We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 3 days ago

Promoted

Senior Data Engineer

InfogainTirupati, IN

Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Kumaran SystemsTirupati, IN

Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 26 days ago

Promoted

Data Engineer

Jade Business Services (JBS)Tirupati, IN

Data Engineer (AI Knowledge Base Platform).The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generatio...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

KeasisTirupati, IN

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 4 days ago

Promoted

GCP Data Engineer

EXLTirupati, IN

Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 4 days ago