RE & DevOps Engineer (Big Data & AI Platform) Contract Position | Global E-Commerce Leader | Bangalore

Prospance IncBangalore Urban, Karnataka, India

4 days ago

Job description

About the Opportunity

We're partnering with a leading global e-commerce company to find an exceptional SRE & DevOps Engineer specializing in Big Data technologies. Join their AI Platform Team and power the data infrastructure that drives innovation for millions of users worldwide.

In this transformative role, you'll support cutting-edge AI platforms handling billion-plus-scale data pipelines, working alongside researchers, data scientists, and engineering teams in a purpose-driven, inclusive environment.

What You'll Do

Platform Operations & Support

Support next-generation AI architecture and big data infrastructure for research and engineering teams
Partner with vendors and infrastructure teams to ensure security and 99.999% service availability
Diagnose and resolve production issues in distributed data pipelines, including performance optimization
Provide technical support to internal customers and create comprehensive documentation

DevOps & Automation

Design and implement zero-downtime monitoring for highly available big data services

Build CI / CD pipelines for automated deployment and configuration of data platforms

Identify automation opportunities to streamline problem management and prevent issues

Develop operational standards for tools, versioning, source control, and deployment practices

Continuous Improvement

Drive customer service enhancements and recommend product improvements

Define engineering excellence and operational maturity standards

Conduct customer training and generate insights reports on technical issues

Accelerate team efficiency through automation, domain expertise, and knowledge sharing

What You Bring

Required Expertise

Should be having 5+ years of experience.

Strong software development skills in Java and Python with data structure, algorithm and production experience

Deep hands-on experience with Big Data technologies : Hadoop, Spark, Flink, Hive, HDFS

Expertise in data integration, bug fixing, and performance optimization for distributed systems

Cloud-native technologies : Kubernetes, Docker, Linux

DevOps proficiency : CI / CD pipelines, Jenkins, test automation

Data quality and governance experience

Excellent debugging and triaging capabilities

Preferred Skills

Building batch pipelines for billion-plus-scale embedding generation (text, image, video)

Experience with vector similarity search and vector databases

AI / ML data pipeline optimization

#SRE #DevOps #BigData #DataEngineering #Hadoop #Spark #Flink #Kubernetes #Python #Java #CloudEngineering #MLOps #Hiring #TechJobs #IndiaJobs #ContractRole

Create a job alert for this search

Big Data Engineer • Bangalore Urban, Karnataka, India

Related jobs

Promoted

Lead Engineer – AI-Powered Full Stack Solutions ( 5+ yrs)

AIMLEAPBengaluru, IN

Lead Engineer – AI-Powered Full Stack Solutions (WFH).Work from Home / Bangalore / India.Tech / MCA / Computer Science / IT. Proven expertise in delivering complex, cross-domain projects across AI, ...Show moreLast updated: 8 days ago

Promoted

Senior AWS Data Engineer

CYAN360hosur, tamil nadu, in

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Snowflake Data Engineer

Impactron Globalhosur, tamil nadu, in

We’re seeking a Snowflake Data Engineer / Sr Data Engineer passionate about building scalable, cloud-native data solutions using Snowflake, dbt, and modern ETL frameworks.You will design, implement...Show moreLast updated: 8 days ago

Promoted

GenAI Lead Engineer (Investment Data Platforms)

Vichara Technologiesbangalore, karnataka, in

We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago

Promoted

Senior Data Platform Engineer

Black Dog Labshosur, tamil nadu, in

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Data Engineering Lead (Snowflake)_ Vice President _Data & Analytics Engineering

Morgan StanleyBangalore, India

Data Engineering Lead (Snowflake)_ Vice President _Data & Analytics Engineering.We're seeking someone to join our team as Data Analytics Engineer will be a part of our FRPPE- FinTech team, to will ...Show moreLast updated: 1 day ago

Promoted

Gen AI Engineer - Enterprise Search

WhatfixBengaluru, Karnataka, India

Founded in 2014 by Khadim Batti and Vara Kumar, Whatfix is a leading global B2B SaaS provider and the largest pure-play enterprise digital adoption platform (DAP). Whatfix empowers companies to maxi...Show moreLast updated: 27 days ago

Promoted

Gen Ai - Engineer

Diligente TechnologiesBangalore, IN

Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 5 days ago

Promoted

Senior / Lead AI Engineer

Tiger AnalyticsBengaluru, Karnataka, India

Location : Chennai, Bangalore, Hyderabad.Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics s...Show moreLast updated: 30+ days ago

Promoted

Data Engineer(Snowflake & Talend)_Director_Software Engineering

Morgan StanleyBangalore, India

We're seeking someone to join our team as (Director) Senior Data Engineer for the modernization of tooling enablement function. As a Senior Data Engineer, you will be responsible for design, modelli...Show moreLast updated: 1 day ago

Promoted

Data Platform Engineer

Intuitive.Cloudhosur, tamil nadu, in

With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 28 days ago

Promoted

Lead AI Engineer

Capital OneBangalore, India

Voyager (94001), India, Bangalore, Karnataka.At Capital One India, we work in a fast paced and intellectually rigorous environment to solve fundamental business problems at scale.Using advanced ana...Show moreLast updated: 1 day ago

Promoted

Senior Google Cloud Engineer - Vice President - Data & Analytics Engineering

Morgan StanleyBangalore, India

Senior Google Cloud Engineer - Vice President - Data & Analytics Engineering.We're seeking someone to join our team as (Vice President) as a Senior Google Cloud Engineer to join our dynamic ENS Clo...Show moreLast updated: 1 day ago

Promoted

Cloud Data and AI Engineer, AVP

Deutsche BankBangalore, India

We are seeking an experienced Cloud (GCP) Data and AI engineer to play a key role in development and implementation of AI and Data engineering solutions. Candidate will work as an Engineering Team m...Show moreLast updated: 1 day ago

Promoted

Lead Data Platform Optimization & Intelligence Engineer (Snowflake / Databricks)

FinOpslyBengaluru, Karnataka, India

AI brain behind cost decisions across .Purpose-built for today’s complex enterprise environments, we .FinOps across AWS, Azure, Snowflake, Databricks, and modern AI workloads — enabling organizatio...Show moreLast updated: 7 days ago

Promoted

AI - Lead Founding Engineer

BPMLinksbangalore district, karnataka, in

Deep experience with LLMs, embeddings, vector search, knowledge graphs, and RAG / GraphRAG pipelines.Strong programming expertise in Python (LangChain, Haystack, FastAPI), and modern backend framewor...Show moreLast updated: 6 days ago

Promoted

Lead Data Engineer

ITQube LTDhosur, tamil nadu, in

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 18 days ago

Promoted

Senior Data Engineer – Snowflake & Python (Remote, India or EU)

Az-Tec Talenthosur, tamil nadu, in

Remote

Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 16 days ago