This job offer is not available in your country.

RE & DevOps Engineer (Big Data & AI Platform) Contract Position | Global E-Commerce Leader | Bangalore

Prospance IncAgra, IN

1 day ago

Job description

About the Opportunity

We're partnering with a leading global e-commerce company to find an exceptional SRE & DevOps Engineer specializing in Big Data technologies. Join their AI Platform Team and power the data infrastructure that drives innovation for millions of users worldwide.

In this transformative role, you'll support cutting-edge AI platforms handling billion-plus-scale data pipelines, working alongside researchers, data scientists, and engineering teams in a purpose-driven, inclusive environment.

What You'll Do

Platform Operations & Support

Support next-generation AI architecture and big data infrastructure for research and engineering teams
Partner with vendors and infrastructure teams to ensure security and 99.999% service availability
Diagnose and resolve production issues in distributed data pipelines, including performance optimization
Provide technical support to internal customers and create comprehensive documentation

DevOps & Automation

Design and implement zero-downtime monitoring for highly available big data services

Build CI / CD pipelines for automated deployment and configuration of data platforms

Identify automation opportunities to streamline problem management and prevent issues

Develop operational standards for tools, versioning, source control, and deployment practices

Continuous Improvement

Drive customer service enhancements and recommend product improvements

Define engineering excellence and operational maturity standards

Conduct customer training and generate insights reports on technical issues

Accelerate team efficiency through automation, domain expertise, and knowledge sharing

What You Bring

Required Expertise

Should be having 5+ years of experience.

Strong software development skills in Java and Python with data structure, algorithm and production experience

Deep hands-on experience with Big Data technologies : Hadoop, Spark, Flink, Hive, HDFS

Expertise in data integration, bug fixing, and performance optimization for distributed systems

Cloud-native technologies : Kubernetes, Docker, Linux

DevOps proficiency : CI / CD pipelines, Jenkins, test automation

Data quality and governance experience

Excellent debugging and triaging capabilities

Preferred Skills

Building batch pipelines for billion-plus-scale embedding generation (text, image, video)

Experience with vector similarity search and vector databases

AI / ML data pipeline optimization

#SRE #DevOps #BigData #DataEngineering #Hadoop #Spark #Flink #Kubernetes #Python #Java #CloudEngineering #MLOps #Hiring #TechJobs #IndiaJobs #ContractRole

Create a job alert for this search

Big Data Engineer • Agra, IN

Related jobs

Promoted

Lead Data Engineer

Eucloid Data SolutionsAgra, IN

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 25 days ago

Promoted
New!

Contract role -Databricks Engineer

KPG99 INCAgra, IN

Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Python for data manipulation and automatio...Show moreLast updated: 6 hours ago

Promoted

Senior Data Engineer – Snowflake & Python (Remote, India or EU)

Az-Tec TalentAgra, IN

Remote

Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 11 days ago

Promoted
New!

Gen Ai - Engineer

Diligente TechnologiesAgra, IN

Hands-on experience with Generative AI (GenAI) and agent-based AI frameworks.Proficiency in backend programming languages such as Node. Strong knowledge of both SQL and NoSQL databases.Experience wi...Show moreLast updated: 6 hours ago

Promoted
New!

Gen AI Engineer

Greymatter InnovationzAgra, IN

Full-time / Onsite (or specify if hybrid / remote).Gen AI Engineer / Junior Consultant.The ideal candidate will possess strong expertise in. LLMs, RAG frameworks, LangChain, and Vector Databases.You w...Show moreLast updated: 6 hours ago

Promoted

Data Engineer (Big Data / Kafka) - Remote / Contract / NOT for freelancers / Independent Contractors

DautomAgra, IN

Remote

Job Description : Data Engineer (Big Data / Kafka).We are seeking a highly experienced Senior Data Engineer with a deep background in Big Data technologies to join our team. This is a contract role for...Show moreLast updated: 1 day ago

Promoted

Lead Engineer – AI-Powered Full Stack Solutions ( 5+ yrs)

AIMLEAPAgra, IN

Lead Engineer – AI-Powered Full Stack Solutions (WFH).Work from Home / Bangalore / India.Tech / MCA / Computer Science / IT. Proven expertise in delivering complex, cross-domain projects across AI, ...Show moreLast updated: 2 days ago

Promoted

AI Lead Engineer - Agentic Platforms

OrbitShift.AIAgra, IN

AI-native Sales Operating System.Our multi-agent AI system enables actionable account insights, RFP response generation, targeted nudges, and sales content. Peak XV (formerly Sequoia Capital), Stell...Show moreLast updated: 25 days ago

Promoted

Backend + AI Engineer

RiviAgra, IN

We build AI-first products across travel and beyond.We’re looking for a backend-builder passionate about scalable APIs, microservices, databases, and LLM integrations to power seamless, high-perfor...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Jade Business Services (JBS)Agra, IN

Data Engineer (AI Knowledge Base Platform).The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generatio...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

ATOM Systems Private LimitedAgra, IN

We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team.The ideal candidate combines strong leadership and technical expertise with the ability to deliver...Show moreLast updated: 2 days ago

Promoted

Senior AWS Data Engineer

CYAN360Agra, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago

Promoted

Principal Data Engineer

K&K Talents - IndiaAgra, IN

This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 2 days ago

Promoted

Data Engineer

Vriba SolutionsAgra, IN

Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 13 days ago

Promoted

Generative AI Engineer

VDart DigitalAgra, IN

Are you ready to build the next wave of AI-driven innovation?.We are looking for a passionate Generative AI Engineers to join our team and help design, develop, scale and deploy advanced AI solutio...Show moreLast updated: 2 days ago

Promoted
New!

Gen AI Engineer

People Prime WorldwideAgra, IN

They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by un...Show moreLast updated: 6 hours ago

Promoted

Senior Data Platform Engineer

Black Dog LabsAgra, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Data Platform Engineer

Intuitive.CloudAgra, IN

With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 23 days ago

Promoted

AI Engineer

Aventis SolutionsAgra, IN

Aventis Solutions is igniting the AI revolution : .Now, our tech partner is establishing a new.AI Innovation Hub in Pune, India. These roles are at the heart of enabling large-scale AI and GenAI adopt...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

KeasisAgra, IN

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 2 days ago