Data Pipeline EngineerStaffingine LLC • Republic Of India, IN
Data Pipeline Engineer
Staffingine LLC • Republic Of India, IN
1 day ago
Job descriptionS3, Glue, Lambda, Redshift, Aurora Kinesis (real-time streaming) DynamoDB (NoSQL databases) AWS serverless architecture design Integration of AWS managed services for data workflows Building event-driven pipelines using AWS Lambda Serverless compute optimization Automated triggering and orchestration of data processes Designing schemas for relational databases (OLTP / OLAP) NoSQL data modeling and storage optimization Understanding of normalization, partitioning, indexing AWS monitoring tools (CloudWatch, CloudTrail) Pipeline performance tuning Cost optimization across cloud resources Cross-functional collaboration with analysts, data scientists, and engineering teams Strong problem-solving, documentation, and communication skills Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field (preferred). Strong hands-on experience with Python for data engineering tasks. Deep understanding of AWS cloud services used for data storage, streaming, ETL, and serverless compute. Experience designing and implementing ETL / ELT pipelines . Solid understanding of relational and NoSQL data modeling concepts. Proven experience building scalable data pipelines using Python. Experience extracting and transforming data from diverse sources into cloud-based environments. Hands-on experience with AWS services such as S3, Glue ETL, Lambda, Redshift / Aurora, Kinesis, and DynamoDB. Demonstrated ability to design and implement serverless architectures. Experience creating event-driven workflows using Lambda and other AWS triggers. Strong experience in monitoring, debugging, and optimizing cloud-based data workflows. Experience collaborating across data science, analytics, and engineering teams to deliver complete data solutions.
Data Engineer
India, Remote
Full Time / Contract
# of Positions - 3
Job Summary
The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL / ELT processes, and deep hands-on experience with AWS cloud services such as S3, Glue, Lambda, Redshift, Kinesis, and DynamoDB. The ideal candidate will excel in building serverless data architectures, designing efficient data models, and ensuring robust pipeline performance through monitoring and optimization. The position is remote within India and open for both full-time and contract engagements.
Key Skills
Data Engineering & Pipelines
- ETL / ELT pipeline development using Python
- Data extraction, transformation, and loading into data lakes / warehouses
- Workflow orchestration and automation
- Real-time and batch data processing
AWS Cloud Expertise
Serverless & Automation
Data Modeling
Monitoring & Optimization
Collaboration & Communication
Minimum Qualifications
Professional Experience Requirements
Create a job alert for this search
Data Pipeline Engineer • Republic Of India, IN
Related jobs
Senior Data Pipeline Engineer
HNR Tech • Republic Of India, IN
We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
Last updated: 6 days ago • Promoted
Data Pipeline Engineer
Atica Global • Pune, Republic Of India, IN
Atica is a leading, tech-first remote sales & revenue management company for Hotels and Hotel operators in the US, enabled by a unified tech-led solution.
We are a startup, funded by the top investo...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
Tech Mahindra • Pune, Republic Of India, IN
Familiarity with other ETL tools (Stitch, Talend, Informatica).REST APIs for custom connectors).Show more
Last updated: 3 days ago • Promoted
Data Pipeline Engineer
Theron Solutions • Chennai, Republic Of India, IN
We are seeking a highly skilled ETL Developer with 5–8 years of experience in data integration, transformation, and pipeline optimization.
This role is a key part of our Data Engineering function wi...Show more
Last updated: 2 days ago • Promoted
Senior Data Pipeline Engineer
EXL • Chennai, Republic Of India, IN
Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation...Show more
Last updated: 4 days ago • Promoted
Data Pipeline Engineer
IntraEdge • Republic Of India, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
Luxoft • Chennai, Republic Of India, IN
This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.
The goal is to enhance data access...Show more
Last updated: 3 days ago • Promoted
Lead Data Pipeline Engineer
Eucloid Data Solutions • Chennai, Republic Of India, IN
Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show more
Last updated: 21 days ago • Promoted
Data Pipeline Engineer
UST • Pune, Republic Of India, IN
The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
EXL • Pune, Republic Of India, IN
DWH / ETL Developer : Strong experience in ETL development and data warehousing (SQL, Informatica).Responsibilities for Candidates.
Design, develop, and maintain ETL workflows ( Informatica ).Optimize ...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
Jaipur Living • Jaipur, Republic Of India, IN
At Jaipur Living, we blend time-honored craftsmanship with modern design to create luxurious rugs and home decor.Headquartered in Acworth, Georgia, we serve global customers with a mission-driven a...Show more
Last updated: 6 days ago • Promoted
Lead Data Pipeline Engineer
MakeMyTrip • Republic Of India, IN
At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
Last updated: 24 days ago • Promoted
Data Pipeline Engineer (GCP)
Capgemini Invent • Pune, Republic Of India, IN
At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
Last updated: 2 days ago • Promoted
Data Pipeline Engineer
HCLTech • Pune, Republic Of India, IN
We’re Expanding Our Digital & Data Talent Pool.Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring i...Show more
Last updated: 6 days ago • Promoted
Data Pipeline Engineer
Yubi • Republic Of India, IN
As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show more
Last updated: 30+ days ago • Promoted
Senior Data Pipeline Engineer
VXI Global Solutions • Republic Of India, IN
We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success.
As a Data Engineer at VXI Glo...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer
System Soft Technologies • Republic Of India, IN
Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
Last updated: 4 days ago • Promoted
Data Pipeline Engineer
Grantify • Republic Of India, IN
Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem.
By aligning student budgets and academic aspirat...Show more
Last updated: 1 hour ago • Promoted • New!