Data Pipeline ArchitectSkillsCapital • Republic Of India, IN
Data Pipeline Architect
SkillsCapital • Republic Of India, IN
19 hours ago
Job descriptionETL / ELT Developer Big Data Engineer (Spark / Hadoop / Databricks) Data Pipeline Engineer Data Platform Engineer Streaming Data Engineer (Kafka / Kinesis / Pub / Sub) Type : Independent Freelance Consultant Location : 100% Remote Duration : Initial 6–12 month contract (extendable to multi-year) Start Date : Immediate or within the next few weeks Clients : Global enterprises, SaaS companies, and cloud-first data teams Design and build scalable, reliable data pipelines using modern data engineering tools and frameworks. Develop ETL / ELT workflows for structured, semi-structured, and unstructured data. Implement data ingestion, transformation, storage, and processing solutions. Work with cloud-native data services (AWS Glue, Redshift, EMR, Azure Data Factory, Synapse, GCP BigQuery, Dataflow). Build batch and streaming data pipelines using Spark, Databricks, Kafka, or similar technologies. Optimize performance, cost, and reliability of data systems for large-scale deployments. Collaborate with analytics, BI, ML, and backend teams to deliver end-to-end data solutions. Ensure data quality, integrity, governance, and security across data workflows. Support CI / CD pipelines, version control, and automation related to data environments. Minimum 2 years of hands-on experience as a Data Engineer. Strong experience with Python or SQL (or both). Practical knowledge of data pipeline development using Spark, PySpark, or equivalent. Hands-on experience with one major cloud platform (AWS, Azure, or GCP). Understanding of data modeling, warehousing concepts, and distributed systems. Experience working with ETL / ELT tools or frameworks. Ability to work independently in a remote, distributed setup. Experience with Databricks or large-scale Spark clusters. Knowledge of streaming technologies (Kafka / Kinesis / Pub / Sub / Flink). Experience working with data lakes (S3, ADLS, GCS) and lakehouse architectures. Exposure to orchestration tools such as Airflow, Dagster, Prefect, or AWS Step Functions. Familiarity with containerization (Docker) and orchestration (Kubernetes). Experience integrating with BI, ML, or analytics platforms. Cloud certifications (AWS / Azure / GCP Data Engineer) are a plus. Large-scale, cloud-native data engineering projects. Multiple openings with fast-track onboarding. Fully remote with flexible working hours. Long-term freelance roles with consistent project work. Work with modern data stacks, lakehouse architectures, and global teams.
We are hiring multiple Data Engineers to join international data platform, analytics, and cloud engineering teams. These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initiatives.
Open Roles (Multiple Positions)
We are recruiting across core and specialized data engineering areas :
Core Data Engineering
- Data Engineer
- Senior Data Engineer
- Cloud Data Engineer (AWS / Azure / GCP)
Specialized Roles
If you have strong experience building data systems or pipelines, we encourage you to apply.
Engagement Details
Key Responsibilities
Minimum Qualifications
Preferred Skills
Why Join This Opportunity
How to Apply
Send your CV to careers@skillscapital.io
Create a job alert for this search
Data Pipeline Architect • Republic Of India, IN
Related jobs
Data Pipeline Architect
Randstad Enterprise • Republic Of India, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Tredence Inc. • Republic Of India, IN
IT experience and 7+ years' experience in SQL Server, SSIS, SQL, Python / C#, ETL, Streaming.Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL p...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
IntraEdge • Republic Of India, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
GCP Data Pipeline Architect
EXL • Pune, Republic Of India, IN
The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on experience using GCP-native tools.Dataflow, Dataproc, P...Show more
Last updated: 19 days ago • Promoted
Lead Data Pipeline Architect
Lear Corporation • Pune, Republic Of India, IN
Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
Last updated: 23 days ago • Promoted
Data Pipeline Architect
Solytics Partners • Pune, Republic Of India, IN
Solytics Partners is a Global Analytics firm, recognized with multiple industry awards for innovation and excellence.Our team comprises experts with deep knowledge in risk, analytics, AI / ML, AML / FC...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Kanerika Inc • Indore, Republic Of India, IN
Hyderabad, Indore and Ahmedabad (India).Develop and maintain data pipelines using Azure Data Factory (ADF) / Databricks for data integration and ETL processes.
Design, implement, and optimize Power B...Show more
Last updated: 25 days ago • Promoted
Data Pipeline Architect
NexionPro Services • Republic Of India, IN
PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
NielsenIQ • Chennai, Republic Of India, IN
Design, build, and optimize large-scale ETL and data-processing pipelines handling GB–TB volumes.Operate within the Databricks ecosystem and drive migration of selected workloads to high-performanc...Show more
Last updated: 14 days ago • Promoted
Data Pipeline Architect
HCLTech • Chennai, Republic Of India, IN
Senior Data Engineer – Vendor Experience : 6–12 Years.We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernete...Show more
Last updated: 14 days ago • Promoted
Data Pipeline Architect
Tata Consultancy Services • Pune, Republic Of India, IN
ETL / Python / SQL, and data visualization / exploration tools.Experience in building complex SQL queries.Familiarity with the Azure Databricks, Azure Data Factory.
Develops and maintains scalable data pi...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Mastek • Chennai, Republic Of India, IN
Work closely with our data science team to help build complex algorithms that provide unique insights into our data.Use agile software development processes to make iterative improvements to our ba...Show more
Last updated: 8 days ago • Promoted
Senior Data Pipeline Architect
Ascendion • Chennai, Republic Of India, IN
Job Description : Senior DBT Engineer (8–12 Years).Senior Data Engineer with strong ELT experience.Focus on building scalable, efficient, and well-governed DBT data models on modern cloud platforms.Show more
Last updated: 5 days ago • Promoted
Data Pipeline Architect
Lemongrass • Republic Of India, IN
Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Architect
Blend • Chennai, Republic Of India, IN
We are looking for an experienced.In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives.You’ll...Show more
Last updated: 5 days ago • Promoted
Lead Data Pipeline Architect
LanceSoft, Inc. • Republic Of India, IN
US working hours (Night Shift form india).This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-...Show more
Last updated: 7 days ago • Promoted
Lead Azure Data Pipeline Architect
All European Careers • Republic Of India, IN
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Last updated: 11 days ago • Promoted
Principal Data Pipeline Architect
Publicis Production • Republic Of India, IN
We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
Last updated: 5 days ago • Promoted