Data Pipeline Architect
MerilVapi, Republic Of India, IN1 day ago
Job descriptionBuild streaming and event-driven data pipelines using Kafka, RabbitMQ, or similar systems. Design and manage scalable data lakes (e.G., Apache Hudi, Iceberg, Delta Lake) over Amazon Implement and optimize distributed databases such as Cassandra, MongoDB, ClickHouse, and Ensure data quality, monitoring, and observability across all data pipeline components. Work with query engines like Trino for federated data access. Manage data versioning and reproducibility using tools like DVC. Perform data migrations, query optimization, and system performance tuning. Collaborate with analytics, product, and AI teams to provide clean and well-structured datasets. Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. 1–2 years of experience as a Data Engineer or in a similar role. Strong proficiency in Python and SQL. Hands-on experience with ETL orchestration tools (Airflow, NiFi, Dagster). Familiarity with data lakes, streaming platforms, and distributed databases. Experience working with cloud / object storage (Amazon S3, MinIO). Knowledge of data governance, security, and pipeline observability. Experience with time-series databases (InfluxDB, TimescaleDB, QuestDB). Familiarity with graph databases (Neo4j, OrientDB, or RavenDB). Understanding of MLOps, feature stores, or data lifecycle automation. Exposure to Elasticsearch for indexing and search use cases. Experience in query performance tuning and data migration strategies.
Job Title : Data Engineer
Experience Required : Minimum 1–2 Years
Location : Vapi, Gujarat
Employment Type : Full-time
About the Role
We are seeking a skilled and motivated Data Engineer to join our growing technology team. The
role involves building and maintaining scalable, reliable, and secure data infrastructure to support
analytics, data-driven decision-making, and AI / ML pipelines.
You’ll work with diverse data types and modern data platforms to design efficient data pipelines and ensure smooth data flow across systems.
Key Responsibilities
- Design, develop, and maintain robust ETL / ELT pipelines for structured and unstructured data
using tools like Apache NiFi, Airflow, or Dagster.
S3 or MinIO.
ElasticSearch.
Must-Have Skills & Experience
Good-to-Have Skills
Create a job alert for this search
Data Pipeline Architect • Vapi, Republic Of India, IN
Related jobs
Thinkgrid Labs is at the forefront of innovation and technology.Our expert team of software engineers, architects, and UI / UX designers specialises in crafting bespoke web, mobile, cloud application...Show moreLast updated: 30+ days ago
- Promoted
Principal / Senior Data Architect
Aaysvapi, gujarat, in Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
- Promoted
Data Architect - Snowflake (Job Location : Kerala)
Reflections Info Systemsvapi, gujarat, in We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show moreLast updated: 16 days ago
- Promoted
- New!
Senior Data Architect
MacroHirevapi, gujarat, in Job Profile- Sr Data Architect.Type of job- Contract for 1 year (extendable).Data Architect will focus on efficiency, security, and performance.
Responsibilities include monitoring, optimization, tr...Show moreLast updated: 6 hours ago
- Promoted
GCP Data Architect
Tata Consultancy Servicesvapi, gujarat, in Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and consumption.Develop Data Pipelines...Show moreLast updated: 25 days ago
- Promoted
Enterprise Data Architect
DBiz.aivapi, gujarat, in You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale.
You will work closely with business stakeholders and tech...Show moreLast updated: 14 days ago
- Promoted
Senior Architect - Data
Quantiphivapi, gujarat, in Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quanti...Show moreLast updated: 30+ days ago
- Promoted
Backend and Data Pipeline Engineer
JRD Systemsvapi, gujarat, in Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
- Promoted
Senior Azure Data Engineer (Architect) - Pan India
Genpactvapi, gujarat, in We are seeking an experienced Azure Data & Analytics Architect with a strong background in delivery and excellent communication skills.
The ideal candidate will have experience and a proven track re...Show moreLast updated: 17 days ago
- Promoted
Azure Cloud Architect
Persistent Systemsvapi, gujarat, in We are seeking an experienced Azure Data Cloud Architect to design, implement, and optimize cutting-edge data solutions on Microsoft Azure.
You will collaborate with cross-functional teams to transl...Show moreLast updated: 25 days ago
- Promoted
- New!
Azure Data Architect
Programmers.iovapi, gujarat, in We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth.
Job Title : Azure Data Architect.Experience required : 15+ ...Show moreLast updated: 6 hours ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsvapi, gujarat, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
- Promoted
Freelance Data Engineer
upGradvapi, gujarat, in We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 23 days ago
- Promoted
Python Tech Lead / Sr Architect
G10Xvapi, gujarat, in Python Developer & Architect (AWS | Kafka | Integrations).We are seeking an experienced Technical Lead / Senior Python Developer & Architect with strong expertise in AWS, Kafka, and large-scale sys...Show moreLast updated: 1 day ago
- Promoted
Data Architect
CareerUS Solutionsvapi, gujarat, in The Data Architect is responsible for.This includes ensuring that data is.The role focuses on developing.Collaborate with software engineers, analysts, and stakeholders to understand data needs and...Show moreLast updated: 2 days ago
- Promoted
Data Architect
Tata Consultancy Servicesvapi, gujarat, in Role- Snowflake Data Architect.Cloud data warehouse technologies on Snowflake and AWS, Azure or GCP.At least one End-to-end Snowflake implementation is a must covering all aspects including archite...Show moreLast updated: 30+ days ago
- Promoted
Fabric Platform Data Architect (Remote)
Thinkgrid Labsvapi, gujarat, inRemote
- Promoted
Data Engineer
Recrovapi, gujarat, in Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Data Analyst
Adeptmindvapi, gujarat, in Our platform helps online retailers bridge the gap between online and offline conversion rates.Our technology uses deep learning and natural.
Our results speak for themselves.Search should be intuit...Show moreLast updated: 23 days ago