Senior Data Pipeline Architect

Data Engineer (onsite | Offshore | PST Overlap Required)

We’re looking for an experienced and independent Data Engineer with 1-5 years of experience to help us design and build data systems that are clean, scalable, and reusable. If you enjoy working with modern data tools, solving real-world data problems, and collaborating with a supportive and capable team, we’d love to connect. Immediate joiners required. A face-to-face interview is mandatory.

This is an On-site contractor role . You can be based offshore, but we ask for at least 3 hours of overlap with the Pacific Time Zone (PST), ideally available until at least 11 AM PST .

What You’ll Do

Build modular and scalable data pipelines that integrate data from multiple sources.

Analyze raw data and organize it based on business requirements.

Collaborate with data scientists, engineers, and application teams to design effective solutions.

Ensure that systems are reliable, reusable, and aligned with best practices.

Identify and address data gaps, quality issues, or discrepancies proactively.

Contribute to architectural discussions with a strong understanding of cloud-native patterns.

What We’re Looking For

Strong foundation in cloud-native application architecture .

Hands-on experience with both relational and non-relational databases , including understanding their trade-offs and design considerations.

Familiarity with API design and implementation .

Comfortable working independently and communicating clearly in a remote environment.

A solid grasp of software engineering principles , clean code practices, and system design.

Technical Skills

Python and Data Engineering

Proficient in Python , with a strong understanding of object-oriented programming, data structures, and algorithms.

Experience with Apache Spark and PySpark , especially using Azure Databricks for large-scale data processing.

Azure Cloud Platform

Practical experience with Azure services, including Function Apps, Blob Storage, DevOps, Networking, and Access Control.

Familiarity with Azure data services, such as :

Azure SQL Database

Azure Synapse Analytics

Azure Cosmos DB

Azure Database for PostgreSQL

Azure Data Lake Storage

Azure Data Factory (ADF) for orchestration and data integration

Database and SQL

Strong SQL skills, including querying, transforming, and managing data in relational databases.

Workflow and Orchestration

Familiarity with scheduling and orchestrating data pipelines using workflow tools.

Role Details

Type : Independent Contractor (Onsite) Full-time

Location : Hyderabad, India

Time Zone Requirement : Minimum 3 hours of overlap with PST (available until 11 AM PST)