No longer accepting applications
Senior Data Engineer
Insight Globalaligarh, uttar pradesh, in10 days ago
Job descriptionStrong experience building production-grade ETL / ELT pipelines processing terabyte-scale data Knowledge of data integration patterns (full refresh, incremental load, change data capture) Experience with data transformation techniques (normalization, denormalization, aggregation) Understanding of data quality frameworks and validation strategies Proficiency with schema evolution handling changes without breaking downstream systems Experience with data lineage tracking from source to consumption Expert-level SQL skills including advanced analytics functions and query optimization Understanding of database performance tuning (indexing, partitioning, query plans) Experience with relational databases (PostgreSQL, MySQL, SQL Server) for source system integration Familiarity with NoSQL databases (Firestore, Bigtable) for specialized use cases Knowledge of data warehousing concepts (fact tables, dimension tables, slowly changing dimensions) Strong Python proficiency for data pipeline development and scripting Experience with Apache Beam SDK for Dataflow pipeline development Proficiency with Pandas, NumPy for data manipulation and analysis Understanding of object-oriented programming and software engineering best practices Experience with Git for version control and collaborative development Basic Shell scripting for automation and operational tasks Understanding of row-level security implementation patterns in BigQuery Experience with PHI / PII data handling and healthcare compliance requirements (HIPAA preferred) Knowledge of data masking and de-identification techniques Understanding of audit logging and compliance reporting requirements Familiarity with least privilege principles and data access controls Google Cloud Professional Data Engineer certification Healthcare industry experience with understanding of clinical and administrative data Experience with Google Cloud Storage lifecycle policies and storage class optimization Knowledge of Cloud Spanner for transactional workloads Familiarity with Cloud DLP API for automated data classification Experience with dbt (data build tool) for analytics engineering Understanding of data mesh or data fabric architectural patterns Background in DevOps practices and CI / CD for data pipelines Experience with Terraform for infrastructure as code Knowledge of data visualization tools (Looker, Tableau, Power BI) Familiarity with machine learning workflows on GCP (Vertex AI) Experience with Docker and Kubernetes (GKE) for containerized workloads
Summary
The Senior Data Engineer is responsible for building and optimizing ETL / ELT pipelines that process terabytes of data daily across 186 data assets, implementing BigQuery datasets with enterprise-scale performance optimization, and creating the data quality monitoring and transparency dashboards that enable data owner self-service.
Required Qualifications
Google Cloud Platform Data Engineering
- 5+ years of data engineering experience with at least 2+ years focused on Google Cloud Platform
- Strong proficiency with BigQuery including :
- Advanced SQL for analytical queries (window functions, CTEs, complex joins)
- Partitioning and clustering strategies for performance optimization
- Materialized views, authorized views, and query optimization techniques
- Cost optimization through efficient query design and storage management
- Understanding of BigQuery architecture (slot allocation, shuffle operations, distributed execution)
- Hands-on experience with Google Cloud Dataflow and Apache Beam :
- Pipeline development in Python or Java
- Batch and streaming data processing patterns
- Performance tuning and resource optimization
- Error handling and pipeline monitoring
- Proficiency with Cloud Composer (Apache Airflow) :
- DAG development and dependency management
- Airflow operators (BigQueryOperator, DataflowOperator, custom operators)
- Workflow orchestration for complex multi-step processes
- Monitoring and troubleshooting failed workflows
ETL / ELT & Data Integration
SQL & Database Technologies
Programming & Scripting
Data Security & Compliance
Preferred Qualifications
Create a job alert for this search
Senior Data Engineer • aligarh, uttar pradesh, in
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
RecroAligarh, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SAIVA AIAligarh, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
MindlanceAligarh, IN We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 3 days ago
- Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European CareersAligarh, INRemote
- Promoted
Senior Data Engineer
IntelliasAligarh, IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 19 days ago
- Promoted
Senior Oracle Data Engineer
Strattek ConsultingAligarh, IN This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs.
Exposure to Oracle FDI (Fusion Data Intel...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
MyData Insights Pvt LtdAligarh, IN The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 3 days ago
- Promoted
Senior Data Engineer
Intellify SolutionsAligarh, IN Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a.
Required : Cloud Data Warehouse experi...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Randstad EnterpriseAligarh, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
DigitalzoneAligarh, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 19 days ago
- Promoted
Senior Data Engineer
Live ConnectionsAligarh, IN Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced.
The ideal candidate will have deep experience in.Python, SQL...Show moreLast updated: 30+ days ago
- Promoted
Sr. Data Engineer
HNR TechAligarh, IN We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show moreLast updated: 11 days ago
- Promoted
Data Engineer
BayOne SolutionsAligarh, IN We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
DataOrbit AIaligarh, uttar pradesh, in DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness.
By uniting strategy, data preparation, technology, and execution, w...Show moreLast updated: less than 1 hour ago
- Promoted
Senior Data Engineer
DonyatiAligarh, IN We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
Insight GlobalAligarh, IN GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
K&K Talentsaligarh, uttar pradesh, in This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai.
Tableau | ETL / ELT | SQL | Python | Snow...Show moreLast updated: 1 hour ago
- Promoted
Senior Data Engineer - Data Acquisition
InfoBeansAligarh, IN We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 11 days ago