Senior Data Engineer
Adaptive Technology InsightsPrayagraj(Allahabad), IN7 hours ago
Job description7+ years of experience in Data Engineering or a related field. Strong hands-on experience with Google Cloud Platform (GCP) services, especially BigQuery and Kafka . Proficiency in SQL and at least one programming language like Python or Golang . Experience with data modeling, ETL / ELT processes, and building data pipelines. Experience with GCP tools like Cloud Dataflow , Pub / Sub , Cloud Composer , and Cloud Storage . Understanding of CI / CD practices and version control systems like Git. Strong problem-solving and communication skills. GCP Professional Data Engineer Certification. Experience with data lakes, streaming data, and real-time analytics. Exposure to other cloud platforms (AWS, Azure) is a plus.
About the Role :
We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) and BigQuery to join our growing data team. You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making across the organization.
Key Responsibilities :
- Design and implement scalable, reliable, and high-performance data pipelines on GCP.
- Build and maintain data warehouse solutions using BigQuery.
- Advanced skills in SQL , Python , Kafka and possibly Scala or Java .
- Develop ETL / ELT processes to ingest structured and unstructured data from multiple sources.
- Ability to make architectural decisions, optimize performance, and manage data security and governance.
- Collaborate with data analysts, data scientists, and business stakeholders to define data needs.
- Optimize query performance and manage data partitioning and clustering in BigQuery.
- Ensure data quality, governance, and security best practices.
- Monitor and troubleshoot pipeline performance and data flow issues.
- Work with tools such as Dataflow, Cloud Composer (Apache Airflow), Pub / Sub, and Cloud Storage.
Required Qualifications :
Preferred Qualifications :
Create a job alert for this search
Senior Data Engineer • Prayagraj(Allahabad), IN
Related jobs
- Promoted
- New!
Senior Data Engineer
TEKsystems Global Services in IndiaPrayagraj(Allahabad), IN Develop and manage data pipelines using ADF and Azure data bricks.Expert knowledge in data warehousing, data modeling and ETL.
Good to have datastage exposure.Expertise in on-prem to azure cloud mig...Show moreLast updated: 7 hours ago
Senior Data Engineer
Professional Search GroupAU PSG are proud to be partnering with a large-scale mining services organisation that plays a critical role in keeping goods and services moving across Australia.
With a rapidly growing customer base ...Show moreLast updated: 30+ days ago
- Promoted
Senior AWS Data Engineer
CYAN360Prayagraj(Allahabad), IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior DataOps Engineer (AWS)
MSBC GroupPrayagraj(Allahabad), IN Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 7 hours ago
Senior Data Engineer (Snowflake)
Redwolf + RoschAU We are seeking an experienced Senior Data Engineer who is passionate about automation and committed to building scalable, repeatable processes.
Your efforts will focus on optimising workflows and re...Show moreLast updated: 10 days ago
- Promoted
- New!
Sr Data Engineer
Futran SolutionsPrayagraj(Allahabad), IN Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show moreLast updated: 7 hours ago
- Promoted
Senior Data Platform Engineer
Black Dog LabsPrayagraj(Allahabad), IN Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps.
We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
- Promoted
- New!
Senior Data Engineer
FornaxPrayagraj(Allahabad), IN If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 6 hours ago
- Promoted
- New!
Senior Data Engineer
MindlancePrayagraj(Allahabad), IN We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 7 hours ago
Senior Data Engineer
Virgin AustraliaAU Step into an exhilarating journey with Velocity Frequent Flyer Virgin Australia’s award-winning loyalty program.We make rewards fast and meaningful — from dream holidays and upgrades to retail, fue...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
American InferencePrayagraj(Allahabad), IN Please apply directly through for this position.We kindly request that candidates refrain from contacting company officials via email or messages regarding this role.
We are an AI and Data Consulti...Show moreLast updated: 14 days ago
- Promoted
Senior Data Engineer
IntelliasPrayagraj(Allahabad), IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 16 days ago
- Promoted
Senior Data Engineer - Data Acquisition
InfoBeansPrayagraj(Allahabad), IN We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
DigitalzonePrayagraj(Allahabad), IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
- Promoted
- New!
Senior Data Engineer / Architect - Snowflake
Aezion, IncPrayagraj(Allahabad), IN We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling.
The ideal candidate will design ...Show moreLast updated: 7 hours ago
- Promoted
Senior Data Engineer
DonyatiPrayagraj(Allahabad), IN We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show moreLast updated: 2 days ago
- Promoted
- New!
Data Engineer
MyData Insights Pvt LtdPrayagraj(Allahabad), IN The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 7 hours ago
- Promoted
Senior Data Engineer
SAIVA AIPrayagraj(Allahabad), IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago