Talent.com
Senior Data Engineer - GCP
Senior Data Engineer - GCPAuxoAI • Gulbarga, IN
No longer accepting applications
Senior Data Engineer - GCP

Senior Data Engineer - GCP

AuxoAI • Gulbarga, IN
17 hours ago
Job description

AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior engineers.

You’ll work closely with cross-functional teams to build production-grade pipelines using tools like BigQuery, Dataflow, Pub / Sub, Cloud Composer, and Dataform, enabling high-quality data delivery and analytics at scale.

Responsibilities :

  • Build and optimize batch and streaming data pipelines using Apache Beam (Dataflow)
  • Design and maintain BigQuery datasets using best practices in partitioning, clustering, and materialized views
  • Develop and manage Airflow DAGs in Cloud Composer for workflow orchestration
  • Implement SQL-based transformations using Dataform (or dbt)
  • Leverage Pub / Sub for event-driven ingestion and Cloud Storage for raw / lake layer data architecture
  • Drive engineering best practices across CI / CD, testing, monitoring, and pipeline observability
  • Partner with solution architects and product teams to translate data requirements into technical designs
  • Mentor junior data engineers and support knowledge-sharing across the team
  • Contribute to documentation, code reviews, sprint planning, and agile ceremonies

Requirements :

  • 5+ years of hands-on experience in data engineering, with at least 2 years on GCP
  • Proven expertise in BigQuery, Dataflow (Apache Beam), Cloud Composer (Airflow)
  • Strong programming skills in Python and / or Java
  • Experience with SQL optimization, data modeling, and pipeline orchestration
  • Familiarity with Git, CI / CD pipelines, and data quality monitoring frameworks
  • Exposure to Dataform, dbt, or similar tools for ELT workflows
  • Solid understanding of data architecture, schema design, and performance tuning
  • Excellent problem-solving and collaboration skills
  • Bonus Skills :

  • GCP Professional Data Engineer certification
  • Experience with Vertex AI, Cloud Functions, Dataproc, or real-time streaming architectures
  • Familiarity with data governance tools (e.g., Atlan, Collibra, Dataplex)
  • Exposure to Docker / Kubernetes, API integration, and infrastructure-as-code (Terraform)
  • Create a job alert for this search

    Senior Data Engineer • Gulbarga, IN

    Related jobs
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Gulbarga, IN
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    HCLTech • Gulbarga, IN
    Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
    Last updated: 28 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    PamTen Inc • Gulbarga, IN
    You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Gulbarga, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 6 days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Gulbarga, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Gulbarga, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    TerraGiG • Gulbarga, IN
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Senior Oracle Data Engineer

    Senior Oracle Data Engineer

    Strattek Consulting • Gulbarga, IN
    This role centers on architecting robust data pipelines across on-prem and cloud Oracle ecosystems, automating ingestion from varied sources including APIs. Exposure to Oracle FDI (Fusion Data Intel...Show more
    Last updated: 13 days ago • Promoted
    Senior AWS Cloud Engineer

    Senior AWS Cloud Engineer

    9NEXUS • Gulbarga, IN
    Job Title : Senior Cloud Engineer (Data Platform).Seeking an experienced Cloud Engineer to support Data Platform function by enabling feature teams with secure, scalable, and reusable AWS infrastruc...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Gulbarga, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Apache NiFi + GCP Data Engineer

    Freelance Apache NiFi + GCP Data Engineer

    ThreatXIntel • Gulbarga, IN
    ThreatXIntel is a startup cybersecurity company specializing in protecting businesses and organizations from cyber threats. We offer services including cloud security, web and mobile security testin...Show more
    Last updated: 17 hours ago • Promoted • New!
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Gulbarga, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 19 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellify Solutions • Gulbarga, IN
    Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show more
    Last updated: 19 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • Gulbarga, IN
    Primesoft Enterprise IT Services Pvt.APIs, analytics, AI and machine learning at scale.Products team, building and maintaining production-grade pipelines and platform components that power business...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)

    SkillsCapital • Gulbarga, IN
    Remote
    These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initi...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Gulbarga, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CXC • Gulbarga, IN
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • Gulbarga, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 20 days ago • Promoted