Talent.com
Principal Data Platform Engineer
Principal Data Platform EngineerCostco IT • Hyderabad, Republic Of India, IN
Principal Data Platform Engineer

Principal Data Platform Engineer

Costco IT • Hyderabad, Republic Of India, IN
30+ days ago
Job description

About Costco Wholesale

Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.

About Costco Wholesale India

At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members’ experiences and make employees’ jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale.

Position Title : Staff, Data Engineer

Job Description :

Roles & Responsibilities :

  • Shape and drive enterprise-wide data architecture strategy : Define and evolve the long-term technical vision for scalable, resilient data infrastructure across multiple business units and domains.
  • Lead large-scale, cross-functional initiatives : Architect and guide the implementation of data platforms and pipelines that enable analytics, AI / ML, and BI at an organizational scale.
  • Pioneer advanced and forward-looking solutions : Introduce novel approaches in real-time processing, hybrid / multi-cloud, and AI / ML integration to transform how data is processed and leveraged across the enterprise.
  • Mentor and develop senior technical leaders : Influence Principal Engineers, Engineering Managers, and other Staff Engineers;

create a culture of deep technical excellence and innovation.

  • Establish cross-org technical standards : Define and enforce best practices for data modeling, pipeline architecture, governance, and compliance at scale.
  • Solve the most complex, ambiguous challenges : Tackle systemic issues in data scalability, interoperability, and performance that impact multiple teams or the enterprise as a whole.
  • Serve as a strategic advisor to executive leadership : Provide technical insights to senior executives on data strategy, emerging technologies, and long-term investments.
  • Represent the organization as a thought leader : Speak at industry events / conferences, publish thought leadership, contribute to open source and standards bodies, and lead partnerships with external research or academic institutions.
  • Technical Skills :

  • 15+ years of experience
  • Mastery of data architecture and distributed systems at enterprise scale : Deep experience in GCP .
  • Advanced programming and infrastructure capabilities : Expertise in writing database queries, Python, or Java, along with infrastructure-as-code tools like Terraform or Cloud Deployment Manager.
  • Leadership in streaming and big data systems : Authority in tools such as BigQuery, Dataflow, Dataproc, Pub / sub for both batch and streaming workloads.
  • Enterprise-grade governance and compliance expertise : Design and implement standards for data quality, lineage, security, privacy (e.G., GDPR, HIPAA), and auditability across the organization.
  • Strategic integration with AI / ML ecosystems : Architect platforms that serve advanced analytics and AI workloads (Vertex AI, TFX, MLflow).
  • Exceptional ability to influence across all levels : Communicate technical vision to engineers, influence strategic direction with executives, and drive alignment across diverse stakeholders.
  • Recognized industry leader : Demonstrated track record through conference presentations, publications, open-source contributions, or standards development.
  • Must Have Skills :

  • Deep expertise in data architecture, distributed systems, and GCP.
  • Python or Java, infrastructure-as-code (e.G. Terraform)
  • Big data tools : BigQuery(Expert level. Having experience on performance tuning and UDFs), Dataflow, Dataproc, Pub / Sub (batch + streaming)
  • Data governance, privacy, and compliance (e.G. GDPR, HIPAA)
  • Data modeling and architecture - level expert, have experience on hybrid architectures
  • SQL Skills level - Expert
  • Deep understanding of BigQuery, have experience on partitioning, clustering and performance optimizations
  • Experience on Cloud function, Composer and Cloud run, dataflow flex templates - should be able to write
  • Understanding of full concepts of cloud architecture.
  • Create a job alert for this search

    Data Platform Engineer • Hyderabad, Republic Of India, IN

    Related jobs
    Data Engineer – Databricks Platform

    Data Engineer – Databricks Platform

    Amicon Hub Services • Hyderabad, Telangana, India
    Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).Excellent problem-solving skills and the ability to work in a fast-paced environment.Familiar wi...Show more
    Last updated: 25 days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Hyderabad, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Hyderabad, Telangana, India
    Key Responsibilities : - Configure, deploy, and maintain Quantexa software on cloud platforms such as AWS, Azure, or Google Cloud. Design, implement, and optimize data pipelines and integration work...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer - Cloud FinOps [T500-20806]

    Principal Engineer - Cloud FinOps [T500-20806]

    ANSR • Hyderabad, Telangana, India
    ANSR is hiring for one of its clients.To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in ...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Solutions Engineer

    Principal Data Solutions Engineer

    EXL • Hyderabad, Republic Of India, IN
    AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena).Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions. Ensure high availability, scalabi...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ANSR • Hyderabad, Republic Of India, IN
    To Care for People on Life's Journey®.Together with our American Eagle regional partners, we offer thousands of flights daily to more than 350 destinations in more than 60 countries.American Airlin...Show more
    Last updated: 30+ days ago • Promoted
    Platform Engineer

    Platform Engineer

    EverestDX Inc • Hyderabad, Telangana, India
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show more
    Last updated: 14 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ValueLabs • Hyderabad, Republic Of India, IN
    As a Senior Data Engineer, you will be the lead architect and builder of the data backbone for our entire next-generation digital asset platform. Embedded within our "Agentic AI & Automation" squad,...Show more
    Last updated: 23 days ago • Promoted
    GenAI Lead Engineer (Investment Data Platforms)

    GenAI Lead Engineer (Investment Data Platforms)

    Vichara Technologies • Hyderabad, IN
    We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    One Tapp Consulting • Hyderabad, IN
    Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT.Python and standard data warehousing principles. Data Platform Management : Implement and manage data proce...Show more
    Last updated: 11 hours ago • Promoted • New!
    Principal Data Solutions Engineer

    Principal Data Solutions Engineer

    Genpact • Hyderabad, Republic Of India, IN
    Ready to build the future with AI?.At Genpact, we don’t just keep up with technology—we set the pace.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI G...Show more
    Last updated: 28 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    ValueMomentum • Hyderabad, Republic Of India, IN
    We are seeking a Senior Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves managing large volum...Show more
    Last updated: 27 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobile • Hyderabad, IN
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show more
    Last updated: 14 days ago • Promoted
    Cloud Platform Engineer

    Cloud Platform Engineer

    The Goodyear Tire & Rubber Company • Hyderabad, Telangana, India
    Proven experience building and scaling.Terraform, GitHub Actions, CI / CD pipelines.Salesforce platform integration.Experience Cloud, Data Cloud, APIs). Experience guiding multiple squads from.Experie...Show more
    Last updated: 30+ days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Saras Analytics • Hyderabad, Republic Of India, IN
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Principal Platform Engineer

    Principal Platform Engineer

    Scale Global Ventures • Hyderabad, Republic Of India, IN
    We are building the operating system that enables brands to expand and scale across global markets — integrating regulatory workflows, product launch and activation processes, and multi-market comm...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog Labs • Hyderabad, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Nike • hyderabad, telangana, in
    We are looking for a visionary principal engineer with a passion for building world-class.You thrive in a fast-paced, collaborative environment and have a proven track record of leading high-impact...Show more
    Last updated: 11 hours ago • Promoted • New!