Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Orion InnovationChennai, Tamil Nadu, India
10 hours ago
Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

What you'll be doing :

  • Design, build, and deploy robust ETL and data management processes specifically for ingesting, transforming, and loading high-volume digital analytics data from Google Analytics 4 (GA4) into BigQuery / Snowflake.
  • Develop and optimize BigQuery / Snowflake datasets, tables, and views to support various analytical needs, ensuring efficient querying and data integrity.
  • Design, build, and deploy ETL job workflows with reliable error / exception handling and rollback frameworks. This includes designing and implementing data pipelines to feed data models for subsequent consumption.
  • Monitoring and optimizing data processing and storage resources, with a focus on performance and cost efficiency.
  • Troubleshooting and resolving data pipeline issues and performance bottlenecks, particularly those related to large-scale digital data processing.
  • Write complex, customized SQL queries to manipulate data, generate automatic periodic reports, and support ad-hoc analytical requests.
  • Build applications and scripts using Python to automate data processes, integrate systems, and enhance data quality.
  • Develop strategies for data ingestion (from multiple sources) into data platforms, using various extract and load techniques through scripting and / or tooling, streaming, API consumption, and replication.
  • Document data engineering processes, best practices, and technical specifications, especially for GA4 data models and BigQuery / Snowflake schemas.
  • Work collaboratively with Business Partner Teams and Business Stakeholders during project scoping and feasibility phases as a Subject Matter Expert (SME) for concept investigation / viability and technical impact; identify and communicate technical risks and mitigations.
  • Conform to agile development practices – Evolutionary design, refactoring, continuous integration / delivery, test-driven development.
  • Provide production support for data load jobs, ensuring the continuous flow of critical digital data. Actively monitor and resolve user support issues, working closely with your functional squad and other squads.
  • Maintain or upgrade existing data applications and pipelines.
  • Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project.
  • Attend key design meetings and provide support.
  • Perform research of viable technical and / or non-technical solutions.
  • Other ad hoc duties as required.

What you’ll need :

  • Education :  Minimum of a Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field preferred.
  • Experience :  8+ years of relevant experience in data warehousing, data modeling, and building data integration pipelines, including ingestion, integration, and ETL.
  • Engineer's Core Skills :

  • Proven experience in working with GA4 data, including understanding its data model, event-based tracking, and integration with BigQuery.
  • 6+ years of hands-on experience with Google BigQuery or Snowflake including advanced SQL techniques (CTEs, window functions, aggregate functions), schema design, and performance optimization.
  • 6+ years of hands-on experience with advanced SQL techniques (CTEs, window functions, aggregate functions).
  • 5+ years of strong experience in Python programming (object-oriented / functional programming, Pandas, PySpark).
  • 5+ years working with cloud platforms.
  • Experience designing star schemas, analyzing data warehouses, and applying data warehouse methodologies, particularly in the context of digital analytics data.
  • Essential experience in loading data into warehouse / ODS environments from diverse sources and formats. Design strategies for new data ingestion requests, including logical and physical data modeling.
  • Hands-on experience with version control and CI / CD pipelines for data engineering workflows.
  • Proven ability to perform unit testing (SQL scripts, ETL modules), integration testing, and performance / load / stress testing.
  • Tools & Technologies :

  • Cloud Platforms :  GCP (BigQuery, DataProc, DataFlow, CloudRun, Cloud Functions, Pub / Sub, etc.) or equivalent cloud platforms like AWS or Azure.
  • Data Platforms :  Snowflake.
  • ETL / Integration Tools :  AWS Glue, Fivetran.
  • Orchestration / Transformation Tools :  Alteryx or DBT (data build tool).
  • Version Control :  GitHub or similar repositories.
  • BI Tools (Bonus) :  Looker or Power BI tools for data consumption.
  • Other Web Analytics (Bonus) :  Experience with other web analytics platforms or marketing data sources.
  • Infrastructure as Code (Bonus) :  Terraform.
  • Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

    Candidate Privacy Policy

    Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This (“Notice”) explains :

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.
  • Your use of Orion services is governed by any applicable terms in this notice and our general .

    Create a job alert for this search

    Data Engineer • Chennai, Tamil Nadu, India

    Related jobs
    • Promoted
    • New!
    Data Engineer I

    Data Engineer I

    CBTSChennai, Tamil Nadu, India
    This program is responsible for developing reporting solutions for vulnerability management.Reporting of vulnerabilities is required for application and infrastructure owners to identify risks on t...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    FractalChennai, Tamil Nadu, India
    It's fun to work in a company where people truly BELIEVE in what they are doing!.If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using ...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    EpamChennai, Tamil Nadu, India
    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities.We embra...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer-Aws

    Data Engineer-Aws

    Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
    Design, develop, and maintain scalable data pipelines using.Work with large datasets to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.Build automa...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NielsenIQChennai, Tamil Nadu, India
    NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK,...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Analytics Engineer

    Data Analytics Engineer

    ValeoChennai, Tamil Nadu, India
    Valeo is a tech global company, designing breakthrough solutions to reinvent the mobility.We are an automotive supplier partner to automakers and new mobility actors worldwide.Our vision? Invent a ...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Cynosure Corporate SolutionsPerungudi, Tamil Nadu, India
    Design, develop, and maintain data pipelines for seamless data flow into Snowflake and other storage solutions.Implement ETL / ELT processes using DBT and orchestration tools (e.Collaborate with data...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Senior Data Platform Engineer / Data Engineer

    Senior Data Platform Engineer / Data Engineer

    Thompsons HR Consulting LLPChennai, Tamil Nadu, India
    Must be proficient in the major languages such as.Write elegant and maintainable code, and be comfortable with picking up new technologies. Proficient in working with distributed systems and have ex...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    TransUnionChennai, Tamil Nadu, India
    Data Pipeline Engineer at Orion project are embedded within our engineering teams and support the development and operation. We are looking for an individual to be part of an autonomous, cross-funct...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Anicalls (Pty) LtdChennai, Tamil Nadu, India
    Proactively partner with IT and research staff to maintain and renovate, as needed, the metadata across the data warehouse, research, reporting, and business intelligence environments to maintain c...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    BorgWarnerChennai, Tamil Nadu, India
    A senior data engineer supports data ingestion for rapid prototyping and experimentation in.The role will support both a traditional business intelligence function as. A senior data engineer takes o...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Trigent Software Private LimitedChennai, Tamil Nadu, India
    Looking profiles with 6-9 yrs experiences.Proficient in SQL and at least one programming language (Python, Java, or Scala). Experience with ETL tools and workflow orchestration (e.AWS Glue, Apache A...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Tazapay Pte LtdChennai, Tamil Nadu, India
    Tazapay is a cross border payment service provider.They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local e...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Sciera Inc. | Aroscop Inc.Chennai, Tamil Nadu, India
    The Data Engineer is a seasoned professional role and applies in-depth disciplinary knowledge, contributing to the development of new techniques and the improvement of processes and work-flow for t...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TaskUsChennai, Tamil Nadu, India
    TaskUs is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands.Levera...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Gainwell TechnologiesChennai, Tamil Nadu, India
    As Data Enginer at Gainwell, you can contribute your skills as we harness the power of technology to help our clients improve the health and well-being of the members they serve a communitys most v...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer Envista

    Data Engineer Envista

    Bahwan Cybertek GroupChennai, Tamil Nadu, India
    Design, develop, and maintain scalable data pipelines and ETL processes.Implement data solutions using Snowflake for data warehousing and analytics. Write efficient, reusable, and maintainable Pytho...Show moreLast updated: 10 hours ago
    • Promoted
    • New!
    Data Engineer I - FTC, Payfort

    Data Engineer I - FTC, Payfort

    ADCI MAA 15 SEZChennai, Tamil Nadu, India
    Want to participate in building the next generation of online payment system that supports multiple countries and payment methods?. Amazon Payment Services (APS) is a leading payment service provide...Show moreLast updated: 10 hours ago