Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

Orion Innovationchennai, India
18 hours ago
Job description

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

What you'll be doing :

  • Design, build, and deploy robust ETL and data management processes specifically for ingesting, transforming, and loading high-volume digital analytics data from Google Analytics 4 (GA4) into BigQuery / Snowflake.
  • Develop and optimize BigQuery / Snowflake datasets, tables, and views to support various analytical needs, ensuring efficient querying and data integrity.
  • Design, build, and deploy ETL job workflows with reliable error / exception handling and rollback frameworks. This includes designing and implementing data pipelines to feed data models for subsequent consumption.
  • Monitoring and optimizing data processing and storage resources, with a focus on performance and cost efficiency.
  • Troubleshooting and resolving data pipeline issues and performance bottlenecks, particularly those related to large-scale digital data processing.
  • Write complex, customized SQL queries to manipulate data, generate automatic periodic reports, and support ad-hoc analytical requests.
  • Build applications and scripts using Python to automate data processes, integrate systems, and enhance data quality.
  • Develop strategies for data ingestion (from multiple sources) into data platforms, using various extract and load techniques through scripting and / or tooling, streaming, API consumption, and replication.
  • Document data engineering processes, best practices, and technical specifications, especially for GA4 data models and BigQuery / Snowflake schemas.
  • Work collaboratively with Business Partner Teams and Business Stakeholders during project scoping and feasibility phases as a Subject Matter Expert (SME) for concept investigation / viability and technical impact; identify and communicate technical risks and mitigations.
  • Conform to agile development practices – Evolutionary design, refactoring, continuous integration / delivery, test-driven development.
  • Provide production support for data load jobs, ensuring the continuous flow of critical digital data. Actively monitor and resolve user support issues, working closely with your functional squad and other squads.
  • Maintain or upgrade existing data applications and pipelines.
  • Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project.
  • Attend key design meetings and provide support.
  • Perform research of viable technical and / or non-technical solutions.
  • Other ad hoc duties as required.

What you’ll need :

  • Education :  Minimum of a Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field preferred.
  • Experience :  8+ years of relevant experience in data warehousing, data modeling, and building data integration pipelines, including ingestion, integration, and ETL.
  • Engineer's Core Skills :

  • Proven experience in working with GA4 data, including understanding its data model, event-based tracking, and integration with BigQuery.
  • 6+ years of hands-on experience with Google BigQuery or Snowflake including advanced SQL techniques (CTEs, window functions, aggregate functions), schema design, and performance optimization.
  • 6+ years of hands-on experience with advanced SQL techniques (CTEs, window functions, aggregate functions).
  • 5+ years of strong experience in Python programming (object-oriented / functional programming, Pandas, PySpark).
  • 5+ years working with cloud platforms.
  • Experience designing star schemas, analyzing data warehouses, and applying data warehouse methodologies, particularly in the context of digital analytics data.
  • Essential experience in loading data into warehouse / ODS environments from diverse sources and formats. Design strategies for new data ingestion requests, including logical and physical data modeling.
  • Hands-on experience with version control and CI / CD pipelines for data engineering workflows.
  • Proven ability to perform unit testing (SQL scripts, ETL modules), integration testing, and performance / load / stress testing.
  • Tools & Technologies :

  • Cloud Platforms :  GCP (BigQuery, DataProc, DataFlow, CloudRun, Cloud Functions, Pub / Sub, etc.) or equivalent cloud platforms like AWS or Azure.
  • Data Platforms :  Snowflake.
  • ETL / Integration Tools :  AWS Glue, Fivetran.
  • Orchestration / Transformation Tools :  Alteryx or DBT (data build tool).
  • Version Control :  GitHub or similar repositories.
  • BI Tools (Bonus) :  Looker or Power BI tools for data consumption.
  • Other Web Analytics (Bonus) :  Experience with other web analytics platforms or marketing data sources.
  • Infrastructure as Code (Bonus) :  Terraform.
  • Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

    Candidate Privacy Policy

    Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This (“Notice”) explains :

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.
  • Your use of Orion services is governed by any applicable terms in this notice and our general .

    Create a job alert for this search

    Data Engineer • chennai, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    XebiaChennai, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 7 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsChennai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Ashley Global Capability CenterChennai, Tamil Nadu, India
    Bachelor's or master’s degree in Computer Science, Mathematics, or related field.Years of experience in developing technology solutions, integrating, or creating AI and machine learning models.Know...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIChennai, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Talent Corner HR Services Pvt LtdChennai, Tamil Nadu, India
    We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines th...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXChennai, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESChennai, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalchennai, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalChennai, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionChennai, IN
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsChennai, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseChennai, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyChennai, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeChennai, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekChennai, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incchennai, tamil nadu, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 20 days ago