Talent.com
Data Engineer

Data Engineer

IntraEdgeindore, India
7 days ago
Job description

Website-

Job Title : Data Engineer

Experience : 5+Years

Location : (Remote)

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • indore, India

    Related jobs
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    IntraEdgeIndore, Madhya Pradesh, India
    Job Title : Data Engineer Experience : 5+Years Location : [Remote].The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst an...Show moreLast updated: 13 hours ago
    Data Engineer Lead

    Data Engineer Lead

    DigiValetIndore, Madhya Pradesh, India, India, India
    Quick Apply
    In this role, you will be responsible for turning data into actionable insights that drive strategic decisions.You will collaborate with cross-functional teams to deliver impactful dashboards, cond...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - ETL / Data Warehousing

    Data Engineer - ETL / Data Warehousing

    HiringeyeIndore
    Modern, we're looking for a driven and detail-oriented Data Engineer with a strong consulting background to join our Client Technology Team. In this role, you will serve as a subject matter exp...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ConfidentialIndore
    Enhance and maintain the MDM platform.Monitor and optimize system performance.Troubleshoot and resolve technical issues.Support production incident resolution. Develop and refactor Python and SQL co...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    RevXIndore, Madhya Pradesh, India
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 13 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesindore, madhya pradesh, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Randstad EnterpriseIndore, Madhya Pradesh, India
    Role : Data Engineer Location : Remote Shift Timing : 2 : 00 Pm - 11 : 00 Pm Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). Must have skillset : GCP - 2 years mi...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGIndore, Madhya Pradesh, India
    Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable).Job Description Design, development, and implementation of performant ETL pipelines using pyth...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Searce IncIndore, Madhya Pradesh, India
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 13 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsindore, madhya pradesh, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 24 days ago
    • Promoted
    NucleusTeq - Data Engineer - BigQuery

    NucleusTeq - Data Engineer - BigQuery

    NucleusTeq Consulting Pvt. Ltd.Indore
    Job Description : As a Data Engineer, you will work under the guidance of senior Data Engineers to design, develop, and maintain applications and data pipelines.You w...Show moreLast updated: 28 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyindore, madhya pradesh, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich Indiaindore, madhya pradesh, in
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    thinkbridgeIndore, Madhya Pradesh, India
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    VeraxionIndore, Madhya Pradesh, India
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. What you’ll do Develop and optimize.Python, DBT, and AWS services (Dat...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    V2SoftIndore, Madhya Pradesh, India
    Data Engineer : 8+year experience in design and development of streaming data pipelines.Experience to deal with large stream volumes. Implementation experience ( atleast couple of projects ) in MSK / ...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDIndore, Madhya Pradesh, India
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kline + CompanyIndore, Madhya Pradesh, India
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 13 hours ago