Talent.com
Data Engineer

Data Engineer

IntraEdgebhopal, India
6 days ago
Job description

Website-

Job Title : Data Engineer

Experience : 5+Years

Location : (Remote)

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • bhopal, India

    Related jobs
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Servicesbhopal, madhya pradesh, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer - ETL / PySpark

    Data Engineer - ETL / PySpark

    Talent VelocityBhopal
    Description : Experience : 6 to 10 Years Location : Any Xebia Location (Bangalore, Chennai, Pune, Bhopal, Hyderabad, Jaipur, G...Show moreLast updated: 15 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    MAHTOBhopal, Madhya Pradesh, India
    Company Description MAHTO is a platform that connects contractors and homeowners with skilled blue-collar workers, primarily from the home building industry. We facilitate easy hiring of constructi...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    People Prime WorldwideBhopal, Madhya Pradesh, India
    Job Title : Senior Data Engineer Skills : Data Engineering, AgenticAI, Python, SQL, Api’s, Azure cloud services, SQL and NoSQL ,Docker, Kubernetes. Location : Pan India Job Type : Full-Time Experience L...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer - Python

    Software Engineer - Python

    Techmynd ConsultingChennai,Pune,Bhopal
    The Senior Software Engineer AI Integration acts as the critical link between AI and real-world implementation.This role is responsible for designing, connecting, and delivering robust, end-to-end...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsbhopal, madhya pradesh, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 23 days ago
    • Promoted
    Xebia - Senior Azure Data Engineer

    Xebia - Senior Azure Data Engineer

    Xebia IT Architects India Pvt LtdBhopal
    Description : - Data Engineer (Azure) - Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Mi...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesbhopal, madhya pradesh, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 10 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadybhopal, madhya pradesh, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    Data & AI Engineer – Cyber Risk Intelligence Platform – India / Remote

    Data & AI Engineer – Cyber Risk Intelligence Platform – India / Remote

    Quantara AIBhopal, Madhya Pradesh, India
    Remote
    Data & AI Engineer – Cyber Risk Intelligence Platform – India Location : India (Remote) About Quantara AI & the Role Quantara AI is a next-generation Cyber Risk Intelligence and Governance platfo...Show moreLast updated: 2 hours ago