Talent.com
Data Engineer

Data Engineer

IntraEdgeIndore, Madhya Pradesh, India
3 days ago
Job description

Website-https : / / intraedge.com /

Job Title : Data Engineer

Experience : 5+Years

Location : [Remote]

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • Indore, Madhya Pradesh, India

    Related jobs
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    Programmers.ioindore, madhya pradesh, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show moreLast updated: 17 days ago
    • Promoted
    Hadoop and Big Data Administrator

    Hadoop and Big Data Administrator

    ClearTrail TechnologiesIndore, Madhya Pradesh, India
    What We Do At ClearTrail, work is more than ‘just a job’.Our calling is to develop solutions that empower those dedicated to keep their people, places and communities safe.For over 24 years, law e...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgeindore, India
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA Globalindore, India
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incindore, India
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Trantorindore, India
    We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS. Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsindore, madhya pradesh, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur Rugsindore, India
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 10 days ago
    • Promoted
    NucleusTeq - Data Engineer - BigQuery

    NucleusTeq - Data Engineer - BigQuery

    NucleusTeq Consulting Pvt. Ltd.Indore
    Job Description : As a Data Engineer, you will work under the guidance of senior Data Engineers to design, develop, and maintain applications and data pipelines.You w...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsindore, India
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    GCP Data Engineer

    GCP Data Engineer

    JRD Systemsindore, madhya pradesh, in
    Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources. Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 21 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyindore, madhya pradesh, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHindore, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXindore, India
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 10 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPindore, India
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 6 days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Servicesindore, madhya pradesh, in
    Job Title : - GCP Data Architect.Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and co...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionindore, India
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 6 days ago
    • Promoted
    LSE / Associate Architect - Big Data

    LSE / Associate Architect - Big Data

    ImpetusIndore, Madhya Pradesh, India
    Lead Software Engineer / Associate Architect with proficiency in design and implmentation of scalable and robust data engineering solutions. In-depth understanding of Big data concepts and distribut...Show moreLast updated: 16 days ago