Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

IntraEdgePrayagraj(Allahabad), IN
30+ days ago
Job description

Website- https : / / intraedge.com /

Job Title : Data Engineer

Experience : 5+Years

Location : [Remote]

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • Prayagraj(Allahabad), IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    EverisePrayagraj(Allahabad), IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesPrayagraj(Allahabad), IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KPG99 INCPrayagraj(Allahabad), IN
    Duration- 12+ months with Extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tra...Show moreLast updated: 5 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncPrayagraj(Allahabad), IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 16 days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudPrayagraj(Allahabad), IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalPrayagraj(Allahabad), IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaPrayagraj(Allahabad), IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 26 days ago
    • Promoted
    SAP Data Engineer (Datasphere)

    SAP Data Engineer (Datasphere)

    KPG99 INCPrayagraj(Allahabad), IN
    Duration : 12-month contract with extensions.Candidates' Core Skillset Must Be : .SAP ABAP, HANA / AMDP / CDS, SOAP / OData / Rest API’s etc.Show moreLast updated: 3 days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Insight GlobalPrayagraj(Allahabad), IN
    Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have ha...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Digivance SolutionsPrayagraj(Allahabad), IN
    Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR.Collaborate with business and technology stakeholders to understand current and future data requirements. Design, build, and maintain reliable,...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer - Scala

    Data Engineer - Scala

    Idyllic ServicesPrayagraj(Allahabad), IN
    Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer - Quant Trading

    Data Engineer - Quant Trading

    Deeter Investments LLPPrayagraj(Allahabad), IN
    Deeter Investments is a founder‑led proprietary trading firm built around real‑time, data‑driven decision‑making.We prize curiosity, collaboration, and a bias for action. After years of discretionar...Show moreLast updated: 5 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradPrayagraj(Allahabad), IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur RugsPrayagraj(Allahabad), IN
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsPrayagraj(Allahabad), IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 5 days ago
    • Promoted
    SAP Data Engineer (DataSphere / BW / HANA / Data Modeling)

    SAP Data Engineer (DataSphere / BW / HANA / Data Modeling)

    KPG99 INCPrayagraj(Allahabad), IN
    Role : SAP Data Engineer (DataSphere / BW / HANA / Data Modeling).Duration : 12-month contract with extensions.Provide state-of-the-art technical support for the SAP Datasphere, BW4 Systems maintenance and...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyPrayagraj(Allahabad), IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisPrayagraj(Allahabad), IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 5 days ago