Talent.com
Data Engineer

Data Engineer

IntraEdgeBhubaneswar, Odisha, India
30+ days ago
Job description

Website-https : / / intraedge.com /

Job Title : Data Engineer

Experience : 5+Years

Location : [Remote]

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • Bhubaneswar, Odisha, India

    Related jobs
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradbhubaneswar, orissa, in
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologiesbhubaneswar, orissa, in
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    BrothersTechbhubaneswar, orissa, in
    Remote (Night Shift - Flexible).Must have excellent English written and verbal communication skills.The ideal candidate should be experienced in data engineering on. Snowflake Azure -ADF, Microsoft ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + Companybhubaneswar, orissa, in
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXbhubaneswar, orissa, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    9NEXUSbhubaneswar, orissa, in
    Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment. The role involves building high-perf...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgebhubaneswar, orissa, in
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Databricks Expert

    Data Engineer - Databricks Expert

    Nebula Tech Solutionsbhubaneswar, orissa, in
    Data Engineer – Databricks Expert.Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a....Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    GEMRAJ TECHNOLOGIES LIMITEDbhubaneswar, orissa, in
    We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDbhubaneswar, orissa, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softbhubaneswar, orissa, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA Globalbhubaneswar, orissa, in
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Impetusbhubaneswar, orissa, in
    Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AIQUbhubaneswar, orissa, in
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladebhubaneswar, orissa, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgebhubaneswar, orissa, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionbhubaneswar, orissa, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Talogybhubaneswar, orissa, in
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHbhubaneswar, orissa, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadybhubaneswar, orissa, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 22 days ago