Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

IntraEdgedindigul, tamil nadu, in
30+ days ago
Job description

Website-https : / / intraedge.com /

Job Title : Data Engineer

Experience : 5+Years

Location : [Remote]

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • dindigul, tamil nadu, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    TalogyDindigul, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseMadurai, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Forage AIMadurai, IN
    Experience Level : Data Engineer- 3- 7 years of relevant experience in data engineering.Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructu...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncMadurai, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaDindigul, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Tytan Technology Inc.Madurai, IN
    Please apply directly or send your resume to.The ideal candidate will have deep expertise in.Design and develop scalable, efficient, and reliable. Architect and implement modern.Work closely with bu...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadMadurai, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Magma ConsultancyMadurai, IN
    Part-time (20–25 hours per week).The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers,...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesMadurai, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXDindigul, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsDindigul, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IGT SolutionsDindigul, IN
    Interested candidate please share resume on Kalyani.Design, develop, and maintain scalable data pipelines using Python and PySpark. Work with SQL and MongoDB to manage and query large datasets.Devel...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsDindigul, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisDindigul, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalMadurai, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsDindigul, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    The Transformation GroupMadurai, IN
    The ideal candidate should possess experience with ETL, data and reporting; and contributing code to deliver new features and functionality. Day-to-day you will collaborate with engineers, product m...Show moreLast updated: 12 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    StraiveDindigul, IN
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NAF Technology IndiaMadurai, IN
    Do you love a Challenge? Are you Passionate about technology? Are you customer obsessed? Looking to innovate? Join NAF Tech! New American Funding (NAF) is a mortgage lender offering an array of loa...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    SynechronMadurai, IN
    We have immediate opportunity for AWS.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technolog...Show moreLast updated: 30+ days ago