Talent.com
No longer accepting applications
Data Engineer

Data Engineer

IntraEdgeSaint Thomas Mount, Tamil Nadu, India
2 days ago
Job description

Website-https : / / intraedge.com /

Job Title : Data Engineer

Experience : 5+Years

Location : [Remote]

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • Saint Thomas Mount, Tamil Nadu, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS is hiring for GCP data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Bengaluru / Chennai / Gurgaon. Skills Required - GCP BigQuery, Python.Hands-on experience in the ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsmount, India
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 9 days ago
    • Promoted
    Data engineer

    Data engineer

    EXLChennai, Tamil Nadu, India
    Job Responsibilities Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines th...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Cleantech Industry ResourcesChennai, Tamil Nadu, India
    Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.The company d...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionChennai, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Epergne SolutionsChennai, Tamil Nadu, India
    Quick Apply
    The ideal candidate will combine strong technical skills with leadership experience, ensuring that agile squads deliver scalable, reliable, and value-driven data products aligned with business goal...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Trantorchennai, India
    We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS. Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXChennai, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KaarTechChennai, Tamil Nadu, India
    Data Pipeline Development : Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs. Data Integration : Integrate data from multiple sources and ens...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalChennai, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgechennai, India
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 7 days ago
    Data Engineer

    Data Engineer

    Excelencia iTech Consulting Pvt LtdChennai City Corporation, TN, in
    Quick Apply
    Responsible for design, development, implementation, testing, documentation, and support of analytical and data solutions / projects requiring data aggregation / data pipelines / ETL / ELT from multiple so...Show moreLast updated: 21 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGSaint Thomas Mount, Tamil Nadu, India
    Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable) Job Description Design, development, and implementation of performant ETL pipelines using pyt...Show moreLast updated: 5 days ago
    Data Engineer-Aws

    Data Engineer-Aws

    Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
    Quick Apply
    Design, develop, and maintain scalable data pipelines using.Work with large datasets to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.Build automa...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseChennai, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncChennai, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 26 days ago