Talent.com
This job offer is not available in your country.
Data Engineer - Data Engineer

Data Engineer - Data Engineer

DeqodeChennai
30+ days ago
Job description

Responsibilities :

  • Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation.
  • Work closely with analysts / data scientists to understand impact to the downstream data models.
  • Write efficient and well-organized software to ship products in an iterative, continual release environment.
  • Contribute to and promote good software engineering practices across the team
  • Communicate clearly and effectively to technical and non-technical audiences.

Minimum Qualifications :

  • University or advanced degree in engineering, computer science, mathematics, or a related field
  • Strong hands-on experience in Databricks using PySpark and Spark SQL (Unity Catalog, workflows, Optimization techniques)
  • Experience with at least one cloud provider solution (GCP preferred)
  • Strong experience working with relational SQL databases.
  • Strong experience with object-oriented / object function scripting language : Python.
  • Working knowledge in any transformation tools, DBT preferred.
  • Ability to work with Linux platform.
  • Strong knowledge of data pipeline and workflow management tools (Airflow)
  • Working knowledge of Git hub / Git Toolkit
  • Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
  • Experience creating Data pipelines that prepare data for ingestion & consumption appropriately.
  • Experience in maintaining and optimizing databases / filesystems for production usage in reporting, analytics.
  • Working in a collaborative environment and interacting effectively with technical and non-technical team members equally well.
  • Good verbal and written communication skill
  • ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Chennai

    Related jobs
    Data Engineer

    Data Engineer

    InfyStratIN
    Remote
    Quick Apply
    InfyStrat is seeking a dedicated Data Engineer to join our data team and contribute to the development and maintenance of our robust data infrastructure. In this role, you will be responsible for de...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Cleantech Industry ResourcesChennai, Tamil Nadu, India
    Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.The company d...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    MphasisChennai, Tamil Nadu, India
    AWS Glue, EMR (Spark), Redshift, Step Functions : Deep experience in using AWS tools for data processing and pipeline orchestration. Python, SQL, PySpark / Scala : Advanced skills in Python and SQL, as ...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DevfiChennai, IN
    Our client is looking for a Senior Data Engineer with Strong Python and AWS.I thought this might catch your interest.Client is looking for someone who is willing to work in US Eastern Time zone - N...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    CentrilogicChennai, IN
    Over 15 years, we have become a premier global provider of multi-cloud management, cloud-native application development solutions, and strategic end-to-end digital transformation services.Headquart...Show moreLast updated: 25 days ago
    Data Engineer

    Data Engineer

    Ideas2IT TechnologiesChennai, Tamil Nadu, India
    As a Data Engineer, you'll build and maintain data pipelines and architectures.Responsibilities include optimizing databases and ETL processes, using Python or SQL, and collaborating with data team...Show moreLast updated: 10 days ago
    Data Engineer

    Data Engineer

    Saint-Gobain India Private Limited - Glass BusinessChennai, Tamil Nadu, India
    Looking for a dynamic, energetic, and self-driven Azure Data Engineer to design, implement, and maintain scalable data solutions. The role focuses on integrating data from multiple sources across al...Show moreLast updated: 1 day ago
    Data Engineer

    Data Engineer

    Excelencia iTech Consulting Pvt LtdChennai, TN, in
    Quick Apply
    Validates correctness and completeness of requirements defined by product owners, implements data logic, and ensures it is adequately tested and of high quality for at least one service within a te...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    FinacPlusChennai, IN
    FinacPlus provides virtual business process services to various types of overseas clients and this position is to be part of the team which provides IT services to a leading provider of data, insig...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HiPaaS Inc.Chennai, IN
    You’ll work on high-impact projects like foundational data tables, ETL frameworks, and data lineage, collaborating with cross-functional teams to drive data quality, accessibility, and innovation.D...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vista Applied Solutions Group IncChennai, IN
    Client is looking for Data Engineer and this remote position from India.Python scripting for automation.Heavy focus on the data modeling. Retail & eCommerce experience required.Adobe web analytics u...Show moreLast updated: 1 day ago
    Data Engineer

    Data Engineer

    Ztek ConsultingChennai, Tamil Nadu, India
    Lead and manage end-to-end data engineering projects, collaborating with cross-functional teams including analytics, product, and engineering. Design and maintain scalable ETL / ELT pipelines using Re...Show moreLast updated: 1 day ago
    Data Engineer

    Data Engineer

    ValueLabsChennai, Tamil Nadu, India
    PySpark : Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.Cloudera Data Platform : Strong experience with Cloudera Data Platform (CDP) components...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Clustrex Data Private LimitedChennai, Tamil Nadu, India
    Madipakkam, Chennai - work from office.Build and optimize data pipelines for efficient data processing.Conduct query performance analysis and enhance database efficiency. Perform statistical analysi...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    NEXUS CONSULTING SOLUTIONSChennai, IN
    Years / Mid-Senior Level / As per requirement].We are seeking a skilled and motivated.The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure effic...Show moreLast updated: 17 days ago
    Data Engineer

    Data Engineer

    IntraEdgeChennai, Tamil Nadu, India
    Data Engineer (Backend Java & Python).We are looking for a highly skilled.In this role, you will design and implement robust data models and architectures, build scalable data ingestion pipelines, ...Show moreLast updated: 13 days ago
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS present an excellent opportunity for Data Engineer.Experience required : 5-12 yrs.Skills : Apache Spark, Python, PySpark, Java, GCP BQ,BIG Data, Python, SQL, PySpark GCP.Walk in Interview date : ...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Teamware SolutionsChennai, Tamil Nadu, India
    Buyer OPEN POSITION NOTIFICATION.Competency Group : All Information Systems.The GRADE / BAND for this Order is : 1.Maximum number of resumes to be submitted per position : 2. Note : Appropriate Affirmativ...Show moreLast updated: 1 day ago