Talent.com
Data Engineer

Data Engineer

Dexian Indiachennai, tamil nadu, in
6 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer • chennai, tamil nadu, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneChennai, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Softobizchennai, tamil nadu, in
    Career-defining role available with Tier 1 Blue Chip Australian Client.As a Data Engineer, you will be involved in all phases of the software development life cycle, collecting and documenting busi...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    DevRabbit IT Solutionschennai, tamil nadu, in
    We are looking for a highly skilled.Data Engineer / Analytics Engineer.The ideal candidate will have strong expertise in. Python, Advanced SQL, DBT, and Snowflake.Design, develop, and maintain robus...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Serviceschennai, tamil nadu, in
    Skill- Azure Senior Data Engineers.Requires skills-Azure Data Platform - Databricks,AzureSQL and ADLS.Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroChennai, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Whitefield Careerschennai, tamil nadu, in
    Passionate about data, analytics and automation.Experience cleaning and modeling large quantities of raw, disorganized data (we use dbt). Experience with a variety of data sources (structured and un...Show moreLast updated: 5 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DraconXChennai, IN
    DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we ex...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Data Engineer 2

    Data Engineer 2

    Yubichennai, tamil nadu, in
    As a Data Engineer, you will be part of a highly talented Data Engineering team.Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines.You...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Ironbook AIchennai, tamil nadu, in
    Data Engineer (Microsoft Fabric & Azure) - Relocation to KL.The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kuoni Tumlarechennai, tamil nadu, in
    At Kuoni Tumlare, we deliver truly inspiring and innovative solutions and experiences that create value both for our Partners and Society at large. Our wide portfolio of products and solutions is bu...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Data Engineer || 6 to 8 years

    Data Engineer || 6 to 8 years

    Innova ESIchennai, tamil nadu, in
    Data Engineer for one of the MNC company with INNIOVA.Strong expertise in Apache Spark (batch + streaming) and Hive.Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / ...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    JMAN GroupChennai, Tamil Nadu, India
    JMAN Group is a fast-growing data engineering & data science consultancy.We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalChennai, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalChennai, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgechennai, tamil nadu, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    loanDNAChennai, Tamil Nadu, India
    We are seeking an experienced Snowflake Developer with a minimum of 5 years of hands-on experience in Snowflake development, integration, migration, and deployment. The ideal candidate will be respo...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VXI Global SolutionsChennai, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    GMGchennai, tamil nadu, in
    GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors.Its vision is to inspir...Show moreLast updated: 4 hours ago