Talent.com
Data Engineer

Data Engineer

Dexian Indiathrissur, kerala, in
20 hours ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer • thrissur, kerala, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionMalappuram, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL DigitalThrissur, IN
    Bachelor’s degree in Computer Science, Information Systems, or a related field.Proficiency in Python, SQL, and data manipulation tools and frameworks (e. Apache Airflow, Spark, dbt, Pandas).Practica...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Dexian Indiamalappuram, kerala, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsthrissur, kerala, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreepalakkad, kerala, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    DigitalzoneMalappuram, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 22 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyPalakkad, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsPalakkad, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 13 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradThrissur, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgethrissur, kerala, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer II

    Data Engineer II

    ClearDemandMalappuram, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 22 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalMalappuram, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Snowflake Data Engineer

    Snowflake Data Engineer

    Newpage SolutionsThrissur, IN
    Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Cimpressmalappuram, kerala, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 20 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicespalakkad, kerala, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroPalakkad, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseMalappuram, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer – Azure & AWS

    Data Engineer – Azure & AWS

    Yoda TechMalappuram, IN
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 9 days ago