Talent.com
Data Engineer
Data EngineerDexian India • Surat, IN
Data Engineer

Data Engineer

Dexian India • Surat, IN
2 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer • Surat, IN

    Related jobs
    Data Engineer

    Data Engineer

    Y&L Consulting, Inc. • mohali, gujarat, in
    P&C Insurance + data engineering + Data Lake.Property and Casualty insurance is a must.Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Surat, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer with Databricks Expertise

    Data Engineer with Databricks Expertise

    Hello World Tech Consulting • Surat, IN
    We are seeking a highly skilled Data Engineer with Databricks certifications and.Databricks Lakehouse platform and its.The ideal candidate will possess a robust understanding of AWS.Design and impl...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Insight Global • surat, gujarat, in
    The Senior Data Engineer is responsible for building and optimizing ETL / ELT pipelines that process terabytes of data daily across 186 data assets, implementing BigQuery datasets with enterprise-sca...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Surat, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Veraxion • Surat, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • mohali, gujarat, in
    We are seeking Data Engineer with hands-on experience in Spark, Pyspark, AWS, Java, Python etc.Location : All Persistent Locations. Job Type : Full Time Employment.Design, build, and maintain data pip...Show more
    Last updated: 4 hours ago • Promoted • New!
    Pyspark Data Engineer

    Pyspark Data Engineer

    People Prime Worldwide • surat, gujarat, in
    Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Sapphire Software Solutions Inc • Surat, IN
    A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Surat, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Surat, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Randstad Enterprise • Surat, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Surat, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    thinkbridge • surat, gujarat, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Koantek • mohali, gujarat, in
    We are seeking an experienced Databricks Full Stack Data Engineer with 3-6 years of industry.The ideal candidate will have a proven track record of working on live projects.He / she will play a key r...Show more
    Last updated: 4 hours ago • Promoted • New!
    Lead Data Engineer

    Lead Data Engineer

    Cimpress • surat, gujarat, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Surat, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Surat, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted