Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

ACL Digitalsecunderabad, telangana, in
30+ days ago
Job description
  • Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.
  • Design, develop, and optimize AWS pipeline as applicable.
  • Implement and manage GitHub asset bundles for version control, CI / CD workflows, and collaborative development.
  • Leverage Databricks capabilities including Delta Lake, MLflow, and notebooks to build robust data solutions.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality, production-ready datasets.
  • Ensure data quality, integrity, and security across all stages of the pipeline.
  • Monitor and troubleshoot performance issues in Spark jobs and Databricks clusters.
  • Document technical designs, workflows, and best practices.

    • Required Qualifications

    • Minimum 5+ years of hands-on experience with Spark in a production environment.
    • Strong proficiency in Databricks platform and ecosystem.
    • Solid understanding of GitHub asset bundle management, including branching strategies, pull requests, and release workflows.
    • Proficient in Python, Scala, or SQL for data engineering tasks.
    • Experience with Delta Lake, Structured Streaming, and Databricks Workflows.
    • Familiarity with cloud platform (AWS) and AWS data services.
    • Excellent problem-solving and communication skills.
    Create a job alert for this search

    Data Engineer • secunderabad, telangana, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLHyderabad, Telangana, India
    The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.AWS (S...Show moreLast updated: 23 days ago
    • Promoted
    ZettaMine - Data Engineer - ETL / Azure

    ZettaMine - Data Engineer - ETL / Azure

    ZettaMine Labs Pvt LtdHyderabad
    Role Overview : ZettaMine is seeking a skilled and experienced Data Engineer to design, build, and maintain robust data pipelines and infrastructure on the Azure pla...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseHyderabad, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXHyderabad, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIHyderabad, IN
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Hyderabad, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Coromandel International LimitedSecunderābād, Telangana, India
    The Data Engineer is responsible for designing, developing, and maintaining robust, scalable, and secure data pipelines and platforms that enable efficient storage, processing, and consumption of d...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeHyderabad, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect / Data Modeler

    Data Architect / Data Modeler

    INUMELLAS CONSULTANCY SERVICES PRIVATE LIMITEDHyderabad,Bangalore,Chennai
    Role - Data Architect / Data Modeler Exp - 12 to 16 Yrs Locations - Chennai, Hyderabad, Bengaluru, Delhi, Pun...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kline + CompanyHyderabad, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 10 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Saras Analyticshyderabad, telangana, in
    As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and workflows. You will work closely with data analysts, data scientists, and other stakeho...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Avenue CodeHyderabad, Telangana, India
    Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical. We’re privately held, profitable, and have be...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika IncHyderabad, Telangana, India
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsHyderabad, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ConfidentialBengaluru / Bangalore, Hyderabad / Secunderabad, Telangana, Chennai
    Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the efficient and reliable delivery of data.Design and implement cu...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsHyderabad, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalHyderabad, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Coforgehyderabad, telangana, in
    ETL, Azure data factory, Azure Data Bricks, Data Modelling.The ideal candidate will design and maintain scalable data pipelines, ensure data quality and compliance, and support analytics through ro...Show moreLast updated: 7 days ago