Talent.com
This job offer is not available in your country.
Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

AutomatonsXhyderabad, telangana, in
4 days ago
Job description

𝐀𝐛𝐨𝐮𝐭 𝐔𝐬 :

AutomatonsX is a new-age brand from CtrlS-Cloud4C group, mission-focused on architecting and delivering intelligent automations for large-scale organizations in key industries. We go beyond regular RPA, rendering hyperautomation solutions powered by data transformations and deep analytics, autonomous platforms, and GenAI innovations. From manufacturing, healthcare, energy, BFSI, logistics industries to the BUs under them, we envision helping leaders smartly automate redundant processes at scale and improve productivity multi-fold, freeing up human resources for critical business and creative activities. Backed by CtrlS-Cloud4C group, the leading rated-IV datacenter and application-focused multi-cloud MSP globally, our experts have saved 1.2 million man hours and supported 5X faster GTMs. That's only the tip of the iceberg! Make your enterprise ready for the intelligent wave. Unlock the X-factor in business growth with the powerful integration of Analytics, AI, and Automation.

Job Summary :

We are seeking a highly skilled Senior Data Engineer to join our data engineering team. The ideal candidate will be responsible for building, optimizing, and maintaining data pipelines and architectures. You will work closely with data analysts, data scientists, and business stakeholders to deliver high-quality data solutions that support analytical and operational use cases.

Key Responsibilities :

  • Design, build, and maintain scalable data pipelines and systems.
  • Develop and optimize ETL / ELT processes for data ingestion, transformation, and loading.
  • Collaborate with cross-functional teams to understand data needs and deliver reliable data solutions.
  • Ensure data quality, integrity, and security across all platforms.
  • Implement and monitor data infrastructure using cloud-based solutions (AWS, Azure, or GCP).
  • Work with large datasets using technologies such as Spark, Kafka, and Hadoop.
  • Develop data models and maintain data dictionaries.
  • Drive automation and performance improvements across the data platform.
  • Mentor junior team members and contribute to best practices and technical standards.

Required Skills and Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 3+ years of experience in data engineering or related fields.
  • Proficiency in SQL and one or more programming languages (Python, Scala, Java).
  • Hands-on experience with big data technologies like Spark, Hadoop, Hive, Kafka.
  • Experience with cloud data services (AWS Redshift, Azure Synapse, GCP BigQuery).
  • Strong understanding of data modeling, warehousing, and distributed systems.
  • Familiarity with CI / CD and DevOps practices in data engineering.
  • Excellent problem-solving and communication skills.
  • Preferred Qualifications :

  • Experience with workflow orchestration tools (e.g., Airflow, Luigi).
  • Familiarity with data governance and compliance practices.
  • Background in real-time data streaming and event-driven architecture
  • Create a job alert for this search

    Senior Data Engineer • hyderabad, telangana, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    StraiveHyderabad, Telangana, India
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

    Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

    AutomatonsXGreater Hyderabad Area, India
    AutomatonsX is a new-age brand from CtrlS-Cloud4C group, mission-focused on architecting and delivering intelligent automations for large-scale organizations in key industries.We go beyond regular ...Show moreLast updated: 4 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisHyderabad, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 25 days ago
    • Promoted
    Senior Data Engineer - Python

    Senior Data Engineer - Python

    KAMKON IT SOLUTIONS PRIVATE LIMITEDHyderabad
    Job Description : We are looking for a highly experienced Senior Data Engineer with a strong background in data engineering, data wrangling, and d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    Guardant Health IndiaHyderabad, Telangana, India
    To support our rapid growth, the Enterprise Software Cloud Engineering team is seeking a Senior DevOps Engineer to elevate our production operations and observability. You’ll work with tools like Ku...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer – Big Data & AWS (Python + PySpark)

    Senior Data Engineer – Big Data & AWS (Python + PySpark)

    Coforgehyderabad, telangana, in
    We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd.Job Location : Greater Noida & Hyderabad Only. For queries, WhatsApp : 9667427662.If you are a...Show moreLast updated: 4 days ago
    • Promoted
    Ingrain Systems Inc - Senior Data Engineer - Python / SQL

    Ingrain Systems Inc - Senior Data Engineer - Python / SQL

    Ingrain Systems IncHyderabad
    Job Description : - Develop and own efficient SQL and Python code to support data analysis and ELT pipeline development.Build and maintain data transformation models ...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Info ServicesHyderabad, Telangana, India
    We are seeking 10 Senior Data Engineers with at least 8 years of total work experience in real-time data integration, the AWS ecosystem, Databricks, Spark, Flink, Kafka, and other relevant technolo...Show moreLast updated: 5 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.ioHyderabad, Telangana, India
    Job Title : Senior Azure Data Engineer Job Location : Remote Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.Shift Timings : Gener...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyhyderabad, telangana, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 6 days ago
    • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    Delphie Consulting servicesHyderabad
    Role Overview : We are seeking a Senior Python Data Engineer (SE4) who can take ownership of data platform design, architecture, and AI integration strategies.This ro...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIHyderabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 18 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ingrain Systems IncHyderabad, Telangana, India
    Develop and own efficient SQL and Python code to support data analysis and ELT pipeline development.Build and maintain data transformation models to transform raw warehouse data into usable formats...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer - Python / Spark

    Senior Data Engineer - Python / Spark

    HIMFLAX INFORMATION TECHNOLOGIES PRIVATE LIMITEDHyderabad
    Key Responsibilities : Data Architecture & Pipeline Development : - Design, implement, and mainta...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Cloud & Analytics

    Senior Data Engineer - Cloud & Analytics

    ConfidentialHyderabad / Secunderabad, Telangana
    Airflow, client-facing, Data Analytics, Data Engineering, ETL, Pyspark, Python, SQL.PvX Partners (One of Uplers' Clients) is Looking for : . Data Lead | Data Engineering | REMOTE who is passionate abo...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAHyderabad, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 15 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainHyderabad, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    People Tech Group IncHyderabad, Telangana, India
    Strong verbal and written communication skills backed with presentation skills.High strategic skills, self-motivated and proactive to effectively design strategy, and implement the business KPIs.Ex...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticssecunderabad, telangana, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 4 days ago
    • Promoted
    ThoughtSpot - Senior Cloud Engineer - Azure

    ThoughtSpot - Senior Cloud Engineer - Azure

    THOUGHTSPOT INDIA PRIVATE LIMITEDHyderabad
    Job Description : ThoughtSpot is looking for a Senior Cloud Engineer to join our Build and Infrastructure team.In this senior-level role, you will le...Show moreLast updated: 30+ days ago