Talent.com
This job offer is not available in your country.
Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

AutomatonsXThane, IN
11 hours ago
Job description

𝐀𝐛𝐨𝐮𝐭 𝐔𝐬 :

AutomatonsX is a new-age brand from CtrlS-Cloud4C group, mission-focused on architecting and delivering intelligent automations for large-scale organizations in key industries. We go beyond regular RPA, rendering hyperautomation solutions powered by data transformations and deep analytics, autonomous platforms, and GenAI innovations. From manufacturing, healthcare, energy, BFSI, logistics industries to the BUs under them, we envision helping leaders smartly automate redundant processes at scale and improve productivity multi-fold, freeing up human resources for critical business and creative activities. Backed by CtrlS-Cloud4C group, the leading rated-IV datacenter and application-focused multi-cloud MSP globally, our experts have saved 1.2 million man hours and supported 5X faster GTMs. That's only the tip of the iceberg! Make your enterprise ready for the intelligent wave. Unlock the X-factor in business growth with the powerful integration of Analytics, AI, and Automation.

Job Summary :

We are seeking a highly skilled Senior Data Engineer to join our data engineering team. The ideal candidate will be responsible for building, optimizing, and maintaining data pipelines and architectures. You will work closely with data analysts, data scientists, and business stakeholders to deliver high-quality data solutions that support analytical and operational use cases.

Key Responsibilities :

  • Design, build, and maintain scalable data pipelines and systems.
  • Develop and optimize ETL / ELT processes for data ingestion, transformation, and loading.
  • Collaborate with cross-functional teams to understand data needs and deliver reliable data solutions.
  • Ensure data quality, integrity, and security across all platforms.
  • Implement and monitor data infrastructure using cloud-based solutions (AWS, Azure, or GCP).
  • Work with large datasets using technologies such as Spark, Kafka, and Hadoop.
  • Develop data models and maintain data dictionaries.
  • Drive automation and performance improvements across the data platform.
  • Mentor junior team members and contribute to best practices and technical standards.

Required Skills and Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 3+ years of experience in data engineering or related fields.
  • Proficiency in SQL and one or more programming languages (Python, Scala, Java).
  • Hands-on experience with big data technologies like Spark, Hadoop, Hive, Kafka.
  • Experience with cloud data services (AWS Redshift, Azure Synapse, GCP BigQuery).
  • Strong understanding of data modeling, warehousing, and distributed systems.
  • Familiarity with CI / CD and DevOps practices in data engineering.
  • Excellent problem-solving and communication skills.
  • Preferred Qualifications :

  • Experience with workflow orchestration tools (e.g., Airflow, Luigi).
  • Familiarity with data governance and compliance practices.
  • Background in real-time data streaming and event-driven architecture
  • Create a job alert for this search

    Senior Data Engineer • Thane, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESKalyan-Dombivli, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsMumbai, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 2 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iomumbai, maharashtra, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsmumbai city, maharashtra, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerxMumbai, India
    Job Title : Senior Data Engineering Lead (Databricks).If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and ma...Show moreLast updated: 12 days ago
    • Promoted
    • New!
    Senior DataOps Engineer (7+ Years ) (SQL | Python | Cloud)

    Senior DataOps Engineer (7+ Years ) (SQL | Python | Cloud)

    Sky Systems, Inc. (SkySys)Thane, Maharashtra, India
    Role : Senior DataOps Engineer Position Type : Full-Time Contract (40hrs / week) Contract Duration : 12 months+ Work Hours : 8am-4pm EST OR 4am-1pm EST Work Schedule : 8 hours / day (Mon-Fri) Location : ...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Confidential JobsKalyan-Dombivli, IN
    This role involves collaborating with cross-functional teams to ensure data reliability, scalability, and performance.The candidate will work closely with data scientists, analysts and software eng...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

    Senior Data Engineer - cloud data services - Python,Spark, Hadoop, Hive, Kafka

    AutomatonsXnavi mumbai, maharashtra, in
    AutomatonsX is a new-age brand from CtrlS-Cloud4C group, mission-focused on architecting and delivering intelligent automations for large-scale organizations in key industries.We go beyond regular ...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Fluent HealthMumbai, Maharashtra, India
    About Us : Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized op...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKalyan-Dombivli, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisMumbai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 21 days ago
    • Promoted
    Lead Data Engineer - Python / Big Data

    Lead Data Engineer - Python / Big Data

    HyreSnapMumbai
    Responsibilities : - Design, execution, and management of a large and complex distributed data system.Monitoring of performance and optimizing existing proje...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    DataceriaThane, Maharashtra, India
    Company : Dataceria software solutions Pvt ltd.Job Position : Senior Data engineer _snowflake Location : Pune Timings to align with UK and USA timings Hybrid : 3 days in NT office Pune Interview s...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.navi mumbai, maharashtra, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Net Zero InsightsThane, IN
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIThane, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 14 days ago
    • Promoted
    Koantek - Senior Data Engineer - Cloud Platform

    Koantek - Senior Data Engineer - Cloud Platform

    KOANTEK INFORMATION SYSTEMS INDIA PRIVATE LIMITEDMumbai
    About Koantek : Koantek is a Databricks Pure-Play Elite Partner, helping enterprises modernize faster and unlock the full power of Data and AI.Backed by Datab...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivemumbai, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadymumbai city, maharashtra, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CareerXperts ConsultingThane, IN
    We are looking for a highly skilled.The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientist...Show moreLast updated: 2 days ago