Talent.com
Senior Data Engineer
Senior Data EngineerSPIRO • Karnataka, India
Senior Data Engineer

Senior Data Engineer

SPIRO • Karnataka, India
16 hours ago
Job description

Position : Senior Data Engineer

Location : Bengaluru

Experience : 5+ years

Job Summary :

We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL processes using PySpark and Spark.
  • Perform data wrangling, transformation, and integration across diverse data sources.
  • Optimize the performance and reliability of data processing workflows.
  • Implement data quality frameworks to ensure data accuracy and integrity.
  • Develop and maintain data architectures and data models to support business needs.
  • Collaborate with cross-functional teams including data analysts, software engineers, and business stakeholders to understand data requirements.
  • Stay updated with the latest advancements in Big Data tools, frameworks, and best practices.
  • Mentor and guide junior data engineers in technical and professional growth.

Required Skills and Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering roles.
  • Expertise in PySpark and Spark for large-scale data processing.
  • Strong understanding of Big Data ecosystems and technologies (e.g., Hadoop, Hive).
  • Hands-on experience with ETL development, data modeling, and data warehousing.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Experience with cloud platforms like AWS, Azure, or Google Cloud.
  • Strong problem-solving skills and a detail-oriented mindset.
  • Excellent communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with containerization and orchestration tools like Docker and Kubernetes.
  • Knowledge of SQL and relational database management systems.
  • Familiarity with data orchestration tools like Airflow, Prefect, or similar.
  • Create a job alert for this search

    Senior Data Engineer • Karnataka, India

    Related jobs
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Karnataka, India, India
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Tehno Right • Karnataka
    Job profile and Role : Data Engineer Job description : - Strong experience with Postgres and SQL and experience working with, supporting and maintaining re...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Engineer - Hadoop / Hive

    Big Data Engineer - Hadoop / Hive

    HARP Technologies and Services • Karnataka
    Description : - Skill : Bigdata + Pyspark - Location : Hyder...Show more
    Last updated: 22 days ago • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • karnataka, karnataka, in
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 10 days ago • Promoted
    124499-1-Data Science

    124499-1-Data Science

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    Master_PageContentPlaceHolder_screen_selectedTab_beelineForm_generalSection_Body" role="presentation"> Show more
    Last updated: 7 days ago
    Niveus Solutions - Cloud Data Engineer - Google Cloud Platform

    Niveus Solutions - Cloud Data Engineer - Google Cloud Platform

    NIVEUS SOLUTIONS PRIVATE LIMITED • Karnataka
    Description : - Builds end-to-end data applications.Integrating backend APIs with analytical front-ends.Good ...Show more
    Last updated: 28 days ago • Promoted