Talent.com
Senior Big Data Solutions Engineer
Senior Big Data Solutions EngineerSPIRO • Bengaluru, Republic Of India, IN
Senior Big Data Solutions Engineer

Senior Big Data Solutions Engineer

SPIRO • Bengaluru, Republic Of India, IN
1 day ago
Job description

Position : Senior Data Engineer

Location : Bengaluru

Experience : 5+ years

Job Summary :

We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designing, building, and optimizing large-scale data processing systems and pipelines.

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL processes using PySpark and Spark.
  • Perform data wrangling, transformation, and integration across diverse data sources.
  • Optimize the performance and reliability of data processing workflows.
  • Implement data quality frameworks to ensure data accuracy and integrity.
  • Develop and maintain data architectures and data models to support business needs.
  • Collaborate with cross-functional teams including data analysts, software engineers, and business stakeholders to understand data requirements.
  • Stay updated with the latest advancements in Big Data tools, frameworks, and best practices.
  • Mentor and guide junior data engineers in technical and professional growth.

Required Skills and Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering roles.
  • Expertise in PySpark and Spark for large-scale data processing.
  • Strong understanding of Big Data ecosystems and technologies (e.G., Hadoop, Hive).
  • Hands-on experience with ETL development, data modeling, and data warehousing.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Experience with cloud platforms like AWS, Azure, or Google Cloud.
  • Strong problem-solving skills and a detail-oriented mindset.
  • Excellent communication and collaboration skills.
  • Preferred Qualifications :

  • Experience with containerization and orchestration tools like Docker and Kubernetes.
  • Knowledge of SQL and relational database management systems.
  • Familiarity with data orchestration tools like Airflow, Prefect, or similar.
  • Create a job alert for this search

    Senior Data Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Senior Data Engineer (Onpremise)

    Senior Data Engineer (Onpremise)

    Blend • Bengaluru, Karnataka, India
    Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable ro...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo Infotech • Bengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with 8-12 years of hands-on experience to join our team on-site.This role requires a self-starter who can architect and implement robust data foun...Show more
    Last updated: 23 days ago • Promoted
    Senior On-Premise Data Solutions Engineer

    Senior On-Premise Data Solutions Engineer

    Blend • Bengaluru, Republic Of India, IN
    Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable ro...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Enginer

    Senior Data Enginer

    Tredence Inc. • Bengaluru, Republic Of India, IN
    Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Databricks and Azure Stack.Ability to provide solutions that are forward-thinking in data engineering and analyt...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Cargill • Bengaluru, Karnataka, India
    The Senior Professional, Data Engineering designs, builds, and maintains complex data systems that enable data analysis and reporting. This role includes a focus on Treasury-specific data solutions,...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Meril • Bengaluru, India
    We're Hiring : Senior Data Engineer.We are looking for a highly skilled Senior Data Engineer to help build and scale our data pipelines and infrastructure. If you are passionate about modern data a...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Zluri • Bengaluru, Republic Of India, IN
    Job Location : Whitefield, Bangalore.Reporting to : Engineering Manager.Zluri is a next-gen Identity Governance and Administration (IGA) platform that enables IT and security teams to discover iden...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    Continental • Bengaluru, Republic Of India, IN
    Govern the enterprise-wide standards for data & analytics modeling and performance within the Databricks Lakehouse.Drive consistency and reuse of core data & analytics artifacts and ensure scalable...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    ANSR • Bengaluru, Republic Of India, IN
    ANSR is hiring for one of its clients.Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members levera...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Publicis Production • Bangalore Urban, Karnataka, India
    We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in ...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Relevance Lab • Bengaluru, Karnataka, India
    Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products. Translate business requirements into robust logical and...Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer(Big Data)

    Senior Data Engineer(Big Data)

    Andor Tech • Bengaluru, Karnataka, India
    If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC. Work on cutting-edge big data solutions f...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digital • Bengaluru, Karnataka, India
    Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts.Key responsibilities ...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    NeoRecruit • Bengaluru, Republic Of India, IN
    Pharmaceutical / Biotechnology.Our client – one of the largest data science companies – is seeking to hire a.The ideal candidate will have a proven track record of delivering robust data solutions ...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Solution Engineer

    Senior Data Solution Engineer

    Relevance Lab • Bengaluru, Republic Of India, IN
    Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products. Translate business requirements into robust logical and...Show more
    Last updated: 8 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIRO • Bengaluru, Karnataka, India
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior Data Solutions Engineer

    Senior Data Solutions Engineer

    Tata Consultancy Services • Bengaluru, Republic Of India, IN
    Greetings from Tata Consulting Services.TCS is Hiring for Azure Databricks+Pyspark.Location : Chennai / Bangalore / Mumbai / Pune / Delhi. Required Technical Skill - Azure Databricks + Pyspark.Show more
    Last updated: 30+ days ago • Promoted
    Senior Azure Data Solutions Engineer

    Senior Azure Data Solutions Engineer

    Capgemini Invent • Bengaluru, Republic Of India, IN
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 6 days ago • Promoted