Talent.com
This job offer is not available in your country.
Pyspark Architect

Pyspark Architect

Talent Worxbangalore, India
12 hours ago
Job description

Job Description : PySpark Architect

Location : Bangalore,Pune,Kolkata

Experience Required : 7 to 13 Years

Role Overview :

We are seeking a highly skilled and motivated PySpark Manager to lead our data

engineering initiatives. The ideal candidate will have deep expertise in PySpark,

Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible for

designing, building, and managing large-scale data processing solutions while leading a

team of data engineers to deliver high-quality outcomes.

Key Responsibilities :

1. Leadership & Team Management :

  • Lead and mentor a team of data engineers, ensuring high performance and

professional growth.

  • Oversee project timelines, quality, and deliverables for multiple data initiatives.
  • 2. Data Engineering & Development :

  • Design and implement robust data pipelines and workflows using PySpark and
  • Hadoop.

  • Optimize performance and scalability of big data solutions for complex data sets.
  • Develop and integrate solutions with AWS services for cloud-based data processing.
  • 3. Technical Expertise :

  • Leverage expertise in PySpark, Hadoop, and Scala to solve complex technical
  • challenges.

  • Work with Teradata for large-scale data warehousing solutions.
  • Utilize data visualization tools (e.g., Tableau, Power BI) to provide insights and
  • reporting solutions.

    4. Stakeholder Collaboration :

  • Collaborate with cross-functional teams, including business stakeholders and product
  • managers, to understand requirements and deliver solutions.

  • Provide thought leadership on best practices in big data technologies and architecture.
  • Required Skills & Qualifications :

  • Technical Expertise :
  • Proficiency in PySpark, Hadoop, AWS (S3, Glue, EMR, Redshift), and Teradata.
  • Hands-on experience with Scala for data engineering tasks.
  • Familiarity with data visualization tools like Tableau, Power BI, or similar platforms.
  • Experience :
  • 7–13 years of experience in data engineering, with a focus on big data technologies.
  • Proven track record of managing end-to-end data engineering projects and leading
  • teams.

  • Educational Background :
  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a
  • related field.

  • Soft Skills :
  • Strong analytical and problem-solving skills.
  • Excellent communication and stakeholder management abilities.
  • Ability to work in a fast-paced, dynamic environment.
  • Preferred Skills :

  • Certification in AWS or related big data tools.
  • Experience in real-time data streaming platforms like Kafka.
  • Knowledge of DevOps practices, including CI / CD pipelines and infrastructure as code.
  • Requirements

    Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a Global and leading provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive digital transformation, and shape the future of global markets.

    Create a job alert for this search

    Architect • bangalore, India

    Related jobs
    • Promoted
    • New!
    Pyspark Architect

    Pyspark Architect

    Saaki Argus & Averil Consultingbangalore, India
    A global IT services and consulting company specializing in digital transformation, cloud services, and automation solutions. Mumbai, Pune, Chennai, Bangalore & Noida.Proven experience as a Technica...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    APAC Presales Solution Architect

    APAC Presales Solution Architect

    WomenTech Networkbangalore, India
    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us.If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now....Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    APAC Presales Solution Architect

    APAC Presales Solution Architect

    NTTbangalore, India
    We are currently seeking a APAC Presales Solution Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties : Senior Data and AI Architect – Presales.Seeking a senior data so...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Solution Architect, Cloud

    Solution Architect, Cloud

    SYNNEXbangalore, India
    To work closely with Sales / Channel Team in approaching new engagements / prospects to find out and document the requirements and key findings. Perform solution mapping and relay requirements to Pre-...Show moreLast updated: 12 hours ago
    • Promoted
    Enterprise Architect

    Enterprise Architect

    HCLTechBengaluru, Karnataka, India
    Minimum Experience - 12+ Years.An experienced Oracle Fusion ERP Enterprise Architect to lead the design and implementation of Oracle Cloud ERP solutions. This role requires deep technical expertise,...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Solutions Architect

    Solutions Architect

    Clouderabangalore, India
    At Cloudera, we empower people to transform complex data into clear and actionable insights.With as much data under management as the hyperscalers, we're the preferred data partner for the top comp...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Solution Architect, Cloud

    Solution Architect, Cloud

    TD SYNNEXbangalore, India
    To work closely with Sales / Channel Team in approaching new engagements / prospects to find out and document the requirements and key findings. Perform solution mapping and relay requirements to Pre-...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Solution Architect

    Solution Architect

    MoEngage Inc.bangalore, India
    MoEngage is an insights-led customer engagement platform trusted by 1,+ global consumer brands, including McAfee, Flipkart, Domino’s, Nestle, Deutsche Telekom, and OYO. MoEngage combines data from m...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior / Principal Platform Architect (P) - Bangalore / Mumbai / Hyderabad

    Senior / Principal Platform Architect (P) - Bangalore / Mumbai / Hyderabad

    ServiceNowbangalore, India
    You will be part of the Customer Excellence team.Our purpose is to accelerate platform adoption and improve customer outcomes. We do this through a portfolio of services, delivered by outstanding co...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Snowflake Architect

    Snowflake Architect

    NTTbangalore, India
    We are currently seeking a Snowflake Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Snowflake Data Platform - Architect. As a Snowflake Architect, you will lead the design an...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Kinaxis Solutions Architect softw...

    Kinaxis Solutions Architect softw...

    Anicalls (Pty) Ltdbangalore, India
    Experience in implementation of different Kinaxis RapidResponse modules, like Supply Planning, Forecasting and Demand Planning, ATP, Aggregate Supply. Planning, Capacity Planning, Attribute-Based Pl...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Databricks Architect

    Databricks Architect

    NTTbangalore, India
    We are currently seeking a Databricks Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Databricks Data Platform - Architect. As a Databricks Architect, you will lead the design...Show moreLast updated: 12 hours ago
    • Promoted
    Architect

    Architect

    LTIMindtreeBengaluru, Karnataka, India
    Role : Spark Scala / Big data Architect.Years of experience : 12 - 16 years.Important Location constraint Pune and Bangalore only. Must have minimum 1012 yrs of Spark Scala Handson experience PySpark...Show moreLast updated: 16 days ago
    • Promoted
    Data Architect

    Data Architect

    InfoBeanshosur, tamil nadu, in
    Data Architect – Snowflake & Matillion.Snowflake, Matillion, Data Modeling, SQL, Python / Bash, Cloud Platforms (AWS / Azure). Immediate to 15 days preferred.The ideal candidate is proactive, self-direc...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    APAC Presales Solution Architect

    APAC Presales Solution Architect

    NTT DATA Servicesbangalore, India
    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us.If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now....Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    Senior Lead / Architect - Azure iPaas

    Senior Lead / Architect - Azure iPaas

    Tiger Analyticsbangalore, India
    Senior Lead / Architect - Azure iPaas .Chennai / Hyderabad / Bangalore (Hybrid).Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges.We ...Show moreLast updated: 12 hours ago
    • Promoted
    Cloud Architect

    Cloud Architect

    Toptalbangalore, karnataka, in
    Join Toptal’s Elite Network of Freelance Talent.Toptal is an exclusive network of the world’s top freelance software developers, designers, finance experts, product managers, and project managers.A...Show moreLast updated: 30+ days ago
    • Promoted
    SAP Basis Cloud architect Advisory

    SAP Basis Cloud architect Advisory

    HCLTechhosur, tamil nadu, in
    CAA (Cloud Architect Advisory).This is SAP Cloud Architect position which is elevated role as per career progression / path for SAP Basis consultant. Architect’s primary role / responsibility is to pl...Show moreLast updated: 30+ days ago