Talent.com
Sr. Data Engineer
Sr. Data EngineerPersistent Systems • Pune (division)
Sr. Data Engineer

Sr. Data Engineer

Persistent Systems • Pune (division)
8 hours ago
Job description

About Position :

As a Senior Scala Engineer, you’ll be part of a team of smart, highly skilled technologists,who are passionate about learning and supporting cutting-edge technologies such as Spark, Scala, Pyspark, Databricks, Airflow, SQL, Docker, Kubernetes, and other Data engineering tools. These technologies are deployed using DevOps pipelines leveraging Azure, Kubernetes, Jenkins and Bitbucket / GIT Hub.

  • Role : Sr. Data Engineer
  • Location : All persistent location
  • Experience : 8 to 12 years
  • Job Type : Full Time Employment

What You'll Do :

  • Develop, test, troubleshoot, debug, and make application enhancements leveraging, Spark , Pyspark, Scala, Pandas, Databricks, Airflow, SQL as the core development technologies.
  • Deploy application components using CI / CD pipelines.
  • Build utilities for monitoring and automating repetitive functions.
  • Collaborate with Agile cross-functional teams - internal and external clients including Operations, Infrastructure, Tech Ops
  • Collaborate with Data Science team and productionize the ML Models.
  • Participate in a rotational support schedule to provide responses to customer queries and deploy bug fixes in a timely and accurate manner
  • Expertise You'll Bring :

  • 8-12 Years of applicable software engineering experience
  • Strong fundamentals with experience in Bigdata technologies, Spark, Pyspark, Scala, Pandas, Databricks, Airflow, SQL,
  • Must have experience in cloud technologies, preferably Microsoft Azure.
  • Must have experience in performance optimization of Spark workloads.
  • Good to have experience with DevOps Technologies such as GIT Hub, Kubernetes, Jenkins, Docker.
  • Good knowledge of relational databases, preferably PostgreSQL.
  • Excellent English communication skills, with the ability to effectively interface across cross-functional technology teams and the business
  • Minimum B.S. degree in Computer Science, Computer Engineering or related
  • field
  • Benefits :

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
  • Values-Driven, People-Centric & Inclusive Work Environment :

    Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We support hybrid work and flexible hours to fit diverse lifestyles.
  • Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
  • Let’s unleash your full potential at Persistent - persistent.com / careers

    “Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

    Create a job alert for this search

    Sr Data Engineer • Pune (division)

    Related jobs
    Data Solution Engineer I II and III

    Data Solution Engineer I II and III

    OpenGov Inc. • Pune (division)
    OpenGov is the leader in AI and ERP solutions for local and state governments in the U.More than 2,000 cities, counties, state agencies, school districts, and special districts rely on the OpenGov ...Show more
    Last updated: 20 days ago • Promoted
    Sr.Azure Data Engineer

    Sr.Azure Data Engineer

    Persistent Systems • Pune (division)
    We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Job Type : Full Time Employment.Design and implement complex, scalable ...Show more
    Last updated: 7 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune (division)
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • Pune (division)
    We are looking for a Data Engineer with Python AWS experience.Job Type : Full Time Employment.Understand the domain for which the entities are being created. Understand the entity creation process fr...Show more
    Last updated: 29 days ago • Promoted
    AWS Data Platform Engineer

    AWS Data Platform Engineer

    Persistent Systems • Pune (division)
    We’re looking for an AWS Data Platform Engineer to help automate and scale our cloud-based analytics environment.You’ll work with our BI and Data Engineering teams to build secure, automated, and r...Show more
    Last updated: 14 days ago • Promoted
    Azure Data Engineer / Data Visualization Lead (Tableau)

    Azure Data Engineer / Data Visualization Lead (Tableau)

    PROADSW3 Relations pvt. ltd. • Pune (division)
    Azure Data Engineer / Data Visualization Lead (Tableau) – AM / DM | 5–8 Years | Budget : 1.Mandate : Databricks Experience. We are seeking a highly skilled Azure Data Engineer – Data Visualization Lead ...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    InfoCepts • Pune (division)
    Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune (division)
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 13 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce Inc • Pune (division)
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune (division)
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer-SAC

    Data Engineer-SAC

    Orbia Pune • Pune (division)
    If you have strong background in.Note : This is a full time role, 5 Days on-site role based at Orbia Global Capability Center in Pune. A minimum of 6 years' experience in data warehousing, data model...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SPIRO • Pune (division)
    We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    Trinity Technology Solutions LLC • Pune (division)
    Location : Pune preferred / remote.Programming Python, PySpark / Spark.Operating Systems Linux (RedHat).Databases Hive, MSSQL, MySQL, PostgreSQL. Big Data Hadoop ecosystem (HDFS, YARN, Sqoop).Version Co...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Synechron • Pune (division)
    We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines cre...Show more
    Last updated: 20 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Capgemini Invent • Pune (division)
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune (division)
    We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong backgro...Show more
    Last updated: 29 days ago • Promoted
    6221 Azure Data Engineer

    6221 Azure Data Engineer

    EXL • Pune (division)
    Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
    Last updated: 6 days ago • Promoted
    5676 - Data Engineer

    5676 - Data Engineer

    EXL • Pune (division)
    Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show more
    Last updated: 20 days ago • Promoted