Talent.com
Senior data engineer
Senior data engineerEXL • Pune, Maharashtra, India
No longer accepting applications
Senior data engineer

Senior data engineer

EXL • Pune, Maharashtra, India
23 hours ago
Job description

Key Responsibilities :

  • Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like Min IO.
  • Leverage technologies and solutions to innovate with increasingly large data sets.
  • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.
  • Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
  • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
  • Perform assigned tasks and production incident independently.

Must Have :

  • 5-9 years of experience in Data Warehouse / Data Lake / Lake House related projects in product or service-based organization
  • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data.
  • Solid Experience of building complex data pipelines through Spark with Scala / Python / Java on Hadoop or Object storage
  • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
  • Proficient in working within an Agile / Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
  • Write and maintain Unix shell scripts, Oracle SQL, PL / SQL, and perform SQL tuning.
  • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance
  • Use Git-based version control systems and CI / CD pipelines (e.g., Jenkins).
  • Implement and manage HIVE external tables, partitions, and various file formats.
  • Work across on-premises and cloud environments (AWS, Azure, Databricks).
  • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP).
  • Experience of building Nifi pipelines.

    Preferred

  • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
  • Strong communication skills - both verbal and written.
  • Ability to multi-task across multiple projects, interface with external / internal resources
  • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
  • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement
  • Experience working diverse and geographically distributed project teams.
  • Skills & Qualifications : Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

    Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    CXC • Pune, IN
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Synechron • Pune, IN
    We have opprotunity for AWS Data Engineer.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative techn...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Fusemachines • Pune, IN
    Quick Apply
    About Fusemachines Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Adjunct Associate Professor at Colu...Show more
    Last updated: 11 days ago
    Senior Data Engineer

    Senior Data Engineer

    Syngenta Group • Pune, Maharashtra, India
    The Senior Data Engineer plays a pivotal role in driving the design development and optimization of robust scalable and high-performance data products and pipelines on Databricks (Spark / Delta Lake / ...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Globant • Pune, IN
    At Globant, we are working to make the world a better place, one step at a time.We enhance business development and enterprise solutions to prepare them for a digital future.With a diverse and tale...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EVERSANA • Pune, Maharashtra, India
    Senior Associate reporting to Associate Director - Engineering will play an essential role in designing developing and maintaining scalable data pipelines and data infrastructure.You will work clos...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 24 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 27 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 18 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    vConstruct Private Limited • Pune, Maharashtra, India
    Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zeza Technologies • Pune, IN
    Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Pune, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Sonatype • Pune, IN
    Sonatype is the software supply chain security company.We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • Pune, IN
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer - GCP

    Senior Data Engineer - GCP

    AuxoAI • Pune, IN
    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP).This role is ideal f...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Talentgigs • pune, maharashtra, in
    Senior Data Engineer -GCP, SQL, Architect, Data Modeller.GCP, SQL, Architect, Data Modeller.Technical role 7+ Years Experience. Specific Contribution : We are looking for an experienced Senior Data E...Show more
    Last updated: less than 1 hour ago • Promoted • New!