Talent.com
Senior data engineer
Senior data engineerEXL • Pune, Maharashtra, India
No longer accepting applications
Senior data engineer

Senior data engineer

EXL • Pune, Maharashtra, India
7 hours ago
Job description

Key Responsibilities :

  • Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like Min IO.
  • Leverage technologies and solutions to innovate with increasingly large data sets.
  • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.
  • Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
  • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
  • Perform assigned tasks and production incident independently.

Must Have :

  • 5-9 years of experience in Data Warehouse / Data Lake / Lake House related projects in product or service-based organization
  • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data.
  • Solid Experience of building complex data pipelines through Spark with Scala / Python / Java on Hadoop or Object storage
  • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
  • Proficient in working within an Agile / Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
  • Write and maintain Unix shell scripts, Oracle SQL, PL / SQL, and perform SQL tuning.
  • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance
  • Use Git-based version control systems and CI / CD pipelines (e.g., Jenkins).
  • Implement and manage HIVE external tables, partitions, and various file formats.
  • Work across on-premises and cloud environments (AWS, Azure, Databricks).
  • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP).
  • Experience of building Nifi pipelines.

    Preferred

  • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
  • Strong communication skills - both verbal and written.
  • Ability to multi-task across multiple projects, interface with external / internal resources
  • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
  • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement
  • Experience working diverse and geographically distributed project teams.
  • Skills & Qualifications : Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

    Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    CXC • Pune, IN
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 15 hours ago • Promoted • New!
    Senior Data Engineer with Data Bricks_ Exp : 5+ Years

    Senior Data Engineer with Data Bricks_ Exp : 5+ Years

    Atyeti Inc • Pune, Maharashtra, India
    Job Description : Role & responsibilities - Implement efficient and maintainable code using best process and coding standards. Design, develop, test, and deploy high-performance and scalable data s...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Saaki Argus & Averil Consulting • Pune, Maharashtra, India
    Quick Apply
    Hiring Senior Data Engineer for an IT Product Company.Minimum 4+Yrs of Relevant Experience.Mandatory Skills : Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or A...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Fusemachines • Pune, IN
    Quick Apply
    About Fusemachines Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Adjunct Associate Professor at Colu...Show more
    Last updated: 11 days ago
    Senior Data Engineer

    Senior Data Engineer

    Syngenta Group • Pune, Maharashtra, India
    The Senior Data Engineer plays a pivotal role in driving the design development and optimization of robust scalable and high-performance data products and pipelines on Databricks (Spark / Delta Lake / ...Show more
    Last updated: 25 days ago • Promoted
    Senior Engineer Data Solutions Applications

    Senior Engineer Data Solutions Applications

    Abacus Insights • Pune, Maharashtra, India
    Abacus Insights is changing the way healthcare works for you.Were on a mission to unlock the power of data so health plans can enable the right care at the right timemaking life better for millions...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Epergne Solutions • Pune, Maharashtra, India
    Quick Apply
    Roles & Responsibilities : -.Design, develop, and deploy scalable data solutions using Python and SQL across enterprise environments. Build and optimize data pipelines and automation scripts leve...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer – Senior Data Engineer

    Senior Software Engineer – Senior Data Engineer

    CGI • Pune, Maharashtra, India
    At CGI were a team of builders.We call our employees members because all who join CGI are building their own company - one that has grown to 72000 professionals located in 40 countries.Founded in 1...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Techify Solutions • Pune, Maharashtra, India
    Designation : Senior Data Engineer.Product-based company in Healthcare Domain.We are seeking an experienced Senior Data Engineer to join our product-based company in the Healthcare domain.The ideal ...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Epergne Solutions • Pune, Maharashtra, India
    Quick Apply
    Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show more
    Last updated: 30+ days ago
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    vConstruct Private Limited • Pune, Maharashtra, India
    Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Pune, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Red Hat • Pune, Maharashtra, India
    The Red Hat Experience Engineering (XE) team is looking for a skilled and well-rounded Senior Data Engineer with excellent programming skills and the ability to partner with internal stakeholders t...Show more
    Last updated: 5 days ago • Promoted