Talent.com
Senior data engineer
Senior data engineerEXL • Pune, Maharashtra, India
No longer accepting applications
Senior data engineer

Senior data engineer

EXL • Pune, Maharashtra, India
10 hours ago
Job description

Key Responsibilities :

  • Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like Min IO.
  • Leverage technologies and solutions to innovate with increasingly large data sets.
  • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.
  • Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
  • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
  • Perform assigned tasks and production incident independently.

Must Have :

  • 5-9 years of experience in Data Warehouse / Data Lake / Lake House related projects in product or service-based organization
  • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data.
  • Solid Experience of building complex data pipelines through Spark with Scala / Python / Java on Hadoop or Object storage
  • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
  • Proficient in working within an Agile / Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
  • Write and maintain Unix shell scripts, Oracle SQL, PL / SQL, and perform SQL tuning.
  • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance
  • Use Git-based version control systems and CI / CD pipelines (e.g., Jenkins).
  • Implement and manage HIVE external tables, partitions, and various file formats.
  • Work across on-premises and cloud environments (AWS, Azure, Databricks).
  • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP).
  • Experience of building Nifi pipelines.

    Preferred

  • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
  • Strong communication skills - both verbal and written.
  • Ability to multi-task across multiple projects, interface with external / internal resources
  • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
  • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement
  • Experience working diverse and geographically distributed project teams.
  • Skills & Qualifications : Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

    Create a job alert for this search

    Senior Data Engineer • Pune, Maharashtra, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    CXC • Pune, IN
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 18 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Saaki Argus & Averil Consulting • Pune, Maharashtra, India
    Quick Apply
    Hiring Senior Data Engineer for an IT Product Company.Minimum 4+Yrs of Relevant Experience.Mandatory Skills : Strong expertise in Python ( Class methods), OOPS in Python, SQL , Databricks , AWS or A...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Fusemachines • Pune, IN
    Quick Apply
    About Fusemachines Fusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Adjunct Associate Professor at Colu...Show more
    Last updated: 11 days ago
    Senior Data Engineer

    Senior Data Engineer

    Syngenta Group • Pune, Maharashtra, India
    The Senior Data Engineer plays a pivotal role in driving the design development and optimization of robust scalable and high-performance data products and pipelines on Databricks (Spark / Delta Lake / ...Show more
    Last updated: 25 days ago • Promoted
    Senior Engineer Data Solutions Applications

    Senior Engineer Data Solutions Applications

    Abacus Insights • Pune, Maharashtra, India
    Abacus Insights is changing the way healthcare works for you.Were on a mission to unlock the power of data so health plans can enable the right care at the right timemaking life better for millions...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (Apache Airflow, DBTSnowparkPySpark, Python and SQL, Stored procedures)

    Senior Data Engineer (Apache Airflow, DBTSnowparkPySpark, Python and SQL, Stored procedures)

    NielsenIQ • Pune, Maharashtra, India
    Financial Services Engineering .At NIQ the Financial Services team uses alternative datasets to help global public equity investors (hedge funds mutual funds pension funds) make better in...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Epergne Solutions • Pune, Maharashtra, India
    Quick Apply
    Roles & Responsibilities : -.Design, develop, and deploy scalable data solutions using Python and SQL across enterprise environments. Build and optimize data pipelines and automation scripts leve...Show more
    Last updated: 30+ days ago
    Senior Data Engineer

    Senior Data Engineer

    Persistent Systems • Pune, Maharashtra, India
    Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks. Proven ability to design and optimize high-performance data pipelines,...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer – Senior Data Engineer

    Senior Software Engineer – Senior Data Engineer

    CGI • Pune, Maharashtra, India
    At CGI were a team of builders.We call our employees members because all who join CGI are building their own company - one that has grown to 72000 professionals located in 40 countries.Founded in 1...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Techify Solutions • Pune, Maharashtra, India
    Designation : Senior Data Engineer.Product-based company in Healthcare Domain.We are seeking an experienced Senior Data Engineer to join our product-based company in the Healthcare domain.The ideal ...Show more
    Last updated: 30+ days ago • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Epergne Solutions • Pune, Maharashtra, India
    Quick Apply
    Immediate / 10 Days To 15 days NP.The ideal candidate should have a solid background in data engineering, strong programming skills, and deep experience working with AWS cloud services.Optimize and...Show more
    Last updated: 30+ days ago
    Senior Data Engineer ( Palantir)

    Senior Data Engineer ( Palantir)

    Lear Corporation • Pune, Maharashtra, India
    Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
    Last updated: 23 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 26 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Pune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    vConstruct Private Limited • Pune, Maharashtra, India
    Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Pune, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Red Hat • Pune, Maharashtra, India
    The Red Hat Experience Engineering (XE) team is looking for a skilled and well-rounded Senior Data Engineer with excellent programming skills and the ability to partner with internal stakeholders t...Show more
    Last updated: 5 days ago • Promoted