Talent.com
Senior Data Engineer
Senior Data EngineerEXL • baddi, himachal pradesh, in
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

EXL • baddi, himachal pradesh, in
30+ days ago
Job description

Key Responsibilities :

  • Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
  • Leverage technologies and solutions to innovate with increasingly large data sets.
  • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.
  • Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
  • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
  • Perform assigned tasks and production incident independently.

Must Have :

  • 5-9 years of experience in Data Warehouse / Data Lake / Lake House related projects in product or service-based organization
  • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data.
  • Solid Experience of building complex data pipelines through Spark with Scala / Python / Java on Hadoop or Object storage
  • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
  • Proficient in working within an Agile / Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
  • Write and maintain Unix shell scripts, Oracle SQL, PL / SQL, and perform SQL tuning.
  • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance
  • Use Git-based version control systems and CI / CD pipelines (e.g., Jenkins).
  • Implement and manage HIVE external tables, partitions, and various file formats.
  • Work across on-premises and cloud environments (AWS, Azure, Databricks).
  • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP).
  • Experience of building Nifi pipelines.

    Preferred

  • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
  • Strong communication skills - both verbal and written.
  • Ability to multi-task across multiple projects, interface with external / internal resources
  • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
  • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement
  • Experience working diverse and geographically distributed project teams.
  • Skills & Qualifications : Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

    Create a job alert for this search

    Senior Data Engineer • baddi, himachal pradesh, in

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • panchkula, haryana, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • baddi, himachal pradesh, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 19 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • panchkula, haryana, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • baddi, himachal pradesh, in
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • baddi, himachal pradesh, in
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 3 days ago • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • baddi, himachal pradesh, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
    Last updated: 18 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • panchkula, haryana, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show more
    Last updated: 27 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobile • baddi, himachal pradesh, in
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show more
    Last updated: 18 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • baddi, himachal pradesh, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 6 days ago • Promoted
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancy • baddi, himachal pradesh, in
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more
    Last updated: 3 days ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy Services • baddi, himachal pradesh, in
    Job Title : Senior Data Engineer (Azure / SSIS).Minimum 6 yrs of experience in building.ETL pipeline using Azure data Factory, Azure Synapse. Minimum 6 yrs of ETL development using PL / SQL.Exposure in A...Show more
    Last updated: 3 days ago • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    HNR Tech • panchkula, haryana, in
    We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
    Last updated: 12 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • panchkula, haryana, in
    Interview Date : Weekend Virtual Drive 15-Nov-25.Extensive coding experience (3+ years) including Python / Pyspark (1 years +). Experience developing in Azure with key data technologies (e.ADLS, ADF, A...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resources • panchkula, haryana, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 18 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • baddi, himachal pradesh, in
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 5 hours ago • Promoted • New!
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • panchkula, haryana, in
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 5 hours ago • Promoted • New!
    Snowflake Data Engineer

    Snowflake Data Engineer

    Live Connections • panchkula, haryana, in
    Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
    Last updated: 9 days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    TTC Group • baddi, himachal pradesh, in
    We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show more
    Last updated: 3 days ago • Promoted