Talent.com
Senior Data Engineer
Senior Data EngineerEXL • Anand, IN
No longer accepting applications
Senior Data Engineer

Senior Data Engineer

EXL • Anand, IN
30+ days ago
Job description

Key Responsibilities :

  • Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
  • Leverage technologies and solutions to innovate with increasingly large data sets.
  • Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.
  • Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
  • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
  • Perform assigned tasks and production incident independently.

Must Have :

  • 5-9 years of experience in Data Warehouse / Data Lake / Lake House related projects in product or service-based organization
  • Expertise in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment handling petabyte scale data.
  • Solid Experience of building complex data pipelines through Spark with Scala / Python / Java on Hadoop or Object storage
  • Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.
  • Proficient in working within an Agile / Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews
  • Write and maintain Unix shell scripts, Oracle SQL, PL / SQL, and perform SQL tuning.
  • Optimize and troubleshoot Spark applications for performance, scalability, and fault tolerance
  • Use Git-based version control systems and CI / CD pipelines (e.g., Jenkins).
  • Implement and manage HIVE external tables, partitions, and various file formats.
  • Work across on-premises and cloud environments (AWS, Azure, Databricks).
  • Strong experience with Hadoop ecosystem and Cloudera Data Platform (CDP).
  • Experience of building Nifi pipelines.

    Preferred

  • Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
  • Strong communication skills - both verbal and written.
  • Ability to multi-task across multiple projects, interface with external / internal resources
  • Proactive, detail-oriented and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
  • Willingness to quickly learn and implement new technologies, participate POC to explore best solution for the problem statement
  • Experience working diverse and geographically distributed project teams.
  • Skills & Qualifications : Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.

    Create a job alert for this search

    Senior Data Engineer • Anand, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • Nadiad, IN
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • anand, gujarat, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 20 days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • ahmedabad, gujarat, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 12 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Vadodara, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • Vadodara, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Anand, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • Anand, IN
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Ahmedabad, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    Analytix Business Solutions (India) Pvt. Ltd. • Ahmedabad, Gujarat, India
    Businesses of all sizes are faced with a rapidly changing competitive environment.Companies that possess both the ability to successfully navigate obstacles and the agility to react to market condi...Show more
    Last updated: 7 days ago • Promoted
    Senior DataOps Engineer (AWS)

    Senior DataOps Engineer (AWS)

    MSBC Group • Ahmedabad, Gujarat, India
    Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show more
    Last updated: 3 days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Nadiad, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    ProductSquads • Ahmedabad, Gujarat, India
    Company Profile : ProductSquads was founded with a bold mission : to engineer capital efficiency through autonomous AI agents, exceptional engineering, and real-time decision intelligence.We’re build...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Vadodara, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer (AWS / GCP)

    Senior Data Engineer (AWS / GCP)

    Armakuni • Ahmedabad, Gujarat, India
    We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • Ahmedabad, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Advantmed • Ahmedabad, Gujarat, India
    Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Vadodara, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Anand, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 4 days ago • Promoted