Talent.com
5447 | Senior Data Engineer

5447 | Senior Data Engineer

EXLMaharashtra, India
1 day ago
Job description

Title : Senior Data Engineer

Experience : 6+ Years

We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging. You will have the opportunity to use your expertise in solving big data problems and apply design thinking, coding and analytical skills to develop data pipelines that support marketing data products. We’re looking for talented Data Engineers passionate about building new data-driven solutions with the latest Big Data technology.

Responsibilities for Internal Candidates

  • You will build services that will integrate directly with LendingClub’s products and with external vendors.
  • You will work with modern data technologies such as Hadoop, Spark, DBT, Dagster / Airflow, Atlan, Trino, etc., modern data platforms such as Databricks and Snowflake and cloud technologies across AWS stack
  • Identify, design, and implement automation of manual processes, optimizing data delivery, reducing Cloud cost, etc.
  • Implement processes and systems to monitor Data Quality, Observability, Governance and Lineage.
  • Support operations to manage the production environment and help in resolving production issues with RCA
  • Write unit / integration tests, adopt Test-driven development, contribute to engineering wiki, and document design / implementation etc.

Qualifications for Internal Candidates

  • 5+ years of experience and a bachelor’s degree in computer science or a related field, or equivalent work experience
  • In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow / Dagster
  • At least 4 years of solid production quality coding experience in data pipeline implementation in Python
  • Experience working with public cloud platforms, preferably AWS
  • Experience working with Databricks and / or Snowflake
  • Experience in Git, JIRA, Jenkins, shell scripting
  • Familiarity with Agile methodology, test-driven development, source control management and test automation
  • Create a job alert for this search

    Senior Data Engineer • Maharashtra, India

    Related jobs
    • Promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    IndsafriAurangabad, IN
    Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalAurangabad, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyAurangabad, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labsaurangabad, maharashtra, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    All European CareersMaharashtra, India, India
    Remote
    For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneAurangabad, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekaurangabad, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    iVoyantAurangabad, IN
    One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIAurangabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz IncAurangabad, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsAurangabad, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladeaurangabad, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straiveaurangabad, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIAurangabad, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandAurangabad, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data Solutionsaurangabad, maharashtra, in
    Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure for our cli...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    SII Group Indiaaurangabad, maharashtra, in
    Databricks, GCP, and Data Pipeline Development.The ideal candidate will have a deep understanding of.Design, develop, and optimize scalable. Cloud Build, BigQuery, Firestore.Collaborate with cross-f...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ACL Digitalaurangabad, maharashtra, in
    We are looking for professionals with expertise in Data Engineering.Data Engineer (We are looking for 7 to 10years of experience) and Tech Lead – Data Engineer -( looking for 10+ years of experienc...Show moreLast updated: 1 day ago