Talent.com
Senior Data Pipeline Architect
Senior Data Pipeline ArchitectValueMomentum • Hyderabad, Republic Of India, IN
Senior Data Pipeline Architect

Senior Data Pipeline Architect

ValueMomentum • Hyderabad, Republic Of India, IN
2 days ago
Job description

Databricks Engineer-Lead

Primary skills : Databricks, PySpark, SQL

Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data Lake.

Experience : 6 to 15 Year

About the Job We are seeking a Tech Lead –

Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake.The role involves managing large volumes of data, building complex ETL solutions, and working closely with business teams to deliver robust data transformations and analytics solutions.

Responsibilities

  • Design and develop ETL pipelines using ADF for data ingestion and transformation.
  • Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.
  • Write SQL, Python, and PySpark code for efficient data processing and transformation.
  • Understand and translate business requirements into technical designs.
  • Develop mapping documents and transformation rules as per project scope.
  • Communicate project status with stakeholders, ensuring smooth project execution.

Requirements

  • 7-10 years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases.
  • Hands-on experience with Azure services : ADLS, Azure Databricks, Data Factory, Synapse, Azure SQL DB.
  • Experience in SQL, Python, and PySpark for data transformation and processing.
  • Familiarity with DevOps and CI / CD deployments.
  • Experience in the insurance or financial industry is preferred
  • Work Location-Hyderabad

    Interested candidates Please share your Resume to venku.reddy@valuemomentum.com

    Create a job alert for this search

    Data Pipeline Architect • Hyderabad, Republic Of India, IN

    Related jobs
    Data Pipeline Architect

    Data Pipeline Architect

    Straive • Hyderabad, Republic Of India, IN
    Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python;.Write and optimize complex SQL for ingestion, transformation and consumption layers. Tune Spark jobs for perform...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Architect

    Senior Data Architect

    Nextracker Inc. • Hyderabad, Telangana, India
    ETL work for the NX organization.The data architect must ensure data is efficiently stored, accessed, and analyzed by leveraging advanced data modeling techniques, cloud technologies, and data gove...Show more
    Last updated: 18 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Blend • Hyderabad, Republic Of India, IN
    We are looking for an experienced.In this role, you will build and maintain scalable data pipelines and architecture to support analytics, data science, and business intelligence initiatives.You’ll...Show more
    Last updated: 23 days ago • Promoted
    Data Architect

    Data Architect

    HCLTech • Hyderabad, Telangana, India
    You will play a pivotal role in leading and architecting data solutions that align with our business goals and technical requirements. Your expertise in Databricks and Azure technologies will be ins...Show more
    Last updated: 15 days ago • Promoted
    Kafka Data Pipeline Architect

    Kafka Data Pipeline Architect

    EXL • Hyderabad, Republic Of India, IN
    We are looking for a skilled Kafka Engineer.The ideal candidate will have strong expertise in.Kafka architecture, and CI / CD integration. You’ll play a key role in enabling real-time data processing ...Show more
    Last updated: 7 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Advanced working Scala ,SQL,Python / PySpark knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Experience bu...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    BPMLinks • Hyderabad, Republic Of India, IN
    In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • Hyderabad, IN
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 11 days ago • Promoted
    Azure Data Architect

    Azure Data Architect

    ValueLabs • Hyderabad, Telangana, India
    Azure Data Architect (Microsoft Fabric).Overall 10+ years of IT experience.Understand the data requirements, source data land scape of the project and architect the solution.Ability to understand t...Show more
    Last updated: 18 days ago • Promoted
    Senior Data Pipeline Architect

    Senior Data Pipeline Architect

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    TCS has been a great pioneer in feeding the fire of Young Techies like you.We are a global leader in the technology arena and there's nothing that can stop us from growing together.We are Hiring fo...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Pipeline Architect

    Azure Data Pipeline Architect

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    TCS is hiring for AWS Data Engineer.Extensive coding experience including Python / Pyspark.Experience developing in Azure with key data technologies (e. ADLS, ADF, Azure Databricks etc.Software develo...Show more
    Last updated: 20 days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Saras Analytics • Hyderabad, Republic Of India, IN
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Prudent Technologies and Consulting, Inc. • Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Kanerika Inc • Hyderabad, Republic Of India, IN
    Hyderabad, Indore and Ahmedabad (India).Develop and maintain data pipelines using Azure Data Factory (ADF) / Databricks for data integration and ETL processes. Design, implement, and optimize Power B...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Pipeline Architect

    AWS Data Pipeline Architect

    Atyeti Inc • Hyderabad, Republic Of India, IN
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.SQL and cloud-native devel...Show more
    Last updated: 24 days ago • Promoted
    Senior Data Architect- Snowflake

    Senior Data Architect- Snowflake

    USEReady • Hyderabad, IN
    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show more
    Last updated: 9 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Hyderabad, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 16 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    APPIT Software Inc • Hyderabad, India
    Requirement : - AWS Data Architect.Job Description : AWS Data Architect.We are seeking an experienced AWS Data Architect with 8–12 years of expertise in designing, developing, and optimizing cloud-bas...Show more
    Last updated: 3 days ago • Promoted