Talent.com
Senior Data Pipeline Architect

Senior Data Pipeline Architect

Acuity Knowledge PartnersBengaluru, Republic Of India, IN
2 days ago
Job description

Acuity Knowledge Partners is hiring multiple ' Senior Data Engineers ' for its Data and Technology Services Team at Bengaluru (hybrid).

"The position requires advanced proficiency in Python and SQL (covering both core programming and data manipulation), hands-on experience with cloud-native platform - Azure, and strong knowledge of Databricks (including core data engineering concepts)"

' Immediate Joiners are highly preferred! ' (0-30 days)

Required Skills :

  • Candidates should have a Bachelors or master’s in science or engineering disciplines (Computer Science, Engineering, Math's, Physics, etc.) or a related field.
  • 5 to 10 years of strong hands-on experience in a data engineering role, preferably within the financial services industry.
  • Strong experience with data pipeline tools and frameworks such as Python, SQL, and Spark.
  • Proficiency in cloud platforms, particularly Azure, Snowflake, and Databricks.
  • Experience with data integration from various sources including APIs and databases.
  • Strong understanding of data warehousing concepts and practices.
  • Familiarity with big data technologies and frameworks.
  • Excellent communication skills, both written and verbal.

Responsibilities :

  • Develop, optimize, and maintain scalable and reliable data pipelines using tools such as Python, SQL, and Spark.
  • Integrate data from various sources including APIs, databases, and cloud storage solutions such as Azure, Snowflake, and Databricks.
  • Implement data quality checks and ensure the accuracy and consistency of data.
  • Manage and optimize data storage solutions, ensuring high performance and availability.
  • Work closely with data scientists and DevOps engineers to ensure seamless integration of data pipelines and support machine learning model deployment.
  • Monitor and optimize the performance of data workflows to handle large volumes of data efficiently.
  • Implement security best practices and ensure compliance with industry standards.
  • Interested ones, please share your updated CV at nihal.upadhyay@acuitykp.com

    Create a job alert for this search

    Data Pipeline Architect • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    DBiz.aihosur, tamil nadu, in
    You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show moreLast updated: 14 days ago
    • Promoted
    AI Data Architect

    AI Data Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    We are seeking an inventive Data Architect for AI with 8–15 years of experience to lead the strategic design and implementation of enterprise-scale AI solutions. ETL / ELT, Big Data cloud data solutio...Show moreLast updated: 20 days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and consumption.Develop Data Pipelines...Show moreLast updated: 25 days ago
    • Promoted
    Azure Data Lead / Architect

    Azure Data Lead / Architect

    TEKsystems Global Services in Indiahosur, tamil nadu, in
    Notice Period : Immediate to15 Days.Please find the below Azure Data Lead / Architect JD.Azure AI skills, Azure Open AI, AI Foundry. Excellent communication and interpersonal skills, with the ability t...Show moreLast updated: 4 days ago
    • Promoted
    Data Architect

    Data Architect

    BrillioBengaluru, Karnataka, India
    Architecting, designing and implementing Modern Data Platforms and Solutions using Microsoft Azure Cloud and understands reference architectures. Deep understanding Data Migration Strategies with 2+...Show moreLast updated: 4 days ago
    • Promoted
    Databricks Data Architect

    Databricks Data Architect

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Experience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e. Docker, Kubernetes) for deploying data workflows.Should be able ...Show moreLast updated: 4 days ago
    • Promoted
    Senior Architect - Data

    Senior Architect - Data

    QuantiphiBengaluru, Karnataka, India
    Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quanti...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    Creative Synergies GroupBengaluru, Karnataka, India
    Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 17 days ago
    • Promoted
    Senior Serdes Architect

    Senior Serdes Architect

    Mulya TechnologiesGreater Bengaluru Area, India
    Senior SerDes Architect and Lead.About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    Sopra SteriaBengaluru, Karnataka, India
    Position : Senior Data Architect.Primary Skills : MDM, Data Architecture, Data Modelling, Data Catalogue, Data Governance, Data Quality, DWH. Data Architect to design and develop comprehensive enterpr...Show moreLast updated: 4 days ago
    • Promoted
    Data Architect

    Data Architect

    Tata Consultancy Serviceshosur, tamil nadu, in
    Role- Snowflake Data Architect.Cloud data warehouse technologies on Snowflake and AWS, Azure or GCP.At least one End-to-end Snowflake implementation is a must covering all aspects including archite...Show moreLast updated: 30+ days ago
    • Promoted
    Principal / Senior Data Architect

    Principal / Senior Data Architect

    AaysBangalore, IN
    Position : Principal / Senior Data Architect.You will act as a key member of the consulting team helping Clients to re-invent their corporate finance function by leveraging advanced analytics.You wil...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Architect

    Senior Data Architect

    MacroHirehosur, tamil nadu, in
    Job Profile- Sr Data Architect.Type of job- Contract for 1 year (extendable).Data Architect will focus on efficiency, security, and performance. Responsibilities include monitoring, optimization, tr...Show moreLast updated: 14 hours ago
    • Promoted
    Senior DAC Architect

    Senior DAC Architect

    Mulya TechnologiesGreater Bengaluru Area, India
    About Omni Design Technologies.Omni Design Technologies is a leading provider of high-performance, ultra-low power IP cores, from 28nm down through advanced FinFET nodes, which enable differentiate...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    Persistent SystemsBengaluru, Karnataka, India
    We are looking for an experienced and talented Data Architect to join our growing data engineering team.The ideal candidate will have a strong background in working with Python, Pyspark, AWS / Databr...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Data Architect

    Azure Data Architect

    Programmers.iohosur, tamil nadu, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show moreLast updated: 14 hours ago
    • Promoted
    Senior Data Architect

    Senior Data Architect

    Tredence Inc.Bengaluru, Karnataka, India
    Designation : Senior Manager (Databricks Architect).Bengaluru, Chennai, Kolkata, Gurugram, Pune and Hyderabad.We are seeking an experienced professional who apart from the required mathematical and ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Architect

    Data Architect

    CareerUS Solutionshosur, tamil nadu, in
    The Data Architect is responsible for.This includes ensuring that data is.The role focuses on developing.Collaborate with software engineers, analysts, and stakeholders to understand data needs and...Show moreLast updated: 2 days ago