Talent.com
Senior Data Platform Engineer
Senior Data Platform EngineerCACI Ltd • Hyderabad, Republic Of India, IN
Senior Data Platform Engineer

Senior Data Platform Engineer

CACI Ltd • Hyderabad, Republic Of India, IN
25 days ago
Job description

CACI International Inc is an American multinational professional services and information technology company headquartered in Northern Virginia.

CACI provides expertise and technology to enterprise and mission customers in support of national security missions and government transformation for defense, intelligence, and civilian customers.

CACI has approximately 23,000 employees worldwide.

Headquartered in London, CACI Ltd is a wholly owned subsidiary of CACI International Inc., a publicly listed company on the NYSE with annual revenue in excess of US $6.2bn.

Founded in 2022, CACI India is an exciting, growing and progressive business unit of CACI Ltd. CACI Ltd currently has over 2000 intelligent professionals and are now adding many more from our Hyderabad and Pune offices. Through a rigorous emphasis on quality, the CACI India has grown considerably to become one of the UKs most well-respected Technology centres.

About Data Platform :

  • The Data Platform will be built and managed “as a Product” to support a Data Mesh organization.
  • The Data Platform focusses on enabling decentralized management, processing, analysis and delivery of data, while enforcing corporate wide federated governance on data, and project environments across business domains.
  • The goal is to empower multiple teams to create and manage high integrity data and data products that are analytics and AI ready, and consumed internally and externally.

What does a Data Infrastructure Engineer do?

  • A Data Infrastructure Engineer will be responsible to develop, maintain and monitor the data platform infrastructure and operations. The infrastructure and pipelines you build will support data processing, data analytics, data science and data management across the CACI business.
  • The data platform infrastructure will conform to a zero trust, least privilege architecture, with a strict adherence to data and infrastructure governance and control in a multi-account, multi-region AWS environment.
  • You will use Infrastructure as Code and CI / CD to continuously improve, evolve and repair the platform.
  • You will be able to design architectures and create re-useable solutions to reflect the business needs.
  • Responsibilities will include :

  • Collaborating across CACI departments to develop and maintain the data platform
  • Building infrastructure and data architectures in Cloud Formation, and SAM.
  • Designing and implementing data processing environments and integrations using AWS PaaS such as Glue, EMR, Sagemaker, Redshift, Aurora and Snowflake
  • Building data processing and analytics pipelines as code, using python, SQL, PySpark, spark, CloudFormation, lambda, step functions, Apache Airflow
  • Monitoring and reporting on the data platform performance, usage and security
  • Designing and applying security and access control architectures to secure sensitive data
  • You will have :

  • 6+ years of experience in a Data Engineering role.
  • Strong experience and knowledge of data architectures implemented in AWS using native AWS services such as S3, DataZone, Glue, EMR, Sagemaker, Aurora and Redshift.
  • Experience administrating databases and data platforms
  • Good coding discipline in terms of style, structure, versioning, documentation and unit tests
  • Strong proficiency in Cloud Formation, Python and SQL
  • Knowledge and experience of relational databases such as Postgres, Redshift
  • Experience using Git for code versioning, and lifecycle management
  • Experience operating to Agile principles and ceremonies
  • Hands-on experience with CI / CD tools such as GitLab
  • Strong problem-solving skills and ability to work independently or in a team environment.
  • Excellent communication and collaboration skills.
  • A keen eye for detail, and a passion for accuracy and correctness in numbers
  • Whilst not essential, the following skills would also be useful :

  • Experience using Jira, or other agile project management and issue tracking software
  • Experience with Snowflake
  • Experience with Spatial Data Processing
  • Create a job alert for this search

    Senior Data Engineer • Hyderabad, Republic Of India, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Creditsafe Technology • Hyderabad, Telangana, India
    With the largest owned database supported by a partner network, Creditsafe provides data on 320 million companies in over 100 countries to support its customers in this regard.Creditsafe is scaling...Show more
    Last updated: 1 day ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.io • Hyderabad, Telangana, India
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 8 Years - 12 years.We are...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    LiveRamp • Hyderabad, Republic Of India, IN
    LiveRamp is the data collaboration platform of choice for the world’s most innovative companies.A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is sett...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Hyderabad, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 9 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Quadrant Technologies • Hyderabad, Telangana, India
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Hyderabad, India
    We are seeking an experienced Data Engineer with strong expertise in AWS cloud services and Databricks to design and implement scalable, high-performance data pipelines. Design, develop, and maintai...Show more
    Last updated: 30+ days ago • Promoted
    Lead Databricks Platform Engineer

    Lead Databricks Platform Engineer

    Sonatype • Hyderabad, Republic Of India, IN
    The Databricks Administrator will be responsible for the overall health, security, and performance of the Databricks platform. This includes managing user access, implementing and enforcing data gov...Show more
    Last updated: 7 days ago • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Location - Bangalore, Chennai, Delhi, Mumbai, Pune, Hyderabad.Architecture of Azure Databricks, differentiating between the control plane and data plane. Describe the role of Databricks Workspaces, ...Show more
    Last updated: 22 days ago • Promoted
    Senior Data Engineer (Azure Databricks)

    Senior Data Engineer (Azure Databricks)

    Stratus • Hyderabad, Republic Of India, IN
    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show more
    Last updated: 18 days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    KPI Partners • Hyderabad, Republic Of India, IN
    We are seeking a highly skilled Principal Data Engineer to join our dynamic team at KPI Partners.Lead data engineering initiatives and projects from conception to delivery.Design and implement scal...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VRIZE • Hyderabad, IN
    Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology Insights • Hyderabad, Telangana, India
    We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
    Last updated: 12 days ago • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Prudent Technologies and Consulting, Inc. • Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Hyderabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analytics • Hyderabad, Telangana, India
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Deutsche Börse Group • Hyderabad, Republic Of India, IN
    Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and com...Show more
    Last updated: 17 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EverestDX Inc • Hyderabad, Telangana, India
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show more
    Last updated: 12 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Hyderabad, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 16 days ago • Promoted