Talent.com
Manager / Senior Manager - Data Engineering - DF

Manager / Senior Manager - Data Engineering - DF

ConfidentialGurugram, Gurgaon / Gurugram, India
12 days ago
Job description

About Us

Website : https : / / www.cognitioanalytics.com /

Cognitio Analytics, founded in 2013, aims to be the preferred provider of AI / ML driven productivity solutions for large enterprises. The company has received awards for its Smart Operations and Total Rewards Analytics Solutions and is dedicated to innovation, R&D, and creating sustained value for clients. Cognitio Analytics has been recognized as a 'Great Place to Work' for its commitment to fostering an innovative work environment and employee satisfaction.

Our solutions include Total Rewards Analytics powered by Cognitio's Total Rewards Data Factory, The Total Rewards Analytics solutions helps our clients achieve better outcomes and higher ROI on investments in all kinds of Total Rewards programs.

Our smart operations solutions drive productivity in complex operations, such as claims processing, commercial underwriting etc. These solutions, based on proprietary capabilities based on AI, advanced process and task mining, and deep understanding of operations drive effective digital transformation for our clients.

Relevant Experience : 8-12 years

Location : Gurgaon

Job Description

  • Lead the data engineering team by driving the design, build, test, and launch of new data pipelines and models on the production data platform
  • Define and implement the processes needed to achieve operational excellence in all areas, including agile development, and data solutions
  • Oversee the design, development and maintenance of data infrastructure, including data warehouses, data lakes, data integration components supporting optimal extraction, transformation, and loading of data
  • Leading the communication with vendors, clients, the leadership team, and other stakeholders to facilitate effective project management and provide ongoing support
  • Collaborate with business owners for roadmap planning and prioritization, to deliver robust cloud-based data solutions for our customers
  • Work closely with cross-functional teams to propel and execute necessary solution enhancements and provide support for existing solutions
  • Define and enforce best practices for data engineering, data modeling, and data quality to ensure accuracy, reliability, reusability, security and consistency of data
  • Evaluate and implement new technologies, tools, and frameworks to improve the performance and efficiency of the data engineering team
  • Lead the planning, prioritization, and execution and tracking of data engineering projects, ensuring timely delivery and alignment with business objectives
  • Establish and monitor key performance indicators (KPIs) to measure the performance and effectiveness of the data engineering team
  • Stay current with industry trends and advancements in data engineering, Azure Cloud, and provide strategic guidance for adopting new technologies or methodologies

Qualifications

  • 8-12 years of demonstrable experience in data engineering, analytics, data warehousing, data management, Data governance and Compliance Requirements.
  • Experience managing data engineers and guiding a team of engineers through project planning, execution, tracking and monitoring, and quality control stages
  • Solid experience with cloud-based data tools and platforms
  • Proficient in implementing efficient cost management strategies, particularly about storage and computational expenses.
  • Experience building processes supporting data transformation, data structures, metadata, security, governance, and workload management.
  • Experience supporting and working with cross-functional teams in a dynamic environment
  • Expertise in designing and optimizing data models, RDBMS, NoSQL DBs, and data warehousing solutions
  • Excellent leadership, communication, and interpersonal skills, with the ability to effectively collaborate with cross-functional teams
  • Proven ability to drive innovation, make strategic decisions and lead complex data engineering initiatives to successful completion
  • Skill Required

    Must Haves :

  • SQL, Python, Py Spark, Spark SQL, Spark, Distributed Systems
  • Databricks, ADLS Gen 2 Blob Storage, Azure DevOps, Azure Data Factory
  • ETL, Building Data Pipelines, Data Warehousing, Datamart, Data Modelling and Governance
  • Agile Practices, SDLC, DevOps practices, and CI / CD pipelines for data engineering workflows
  • Solid understanding of the Microsoft Azure stack for large-scale data engineering developments and deployments is highly preferred
  • Hands-on experience with Azure Databricks, including data ingestion, data transformation, workflow management and optimization, monitoring and troubleshooting Spark Jobs
  • Ability to set up and manage Azure Data Lake Storage (ADLS) Gen 2 accounts, and familiarity with data lake architecture and best practices
  • Familiarity with big data frameworks (e.g., Apache Spark).
  • Knowledge of Azure Key Vaults for securely storing and managing cryptographic keys, secrets, and certificates
  • Good To Have

  • Event Hubs for log management
  • Workflow Orchestration
  • Cosmos DB
  • Power BI
  • Professional Services Background
  • Scala, Java
  • Skills Required

    Py Spark, Data Governance, Python, Azure Devops, Spark SQL, Data Modelling, Apache Spark, Datamart, Sql, Sdlc, Azure Data Factory, Databricks, Data Warehousing, Etl

    Create a job alert for this search

    Engineering Manager • Gurugram, Gurgaon / Gurugram, India

    Related jobs
    • Promoted
    Senior Software Engineering Manager

    Senior Software Engineering Manager

    ValueMatrix.AIGhaziabad, IN
    This is a full-time remote role for a Senior Software Engineering Manager at ValueMatrix.The Senior Software Engineering Manager will be responsible for leading a team of software engineers and man...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineering Manager - Hashicorp Cloud Platform

    Senior Engineering Manager - Hashicorp Cloud Platform

    IBMnew delhi, delhi, in
    This role is responsible for leading our India-based Cloud Platform Services team at HashiCorp.From Core Platform & Visibility to Identity / IAM and cloud-based Billing services, Cloud Platform Servi...Show moreLast updated: 2 days ago
    • Promoted
    Engineering Manager - Data Platform

    Engineering Manager - Data Platform

    CoinbaseDelhi, IN
    Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 22 days ago
    • Promoted
    Engineering Manager - II, Data Engineering Platform

    Engineering Manager - II, Data Engineering Platform

    TamaraDelhi, IN
    Data Engineering Manager II : Real-Time Data & Experimentation Platform (Remote, India).Saudi Arabia's first fintech unicorn. GCC, with a mission to empower dreams through customer-centric financial ...Show moreLast updated: 8 days ago
    • Promoted
    Senior Manager - Data Engineering, ETML

    Senior Manager - Data Engineering, ETML

    ConfidentialGurgaon / Gurugram, India
    Driving lasting impact and building long-term capabilities with our clients is not easy work.You are the kind of person who thrives in a high performance / high reward culture - doing hard things, pi...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incDelhi, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Manager Data Engineering

    Senior Manager Data Engineering

    ConfidentialGurgaon / Gurugram, India
    As Senior Manager in Data Engineering, you are responsible for defining and executing data strategy for clients.Your role focused on high quality strategy, definition and delivery of solutions invo...Show moreLast updated: 1 day ago
    • Promoted
    Project Manager – Data Engineering & Analytics

    Project Manager – Data Engineering & Analytics

    BrillioGhaziabad, IN
    We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics.You will manage cross-functional teams to execute data platform, pipeline, and ...Show moreLast updated: 30+ days ago
    • Promoted
    Manager / Senior Manager - Databricks

    Manager / Senior Manager - Databricks

    Tiger Analyticsfaridabad, haryana, in
    Manager / Senior Manager - Databricks.Tiger Analytics is a global leader in data and analytics services, helping organizations solve. We are looking for a Manager / Senior Manager - Databricks with a st...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager

    Engineering Manager

    TamaraDelhi, IN
    Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app o...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineering Manager

    Software Engineering Manager

    FNZGurgaon, India
    The role is to assist the Head of Development in the execution of technical and personnel management duties.Engineering manager are part of the global Delivery function, reporting to the local Head...Show moreLast updated: 30+ days ago
    • Promoted
    Publicis Sapient - Senior Manager - Data Engineering

    Publicis Sapient - Senior Manager - Data Engineering

    Publicis SapientNoida
    Job Description : We are looking for a technically strong, business friendly Data Engineering Leader who can drive initiatives across data lake infrastructure, large-...Show moreLast updated: 7 days ago
    • Promoted
    Engineering Manager

    Engineering Manager

    Curately AI, IncDelhi, IN
    The ideal candidate will be responsible for managing and inspiring his or her team to achieve their performance metrics.Your role will involve strategizing, project management, part staff managemen...Show moreLast updated: 18 days ago
    • Promoted
    Engineering Manager AI & Automation [T500-20547]

    Engineering Manager AI & Automation [T500-20547]

    ANSRfaridabad, haryana, in
    Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager

    Engineering Manager

    YourTribeDelhi, India
    The Role We're seeking an Engineering Manager for Data & Platform who thrives at the intersection of real-time data architecture and people leadership. Reporting directly to our CTO, you'll lead a h...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineering Manager

    Senior Engineering Manager

    Intelliserve Konsulting Pvt LtdGurugram, Haryana, India
    Organization : Leading Global Management Consulting firm.Role : - Sr Manager Engineering- Technology (Software Development). Location : - Bangalore / Gurugram.Primary Tech Stack and Functional Skills : -...Show moreLast updated: 8 days ago
    • Promoted
    Software Engineering Manager

    Software Engineering Manager

    Intellify SolutionsDelhi, IN
    Intellify Solutions is looking for the hands-on and execution-focused engineering manager, you will lead a team that builds and scales the core customer quoting experience for a leading e-commerce ...Show moreLast updated: 7 days ago
    • Promoted
    Manager - Data Engineering

    Manager - Data Engineering

    ConfidentialGurgaon / Gurugram, India
    The Manager - Data Engineering is responsible for steering and building the NextGen Business Intelligence & Data Strategy, Data Virtualization, and Data Lakes Warehousing, through researching and e...Show moreLast updated: 3 days ago