Manager, Data EngineeringCargill • Lucknow, IN
No longer accepting applications
Manager, Data Engineering
Cargill • Lucknow, IN
16 hours ago
Job descriptionDATA & ANALYTICAL SOLUTIONS : Oversees the development of data products and solutions using big data and cloud based technologies, ensuring they are designed and built to be scalable, sustainable and robust. DATA PIPELINES : Develops and monitors streaming and batch data pipelines that facilitate the seamless ingestion of data from various data sources, transform the data into information and move to data stores like data lake, data warehouse and others. DATA SYSTEMS : Reviews existing data systems and architectures to lead identification of areas for improvement and optimization. DATA INFRASTRUCTURE : Oversees the preparation of data infrastructure to drive the efficient storage and retrieval of data. DATA FORMATS : Reviews and resolves appropriate data formats to improve data usability and accessibility across the organization. STAKEHOLDER MANAGEMENT : Partners collaboratively with multi-functional data and advanced analytic teams to capture requirements and ensure that data solutions meet the functional and non-functional needs of various partners. DATA FRAMEWORKS : Builds complex prototypes to test new concepts and provides guidance to implement data engineering frameworks and architectures that improve data processing capabilities and support advanced analytics initiatives. AUTOMATED DEPLOYMENT PIPELINES : Oversees the development of automated deployment pipelines improving efficiency of code deployments with fit for purpose governance. DATA MODELING : Guides the team to perform data modeling in accordance to the datastore technology to ensure sustainable performance and accessibility. TEAM MANAGEMENT : Manages team members to achieve the organization's goals, by ensuring productivity, communicating performance expectations, creating goal alignment, giving and seeking feedback, providing coaching, measuring progress and holding people accountable, supporting employee development, recognizing achievement and lessons learned, and developing enabling conditions for talent to thrive in an inclusive team culture. Minimum requirement of 4 years of relevant work experience. Typically reflects 5 years or more of relevant experience. DATA ENGINEERING : Experience with data engineering on corporate finance data is strongly preferred. CLOUD ENVIRONMENTS : Familiarity with major cloud platforms (AWS, GCP, Azure). DATA ARCHITECTURE : Experience with modern data architectures, including data lakes, data lakehouses, and data hubs, along with related capabilities such as ingestion, governance, modeling, and observability. DATA INGESTION : Proficiency in data collection, ingestion tools (Kafka, AWS Glue), and storage formats (Iceberg, Parquet). DATA STREAMING : Knowledge of streaming architectures and tools (Kafka, Flink). DATA MODELING : Strong background in data transformation and modeling using SQL-based frameworks and orchestration tools (dbt, AWS Glue, Airflow). Experience with modeling concepts like SCD and schema evolution. DATA TRANSFORMATION : Familiarity with using Spark for data transformation, including streaming, performance tuning, and debugging with Spark UI. PROGRAMMING : Proficient with programming in Python, Java, Scala, or similar languages. Expert-level proficiency in SQL for data manipulation and optimization. DEVOPS : Demonstrated experience in DevOps practices, including code management, CI / CD, and deployment strategies. DATA GOVERNANCE : Understanding of data governance principles, including data quality, privacy, and security considerations for data product development and consumption.
Job Purpose and Impact
- The Supervisor II, Data Engineering job sets goals and objectives for the achievement of operational results for the team responsible for designing, building and maintaining robust data systems that enable data analysis and reporting. This job leads implementing the end to end process to ensure that large sets of data are efficiently processed and made accessible for decision making.
Key Accountabilities
Qualifications
Create a job alert for this search
Manager Data Engineering • Lucknow, IN
Similar jobs
![Software Engineering Manager - IT Infra [T500-22580]](https://cdn-logos.talent.com/v1/logo/image?feedcode=clickcast-appcast-li-in-cpc&company_name=Ferguson%20GCC)
Data Engineering Consultant
Eton Technologies • lucknow, uttar pradesh, in
The role requires strong hands-on expertise in.ETL / ELT tools such as Fivetran and Alteryx.Snowflake, Databricks, Amazon Redshift, or Azure Synapse Analytics.
Snowflake, Alteryx, Power BI, or Tableau...Show more
Last updated: 24 days ago • Promoted
Engineering Manager - Gen Ai
Exotel • lucknow, uttar pradesh, in
Exotel is a leading provider of AI transformation solutions for enterprise customer engagement and experience.With over 20 billion annual conversations across omnichannel, voice, agents, and bots, ...Show more
Last updated: 4 hours ago • Promoted • New!
Technical Lead
Ascendion • Lucknow, IN
Location : : Bengaluru (Remote).Minimum years of experience : : 10+ Years.Leading Data Engineering projects.Experience with CDC (Change Data Capture).
The Designated Responsible Individual (DRI) is a ...Show more
Last updated: 3 days ago • Promoted
Technical Data Manager
Xebia • Lucknow, IN
Job Title : Technical Data & AI Program Manager.We are seeking a Delivery Manager with a strong data background to lead the successful execution of data-centric projects and programs.This role bridg...Show more
Last updated: 24 days ago • Promoted
Engineering Manager
Interview Kickstart • Lucknow, IN
Interviews can be hard, especially at top tech companies like Google, Facebook, and Netflix.Many candidates fall short simply because they aren’t adequately prepared.
Our acclaimed courses specializ...Show more
Last updated: 3 days ago • Promoted
Data Transformation Engineer
HireGenie | Finance Recruitment Expert • Lucknow, IN
Data Transformation Engineer – AI Technology Company – Remote (Dubai).A leading AI-driven technology company is hiring for a.
The role focuses on ETL / ELT development, data normalization, and transfo...Show more
Last updated: 16 days ago • Promoted
Lead Data Engineer
ValueMomentum • Lucknow, IN
Senior Data Architect / Lead Data Engineer – Azure & Databricks.Senior Data Architect / Lead Data Engineer.The role involves architecting end-to-end modern data solutions, leading data strategy ini...Show more
Last updated: 20 days ago • Promoted
Software Engineering Manager - IT Infra [T500-22580]
Ferguson GCC • Lucknow, IN
Since 1953, Ferguson has been a source of quality supplies for a variety of industries.Together We Build Better infrastructure, better homes and better businesses.
We exist to make our customers’ co...Show more
Last updated: 23 days ago • Promoted
Manager- Engineering
Destination Hotels • Lucknow, India
You will be responsible forthe efficient running ofthe department in line with Hyatt International's Corporate Strategies andbrand standards, whilst meetingemployee, guest and owner expectations.Th...Show more
Last updated: 6 days ago • Promoted
Delivery Manager
Growel Softech Private Limited • Lucknow
We are looking for an experienced Data & Analytics Delivery Manager with a proven track record in delivering complex projects, managing large teams, and handling client portfolios in modern cloud a...Show more
Last updated: 7 days ago • Promoted
Engineering Manager
Smoothstack • Lucknow, IN
Smoothstack multiplies technology talent potential to power today's top businesses.We accomplish this by removing barriers to hire diverse talent and upskilling them through elite, immersive, outco...Show more
Last updated: 6 days ago • Promoted
Manager - GTM
LoglineAI • Lucknow, IN
The company operates at the intersection of.This role sits close to the founder and product team and focuses on.Execute GTM initiatives across LoglineAI’s.
Translate product capabilities into.Target...Show more
Last updated: 27 days ago • Promoted
Web Engineering Manager
Closeloop Technologies Pvt. Ltd • Lucknow, IN
Job Title : Web Engineering Manager (Sitecore, React, Node.We are looking for a Engineering Manager to lead a mid-sized, high-performing team of backend, frontend, and QA engineers.The ideal candida...Show more
Last updated: 30+ days ago • Promoted
Engineering Manager
Tamara • Lucknow, IN
Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app o...Show more
Last updated: 6 days ago • Promoted
Data Science Manager
TaskUs • Lucknow, IN
Strategic Transformation Leadership.Define and lead enterprise transformation programs focused on cost reduction, process efficiency, and quality improvement across global BPO operations.Align tran...Show more
Last updated: 13 days ago • Promoted
Engineering Manager
Branch International • Lucknow, IN
Branch delivers world-class financial services to the mobile generation.With offices in the United States, Nigeria, Kenya, and India, Branch is a for-profit socially conscious company that uses the...Show more
Last updated: 30+ days ago • Promoted
Manager- Engineering
Hyatt Regency • Lucknow, India
Organization- Hyatt Regency Lucknow.You will be responsible for the efficient running of the department in line with Hyatt International's Corporate Strategies and brand standards, whilst meeting e...Show more
Last updated: 6 days ago • Promoted
Principal data Engineer
BigHammer.ai • Lucknow, IN
We are building a next-generation data engineering platform designed to simplify complex data workflows, automate orchestration, and deliver high-performance pipelines at scale.Python, Apache Airfl...Show more
Last updated: 6 days ago • Promoted