This job offer is not available in your country.
Tech Lead - Databricks Job
YASH Technologiesindore, India15 hours ago
Job descriptionArchitect and develop ETL / ELT pipelines using PySpark, Spark SQL, and Delta Lake. Optimize data workflows for performance, scalability, and cost-efficiency. Integrate structured and unstructured data from various sources. Leverage cloud services (AWS S3, Lambda, Glue, etc.) for data processing. Ensure secure and compliant integration between Databricks and cloud platforms. Implement data governance policies using Unity Catalog or similar tools. Ensure data lineage, cataloging, and access control compliance. Collaborate with DevOps teams to automate deployments using CI / CD pipelines (Azure DevOps, Git). Manage infrastructure as code and monitor workloads for performance bottlenecks. Mentor junior developers and conduct code reviews. Work closely with data scientists, analysts, and business stakeholders. Communicate technical concepts effectively to both technical and non-technical audiences. Basic knowledge of customer's business processes- relevant technology platform or product. Able to prepare process maps, workflows, business cases and simple business models in line with customer requirements with assistance from SME and apply industry standards / practices in implementation with guidance from experienced team members. Working knowledge of requirement management processes and requirement analysis processes, tools & methodologies. Able to analyse the impact of change requested / enhancement / defect fix and identify dependencies or interrelationships among requirements & transition requirements for engagement. Working knowledge of technology product / platform standards and specifications. Able to implement code or configure / customize products and provide inputs in design and architecture adhering to industry standards / practices in implementation. Analyze various frameworks / tools, review the code and provide feedback on improvement opportunities. Working knowledge of architecture Industry tools & frameworks. Able to identify pros / cons of available tools & frameworks in market and use those as per Customer requirement and explore new tools / framework for implementation. Working knowledge of architectural elements, SDLC, methodologies. Able to provides architectural design / documentation at an application or function capability level and implement architectural patterns in solution & engagements and communicates architecture direction to the business. Knowledge of statistical & machine learning techniques like classification, linear regression modelling, clustering & decision trees. Able to identify the cause of errors and their potential solutions. Familiar with wide range of mainstream commercial & open-source data science / analytics software tools, their constraints, advantages, disadvantages, and areas of application. Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team. Shares information within team, participates in team activities, asks questions to understand other points of view. Demonstrates readiness for change, asking questions and determining how changes could impact own work. Identifies trends and patterns emerging from customer preferences and works towards customizing / refining existing services to exceed customer needs and expectations. Targets communications for the appropriate audience, clearly articulating and presenting his / her position or decision. Sets realistic stretch goals for self & others to achieve and exceed defined goals / targets. Displays sensitivity in interactions and strives to understand others’ views and concerns. Flexible work arrangements, Free spirit, and emotional positivity Agile self-determination, trust, transparency, and open collaboration All Support needed for the realization of business goals, Stable employment with a great atmosphere and ethical corporate culture
Job Description
Platform Design & Architecture
- Lead the design and deployment of large-scale data solutions on Databricks.
- Establish best practices for notebook development, job orchestration, and cluster management.
- Stay updated with the latest Databricks features and implement improvements.
Data Engineering & Pipeline Development
Cloud Integration
Data Governance & Security
DevOps & Automation
Team Collaboration
Required Technical / Functional Competencies
Domain / Industry Knowledge :
Requirement Gathering and Analysis :
Product / Technology Knowledge :
Architecture tools and frameworks :
Architecture concepts and principles :
Analytics Solution Design :
Tools & Platform Knowledge :
Required Behavioral Competencies
Accountability :
Collaboration :
Agility :
Customer Focus :
Communication :
Drives Results :
Resolves Conflict :
Certifications
Mandatory At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale. Our Hyperlearning workplace is grounded upon four principles
Create a job alert for this search
Tech Lead • indore, India
Related jobs
- Promoted
- New!
Tech Lead - AWS SageMaker Job
YASH Technologiesindore, India Simplify analytics and AI with unified data management across Amazon S3 data lakes, Amazon Redshift data warehouses, operational databases, and enterprise applications.
Use Visual ETL jobs and unifi...Show moreLast updated: 15 hours ago
- Promoted
- New!
Tech Lead - AWS Data Engineer Job
YASH Technologiesindore, India Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: 15 hours ago
- Promoted
- New!
IoT - Module Lead Job
YASH Technologiesindore, India Designing and developing IoT solutions using AWS IoT services (e.IoT Core, Device Management, IoT Analytics, IoT GreenGrass and IoT Events).
Experience with designing solution with EC2, S3, Lambda, ...Show moreLast updated: 15 hours ago
- Promoted
Technical Lead
Chargebeeindore, madhya pradesh, in Chargebee is a subscription billing and revenue management platform powering some of the fastest-growing brands around the world today, including Calendly, Hopin, Pret-a-Manger, Freshworks, Okta, S...Show moreLast updated: 21 days ago
- Promoted
ETL LEAD with IBM DataStage experienced
IntraEdgeindore, madhya pradesh, in ETL Developer – DataStage, AWS, Snowflake.We are looking for a talented and motivated ETL Developer / Senior Developer.You will work on building scalable and efficient data pipelines using.IBM Data...Show moreLast updated: 30+ days ago
- Promoted
- New!
Sr. Tech Lead - Microsoft Fabric Job
YASH TechnologiesIndore, India Data Engineering for analytical projects.Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integ...Show moreLast updated: 15 hours ago
- Promoted
Senior Manager - Data Engineering Lead
DIAGEO Indiaindore, madhya pradesh, in Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field.
Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 27 days ago
- Promoted
Lead Azure Data Engineer
RandomTreesindore, madhya pradesh, in We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.
If you're passionate about building r...Show moreLast updated: 27 days ago
- Promoted
- New!
Tech Lead - Data Modeler Job
YASH TechnologiesIndore, India Collaborate with business analysts and data engineers to understand data requirements.Maintain and update data models as business needs evolve.
Work with database administrators to implement models ...Show moreLast updated: 15 hours ago
- Promoted
Data Engineering Azure databricks
EXLindore, madhya pradesh, in Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Work with stakeholders to unders...Show moreLast updated: 1 day ago
- Promoted
Technical Lead
Antal Internationalindore, madhya pradesh, in Polyglot Developer (Technical Lead).You’ll design, build, and deploy scalable solutions, working closely with clients to bring strategic technical visions to life.
Design and deliver scalable backen...Show moreLast updated: 19 days ago
- Promoted
- New!
Technical Architect - Databricks Job
YASH Technologiesindore, India Design and implement scalable data architectures using .Develop and maintain data models, databases, and ETL pipelines.Integrate legacy systems including .
Collaborate with software engineers to bui...Show moreLast updated: 15 hours ago
- Promoted
- New!
Module Lead - Teradata Job
YASH TechnologiesIndore, India Design, implement, and support applications that use Teradata databases, atleast 4+ year exp into Teradata.Write SQL queries to support business requirements.
Create and maintain technical documenta...Show moreLast updated: 15 hours ago
- Promoted
Technical Lead
HCLTechindore, madhya pradesh, in NET MVC), Ensure all front-end and back-end components meet WCAG 2.RESTful APIs, version control (TFS), and CI / CD practices.
Proven experience delivering WCAG 2.Proficiency in one or more MVC framew...Show moreLast updated: 30+ days ago
- Promoted
Technical Lead - Backend
dialfloindore, madhya pradesh, in Hiring Backend Technical Lead at Dialflo – Build Dialect Aware AI Systems that talks like a Human!.AI-powered voice calls, making phone numbers their new business identity.We’re a Bangalore-based, ...Show moreLast updated: 16 days ago
- Promoted
- New!
Tech Lead - Databricks Job
YASH TechnologiesIndore, India Platform Design & Architecture.Lead the design and deployment of large-scale data solutions on Databricks.Establish best practices for notebook development, job orchestration, and cluster managemen...Show moreLast updated: 15 hours ago
- Promoted
- New!
Tech Lead - Microsoft Fabric Job
YASH Technologiesindore, India Data Engineering for analytical projects.Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integ...Show moreLast updated: 15 hours ago
- Promoted
- New!
Tech Lead - Data Modeling Job
YASH TechnologiesIndore, India We are looking for a seasoned Data Modeler with 8–10 years of experience in enterprise data modelling, Source-to-Target (ST) mapping, and data profiling.
The ideal candidate will be responsible for ...Show moreLast updated: 15 hours ago
- Promoted
Lead Data Engineer
Eucloid Data Solutionsindore, madhya pradesh, in Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
- Promoted
Data Engineer Team Lead
SGIindore, madhya pradesh, in To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 7 days ago