This job offer is not available in your country.
Tech Lead - Databricks Job
YASH Technologieshyderabad, India5 hours ago
Job descriptionArchitect and develop ETL / ELT pipelines using PySpark, Spark SQL, and Delta Lake. Optimize data workflows for performance, scalability, and cost-efficiency. Integrate structured and unstructured data from various sources. Leverage cloud services (AWS S3, Lambda, Glue, etc.) for data processing. Ensure secure and compliant integration between Databricks and cloud platforms. Implement data governance policies using Unity Catalog or similar tools. Ensure data lineage, cataloging, and access control compliance. Collaborate with DevOps teams to automate deployments using CI / CD pipelines (Azure DevOps, Git). Manage infrastructure as code and monitor workloads for performance bottlenecks. Mentor junior developers and conduct code reviews. Work closely with data scientists, analysts, and business stakeholders. Communicate technical concepts effectively to both technical and non-technical audiences. Basic knowledge of customer's business processes- relevant technology platform or product. Able to prepare process maps, workflows, business cases and simple business models in line with customer requirements with assistance from SME and apply industry standards / practices in implementation with guidance from experienced team members. Working knowledge of requirement management processes and requirement analysis processes, tools & methodologies. Able to analyse the impact of change requested / enhancement / defect fix and identify dependencies or interrelationships among requirements & transition requirements for engagement. Working knowledge of technology product / platform standards and specifications. Able to implement code or configure / customize products and provide inputs in design and architecture adhering to industry standards / practices in implementation. Analyze various frameworks / tools, review the code and provide feedback on improvement opportunities. Working knowledge of architecture Industry tools & frameworks. Able to identify pros / cons of available tools & frameworks in market and use those as per Customer requirement and explore new tools / framework for implementation. Working knowledge of architectural elements, SDLC, methodologies. Able to provides architectural design / documentation at an application or function capability level and implement architectural patterns in solution & engagements and communicates architecture direction to the business. Knowledge of statistical & machine learning techniques like classification, linear regression modelling, clustering & decision trees. Able to identify the cause of errors and their potential solutions. Familiar with wide range of mainstream commercial & open-source data science / analytics software tools, their constraints, advantages, disadvantages, and areas of application. Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team. Shares information within team, participates in team activities, asks questions to understand other points of view. Demonstrates readiness for change, asking questions and determining how changes could impact own work. Identifies trends and patterns emerging from customer preferences and works towards customizing / refining existing services to exceed customer needs and expectations. Targets communications for the appropriate audience, clearly articulating and presenting his / her position or decision. Sets realistic stretch goals for self & others to achieve and exceed defined goals / targets. Displays sensitivity in interactions and strives to understand others’ views and concerns. Flexible work arrangements, Free spirit, and emotional positivity Agile self-determination, trust, transparency, and open collaboration All Support needed for the realization of business goals, Stable employment with a great atmosphere and ethical corporate culture
Job Description
Platform Design & Architecture
- Lead the design and deployment of large-scale data solutions on Databricks.
- Establish best practices for notebook development, job orchestration, and cluster management.
- Stay updated with the latest Databricks features and implement improvements.
Data Engineering & Pipeline Development
Cloud Integration
Data Governance & Security
DevOps & Automation
Team Collaboration
Required Technical / Functional Competencies
Domain / Industry Knowledge :
Requirement Gathering and Analysis :
Product / Technology Knowledge :
Architecture tools and frameworks :
Architecture concepts and principles :
Analytics Solution Design :
Tools & Platform Knowledge :
Required Behavioral Competencies
Accountability :
Collaboration :
Agility :
Customer Focus :
Communication :
Drives Results :
Resolves Conflict :
Certifications
Mandatory At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale. Our Hyperlearning workplace is grounded upon four principles
Create a job alert for this search
Tech Lead • hyderabad, India
Related jobs%20Ltd)
- Promoted
- New!
IoT Cloud Data lead
Anicalls (Pty) Ltdhyderabad, India Experience with Data ingestion patterns.Strong data engineering and consulting experience.Experience with Analytics strategies of IoT data in the cloud.
Knowledge of emerging technologies in Cloud (...Show moreLast updated: 5 hours ago
- Promoted
- New!
Database Team Lead
Chiselon Technologies Pvt Ltdhyderabad, India Experience building and optimizing big data data pipelines, architectures, and data sets.Experience in relational databases such as.
Postgres, Oracle SnowFlake, BigQuery, and other cloud databases.E...Show moreLast updated: 5 hours ago
- Promoted
- New!
PowerBI Developer
Saaki Argus & Averil Consultinghyderabad, India About the client : One of the leading Data Analytics and AI services MNC Company.Lead Developer - Power BI and SQL.We are seeking an experienced and results-driven Lead Developer specializing in Pow...Show moreLast updated: 5 hours ago
- Promoted
- New!
Tech Lead
Virtusahyderabad, India Tech Lead - CREQ Description Design and develop on Hadoop applications,.Hands on in developing Jobs in pySpark with Python / SCALA (Preferred) or Java / SCALA.
Experience on Core Java, Experience on ...Show moreLast updated: 5 hours ago
- Promoted
- New!
Principal Consultant- Databricks Lead Developer!
Genpacthyderabad, India Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 5 hours ago
- Promoted
- New!
Module Lead - Teradata Job
YASH Technologieshyderabad, India Design, implement, and support applications that use Teradata databases, atleast 4+ year exp into Teradata.Write SQL queries to support business requirements.
Create and maintain technical documenta...Show moreLast updated: 5 hours ago
- Promoted
- New!
Technical Lead with Cloud GCP
Virtusahyderabad, India Technical Lead with Cloud GCP - CREQ Description Mandatory Skills.Technical Lead with Cloud GCP Experience 8 to 12 Years.
Experience in working within an agile, multidisciplinary devops team.Hadoop...Show moreLast updated: 5 hours ago
- Promoted
- New!
Tech Lead - Data Modeler Job
YASH Technologieshyderabad, India Collaborate with business analysts and data engineers to understand data requirements.Maintain and update data models as business needs evolve.
Work with database administrators to implement models ...Show moreLast updated: 5 hours ago
- Promoted
- New!
Tech Lead - Data Modeling Job
YASH Technologieshyderabad, India We are looking for a seasoned Data Modeler with 8–10 years of experience in enterprise data modelling, Source-to-Target (ST) mapping, and data profiling.
The ideal candidate will be responsible for ...Show moreLast updated: 5 hours ago
- Promoted
- New!
Tech Lead - AWS SageMaker Job
YASH Technologieshyderabad, India Simplify analytics and AI with unified data management across Amazon S3 data lakes, Amazon Redshift data warehouses, operational databases, and enterprise applications.
Use Visual ETL jobs and unifi...Show moreLast updated: 5 hours ago
- Promoted
- New!
Module Lead - Azure Databricks Job
YASH Technologieshyderabad, India Should have good hands-on azure services and data bricks and should have strong knowledge in medallion architecture.At YASH, you are empowered to create a career that will take you to where you wan...Show moreLast updated: 5 hours ago
- Promoted
- New!
Azure Data Technical Delivery Lead...
Anicalls (Pty) Ltdhyderabad, India Azure DataFactory (ADF) • In - depth SQL.PowerBI • Ability to handle his pressure environments.Show moreLast updated: 5 hours ago
- Promoted
- New!
Sr. Tech Lead - Microsoft Fabric Job
YASH Technologieshyderabad, India Data Engineering for analytical projects.Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integ...Show moreLast updated: 5 hours ago
- Promoted
- New!
Cloud Technical Lead - Data.
Insight Enterpriseshyderabad, India Location : Delhi NCR, Bangalore, Hyderabad, Pune.Received 35+ industry and partner awards in the past year.Fortune’s World's Best Workplaces list.
Forbes World's Best Employers in IT – 2023.Forbes Be...Show moreLast updated: 5 hours ago
- Promoted
- New!
Azure Data Engineering Lead
Trigent Software Private Limitedhyderabad, India We are looking for a highly skilled Azure Data Engineering Lead to design, develop, and optimize scalable data solutions using Azure Databricks and Azure Data Factory (ADF).This role involves colla...Show moreLast updated: 5 hours ago
- Promoted
- New!
Technology Lead
Infosyshyderabad, India PROGRESS DB, Appserver, Roundtable, XML • Strong analytical and problem-solving skills • Excellent written and verbal communication skills • Willing to learn new tools and technologies.SQL, PL / SQL • Da...Show moreLast updated: 5 hours ago
- Promoted
- New!
Tech Lead - Microsoft Fabric Job
YASH Technologieshyderabad, India Data Engineering for analytical projects.Proven expertise in designing, developing, and deploying high-volume, end-to-end ETL pipelines for complex models, including batch, and real-time data integ...Show moreLast updated: 5 hours ago
- Promoted
- New!
Lead Consultant- Databricks Developer!
Genpacthyderabad, India Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 5 hours ago