This job offer is not available in your country.
Tech Lead - Databricks Job
ConfidentialHyderabad / Secunderabad, Telangana, India9 days ago
Job descriptionArchitect and develop ETL / ELT pipelines using PySpark, Spark SQL, and Delta Lake. Optimize data workflows for performance, scalability, and cost-efficiency. Integrate structured and unstructured data from various sources. Leverage cloud services (AWS S3, Lambda, Glue, etc.) for data processing. Ensure secure and compliant integration between Databricks and cloud platforms. Implement data governance policies using Unity Catalog or similar tools. Ensure data lineage, cataloging, and access control compliance. Collaborate with DevOps teams to automate deployments using CI / CD pipelines (Azure DevOps, Git). Manage infrastructure as code and monitor workloads for performance bottlenecks. Mentor junior developers and conduct code reviews. Work closely with data scientists, analysts, and business stakeholders. Communicate technical concepts effectively to both technical and non-technical audiences. Basic knowledge of customer's business processes- relevant technology platform or product. Able to prepare process maps, workflows, business cases and simple business models in line with customer requirements with assistance from SME and apply industry standards / practices in implementation with guidance from experienced team members. Working knowledge of requirement management processes and requirement analysis processes, tools & methodologies. Able to analyse the impact of change requested / enhancement / defect fix and identify dependencies or interrelationships among requirements & transition requirements for engagement. Working knowledge of technology product / platform standards and specifications. Able to implement code or configure / customize products and provide inputs in design and architecture adhering to industry standards / practices in implementation. Analyze various frameworks / tools, review the code and provide feedback on improvement opportunities. Working knowledge of architecture Industry tools & frameworks. Able to identify pros / cons of available tools & frameworks in market and use those as per Customer requirement and explore new tools / framework for implementation. Working knowledge of architectural elements, SDLC, methodologies. Able to provides architectural design / documentation at an application or function capability level and implement architectural patterns in solution & engagements and communicates architecture direction to the business. Knowledge of statistical & machine learning techniques like classification, linear regression modelling, clustering & decision trees. Able to identify the cause of errors and their potential solutions. Familiar with wide range of mainstream commercial & open-source data science / analytics software tools, their constraints, advantages, disadvantages, and areas of application. Takes responsibility for and ensures accuracy of own work, as well as the work and deadlines of the team. Shares information within team, participates in team activities, asks questions to understand other points of view. Demonstrates readiness for change, asking questions and determining how changes could impact own work. Identifies trends and patterns emerging from customer preferences and works towards customizing / refining existing services to exceed customer needs and expectations. Targets communications for the appropriate audience, clearly articulating and presenting his / her position or decision. Sets realistic stretch goals for self & others to achieve and exceed defined goals / targets. Displays sensitivity in interactions and strives to understand others' views and concerns. Flexible work arrangements, Free spirit, and emotional positivity Agile self-determination, trust, transparency, and open collaboration All Support needed for the realization of business goals, Stable employment with a great atmosphere and ethical corporate culture
Job Description :
YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.
At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.
We are looking forward to hireDatabricks Professionals in the following areas :
Experience
8-10 Years
Job Description
Platform Design & Architecture
- Lead the design and deployment of large-scale data solutions on Databricks.
- Establish best practices for notebook development, job orchestration, and cluster management.
- Stay updated with the latest Databricks features and implement improvements.
Data Engineering & Pipeline Development
Cloud Integration
Data Governance & Security
DevOps & Automation
Team Collaboration
Required Technical / Functional Competencies
Domain / Industry Knowledge :
Requirement Gathering and Analysis :
Product / Technology Knowledge :
Architecture tools and frameworks :
Architecture concepts and principles :
Analytics Solution Design :
Tools & Platform Knowledge :
Required Behavioral Competencies
Accountability :
Collaboration :
Agility :
Customer Focus :
Communication :
Drives Results :
Resolves Conflict :
Certifications
Mandatory
At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.
Our Hyperlearning workplace is grounded upon four principles
Skills Required
S3, Databricks, Aws, glue , Spark SQL, Lambda, Git, Pyspark, Azure Devops
Create a job alert for this search
Tech Lead • Hyderabad / Secunderabad, Telangana, India
Related jobs
- Promoted
Technical Lead
Chargebeehyderabad, telangana, in Chargebee is a subscription billing and revenue management platform powering some of the fastest-growing brands around the world today, including Calendly, Hopin, Pret-a-Manger, Freshworks, Okta, S...Show moreLast updated: 20 days ago
- Promoted
Technical Lead - Azure Databricks
ValuemomentumHyderabad About the job : Job Title : Databricks Engineer- Lead Primary skills : Databricks, PySpark, SQL ...Show moreLast updated: 30+ days ago
- Promoted
Azure Databricks / PySpark Developer - ETL
JRD Systems Private LtdHyderabad Key Responsibilities : - Design, develop, and maintain scalable data pipelines and ETL / ELT processes using PySpark, SQL, and Python.Build and manag...Show moreLast updated: 30+ days ago
- Promoted
Technical Lead
HCLTechhyderabad, telangana, in Informatica EDC CAI / CDI Developer.Informatica CAI (Cloud Application Integration) - Integration Platform.API Development (REST / SOAP, Swagger / WSDL) - Web Services & APIs.
Workflow Orchestration (Even...Show moreLast updated: 30+ days ago
- Promoted
Tech Lead
CherryTechSolutionshyderabad, telangana, in We are looking for an experienced, skilled, enthusiastic, and energetic.He / she will analyze and improve upon technology standards across the organization to maintain a technological and competitive...Show moreLast updated: 26 days ago
- Promoted
Value Momentum Software - Data Team Lead - ETL / Data Ingestion
ValuemomentumHyderabad Job Title : Tech Lead Databricks Lead Primary skills : Azure Databricks, PySpark, Azure Data Factory Secondary sk...Show moreLast updated: 30+ days ago
- Promoted
Azure Databricks Developer - Data Engineering
People Prime World WideHyderabad About Client : Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.Billion USD, with Global work force of ...Show moreLast updated: 30+ days ago
- Promoted
Technical Lead
ValueMomentumHyderabad, India Location : Hyderabad Preffered ( Open to Remote also).Experience : 8+ years (with 3+ years in Liferay 7.Employment Type : Contract - 3months.
We are seeking a highly skilled and hands-on Liferay Te...Show moreLast updated: 6 days ago
- Promoted
Gramener Technology - Cloud Lead - Analytics & Data Products
Gramener Technology Solutions Private limitedHyderabad What Gramener offers you : Gramener will offer you an inviting workplace, talented colleagues from diverse backgrounds, career path, steady growth prospects with gre...Show moreLast updated: 30+ days ago
- Promoted
Genzeon - Team Lead - Snowflake DB
Genzeon Technology Solutions Pvt. Ltd.Hyderabad Lead Data Engineer - Snowflake Experience Level : 8+ years (with 3+ in Snowflake) Role Overview : Show moreLast updated: 30+ days ago
- Promoted
DigiHelic Solutions - Snowflake Developer - ETL Tools
Digihelic Solutions Private LimitedHyderabad Job Role - Snowflake Developer Experience - 5-7 Years Location - Model - Hybrid Mandatory Skills - Snowflake, PySpark Show moreLast updated: 30+ days ago
- Promoted
Senior Manager - Data Engineering Lead
DIAGEO Indiahyderabad, telangana, in Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field.
Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 26 days ago
- Promoted
YASH Technologies - Tech Lead - Azure Databricks
YASH TechnologiesHyderabad Tech Lead Data Bricks Job : Date : Aug 2, 2025 Job Requisition Id : 5...Show moreLast updated: 30+ days ago
- Promoted
- New!
Technology Lead
BAY6.AIhyderabad, telangana, in AI solutions company that builds purpose-driven software for automation, insights, and customer engagement.We combine AI / ML, APIs, cloud-native architectures, and intelligent automation to deliver ...Show moreLast updated: 7 hours ago
- Promoted
Digital : Databricks
Tata Consultancy ServicesHyderabad, Telangana, India Spark-SQL, Pyspark, Pandas,DevOps, CI / CD ,as SQL server, Oracle.ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team / leads.Assure that data is clean...Show moreLast updated: 30+ days ago
- Promoted
Kanerika Software - Data Engineering Lead - Power BI
Kanerika IncHyderabad Job Location : Hyderabad, Indore and Ahmedabad (India).Following are high level responsibilities that you will play but not limited to : .
Develop and maintain data pipelines using Azure Data Factory (...Show moreLast updated: 18 days ago
- Promoted
Technical Lead
vidaXLhyderabad, telangana, in Job Title : Tech Lead Salesforce (E-Commerce).Work Mode : Semi Hybrid Mode (4days work from office) and (1 day work from home(either Monday or Wednesday or Friday)) in a week.We are looking for an ex...Show moreLast updated: 30+ days ago
- Promoted
Technical Team Lead - Data Engineering
SUPERSOURCING TECHNOLOGIES PRIVATE LIMITEDHyderabad Key Responsibilities : - Design, develop, and maintain data pipelines using Spark DataFrames and Hadoop ecosystem components.
Develop and optimize PySpark (Spa...Show moreLast updated: 30+ days ago
- Promoted
2782 - Technical Lead
EXLHyderabad, Telangana, India We are seeking a seasoned Technical Lead.The ideal candidate will be an expert in container technologies, real-time data streaming, DevOps practices, and performance optimization.You will play a ke...Show moreLast updated: 17 days ago
- Promoted
YASH Technologies - Technical Lead - Data Warehousing Solutions
YASH TechnologiesHyderabad Job Description : Key Responsibilities : <...Show moreLast updated: 30+ days ago