Job Title : Senior Databricks Developer
Location : Hyderabad, India
Experience : 68 Years
Employment Type : Full-Time
Job Summary :
We are looking for a skilled and experienced Databricks Developer to join our data engineering team. The ideal candidate will have a strong background in PySpark, Python, SQL, and cloud technologies, particularly AWS. You will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Databricks to support analytics and data-driven decision-making.
Key Responsibilities :
- Develop and optimize large-scale data pipelines using Apache Spark (PySpark) within the Databricks environment.
- Design and implement ETL / ELT processes to support data ingestion and transformation.
- Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver solutions.
- Manage and monitor data workflows on AWS Cloud, ensuring reliability and performance.
- Write efficient, testable, and scalable Python and SQL code to manipulate and analyze data.
- Work with structured and unstructured datasets, implementing data quality and validation rules.
- Participate in code reviews, technical discussions, and architectural decisions.
- Optimize performance of data processing workflows and troubleshoot issues in production environments.
Required Skills & Qualifications :
68 years of hands-on experience in data engineering and big data processing.Proficiency in Apache Spark (PySpark) and Databricks platform.Strong programming experience in Python.Solid knowledge of SQL for data manipulation and analysis.Experience with AWS services such as S3, EC2, Lambda, Glue, or Redshift.Experience with CI / CD pipelines and version control tools (e.g., Git).Strong problem-solving and communication skills.Bachelors or Masters degree in Computer Science, Engineering, or a related field.Preferred Qualifications :
Databricks or AWS certification(s).Experience with Delta Lake, Apache Airflow, or similar orchestration tools.Knowledge of data modeling and warehousing concepts.ref : hirist.tech)