Databricks consultant

Role : Databricks consultant

Location : PAN India (Cognizant Office)

Exp : 10 to 12 years

Senior Data Engineer : Years for Exp : 10-12 yrs.

Must Have : Python, Databricks, DBT (Data Build Tool), SQL, DAB, Spark, Delta tables,

Nice to have : Collibra DQ, Collibra, Jenkins

Job Description :

• Build and maintain robust data pipelines using Python, Databricks, Spark, DBT, and Delta Lake to transform and deliver high quality analytics-ready datasets.
• Design and implement efficient data models (star, snowflake, and dimensional schemas), choosing normalized or denormalized structures based on performance and use cases.
• Write performant SQL and Databricks notebooks, manage versioning and orchestration, and ensure data quality and lineage across pipelines.
• Leveraging tools Github actions / Jenkins to automate testing, validation, and deployments.
• Implement best practices in data modeling, performance tuning, and scalable architecture and coding practices
• Nice-to-have additions : experience with Autoloader and SAP integration for ingestion workflows, Collibra, Power BI