Databricks consultant

Role : Databricks consultant

Location : PAN India (Cognizant Office)

Exp : 10 to 12 years

Senior Data Engineer : Years for Exp : 10-12 yrs.

Must Have : Python, Databricks, DBT (Data Build Tool), SQL, DAB, Spark, Delta tables,

Nice to have : Collibra DQ, Collibra, Jenkins

Job Description :

Build and maintain robust data pipelines using Python, Databricks, Spark, DBT, and Delta Lake to transform and deliver high quality analytics-ready datasets.

Design and implement efficient data models (star, snowflake, and dimensional schemas), choosing normalized or denormalized structures based on performance and use cases.

Write performant SQL and Databricks notebooks, manage versioning and orchestration, and ensure data quality and lineage across pipelines.

Leveraging tools Github actions / Jenkins to automate testing, validation, and deployments.

Implement best practices in data modeling, performance tuning, and scalable architecture and coding practices

Nice-to-have additions : experience with Autoloader and SAP integration for ingestion workflows, Collibra, Power BI