Job Title : Senior Data Engineer
Location : Bengaluru / Coimbatore
Job Type : Full-Time
Immediate joiners or notice period of less than 10days are needed.
Job Role :
As a Senior Data Engineer at LogixHealth, you will work with a globally distributed team of engineers to design and build cutting-edge solutions that directly improve the healthcare industry. You’ll contribute to our fast-paced, collaborative environment and bring your expertise to continue delivering innovative technology solutions, while mentoring others.
Duties and Responsibilities :
- Lead and contribute to the creation of a self-service data platform for reporting and analytics
- Design and build data solutions using Databricks, SQL, Python, Spark, and Delta Lake in the Azure ecosystem (Blob Storage, Data Factory, Event Hubs)
- Ensure best practices for ETL / ELT processes (data quality management, data processing, data partitioning, maintainability, and reusability)
- Collaborate with engineers, product, and business leaders to ensure data platform is integrated with other systems and technologies (Tableau, Power BI, APIs, custom applications)
- Establish CI / CD processes, test frameworks, infrastructure-as-code tools, and monitoring / alerting (Git, Terraform, Azure DevOps / GitHub Actions / Jenkins, Azure Monitor / Datadog)
- Adhere to the Code of Conduct and be familiar with all compliance policies and procedures stored in LogixGarden relevant to this position
Qualifications :
To perform this job successfully, an individual must be able to perform each duty satisfactorily. The requirements listed below are representative of the knowledge, skills, and / or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the duties.
Education (Degrees, Certificates, Licenses, Etc.)
BE (or higher, MS / PhD) degree in computer science / related field, or equivalent technical experience.
Experience :
Experience with native and third-party Databricks integrations (Delta Live Tables, Auto Loader, Databricks Workflows / Apache Airflow, Unity Catalog)8+ years data engineering experience3+ years in a Senior, Staff or Principal Engineer roleExperience designing scalable data pipelinesExperience leading projects within a team and across teamsAzure experience preferredAzure Databricks implementation experience preferredExperience designing and implementing data security and governance platform adhering to compliance standards (HIPPA, SOC 2) preferredSpecific Job Knowledge, Skill and Ability :
Strong programming skills in pySpark / ScalaStrong Dataframe programming skills, such as Spark, Pandas, NumPyPassion for mentoring and guiding othersStrong written and verbal communication skillsExpert knowledge in architecting, designing, and implementing data solutions to serve the needs of our business processes and software productsAbility to keep security, maintainability, and scalability in mind with the solutions builtPossess excellent interpersonal communication skills and an aptitude for continued learning