Overview :
TekWissen is a global workforce management provider throughout India and many other countries in the world. The below client is a global company with shared ideals and a deep sense of family. From our earliest days as a pioneer of modern transportation we have sought to make the world a better place one that benefits lives communities and the planet
Job Title : Software Engineer IV - Premium Engineer III
Location : Chennai
Work Type : Hybrid
Position Description :
- As our Senior Data Engineer you will be a key driver of our data engineering strategy focusing on the design implementation and maintenance of our data infrastructure on Google Cloud Platform (GCP).
- You will leverage your expertise in GCP services (Data Engineering Pipeline BigQuery DataFlow etc.) and related technologies to build and enhance our data pipelines and platforms ensuring they are scalable reliable and adaptable to our evolving needs.
Responsibilities :
Your responsibilities will include :Platform Migration and Modernization : Lead setting up of data in GCP ensuring data integrity and designing for scalability and performance.Pipeline Development and Enhancement : Design develop and maintain robust and scalable data pipelines using GCP services (BigQuery DataFlow Batch processing etc.).This includes creating reusable components implementing best practices and ensuring the pipelines maintainability and extensibility.Experience with automated data lineage is essential.Data Governance and Security : Implement and maintain data governance and security best practices within the GCP environment ensuring compliance with relevant regulations.CI / CD Integration : Integrate data pipelines into our continuous integration and continuous delivery (CI / CD) pipeline.Performance Optimization : Continuously monitor and optimize the performance of data pipelines and platforms to ensure fast and reliable data processing.Troubleshooting and Debugging : Identify troubleshoot and resolve issues related to data pipelines and platforms providing timely solutions to ensure continuous data flow.Reporting and Analysis : Generate reports on data pipeline performance and data quality analyzing results to identify trends and areas for improvement.Skills Required :
Google Cloud Platform - Biq Query Data FlowDataproc Data Fusion TERRAFORM TektonCloud SQLAIRFLOW POSTGRES Airflow PySpark Python APISkills Preferred :
Big Query AIRFLOWExperience Required :
Engineer III Exp : 2 coding lang. or adv. 1 lang.6 years in IT;4 years in developmentExperience Preferred :
Experience in GCP Big-Query Astronomer and exp in any ETL technologyEducation Required :
Bachelors DegreeEducation Preferred :
Bachelors DegreeTekWissen Group is an equal opportunity employer supporting workforce diversity.
Key Skills
Spring,.NET,C / C++,Go,React,OOP,C#,Data Structures,JavaScript,Software Development,Java,Distributed Systems
Employment Type : Full Time
Experience : years
Vacancy : 1