ETL Developer

Summary We are looking for highly skilled Data Engineers with 3 to 5 years of experience in building and managing advanced data solutions. The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata and Google Cloud Platform (GCP).

Key Responsibilities

Be the part of the team towards design, development, and optimization of large-scale data pipelines, ensuring they meet business and technical requirements.

 Implement data solutions using SQL, Ab-Initio, Teradata and GCP; ensuring scalability, reliability, and performance.  Mentor and guide the colleagues in the development and execution of ETL processes and data integration solutions.

 Take ownership of end-to-end data workflows, from data ingestion to transformation, storage, and accessibility.

 Lead performance tuning and optimization efforts for complex SQL queries and Teradata database systems.

 Design and implement data governance, quality, and security best practices to ensure data integrity and compliance.

 Manage the migration of legacy data systems to cloud-based solutions on Google Cloud Platform (GCP).

 Ensure continuous improvement and automation of data pipelines and workflows.  Troubleshoot and resolve issues related to data quality, pipeline performance, and system integration.

 Stay up-to-date with industry trends and emerging technologies to drive innovation and improve data engineering practices within the team.

Required Skills

 4 to 6 years of experience in data engineering or related roles.

 Strong expertise in SQL, Teradata, and Ab-Initio.

 Proficient and good hands on experience in using the Ab-Initio development products - GDE, Conduct>

IT, Control Center, Continuous Flows, EME, M-HUB, etc.

 Hands-on experience over Unix / Shell scripting.

 Proficient in scheduling and analyzing jobs using Autosys (or any similar) Scheduler.  In-depth experience with Google Cloud Platform (GCP), including tools like BigQuery, Cloud Storage, Dataflow, etc.

 Proven track record of leading teams and projects related to data engineering and ETL pipeline development.

 Experience with data warehousing and cloud-native storage solutions.

 Strong analytical and problem-solving skills.

 Experience in setting up and enforcing data governance, security, and compliance standards. Preferred (good to have) Skills

 Familiarity with other cloud platforms / services (AWS, Azure).

 Familiarity with any other ETL tools like Informatica, Datastage, Alteryx, etc.

 Knowledge of Big Data technologies like Hadoop, Spark, Hive, Scala, etc.  Strong communication skills and the ability to collaborate effectively with both technical and non-technical teams.