Data Integration Engineer

Description

: SSIS Conversion to Abinitio

Responsibilities for Ab Initio developer :

Knowledge of databases and database concepts to support Design / development of Datawarehouse / Datalake application.

Analyze the business requirements and work with the business and data modeler to support dataflow from source to target destination

Follow release and change processes : distribution of software builds and releases to development , test environments and production

Adheres to project's SDLC process (Agile), participates in Team discussion, scrum call, and works collaboratively with internal and external team members

Develop ETL using Ab Initio, Databases : MS SQL server, Bigdata, text / excel files

Should engage in the intake / release / change / incident / problem management processes

Should be able to prioritize and drive all the relevant support priorities including (Incident, change, problem, knowledge, engagement with projects )

Develop and document a high-level Conceptual Data Process Design for review by Architect, data analysts that will serve as a basis for writing ETL code and designing test plans

Thoroughly unit test ETL code to ensure error free / efficient delivery

Analyze several aspects of code prior to release to ensure that it will run efficiently and can be supported in the production environment.

Should be able to provide data modeling solutions.

Be independent developer. Seek support from seniors in the team for ensuring smooth delivery

Qualifications for Ab Initio developer :

Minimum 7+ years professional experience in ETL-Ab Initio, RDBMS(MS SQL Server), Batch Processing

Strong in-depth knowledge of RDBMS database, Datawarehouse / Datalake concepts

Should be well proficient in Ab Initio, MS SQL Server, Hadoop / MangoDB, other Scripting to support ETL development

4+ years of experience in Datawarehouse / Datalake development using the Ab Initio ETL tool as well as have used MS SQL database

Experience with scripting language such as T-SQl, hive / hql, batch scripting, shell scripting and any other popular scripting

Experience working in complex development environment with Large data

Strong Communication / team skills and analytical skills

Ability to articulate advanced technical topics to both technical and non-technical staff