IICS Developer - ETL/Azure Databricks

Job Summary :

We are seeking an experienced Informatica Intelligent Cloud Services (IICS) Developer with hands-on expertise in Databricks to design, develop, and support cloud-based data integration and ETL solutions. The ideal candidate should have strong experience in building scalable data pipelines, integrating multiple cloud and on-premises data sources, and working with modern cloud data platforms.

Key Responsibilities :

- Design, develop, and maintain ETL/ELT pipelines using Informatica Intelligent Cloud Services (IICS).

- Build and optimize data integration workflows using Cloud Data Integration (CDI), Mass Ingestion, and Cloud Data Integration services.

- Develop and support scalable data pipelines using Databricks (PySpark & Spark SQL).

- Integrate data from cloud and on-premises sources including Oracle, SQL Server, Snowflake, Azure Data Lake, AWS S3, Google Cloud Storage, PostgreSQL, MySQL, and REST/SOAP APIs.

- Perform data extraction, transformation, cleansing, validation, and loading (ETL/ELT).

- Develop reusable mappings, parameterized mappings, taskflows, mapping templates, and workflow automation.

- Optimize ETL jobs for performance, scalability, reliability, and maintainability.

- Collaborate with business analysts, data engineers, architects, and stakeholders to understand business requirements and deliver high-quality solutions.

- Monitor production jobs, troubleshoot failures, perform root cause analysis, and implement preventive measures.

- Participate in code reviews, unit testing, deployment, release management, and production support.

- Prepare technical documentation and facilitate knowledge transfer sessions.

- Follow ETL development standards, data governance, and best practices.

Mandatory Skills :

- 5+ years of experience in ETL/Data Integration development.

- 3+ years of hands-on experience with Informatica Intelligent Cloud Services (IICS).

- Strong expertise in :

1. IICS Cloud Data Integration (CDI)

2. Mapping Designer

3. Taskflows

4. Dynamic Mapping

5. Parameter Files

6. Reusable Mappings

7. Scheduling & Monitoring

8. REST & SOAP API Integration

9. Error Handling and Logging

- Hands-on experience with Databricks.

- Strong knowledge of PySpark and Spark SQL.

- Experience working with Delta Lake.

- Strong SQL programming and query optimization skills.

- Experience with cloud storage platforms :

1. Azure Data Lake Storage (ADLS)

2. AWS S3

3. Google Cloud Storage (GCS)

- Experience working with relational databases such as :

1. Oracle

2. SQL Server

3. PostgreSQL

4. MySQL

- Good understanding of ETL best practices, performance tuning, data quality, and metadata management.

- Experience in production support, incident management, and troubleshooting.

Preferred Skills :

- Experience with Snowflake integration.

- Knowledge of Azure Data Factory (ADF) or other cloud ETL tools.

- Familiarity with CI/CD pipelines and Git version control.

- Experience working in Agile/Scrum environments.

- Exposure to cloud platforms such as Azure, AWS, or Google Cloud Platform (GCP).

- Knowledge of data warehousing concepts and dimensional modeling.

- Familiarity with Informatica Mass Ingestion and Cloud Application Integration (CAI) is an added advantage.

Qualifications :

- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

- Informatica IICS Certification is a plus.

Nice to Have :

- Experience with Delta Live Tables (DLT).

- Exposure to Unity Catalog.

- Experience with Apache Spark optimization techniques.

- Understanding of Data Lakehouse architecture.

- Knowledge of DevOps tools such as Azure DevOps, Jenkins, or GitHub Actions.

(ref:hirist.tech)