Data Integration Engineer (Airflow)

Job Title : Data Integration Engineer

Location : [Add Location or mention “Remote / Hybrid”]

Company : LumenData

Role Overview

We are seeking a Data Integration Engineer with expertise in building and orchestrating data pipelines using Apache Airflow to integrate data from diverse sources into Snowflake.

The ideal candidate will have strong experience with JDBC and API-based integrations (REST / JSON), hands-on proficiency with Postman, and solid skills in SQL encryption / decryption, Python development, and pipeline monitoring.

Key Responsibilities

• Design, develop, and maintain Airflow DAGs to orchestrate end-to-end data workflows.
• Integrate structured and unstructured data from multiple systems into Snowflake using JDBC connectors, APIs, and flat-file ingestion.
• Use Postman and other tools to test, validate, and automate API integrations.
• Implement SQL encryption / decryption techniques to protect sensitive datasets.
• Perform data quality checks, including row-level validation, hash-based reconciliation, and exception handling.
• Develop transformation logic using Python and SQL, ensuring performance, scalability, and maintainability.
• Implement detailed logging, monitoring, and alerting to ensure pipeline reliability and compliance.
• Collaborate with stakeholders to understand requirements and deliver scalable, production-ready solutions.

Required Skills & Experience