About the Role :
We are building an independent AI team to power next-generation data-driven solutions for AashaPurti (Personal & Gold Loans) and India Online Pay (Payment Gateway). As a Data Engineer, you will play a key role in designing and implementing scalable data pipelines, data lakes, and ETL workflows to support AI models, real-time analytics, and BI dashboards. You will ensure high-quality, reliable, and secure data availability for credit scoring, fraud detection, and other fintech use cases.
Key Responsibilities :
- Design, develop, and maintain ETL / ELT pipelines for structured and unstructured data from multiple sources (loan management systems, payment gateways, transaction logs, external APIs like CIBIL).
- Build and manage data lakes and data warehouses for analytics and machine learning use cases.
- Optimize data ingestion and processing frameworks for real-time and batch workflows.
- Implement data quality, validation, and monitoring systems.
- Work closely with Data Scientists, AI Engineers, and BI teams to deliver high-quality datasets for model training and dashboards.
- Ensure data security and compliance with RBI guidelines, GDPR, and internal policies.
- Collaborate with MLOps engineers for model deployment pipelines.
- Troubleshoot data-related issues and optimize performance for scalability.
- Document data models, workflows, and processes.
Required Skills & Qualifications :
Education : B.E / B.Tech / MCA / M.Sc. in Computer Science, Data Engineering, or related field.
Experience : 36 years in Data Engineering roles (preferably in fintech, banking, or payment systems).
Technical Skills :
Strong programming skills in Python (Pandas, PySpark) or Java / Scala.Proficient in SQL and NoSQL databases (PostgreSQL, MongoDB, Cassandra).Experience with big data technologies : Apache Spark, Hadoop, Kafka.Hands-on with ETL tools (Airflow, Prefect, Luigi).Familiarity with cloud platforms (AWS / GCP / Azure) and data services (S3, BigQuery, Redshift).Knowledge of data lake and warehouse design.Bonus Skills :
Experience with real-time streaming (Kafka, Kinesis).Exposure to MLOps and AI / ML data pipelines.Understanding of fintech data structures (KYC, transactions, credit scoring).Soft Skills :
Strong problem-solving and analytical skills.Ability to work in a fast-paced, agile environment.Excellent communication and documentation skills.Compliance & Security Awareness :
Familiarity with RBI guidelines, data localization, and data privacy regulations.Experience implementing data encryption and masking techniques.Why Join Us?
Work on cutting-edge AI and analytics solutions in the fintech domain.Be part of a new AI innovation team with high visibility and impact.Opportunity to design data architecture from the ground up.Competitive compensation, flexible work culture, and growth opportunities(ref : hirist.tech)