Data Engineer

Job Description & Summary : A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Job Position Title : Senior Associate

Responsibilities :

• Design, develop, and maintain scalable ETL / ELT pipelines
• Ingest data from various sources (APIs, databases, files, etc.)
• Implement both real-time and batch processing solutions based on use case requirements
• Ensure data quality through validation and cleansing processes
• Collaborate with Product Managers and Business Stakeholders to gather and understand data requirements
• Translate business needs into technical specifications
• Ensure data security, access control, and compliance with relevant policies
• Maintain documentation and follow best practices for data engineering

Mandatory skill sets :

1. AWS, 2. Snowflake, 3. Kafka, 4. Airflow, 5. GitHub, 6. PySpark 7.

All Mandatory

Years of experience required :

Experience and Qualifications

Education qualification :

o BE, B.Tech, ME, M,Tech, MBA, MCA