Data Engineer

JOB OBJECTIVE

We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality, and accessibility for data-driven decision-making.

KEY ACCOUNTABILITIES

• Data Pipeline Development : o Design, develop, and maintain data pipelines to ingest, process, and transform data from various sources into usable formats. o Implement data integration solutions that connect disparate data systems, including databases, APIs, and third-party data sources.
• Data Storage and Warehousing :

Create and manage data storage solutions, such as data lakes, data warehouses, and NoSQL databases.

Optimize data storage for performance, scalability, and cost-efficiency.

Data Quality and Governance : o Establish data quality standards and implement data validation and cleansing processes.

o Collaborate with data analysts and data scientists to ensure data consistency and accuracy.

ETL (Extract, Transform, Load) :

o Develop ETL processes to transform raw data into a structured and usable format.

o Monitor and troubleshoot ETL jobs to ensure data flows smoothly.

Performance Tuning :

o Optimize data pipelines and queries for improved performance and efficiency.

o Identify and resolve bottlenecks in data processing.

o Maintain comprehensive documentation for data pipelines, schemas, and data dictionaries.

o Create and update data lineage and metadata documentation.

Scalability and Reliability :

o Design data infrastructure to scale with growing data volumes and business requirements.

o Implement data recovery and backup strategies to ensure data availability and resilience.

o Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver data solutions.

o Provide technical support and guidance to data users.

o Stay updated on emerging technologies, tools, and best practices in data engineering.

o Implement new technologies to enhance data processing capabilities.

QUALIFICATIONS, EXPERIENCE, & COMPETENCIES

Interviews in Chennai –

Positions : Python / java / data engineer / fronted developer

Interview Dates : (20th September Saturday)

Years of experience - 4-12 Years

Preferences – previous experience in BFSI, NBFC, MFI or in fintech organization.

Venue : will be informed shortly ( Chennai)

Eligibility Criteria : BE / B. Tech only.

sahiba