About Company : one of thecloud and data analytics company that empowers businesses to unlock insights and drive innovation through modern data solutions.
Experience : 6+Yrs
Location : Chennai
Roles and responsibilities :
- Design, develop, and maintain scalable data pipelines using Databricks and PySpark .
- Work with large datasets to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.
- Write efficient and optimized SQL queries for data extraction, transformation, and reporting purposes.
- Build automation scripts and tools using Python to support data ingestion and transformation processes.
- Develop and deploy data solutions in a cloud environment (AWS) using services such as S3, Lambda, Glue, Redshift, EMR, and others.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver robust solutions.
- Monitor and optimize data workflows for performance, scalability, and reliability.
- Ensure data quality, consistency, and governance standards are upheld across data assets.
Qualification : B.E / B.TECH