Senior Data Engineer

We are looking for a Senior Data Engineer with at least 6+ years of development experience as Data Engineer.

Location : Pune (On-Site)

Job Description :

• Responsible for design, development, optimization, and maintenance of robust and scalable data engineering pipelines.
• Ensure data and analytical solutions meet Business Requirements and best practices.
• Collaborate with data architects, data scientists, and other stakeholders to provide scalable analytical solutions for the organization.
• Continuously improve and optimize existing ETL processes, adhering to data privacy and best practices.
• Document all data engineering processes and architecture.
• Development, maintenance, and enhancement of Data Pipelines (ETL / ELT) and processes with thorough knowledge of star / snowflake schemas
• Developing complex SQL queries and SQL optimization
• Development experience must be full Life Cycle experience, including business requirements gathering, data sourcing, testing / data reconciliation, and deployment within Business
• Intelligence / Data Warehousing Architecture.
• Designing and implementing data security
• Monitoring and optimizing data storage and data processing
• Use of Object function / object-oriented scripting languages, including Scala, C++, Java, and Python
• Cloud data warehouse and data lake platforms (e.g., Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Apache Haddop, etc.)
• Demonstrated understanding and experience using software and tools including ETL, relational
• SQL and NoSQL databases, big data tools like Kafka, Spark, and Hadoop
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Understanding of data science concepts
• Familiarity with AI / ML frameworks and libraries