Sr Data Engineer

Experience Level: 6+ years

About Us

ServCrust is revolutionizing the Construction and Mining Industry with its one-of-a-kind eCommerce, ERP,

and Fintech platform. Our cutting-edge cloud-based SaaS technologies are driven by a strong data-first

approach and AI-powered workflows. We are seeking Senior Engineers with a passion for technology and

a proven track record in Agile product development. Join us on our journey to build India's leading

eCommerce platform.

Responsibilities

• Lead the design and development of scalable, robust data solutions that meet cross-functional teams' data requirements.
• Architect, develop, and optimize ETL (Extract, Transform, Load) processes to seamlessly integrate data from multiple sources into our data warehouse.
• Implement advanced data modeling techniques and design efficient, optimized databases to support complex business needs.
• Ensure the highest levels of data quality and integrity through rigorous data validation and cleansing processes.
• Collaborate closely with data scientists and analysts to provide clean, structured data for advanced analytics and machine learning models.
• Oversee and manage big data technologies and frameworks, including Hadoop, Spark, and Apache Airflow, to handle large-scale data processing tasks.
• Optimize, troubleshoot, and enhance the performance, scalability, and reliability of data processing pipelines.
• Mentor junior engineers and lead initiatives to integrate industry best practices and emerging technologies in data engineering into our workflows.
• Contribute to the strategic planning of data infrastructure to support the company's growing data needs.
  
  

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 6+ years of experience in data engineering or a related role.
• Expertise in programming languages such as Python, Java, or Scala.
• Advanced experience with SQL and database technologies (e.g., PostgreSQL, MySQL).
• Proven expertise in designing and optimizing ETL processes and tools.
• Deep understanding of data modeling, database design principles, and data architecture.
• Extensive hands-on experience with big data technologies and distributed computing environments.
• Strong problem-solving and analytical skills, with a proven ability to lead complex projects. 9. Demonstrated ability to optimize and scale data processing pipelines for performance and reliability.

Skills Required
Spark, Etl, Scala, Sql, Apache Airflow, Java, Mysql, Postgresql, Python, Hadoop