Pinnacle Infotech - Data Engineer - ETL / Big Data

Job Summary :

We are seeking a highly proficient Data Engineer with 46+ years of specialized experience in designing, building, and maintaining robust, scalable, and secure data infrastructure.

This role is pivotal in enabling advanced analytics, reporting, and machine learning use cases by focusing on data integration, transformation (ETL / ELT), and optimal storage solutions.

The engineer will collaborate closely with data analysts, data scientists, and software engineers to ensure high-quality, well-structured datasets are accessible, accurate, and ready for critical business decision-making and product innovation.

Job Description :

Data Pipeline Architecture and Development :

• Design, build, and optimize scalable and resilient data pipelines and architectures, ensuring reliable, high-volume data flow from various sources.
• Utilize expert proficiency in programming languages such as Python, Java, or Scala for the development and maintenance of complex data processing pipelines.
• Implement and manage stream processing technologies like Kafka or Kinesis to handle real-time data ingestion and processing requirements.
• Lead the technical execution of data integration, transformation, and storage processes (ETL / ELT) to deliver clean, structured data for downstream consumption.
• Apply strong analytical and troubleshooting skills to proactively identify and resolve data quality, pipeline performance, and data integrity issues.

Database and Data Modeling Expertise :

Analytics, Integration, and Collaboration :

Required Skills & Expertise :

Programming :

Databases (Relational) :

Databases (NoSQL) :

Streaming / Big Data :

Data Integration :

Quality & Performance :

Soft Skills :

(ref : hirist.tech)