Sr. Data Engineer

PERMEVObhopal, madhya pradesh, in

14 hours ago

Job description

𝗝𝗼𝗯 𝗧𝗶𝘁𝗹𝗲 : Sr. Data Engineer

𝗝𝗼𝗯 𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻 : Chennai, Tamil Nadu, India

𝗝𝗼𝗯 𝗗𝘂𝗿𝗮𝘁𝗶𝗼𝗻 : Permanent

𝗝𝗼𝗯 𝗧𝘆𝗽𝗲 : On-Site

𝗧𝗵𝗲 𝗖𝗵𝗮𝗹𝗹𝗲𝗻𝗴𝗲 :

We are seeking a skilled Sr. Data Engineer with 5-8 years of experience in building and managing data pipelines. The ideal candidate will have a strong proficiency in relational and NoSQL databases, as well as experience with data warehouses and real-time data streaming. This role requires excellent problem-solving skills, attention to detail, and the ability to work effectively in a team environment.

𝗥𝗼𝗹𝗲𝘀 & 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀 :

Design, build, and maintain efficient and scalable data pipelines to support data integration and transformation across various sources.
Work with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra) to manage and optimize large datasets.
Utilize Apache Spark for distributed data processing and real-time analytics.
Implement and manage Kafka for data streaming and real-time data integration between systems.
Collaborate with cross-functional teams to gather and translate business requirements into technical solutions.
Monitor and optimize the performance of data pipelines and architectures, ensuring high availability and reliability.
Ensure data quality, consistency, and integrity across all systems.
Stay up to date with the latest trends and best practices in data engineering and big data technologies.

𝗘𝘀𝘀𝗲𝗻𝘁𝗶𝗮𝗹 𝗦𝗸𝗶𝗹𝗹𝘀 & 𝗥𝗲𝗾𝘂𝗶𝗿𝗲𝗺𝗲𝗻𝘁𝘀 :

𝗠𝘂𝘀𝘁 𝗛𝗮𝘃𝗲 :

5-8 years of experience in data engineering, with a focus on building and managing data pipelines.

Strong proficiency in relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Experience in building data pipelines with data warehouses like Snowflake and Redshift.

Experience in processing unstructured data stored from S3 using Athena, Glue, etc.

Hands-on experience with Kafka for real-time data streaming and messaging.

Solid understanding of ETL processes, data integration, and data pipeline optimization.

Proficiency in programming languages like Python, Java, or Scala for data processing.

Experience with Apache Spark for big data processing and analytics.

Excellent problem-solving skills and attention to detail.

Strong communication and collaboration skills, with the ability to work effectively in a team environment.

𝗣𝗿𝗲𝗳𝗲𝗿𝗿𝗲𝗱 𝗤𝘂𝗮𝗹𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀 :

Familiarity with cloud platforms like AWS, GCP, or Azure for data infrastructure.

Create a job alert for this search

Sr Data Engineer • bhopal, madhya pradesh, in