Data Architect

Location – Gurgaon

Experience – 5-10 years

Role – Big Data Architect.

About the Role :

As a Big Data Engineer, you will play a critical role in integrating multiple data sources, designing scalable data workflows, and collaborating with data architects, scientists, and analysts to develop innovative solutions. You will work with rapidly evolving technologies to achieve strategic business goals.

Must-Have Skills :

• 4+ year's of mandatory experience with Big data.
• 4+ year's mandatory experience in Apache Spark.
• Proficiency in Apache Spark, Hive on Tez, and Hadoop ecosystem components.
• Strong coding skills in Python & Pyspark.
• Experience building reusable components or frameworks using Spark
• Expertise in data ingestion from multiple sources using APIs, HDFS, and NiFi.
• Solid experience working with structured, unstructured, and semi-structured data formats (Text, JSON, Avro, Parquet, ORC, etc.).
• Experience with UNIX Bash scripting and databases like Postgres, MySQL and Oracle.
• Ability to design, develop, and evolve fault-tolerant distributed systems.
• Strong SQL skills, with expertise in Hive, Impala, Mongo and NoSQL databases.
• Hands-on with Git and CI / CD tools
• Experience with streaming data technologies (Kafka, Spark Streaming, Apache Flink, etc.).
• Proficient with HDFS, or similar data lake technologies
• Excellent problem-solving skills — you will be evaluated through coding rounds

Key Responsibilities :

Skills Required

orc, Kafka, Json, Avro, Bash Scripting, Mysql, Postgres, Oracle, Python, Pyspark, Apis, Apache Flink, Mongo, Apache Spark, hdfs , Impala, Sql, Unix, Git, Spark Streaming, Hive