Data Engineer

Qualifications for Data Engineer:

• 3+ Years of experience in building and optimizing big data solutions required to fulfill business and technology requirements.
• 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.
• Strong analytic skills to understand and create solutions for business use cases.
• Ensure best practices to implement data governance principles, data quality checks on each data layer.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• We are looking for a candidate with 3+ years of experience in a Data Engineer role, who has attained a Graduate degree in B.Tech/B.E.

They should also have experience using the following software/tools

• :Experience with big data: Hadoop, Map Reduce, Hive, Spark, Kafka, Airflow etc
• .Experience with relational SQL and NoSQL databases: MySQL, Postgres, MongoDB, HBase, Cassandra etc
• .Experience with cloud Data platform: AWS, Azure-HDInsight's, GCP, CDP
• .Experience with real-time data processing: Storm, Spark-Streaming etc
• .Experience with object-oriented/object function scripting languages: Java, Python, Scala, etc

.
Skills Required
Hive, Spark, Scala, Cassandra, Kafka, Postgres, Storm, Gcp, Java, Airflow, Mongodb, Hbase, Aws, Mysql, Python, Hadoop