GCP Big Data Engineer

Job Description

• .css-ylb{color : var( chakra-colors-black-);}.css-l0deym h1{margin : 0;padding : 0;font-size : 26px;}.css-l0deym h2{margin : 0;padding : 0;font-size : 20px;}.css-l0deym h3{margin : 0;padding : 0;font-size : 15px;}.css-l0deym h4{margin : 0;padding : 0;font-size : 13px;}.css-l0deym ul{list-style-type : disc;margin : 0.5rem;margin-bottom : 1.5rem;}.css-l0deym ul ul{list-style-type : circle;}.css-l0deym ul ul ul{list-style-type : square;}.css-l0deym ol{margin : 0.5rem;margin-bottom : 1.5rem;list-style-type : decimal;}.css-l0deym ol ol{list-style-type : lower-alpha;}.css-l0deym ol ol ol{list-style-type : lower-roman;}.css-l0deym ol ol ol ol{list-style-type : decimal;}.css-l0deym strong{font-weight : bold;}.css-l0deym blockquote{border-left : 5px solid #eee;color : #;font-family : 'Hoefler Text','Georgia',serif;font-style : italic;margin : 16px 0;padding : 10px 20px;}.css-l0deym p code{font-family : 'Courier New',monospace,'Lucida Console';}About the role : We are looking for a Senior Data Engineer to be based out of our Chennai office. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will
• Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.
• Set up and run Hadoop development frameworks.
• Collaborate with a team of business domain experts, data scientists, and application developers to identify relevant data for analysis and develop the Big Data solution.
• Explore and learn new technologies for creative business problem-solving.#LI-UNPost.css-vfo6{padding-top : 24px;padding-bottom : 12px;font-size : 20px;font-weight : ;}Job RequirementRequired Experience, Skills & Competencies :
• Ability to develop and manage scalable Hadoop cluster environments
• Ability to design solutions for Big Data applications
• Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc
• Working experience on Big Data services in any cloud-based environment.
• Experience in Spark, Pyspark, Python or Scala, Kafka, Akka, core or advanced Java, and Databricks
• Knowledge of how to create and debug Hadoop and Spark jobs
• Experience in NoSQL technologies like HBase, Cassandra, MongoDB, Cloudera, or Hortonworks Hadoop distribution
• Familiar with data warehousing concepts, distributed systems, data pipelines, and ETL
• Familiar with data visualization tools like Tableau
• Good communication and interpersonal skills
• Minimum 6-8 years of Professional experience with 3+ years of Big Data project experience
• B.Tech / B.E from reputed institute preferred#LI-UNPost.css-1uw51ih{padding : 28px 0;display : -webkit-box;display : -webkit-flex;display : -ms-flexbox;display : flex;-webkit-flex-direction : row;-ms-flex-direction : row;flex-direction : row;-webkit-box-flex-wrap : wrap;-webkit-flex-wrap : wrap;-ms-flex-wrap : wrap;flex-wrap : wrap;-webkit-align-items : baseline;-webkit-box-align : baseline;-ms-flex-align : baseline;align-items : baseline;-webkit-box-pack : justify;-webkit-justify-content : space-between;justify-content : space-between;padding-bottom : 16px;}.css-12oy1kx{font-size : 1rem;font-weight : inherit;display : inline-block;padding-right : var( chakra-space-5);}.css-jkbrc8{position : relative;width : %;margin : 0 auto;box-sizing : border-box;}.css-1ylu0bo{display : -webkit-box;display : -webkit-flex;display : -ms-flexbox;display : flex;-webkit-flex-direction : column;-ms-flex-direction : column;flex-direction : column;-webkit-box-flex : 1;-webkit-flex-grow : 1;-ms-flex-positive : 1;flex-grow : 1;}.css-1n7cw71{width : %;-webkit-margin-start : auto;margin-inline-start : auto;-webkit-margin-end : auto;margin-inline-end : auto;max-width : var( chakra-sizes-container-lg);-webkit-padding-start : 1rem;padding-inline-start : 1rem;-webkit-padding-end : 1rem;padding-inline-end : 1rem;-webkit-box-pack : center;-ms-flex-pack : center;-webkit-justify-content : center;justify-content : center;display : -webkit-box;display : -webkit-flex;display : -ms-flexbox;display : flex;}.css-1yrkcw4{transition-property : var( chakra-transition-property-common);transition-duration : var( chakra-transition-duration-fast);transition-timing-function : var( chakra-transition-easing-ease-out);cursor : pointer;-webkit-text-decoration : none;text-decoration : none;outline : 2px solid transparent;outline-offset : 2px;color : inherit;font-weight : ;font-size : var( chakra-fontSizes-md);margin : 20px;}.css-1yrkcw4 : hover,.css-1yrkcw4(data-hover){-webkit-text-decoration : underline;text-decoration : underline;cursor : pointer;}.css-1yrkcw4 : focus,.css-1yrkcw4(data-focus){box-shadow : var( chakra-shadows-outline);}