Position: Sr. Cloud Data Engineer (AWS-Big Data)
Location: Nagpur/Pune/Chennai/Bangalore
Purpose of the Position: As a Cloud Data Engineer, this position requires candidate who are enthusiastic about specialized skills in AWS Services and Big Data. As a member of the team, you will help our clients, by building Models that supports to progress on their AWS cloud journey.
Key Result Areas and Activities:
- Share and Build Expertise- Develop and share expertise in cloud solutioning domain and actively mine the experience and expertise in the organization for sharing across teams and clients in the firm. Support the cloud COE initiatives.
- Nurture and Grow Talent- Provide support for recruitment, coaching and mentoring, and building practice capacity in the firm in Cloud.
- AWS Integration- Integrate various AWS services to create seamless workflows and data processing solutions.
- Data Pipeline Development- Design, build, and maintain scalable data pipelines using AWS services to support data processing and analytics.
Essential Skills:
- Knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step Functions
- Cloud Databases– AWS Aurora, Singlestore, RedShift, Snowflake
- Big Data- Hadoop, Hive, Spark, YARN
- Programming Language– Scala, Python, Shell Scripts, PySpark
- Operating System- Any flavor of Linux, Windows
- Strong SQL Skills
- Orchestration Tools: Apache Airflow
- Hands-on in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations, etc.
Desirable Skills:
- Experience and Technical Knowledge in Databricks
- Strong Experience with event stream processing technologies such as Kafka, KDS
- Knowledge of Operating System- Any flavor of Linux, ETL Tools Informatica, Talend
- Experience with at least one major Hadoop platform (Cloudera, Hortonworks, MapR) will be a plus
Qualifications:
- Overall 5+years of IT experience & 3+ years of AWS related project
- Bachelors degree in computer science, engineering, or related field (Masters degree is a plus)
- Demonstrated continued learning through one or more technical certifications or related methods
Qualities:
- Hold strong technical knowledge and experience
- Should have the capability to deep dive and research in various technical related fields
- Self-motivated and focused on delivering outcomes for a fast growing team and firm
- Able to communicate persuasively through speaking, writing, and client presentations
Skills Required
snowflake , Windows, Hive, Spark, Scala, Shell Scripts, Ec2, S3, Yarn, Emr, Redshift, Pyspark, Lambda, Aws Services, Sql, Apache Airflow, Step Functions, AWS Aurora, Linux, AWS Glue, Python, Hadoop
