Senior Associate - Data Engineering (Level 2)
Role Overview :
As a Senior Associate L2 - Data Engineering, you will translate client requirements into technical designs and implement components for data engineering solutions. You will leverage your deep understanding of data integration, big data design principles, and cloud platforms (GCP / Azure) to create custom solutions or implement packaged solutions. You will also independently drive design discussions to ensure the health of the overall solution.
Your Impact :
- Design and implement data ingestion, integration, and transformation pipelines.
- Build and optimize data storage and computation frameworks for performance and scalability.
- Develop analytics and visualization solutions for business insights.
- Leverage GCP / Azure cloud services to build secure, scalable data platforms.
- Implement data management platforms ensuring quality and governance.
- Build functionality for ingestion from multiple heterogeneous sources in batch and real-time.
- Develop solutions for data analytics, search, and aggregation.
Skills & Experience :
5.5-8 years of total experience, with at least 4 years in Big Data technologies.Hands-on experience with the Hadoop ecosystem : HDFS, Sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, Hive, Oozie, Airflow.Strong programming skills in Java, Scala, or Python (Java preferred).Proficiency with NoSQL and MPP data platforms such as HBase, MongoDB, Cassandra, Azure SQLDW, GCP BigQuery.Mandatory : Hands-on expertise in GCP and / or Azure data platform services (BigQuery, Dataflow, Dataproc, Pub / Sub, Azure Data Lake, Azure Synapse, Databricks, etc.).Experience in designing real-time data pipelines is an advantage.Bachelor's degree or equivalent in Computer Science, Engineering, or related field.Set Yourself Apart With :
Knowledge of ETL tools (Informatica, Talend) and relational databases (Oracle, MySQL, SQL Server, Postgres).Familiarity with data governance tools (Collibra, Alation).Exposure to messaging frameworks (ActiveMQ, RabbitMQ, Solace).Experience in search, indexing, and microservices architectures.Performance tuning and optimization of large-scale data pipelines.Certifications in GCP or Azure Big Data / Cloud specialties.Benefits of Working Here :
Gender-neutral policies.18 paid holidays annually.Generous parental leave and transition programs.Flexible work arrangements.Employee Assistance Programs for wellness and well-being.A Tip from the Hiring Manager :
Join our team to sharpen your skills and expand your collaborative methods. Make an impact on clients and their businesses directly through your work on cutting-edge GCP / Azure-based data solutions.
(ref : hirist.tech)