Talent.com
Senior Data Engineer

Senior Data Engineer

ConfidentialThiruvananthapuram, Thiruvananthapuram / Trivandrum, India
30+ days ago
Job description

Join SADA, An Insight Company as a Sr. Data Engineer!

Your Mission

As a Sr. Data Engineer at SADA, you will work collaboratively with architects and other engineers to recommend, prototype, build and debug data infrastructures on Google Cloud Platform (GCP). You will have an opportunity to work on real-world data problems facing our customers today. Engagements vary from being purely consultative to requiring heavy hands-on work, and cover a diverse array of domain areas, such as data migrations, data archival and disaster recovery, and big data analytics solutions requiring batch or streaming data pipelines, data lakes and data warehouses.

You will be expected to run point on whole projects, end-to-end, and to mentor less experienced Data Engineers. You will be recognized as an expert within the team and will build a reputation with Google and our customers. You will demonstrate repeated delivery of project architectures and critical components that other engineers demur to you for lack of expertise. You will also participate in early-stage opportunity qualification calls, as well as lead client-facing technical discussions for established projects.

Pathway to Success

At SADA, and Insight company, we are in the business of change. We are focused on leading-edge technology that is ever-evolving. We embrace change enthusiastically and encourage agility. This means that not only do our engineers know that change is inevitable, but they embrace this change to continuously expand their skills, preparing for future customer needs.

Your success starts by positively impacting the direction of a fast growing practice with vision and passion. You will be measured quarterly by the breadth, magnitude and quality of your contributions, your ability to estimate accurately, customer feedback at the close of projects, how well you collaborate with your peers, and the consultative polish you bring to customer interactions.

As you continue to execute successfully, we will build a customized development plan together that leads you through the engineering or management growth tracks.

Expectations

Required Travel - 30% travel to customer sites, conferences, and other related events.

Customer Facing - You will interact with customers on a regular basis, sometimes daily, other times weekly / bi-weekly. Common touchpoints occur when qualifying potential opportunities, at project kickoff, throughout the engagement as progress is communicated, and at project close. You can expect to interact with a range of customer stakeholders, including engineers, technical project managers, and executives.

Job Requirements

Required Credentials :

  • Google Professional Data Engineer Certified or able to complete within the first 45 days of employment

Required Qualifications :

  • Mastery in at least one of the following domain areas :
  • Big Data : managing Hadoop clusters (all included services), troubleshooting cluster operation issues, migrating Hadoop workloads, architecting solutions on Hadoop, experience with NoSQL data stores like Cassandra and HBase, building batch / streaming ETL pipelines with frameworks such as Spark, Spark Streaming and Apache Beam, and working with messaging systems like Pub / Sub, Kafka and RabbitMQ.
  • Data warehouse modernization : building complete data warehouse solutions on BigQuery, including technical architectures, star / snowflake schema designs, query optimization, ETL / ELT pipelines and reporting / analytic tools. Must have hands-on experience working with batch or streaming data processing software (such as Beam, Airflow, Hadoop, Spark, Hive).
  • Data migration : migrating data stores to reliable and scalable cloud-based stores, including strategies for minimizing downtime. May involve conversion between relational and NoSQL data stores, or vice versa.
  • Backup, restore & disaster recovery : building production-grade data backup and restore, and disaster recovery solutions. Up to petabytes in scale.
  • Experience writing software in one or more languages such as Python, Java, Scala, or Go
  • Experience building production-grade data solutions (relational and NoSQL)
  • Experience with systems monitoring / alerting, capacity planning and performance tuning
  • Experience in technical consulting or other customer facing role
  • Useful Qualifications :

  • Experience working with Google Cloud data products (CloudSQL, Spanner, Cloud Storage, Pub / Sub, Dataflow, Dataproc, Bigtable, BigQuery, Dataprep, Composer, etc)
  • Experience with IoT architectures and building real-time data streaming pipelines
  • Experience operationalizing machine learning models on large datasets
  • Demonstrated leadership and self-direction willingness to teach others and learn new techniques
  • Demonstrated skills in selecting the right statistical tools given a data analysis problem
  • About SADA An Insight company

    Values : We built our core values on themes that internally compel us to deliver our best to our partners, our customers and to each other. Ensuring a diverse and inclusive workplace where we learn from each other is core to SADA's values. We welcome people of different backgrounds, experiences, abilities, and perspectives. We are an equal opportunity employer.

  • Hunger
  • Heart
  • Harmony
  • Work with the best : SADA has been the largest Google Cloud partner in North America since 2016 and, for the eighth year in a row, has been named a Google Global Partner of the Year.

    Business Performance : SADA has been named to the INC 5000 Fastest-Growing Private Companies list for 15 years in a row, garnering Honoree status. CRN has also named SADA on the Top 500 Global Solutions Providers list for the past 5 years. The overall culture continues to evolve with engineering at its core : 3200+ projects completed, 4000+ customers served, 10K+ workloads and 30M+ users migrated to the cloud.

    SADA India is committed to the safety of its employees and recommends that new hires receive a COVID vaccination before beginning work .

    Skills Required

    Java, Airflow, BigQuery, Hadoop, Scala, Kafka, Go, ELT, Rabbitmq, Spark Streaming, Hive, Spark, Apache Beam, Python, Etl

    Create a job alert for this search

    Senior Data Engineer • Thiruvananthapuram, Thiruvananthapuram / Trivandrum, India

    Related jobs
    • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    iVoyantThiruvananthapuram, IN
    One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz IncThiruvananthapuram, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroThiruvananthapuram, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekkollam, kerala, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladethiruvananthapuram, kerala, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiakollam, kerala, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 20 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incthiruvananthapuram, kerala, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKollam, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIThiruvananthapuram, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalThiruvananthapuram, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer – Azure & AWS

    Data Engineer – Azure & AWS

    Yoda TechThiruvananthapuram, IN
    We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivekollam, kerala, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labsthiruvananthapuram, kerala, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasThiruvananthapuram, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyKollam, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cothiruvananthapuram, kerala, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneKollam, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Data Engineer with AWS_ Exp : 6+ Years

    Senior Data Engineer with AWS_ Exp : 6+ Years

    Atyeti IncThiruvananthapuram, IN
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 22 hours ago