Talent.com
Data Engineer

Data Engineer

Randstad Enterprisekozhikode, India
7 days ago
Job description

Role : Data Engineer

Location : Remote

Shift Timing : 2 : 00 Pm - 11 : 00 Pm

Experience : 2- 4 years relevant Experience only ( this is a Junior position with us )

Must have skillset :

GCP - 2 years minimum working Experience

Python and Pyspark - 2 years

SQL - 2 years

Excellent communication

Worked with global stakeholders

Who we are :

Randstad Sourceright’s global talent solutions provides instant access to experienced recruitment

and contingent workforce management support by combining technology, analytics and deep

global and local expertise. Our operations consist of the client aligned service delivery teams

operating across RPO, MSP and Blended Workforce Solutions. We are certified as a “great place to

work” for the last 3 consecutive years and are recognized as the best place to work by Glassdoor

Group Objective

The mission of the business intelligence team is to create a data-driven culture that empowers leaders to integrate data into daily decisions and strategic planning. We aim to provide visibility, transparency, and guidance regarding the quantity and quality of results, activities, financial KPIs, and leading indicators to identify trends aimed at data-based decision-making easily.

Position Objective

As a Senior Data Engineer, you will be responsible for designing, architecting, and implementing robust data solutions in a cloud-based environment (GCP). You will partner with other data engineers and technical teams to ensure the availability, reliability, and performance of our data systems.

Position Summary

Programming & Code Writing

  • Architect and build complex data pipelines using advanced cloud data technologies
  • Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
  • Define industry best practices for building data pipelines
  • Ensure data security, compliance, and governance standards are met.
  • Partner with leadership team to define and implement agile and DevOps methodologies

Consulting & Partnership

  • Serve as subject matter expert and define data architecture and infrastructure requirements
  • Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times
  • Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations
  • Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes
  • Troubleshooting & Continuous Improvement

  • Design and implement a robust data observability process
  • Resolve escalated reporting requests and communicate proactively and timely
  • Troubleshoot, and provide technical guidance to resolve issues related to misaligned or inaccurate data or data fields or new customer requirements
  • Maintain new release, migration, and sprint schedules for software upgrades, enhancements, and fixes to aid with product evolution
  • Write QA / QC Scripts to conduct first round of testing and partner with BA team for test validation for new developments prior to moving to production
  • Use industry knowledge & feedback to aid in the development of technology roadmap and future product(s) vision
  • Document standard ways of working via QRGs, intranet pages, and video series
  • Senior activities

  • Drive day-to-day development activities of development team in close collaboration with on-site and off-shore resources, scrum masters and product owners
  • Bootstrapping a data engineering team at an early stage in the team’s evolution
  • Provide leadership on technical front in difficult situations facilitate contentious discussions, and report up when necessary
  • Guide, mentor and coach offshore resources
  • Provide input in forming a long-term data strategy
  • Education

  • Master’s degree in Computer Science / Information Technology or related field, highly preferred
  • Experience

  • Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions
  • Extensive Experience with data lakes, ETL and data warehouses
  • Advanced experience of building data pipelines
  • Passion for building quality BI software
  • Project Management and / or process improvement experience highly preferred
  • Knowledge, Skills, and Abilities

  • Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. Tableau
  • Advanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered.
  • Any exposure to Kafka, Spark, and Scala will be an added advantage.
  • Should demonstrate a strong understanding of OOPS concepts and methodologies
  • Expert level understanding of data engineering
  • Intrinsic motivation and problem-solving
  • Proactive leadership, project management, time management, and problem-solving skills
  • Demonstrated continuous improvement, process documentation, and workflow skills
  • Extensive experience with data analysis , modeling, and data pipelining including data cleaning, standardizing, scaling, tuning, scheduling and deployment
  • Experience composing detailed technical documentation and procedures for data models
  • Ability to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining quality
  • Strong drive and commitment for delivering outstanding results
  • Strong follow up and service orientation
  • Supervisory Responsibility

    ☒ Provides guidance, leadership, or training to junior employees

    ☐ Directly responsible for supervising non-exempt, clerical, or office administrative personnel

    ☐ Directly responsible for supervising exempt, professional, or technical employees

    ☒ Directly responsible for supervising supervisory / managerial employees

    Organizational Structure :

    Job Title this position reports : Manager, Data Engineering

    Create a job alert for this search

    Data Engineer • kozhikode, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionMalappuram, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 5 days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsMalappuram, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 7 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradMalappuram, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jaipur RugsMalappuram, IN
    Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets. It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 12 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPKozhikode, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Serviceskozhikode, kerala, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeMalappuram, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGMalappuram, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer with Snowflake Experience- Contract

    Data Engineer with Snowflake Experience- Contract

    Gravity Infosolutions, Inc.Malappuram, IN
    Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHkozhikode, kerala, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incmalappuram, kerala, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXMalappuram, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalKozhikode, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 16 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKozhikode, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseMalappuram, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLMalappuram, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsMalappuram, IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKozhikode, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 24 days ago