Talent.com
Data Engineer

Data Engineer

Randstad Enterpriseanand, gujarat, in
30+ days ago
Job description

Role : Data Engineer

Location : Remote

Shift Timing : 2 : 00 Pm - 11 : 00 Pm

Experience : 2- 4 years relevant Experience only ( this is a Junior position with us )

Must have skillset :

GCP - 2 years minimum working Experience

Python and Pyspark - 2 years

SQL - 2 years

Excellent communication

Worked with global stakeholders

Who we are :

Randstad Sourceright’s global talent solutions provides instant access to experienced recruitment

and contingent workforce management support by combining technology, analytics and deep

global and local expertise. Our operations consist of the client aligned service delivery teams

operating across RPO, MSP and Blended Workforce Solutions. We are certified as a “great place to

work” for the last 3 consecutive years and are recognized as the best place to work by Glassdoor

Group Objective

The mission of the business intelligence team is to create a data-driven culture that empowers leaders to integrate data into daily decisions and strategic planning. We aim to provide visibility, transparency, and guidance regarding the quantity and quality of results, activities, financial KPIs, and leading indicators to identify trends aimed at data-based decision-making easily.

Position Objective

As a Senior Data Engineer, you will be responsible for designing, architecting, and implementing robust data solutions in a cloud-based environment (GCP). You will partner with other data engineers and technical teams to ensure the availability, reliability, and performance of our data systems.

Position Summary

Programming & Code Writing

  • Architect and build complex data pipelines using advanced cloud data technologies
  • Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
  • Define industry best practices for building data pipelines
  • Ensure data security, compliance, and governance standards are met.
  • Partner with leadership team to define and implement agile and DevOps methodologies

Consulting & Partnership

  • Serve as subject matter expert and define data architecture and infrastructure requirements
  • Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times
  • Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations
  • Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes
  • Troubleshooting & Continuous Improvement

  • Design and implement a robust data observability process
  • Resolve escalated reporting requests and communicate proactively and timely
  • Troubleshoot, and provide technical guidance to resolve issues related to misaligned or inaccurate data or data fields or new customer requirements
  • Maintain new release, migration, and sprint schedules for software upgrades, enhancements, and fixes to aid with product evolution
  • Write QA / QC Scripts to conduct first round of testing and partner with BA team for test validation for new developments prior to moving to production
  • Use industry knowledge & feedback to aid in the development of technology roadmap and future product(s) vision
  • Document standard ways of working via QRGs, intranet pages, and video series
  • Senior activities

  • Drive day-to-day development activities of development team in close collaboration with on-site and off-shore resources, scrum masters and product owners
  • Bootstrapping a data engineering team at an early stage in the team’s evolution
  • Provide leadership on technical front in difficult situations facilitate contentious discussions, and report up when necessary
  • Guide, mentor and coach offshore resources
  • Provide input in forming a long-term data strategy
  • Education

  • Master’s degree in Computer Science / Information Technology or related field, highly preferred
  • Experience

  • Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions
  • Extensive Experience with data lakes, ETL and data warehouses
  • Advanced experience of building data pipelines
  • Passion for building quality BI software
  • Project Management and / or process improvement experience highly preferred
  • Knowledge, Skills, and Abilities

  • Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. Tableau
  • Advanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered.
  • Any exposure to Kafka, Spark, and Scala will be an added advantage.
  • Should demonstrate a strong understanding of OOPS concepts and methodologies
  • Expert level understanding of data engineering
  • Intrinsic motivation and problem-solving
  • Proactive leadership, project management, time management, and problem-solving skills
  • Demonstrated continuous improvement, process documentation, and workflow skills
  • Extensive experience with data analysis , modeling, and data pipelining including data cleaning, standardizing, scaling, tuning, scheduling and deployment
  • Experience composing detailed technical documentation and procedures for data models
  • Ability to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining quality
  • Strong drive and commitment for delivering outstanding results
  • Strong follow up and service orientation
  • Supervisory Responsibility

    ☒ Provides guidance, leadership, or training to junior employees

    ☐ Directly responsible for supervising non-exempt, clerical, or office administrative personnel

    ☐ Directly responsible for supervising exempt, professional, or technical employees

    ☒ Directly responsible for supervising supervisory / managerial employees

    Organizational Structure :

    Job Title this position reports : Manager, Data Engineering

    Create a job alert for this search

    Data Engineer • anand, gujarat, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionAnand, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 11 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGVadodara, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 11 days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsVadodara, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika IncAhmedabad, Gujarat, India
    Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseAhmedabad, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Azilen TechnologiesAhmedabad, Gujarat, India
    Manage and create design schema, SQL query tuning, and code review.Min 3+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development.D...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIVadodara, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer with Snowflake Experience- Contract

    Data Engineer with Snowflake Experience- Contract

    Gravity Infosolutions, Inc.Vadodara, IN
    Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgevadodara, gujarat, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladeahmedabad, gujarat, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHvadodara, gujarat, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalNadiad, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    SystemBenderAhmedabad, IN
    Job Title : Data Engineer (Microsoft Fabric & Azure).The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and modern data lakehouse architectures using M...Show moreLast updated: 9 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsVadodara, IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyAnand, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DunboxedAhmedabad, IN
    Dunboxed is a boutique data services firm specializing in Data Analytics, Business Intelligence (BI), and Data Engineering. We don't just deliver services; we build strategic partnerships that drive...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradVadodara, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeahmedabad, gujarat, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago