Talent.com
Data Engineer

Data Engineer

Randstad EnterpriseMadurai, IN
30+ days ago
Job description

Role : Data Engineer

Location : Remote

Shift Timing : 2 : 00 Pm - 11 : 00 Pm

Experience : 2- 4 years relevant Experience only ( this is a Junior position with us )

Must have skillset :

GCP - 2 years minimum working Experience

Python and Pyspark - 2 years

SQL - 2 years

Excellent communication

Worked with global stakeholders

Who we are :

Randstad Sourceright’s global talent solutions provides instant access to experienced recruitment

and contingent workforce management support by combining technology, analytics and deep

global and local expertise. Our operations consist of the client aligned service delivery teams

operating across RPO, MSP and Blended Workforce Solutions. We are certified as a “great place to

work” for the last 3 consecutive years and are recognized as the best place to work by Glassdoor

Group Objective

The mission of the business intelligence team is to create a data-driven culture that empowers leaders to integrate data into daily decisions and strategic planning. We aim to provide visibility, transparency, and guidance regarding the quantity and quality of results, activities, financial KPIs, and leading indicators to identify trends aimed at data-based decision-making easily.

Position Objective

As a Senior Data Engineer, you will be responsible for designing, architecting, and implementing robust data solutions in a cloud-based environment (GCP). You will partner with other data engineers and technical teams to ensure the availability, reliability, and performance of our data systems.

Position Summary

Programming & Code Writing

  • Architect and build complex data pipelines using advanced cloud data technologies
  • Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
  • Define industry best practices for building data pipelines
  • Ensure data security, compliance, and governance standards are met.
  • Partner with leadership team to define and implement agile and DevOps methodologies

Consulting & Partnership

  • Serve as subject matter expert and define data architecture and infrastructure requirements
  • Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times
  • Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations
  • Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes
  • Troubleshooting & Continuous Improvement

  • Design and implement a robust data observability process
  • Resolve escalated reporting requests and communicate proactively and timely
  • Troubleshoot, and provide technical guidance to resolve issues related to misaligned or inaccurate data or data fields or new customer requirements
  • Maintain new release, migration, and sprint schedules for software upgrades, enhancements, and fixes to aid with product evolution
  • Write QA / QC Scripts to conduct first round of testing and partner with BA team for test validation for new developments prior to moving to production
  • Use industry knowledge & feedback to aid in the development of technology roadmap and future product(s) vision
  • Document standard ways of working via QRGs, intranet pages, and video series
  • Senior activities

  • Drive day-to-day development activities of development team in close collaboration with on-site and off-shore resources, scrum masters and product owners
  • Bootstrapping a data engineering team at an early stage in the team’s evolution
  • Provide leadership on technical front in difficult situations facilitate contentious discussions, and report up when necessary
  • Guide, mentor and coach offshore resources
  • Provide input in forming a long-term data strategy
  • Education

  • Master’s degree in Computer Science / Information Technology or related field, highly preferred
  • Experience

  • Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions
  • Extensive Experience with data lakes, ETL and data warehouses
  • Advanced experience of building data pipelines
  • Passion for building quality BI software
  • Project Management and / or process improvement experience highly preferred
  • Knowledge, Skills, and Abilities

  • Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. Tableau
  • Advanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered.
  • Any exposure to Kafka, Spark, and Scala will be an added advantage.
  • Should demonstrate a strong understanding of OOPS concepts and methodologies
  • Expert level understanding of data engineering
  • Intrinsic motivation and problem-solving
  • Proactive leadership, project management, time management, and problem-solving skills
  • Demonstrated continuous improvement, process documentation, and workflow skills
  • Extensive experience with data analysis , modeling, and data pipelining including data cleaning, standardizing, scaling, tuning, scheduling and deployment
  • Experience composing detailed technical documentation and procedures for data models
  • Ability to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining quality
  • Strong drive and commitment for delivering outstanding results
  • Strong follow up and service orientation
  • Supervisory Responsibility

    ☒ Provides guidance, leadership, or training to junior employees

    ☐ Directly responsible for supervising non-exempt, clerical, or office administrative personnel

    ☐ Directly responsible for supervising exempt, professional, or technical employees

    ☒ Directly responsible for supervising supervisory / managerial employees

    Organizational Structure :

    Job Title this position reports : Manager, Data Engineering

    Create a job alert for this search

    Data Engineer • Madurai, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalMadurai, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Idyllic ServicesDindigul, IN
    We are looking for an enthusiastic GCP Data Engineer to join our dynamic and growing project team.In this role, you will have the opportunity to develop your skills while contributing to large-scal...Show moreLast updated: 23 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroMadurai, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell ResourcesMadurai, IN
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    BayOne SolutionsDindigul, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesMadurai, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICESDindigul, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 7 days ago
    • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions LimitedDindigul, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 23 hours ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group IncMadurai, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show moreLast updated: 23 hours ago
    • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP GroupMadurai, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show moreLast updated: 30+ days ago
    • Promoted
    Google Looker Data Engineer

    Google Looker Data Engineer

    Insight GlobalDindigul, IN
    We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionMadurai, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    People Prime WorldwideMadurai, IN
    Immediate Joiners Only (≤15 days).Python, PySpark, AWS / Snowflake.Our client is a global leader in IT and business services, operating in. With a strong commitment to continuous innovation, they he...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer JIS117883

    Data Engineer JIS117883

    Krayr SolutionsDindigul, IN
    Bachelor’s Degree in Computer Science, IT, or related field.Looker (LookML development & dashboards).Expertise in databases such as. Postgres, MongoDB, MySQL, BigQuery.Experience with visualization ...Show moreLast updated: 23 hours ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Blue Cloud Softech Solutions LimitedDindigul, IN
    Job Overview – Cloud Data Engineer.We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational effic...Show moreLast updated: 23 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneMadurai, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeMadurai, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    AdastraDindigul, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 1 day ago