Talent.com
This job offer is not available in your country.
Data Specialist - AWS Cloud Services

Data Specialist - AWS Cloud Services

Velodata Global Pvt LtdKochi
22 days ago
Job description

About the job :

Role : Lead Data Engineer

Location : kochi / Trivandrum / Remote

Experience : 7+ years

Skill Set : S3, GLue, Lambda, Step function, snowflake, pyspark

The work location will be Kochi or Trivandrum. Candidates are required to attend the final round of the interview in person. In exceptional cases, a remote interview can be considered; however, the selected candidate must work from the office during the first month.

Job Overview :

We are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for someone with deep expertise in building and managing big data pipelines using modern AWS-based technologies, and who is passionate about driving quality and efficiency in data processing systems.

Key Responsibilities :

Data Ingestion Framework :

  • Design & Development : Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data from diverse sources.
  • Framework Optimization : Use AWS services such as AWS Glue, Lambda, EMR, ECS , EC2 and Step Functions to build highly scalable, resilient, and automated data pipelines.

Data Quality & Validation :

  • Validation Processes : Develop and implement automated data quality checks, validation routines, and error-handling mechanisms to ensure the accuracy and integrity of incoming data.
  • Monitoring & Reporting : Establish comprehensive monitoring, logging, and alerting systems to proactively identify and resolve data quality issues.
  • API Development :

  • Design & Implementation : Architect and develop secure, high-performance APIs to enable seamless integration of data services with external applications and internal systems.
  • Documentation & Best Practices : Create thorough API documentation and establish standards for API security, versioning, and performance optimization.
  • Collaboration & Agile Practices :

  • Cross-Functional Communication : Work closely with business stakeholders, data scientists, and operations teams to understand requirements and translate them into technical solutions.
  • Agile Development : Participate in sprint planning, code reviews, and agile ceremonies, while contributing to continuous improvement initiatives and CI / CD pipeline development (using tools like GitLab).
  • Required Qualifications :

    Experience & Technical Skills :

  • Professional Background : At least 5 years of relevant experience in data engineering with a strong emphasis on analytical platform development.
  • Programming Skills : Proficiency in Python and / or PySpark, SQL for developing ETL processes and handling large-scale data manipulation.
  • AWS Expertise : Extensive experience using AWS services including AWS Glue, Lambda, Step Functions, and S3 to build and manage data ingestion frameworks.
  • Data Platforms : Familiarity with big data systems (e.g., AWS EMR, Apache Spark, Apache Iceberg) and databases like DynamoDB, Aurora, Postgres, or Redshift.
  • API Development : Proven experience in designing and implementing RESTful APIs and integrating them with external and internal systems.
  • CI / CD & Agile : Hands-on experience with CI / CD pipelines (preferably with GitLab) and Agile development methodologies.
  • Soft Skills :

  • Strong problem-solving abilities and attention to detail.
  • Excellent communication and interpersonal skills with the ability to work independently and collaboratively.
  • Capacity to quickly learn and adapt to new technologies and evolving business requirements.
  • Preferred Qualifications :

  • Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
  • Experience with additional AWS services such as Kinesis, Firehose, and SQS.
  • Familiarity with data lakehouse architectures and modern data quality frameworks.
  • Prior experience in a role that required proactive data quality management and API-driven integrations in complex, multi-cluster environments.
  • (ref : hirist.tech)

    Create a job alert for this search

    Cloud Data Specialist • Kochi

    Related jobs
    • Promoted
    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_kochi

    TCS Hiring for AWS Senior Data Engineer with Pyspark, AWS, Glue_kochi

    Tata Consultancy ServicesKochi, Kerala, India
    Job Title : AWS Senior Data Engineer with Pyspark, AWS, Glue.PySpark, AWS[ETL Concepts, S3, Glue, EMR, Redshift, DMS, AppFlow] ,Qlik Replicate, Data Testing. Hadoop, Teradata Background, IaC[Cloud Fo...Show moreLast updated: 21 days ago
    • Promoted
    AWS Sales Professional

    AWS Sales Professional

    TUTOADDAKochi, IN
    Generate leads through events, cold calling, email marketing, and other outreach methods.Identify and engage potential customers to promote AWS services and solutions. Develop and execute sales stra...Show moreLast updated: 2 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    EXLKottayam, IN
    We're looking for a highly skilled and experienced Cloud AI Engineer to join our dynamic team.In this role, you'll be instrumental in designing, developing, and deploying cutting-edge artificial in...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKottayam, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Google Cloud Specialist

    Google Cloud Specialist

    KV TECH SOLUTIONS PVT LTDKottayam, IN
    KV Tech Solutions Pvt Ltd embodies the spirit of innovation and adaptability in today's rapidly evolving digital landscape. Our mission is to transform businesses with Google Cloud excellence.We are...Show moreLast updated: 3 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    VML Enterprise SolutionsKochi, IN
    Type of position : Contract- 6 months.We are looking for talented developers with experience developing complex Cloud AWS serverless applications to join an exciting client project as part of our ex...Show moreLast updated: 6 days ago
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    CareerXperts ConsultingKochi, IN
    You’ll work closely with development, operations, and security teams to ensure optimal cloud performance and drive adoption of best practices across the organization. Design, deploy, and manage clou...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyKottayam, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Spend Optimization Engineer

    Cloud Spend Optimization Engineer

    Abacus.AIKottayam, IN
    We’re seeking an engineer with expertise in optimizing AWS cloud costs.In this role, you’ll drive cost efficiency across our infrastructure by analyzing usage, automating optimizations, and guiding...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    K&K Talents - IndiaKottayam, IN
    This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 6 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Strobes Security, Inc.Kottayam, IN
    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer (Pyspark)

    AWS Data Engineer (Pyspark)

    Tata Consultancy ServicesKochi, Kerala, India
    Bangalore,Chennai,Hyderabad,Pune,Kochi,Bhubaneshawar,Kolkata.AWS Lambda, Python, Boto3 ,Pyspark, Glue.Strong experience in Python to package, deploy and monitor data science apps.Knowledge in Pytho...Show moreLast updated: 16 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    LemongrassKottayam, IN
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudKottayam, IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 26 days ago
    • Promoted
    Azure Cloud Engineer

    Azure Cloud Engineer

    Vriba SolutionsKottayam, IN
    Engineer for Airlines, you will push to improve existing systems and processes, with the creativity to develop innovative solutions to evolving challenges. You will be responsible for the availabili...Show moreLast updated: 1 day ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Kottayam, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    iVedha Inc.Kottayam, IN
    Seeking a highly experienced Cloud Architect to design and oversee robust, scalable, and secure.Architect end-to-end cloud solutions (public, private, hybrid) with a focus on reliability, security,...Show moreLast updated: 30+ days ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesKottayam, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisKottayam, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 6 days ago
    • Promoted
    IT & Cloud Specialist - 45733

    IT & Cloud Specialist - 45733

    TuringKottayam, IN
    Based in San Francisco, California, Turing is the world’s leading.AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways : first, by...Show moreLast updated: 16 days ago