Talent.com
Engineer (Devops & Big Data)

Engineer (Devops & Big Data)

AMISEQBengaluru, Karnataka, India
5 days ago
Job description

SRE & Devops (Big Data)

Immediate Joiner only

Bengaluru, KA

Exp- 3-6 Years

You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization.

  • You'll partner with vendors and the infrastructure engineering team for security and service availability
  • You'll fix production issues with engineering teams, researchers, data scientists, including performance and functional issues
  • Diagnose and solve customer technical problems
  • Participate in training customers and prepare reports on customer issues
  • Be responsible for customer service improvements and recommend product improvements
  • Write support documentation
  • You'll design and implement zero-downtime to monitor and accomplish a highly available service (99.999%)
  • As a support engineer, find opportunities to automate as part of the problem management process, creating automation to avoid issues.
  • Define engineering excellence for operational maturity
  • You'll work together with AI platform developers to provide the CI / CD model to deploy and configure the production system automatically
  • Develop and follow operational standard processes for tools and automation development. Including : Style guides, versioning practices, source control, branching and merging patterns and advising other engineers on development standards
  • Deliver solutions that accelerate the activities, phenomenal engineers would perform through automation, deep domain expertise, and knowledge sharing

Required Skills :

  • Demonstrated ability in designing, building, refactoring and releasing software written in Java, Python.
  • Strong experience with Big Data technologies including Hadoop, Spark, Flink, Hive, HDFS.
  • Ability to handle data integration, bug fixing, performance optimization, and feature enhancements for distributed data pipelines.
  • Having experience with building batch pipelines to support billion-plus-scale embedding generation for text, image and video is a big plus.
  • Experience with data quality and governance.
  • Having experience with vector similarity search and vector databases is a big plus.
  • Debugging and triaging skills.
  • Cloud technologies like Kubernetes, Docker and Linux fundamentals.
  • Familiar with DevOps practices and continuous testing
  • DevOps pipeline and automations : app deployment / configuration & performance monitoring.
  • Test automations, Jenkins CI / CD.
  • Excellent communication, presentation, and leadership skills to be able to work and collaborate with partners, customers and engineering teams.
  • Well organized and able to manage multiple projects in a fast paced and demanding environment.
  • Good oral / reading / writing English ability.
  • Create a job alert for this search

    Big Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AscendionBengaluru, Karnataka, India
    We’re Hiring – GCP BigQuery Developers!.Are you passionate about building scalable data solutions and working with cutting-edge cloud technologies?. Bangalore / Hyderabad / Chennai / Pune.Immediate to 15 ...Show moreLast updated: 3 days ago
    • Promoted
    Gcp Data Engineer

    Gcp Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Required Technical Skill Set • •.Big Data,Pyspark, Google Cloud, Airflow, Scala.Bangalore - TCS Bangalore Global axis (walk-in Drive). Min 8+ years experience in BigData, Spark and Scala.Experience in...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusBengaluru, Karnataka, India
    GCP Developers for Gurgaon & Bangalore location.We are looking with good experience in Bigdata, Spark, Pyspark, Python / Java, GCP-Bigquery, airflow, dataflow, Dataproc, Pubsub, Cloud Composer, GCS O...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Zetabangalore, karnataka, in
    It was founded by Bhavin Turakhia and Ramki Gaddipati in 2015.Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer – BigQuery / Dataform / Looker

    Data Engineer – BigQuery / Dataform / Looker

    JRD SystemsBengaluru, Karnataka, India
    Data Engineer – BigQuery / Dataform / Looker (Meridian Program).Transportation Data & Analytics.We are seeking a highly skilled. You’ll play a key role in maintaining current Roadnet data flows whil...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Aezion, IncBengaluru, Karnataka, India
    Location : Bangalore / Coimbatore.Required Skills and Qualifications : .Data Engineering and Analytics, with at least 2+ years in a leadership role. Proven experience managing global teams, both onsite ...Show moreLast updated: 5 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    ImpetusBangalore Urban, Karnataka, India
    Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark / Spark to transform, clean, aggregate and prepare data for an...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Newpage Solutionshosur, tamil nadu, in
    Location : Remote | Type : Contract.Newpage Solutions is a global digital health innovation company helping people live longer, healthier lives. We partner with life sciences organizations—including p...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Xebiabangalore, karnataka, in
    Job Title : Senior Data Engineer.Notice Period : immediate - 15 days.We are looking for Data Engineer with hands on experience on Python , Pyspark , Hadoop Hive, HDFS, Oozie, Yarn.Design, develop a...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Cohosur, tamil nadu, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 6 days ago
    • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    iVoyanthosur, tamil nadu, in
    One of our clients is looking for an experienced Senior Snowflake Data Engineer to join their team.We are seeking a Senior Data Engineer with 8+ years of experience in end-to-end data engineering a...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer(Big Data)

    Senior Data Engineer(Big Data)

    Andor TechBengaluru, Karnataka, India
    If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!.Deployment to a Product-Based Retail MNC. Work on cutting-edge big data solutions f...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AscendionBengaluru, Karnataka, India
    Location : Bengaluru, Chennai, Hyderabad and Pune (Hybrid Work model).The ideal candidate should have hands-on experience working with. SQL queries to support data transformation, analytics, and repo...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    LogixHealthbangalore, karnataka, in
    Immediate joiners or notice period of less than 10days are needed.As a Senior Data Engineer at LogixHealth, you will work with a globally distributed team of engineers to design and build cutting-e...Show moreLast updated: 30+ days ago
    • Promoted
    Engineer (Devops & Big Data)

    Engineer (Devops & Big Data)

    AMISEQBengaluru, Karnataka, India
    You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization. You'll partner with vendors and the i...Show moreLast updated: 5 days ago
    • Promoted
    GCP Senior Data Engineer

    GCP Senior Data Engineer

    Tata Consultancy ServicesBengaluru, Karnataka, India
    Role- GCP Senior Data Engineer.Location- Hyderabad, Chennai, Bangalore, Kolkata, Mumbai.Data Integration, orchestration mechanism, ability to design BI solutions using Cloud Store, Big Query, Cloud...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer (Qlick Experience)

    Data Engineer (Qlick Experience)

    Add Min Web Worldhosur, tamil nadu, in
    Job Title : Data Engineer (Qlik Experience).We are looking for a dedicated.The ideal candidate should have a strong understanding of data processing, integration, and reporting, along with the abili...Show moreLast updated: 5 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PRI Globalbangalore, karnataka, in
    Sr Data Engineer, Strong Python, Snowflake, SQL, Git / Confluence and Jira.Min 5+ Yrs in Snowflake (Must).Min 5+ Yrs in Python Development (Must). Experienced Data management specialist responsible fo...Show moreLast updated: 6 days ago