Talent.com
This job offer is not available in your country.
Data Engineer

Data Engineer

IntraEdgeBelgaum, IN
30+ days ago
Job description

Website- https : / / intraedge.com /

Job Title : Data Engineer

Experience : 5+Years

Location : [Remote]

Senior Data Engineer

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both internal and external stakeholders

Responsibilities

  • Design, build and maintain data infrastructure that powers both batch and realtime processing of billions of records a day.
  • Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
  • Design, build and maintain a central data cataloging system to ease integration and discovery of datasets
  • Develop data pipelines that provide fast, optimized, and robust end-to-end analytical solutions
  • Automate manual processes and create a platform in favor of self-service data consumption
  • Deploy and configure components to production environments.
  • Participate in on-call schedule to provide emergency incident support
  • Mentor and train teammates on design and operation of data platform
  • Stay current with industry trends, making recommendations as needed to help the company excel
  • Other job-related duties as assigned Skills,

Experience and Qualifications

  • Bachelor’s Degree in Computer Science or Engineering a plus
  • 5+ years of relevant industry experience in Data Engineering working with large scale data driven systems
  • Deep knowledge of dimensional modeling and designing schemas and data sets optimized for OLAP environment
  • Experience fine-tuning queries around large, complex data sets
  • Extensive experience working with an MPP data platform (ie Snowflake, BigQuery, or Databricks)
  • Experience designing and implementing workflows on a modern orchestration framework (ie Airflow, Prefect)
  • Advanced Data Build Tool (DBT) experience (ie macro design, generalizing tests, using different incremental strategies)
  • Deep understanding of SQL and data warehouse systems, especially Snowflake (SnowPro certification preferred)
  • Experience working with and administering a BI tool (Tableau preferred)
  • Expertise in object-oriented and / or functional programming languages (Python preferred)
  • Strong programming skills, able to write modular, maintainable code
  • Understanding of DevOps principles such as automating of CI / CD pipelines and Infrastructure as code
  • Understanding of polyglot data persistence (relational, key / value, document, column)
  • Excellent problem-solving skills and the ability to proactively solve issues
  • Excellent communication and organizational skills and proven ability to complete tasks and meet deadlines
  • Ability to be flexible with working in tandem with a team of engineers or alone, as required
  • Create a job alert for this search

    Data Engineer • Belgaum, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    EveriseBelgaum, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXBelgaum, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalbelagavi, karnataka, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Namasys Analyticsbelgaum, karnataka, in
    Immediate joiners preferred; up to 15 days acceptable.Seeking a Data Engineer to design, build, and maintain scalable data pipelines that automate ingestion and transformation from multiple data so...Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    The Transformation GroupBelgaum, IN
    The ideal candidate should possess experience with ETL, data and reporting; and contributing code to deliver new features and functionality. Day-to-day you will collaborate with engineers, product m...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Data-Hat AIBelgaum, IN
    Data Engineering & AI Solutions .Lead Data Solutions Architect .International travel required (up to 30–40%) .We are hiring a senior-level Data Engineer to lead the design, development, and optimiz...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaBelgaum, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalBelgaum, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Vriba SolutionsBelgaum, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    Eucloid Data SolutionsBelgaum, IN
    Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which ma...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesbelagavi, karnataka, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseBelgaum, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant only ( this is a Junior position with us ).GCP - 2 years minimum working Experience. Worked with global stakeholders.Randstad Sourc...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    LanceSoft Middle EastBelgaum, IN
    We have a new opportunity for ".Interested candidates send me your CV to.Months Contract with possible extension.Previous experience 7-10+ as a big data engineer. In-depth knowledge of Hadoop (Cloud...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyBelgaum, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 5 days ago
    • Promoted
    Rocket UniData Engineer

    Rocket UniData Engineer

    Mitra AIbelagavi, karnataka, in
    The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsBelgaum, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 13 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsBelgaum, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekBelgaum, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Searce IncBelgaum, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 14 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incbelagavi, karnataka, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 24 days ago