Talent.com
Data Engineer - Big Data Technologies

Data Engineer - Big Data Technologies

Career Soft SolutionsIndia
30+ days ago
Job description

About the Role :

We are seeking a talented and motivated Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that enable data-driven decision-making.

The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure reliable data flow and integration across multiple sources and systems.

Key Responsibilities :

  • Design, develop, and maintain robust and scalable data pipelines and ETL processes to ingest, transform, and integrate data from various sources.
  • Build and optimize data architectures, including data warehouses, lakes, and marts.
  • Work closely with data scientists and analysts to support their data requirements and enable advanced analytics and machine learning.
  • Monitor and troubleshoot data workflows to ensure data quality, availability, and performance.
  • Implement best practices for data governance, security, and compliance.
  • Collaborate with cross-functional teams to understand business needs and translate them into technical data solutions.
  • Automate repetitive data tasks and improve data processing efficiency.
  • Document data workflows, architectures, and processes.
  • Stay current with emerging data technologies and tools to drive continuous improvement.

Required Skills and Qualifications :

  • Bachelors degree in Computer Science, Engineering, or a related field.
  • Proven experience in data engineering or related roles.
  • Strong proficiency in SQL and experience with relational databases (e. , MySQL, PostgreSQL, Oracle).
  • Experience with big data technologies such as Hadoop, Spark, Kafka, or similar.
  • Proficiency in one or more programming languages such as Python, Java, or Scala.
  • Experience with cloud data platforms (AWS, GCP, Azure) and associated services (Redshift, BigQuery, Azure Data Factory).
  • Knowledge of ETL tools (Informatica, Talend, Apache NiFi) and workflow orchestration tools (Airflow, Luigi).
  • Familiarity with data modeling, schema design, and performance tuning.
  • Experience with containerization and orchestration tools (Docker, Kubernetes) is a plus.
  • Strong problem-solving and analytical skills
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyNagpur, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLNagpur, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseNagpur, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AINagpur, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsNagpur, IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 15 days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsNagpur, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 6 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Nagpur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeNagpur, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechNagpur, IN
    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyNagpur, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich IndiaNagpur, IN
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncNagpur, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalNagpur, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 15 days ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPNagpur, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionNagpur, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AINagpur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradNagpur, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsNagpur, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 15 days ago