Talent.com
Data Pipeline Engineer

Data Pipeline Engineer

Enterprise Minds, IncPune, Republic Of India, IN
14 days ago
Job description

Data Engineer

No of Positions-2

Exp-4-8 Years

Mode-Hybrid

Location-Pune

Your Position

As a data engineer, you will be responsible for delivering data intelligence solutions to our customers all around the globe, based on an innovative product, which provides insights into the performance of their material handling systems. You will be working on implementing and deploying the product as well as designing solutions to fit it to our customer needs. You will work together with an energetic and multidisciplinary team to build end-to-end data ingestion pipelines and implement and deploy dashboards.

Your tasks and responsibilities

  • You will design and implement data & dashboarding solutions to maximize customer value.
  • You will deploy and automate the data pipelines and dashboards to enable further project implementation.
  • You embrace working in an international, diverse team, with an open and respectful atmosphere.
  • You leverage data by making it available for other teams within our department as well to enable our platform vision.
  • You enjoy an independent and self-reliant way of working with a proactive style of communication to take ownership to provide the best possible solution.
  • You will be part of an agile team that encourages you to speak up freely about improvements, concerns, and blockages. As part of Scrum methodology, you will independently create stories and participate in the refinement process.
  • You collect feedback and always search for opportunities to improve the existing standardized product.
  • Execute projects from conception through client handover with a positive contribution on technical performance and the organization.
  • You will take the lead in communication with different stakeholders that are involved in the projects that are being deployed.

Your profile

  • Bachelor's or master's degree in computer science, IT, or equivalent and a minimum of 4 to 8 years of experience building and deploying complex data pipelines and data solutions.
  • Bachelor's or master's degree in computer science, IT, or equivalent (for junior profiles).
  • Experience deploying data pipelines using technologies like Databricks.
  • Hands on experience with Java.
  • Hands-on experience in Databricks.
  • Experience with visualization software, preferably Splunk (or else Grafana, Prometheus, PowerBI, Tableau, or similar).
  • Strong experience with SQL, Java with hands-on experience in data modeling.
  • Experience with Pyspark or Spark to deal with distributed data.
  • Good to have knowledge on Splunk (SPL)
  • Experience with data schemas (e.G. JSON / XML / Avro).
  • Experience in deploying services as containers (e.G. Docker, Kubernetes).
  • Experience in working with cloud services (preferably with Azure).
  • Experience with streaming and / or batch storage (e.G. Kafka, streaming platform) is a plus.
  • Experience in data quality management and monitoring is a plus.
  • Strong communication skills in English.
  • Create a job alert for this search

    Data Pipeline Engineer • Pune, Republic Of India, IN

    Related jobs
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsIndia, India
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneNagpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroIndia, India
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpressnagpur, maharashtra, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladenagpur, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsnagpur, maharashtra, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    JRD Systemsnagpur, maharashtra, in
    Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources. Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyNagpur, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian Indianagpur, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPNagpur, IN
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 23 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionnagpur, maharashtra, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indianagpur, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandNagpur, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 1 day ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantIndia, India
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 12 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesnagpur, maharashtra, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 9 days ago
    • Promoted
    Sr ETL Data Engineer -HL7

    Sr ETL Data Engineer -HL7

    BigRionagpur, maharashtra, in
    Job Title : Sr ETL Data Engineer -HL7.Location : Remote – India (UK Shift).BigRio is a remote-based, technology consulting firm headquartered in Boston, MA. We specialize in delivering advanced softwa...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtreenagpur, maharashtra, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradNagpur, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 21 days ago