Talent.com
Reply - Data Engineer - Python/Spark
Reply - Data Engineer - Python/SparkVALOREM PVT LTD • Kochi
Reply - Data Engineer - Python / Spark

Reply - Data Engineer - Python / Spark

VALOREM PVT LTD • Kochi
30+ days ago
Job description

Description :

  • Reply is looking for a Data Engineer with experience building and contributing to the design of database systems, both normalized transactional systems and dimensional reporting systems.
  • Strong experience with SQL Server as a database engine, as well as Microsoft and Databricks technology experience implementing Big Data with Advanced Analytics solutions.
  • Successful candidates will have experience and skill in providing solutions for storing, retrieving, transforming and aggregating data to support line of business applications as well as reporting systems.
  • The Data Engineer will work with customers to deliver solutions utilizing strong business, technical and data modelling skills.
  • This position will represent Valorem's approach to data visualization and information delivery solutions and as such must demonstrate proficiency with Power BI and Azure Data Services.

Key Responsibilities :

  • Design and implement general architecture for complex data systems
  • Translate business requirements into functional and technical specifications
  • Design and implement lakehouse architecture
  • Develop and manage cloud-based data architecture and reporting solutions
  • Apply data modelling principles for relational and dimensional data structures
  • Design Data Warehouses following established principles (e.g., Kimball, Inmon)
  • Create and manage source-to-target mappings for ETL / ELT processes
  • Mentor junior engineers and contribute to architectural decisions and code reviews
  • Minimum Qualifications :

  • Bachelors degree in computer science, Computer Engineering, MIS, or related field
  • 5+years of experience with Microsoft SQL Server and strong proficiency in T- SQL, SQL performance tuning (Indexing, Structure, Query Optimization)
  • 5+years of experience in Microsoft data platform development and implementation
  • 5+years of experience with PowerBI or other competitive technologies
  • 3+years of experience in consulting, with a focus on analytics and data solutions
  • 2+ years of experience with Databricks, including Unity Catalog, Databricks SQL, Workflows, and Delta Sharing
  • Proficiency in Python and Apache Spark
  • Develop and manage Databricks notebooks for data transformation, exploration, and model deployment
  • Expertise in Microsoft Azure services, including Azure SQL, Azure Data Factory (ADF), Azure Data Warehouse (Synapse Analytics), Azure Data Lake, and Stream Analytics
  • Preferred Qualifications :

  • Experience with Microsoft Fabric
  • Familiarity with CI / CD pipelines and infrastructure-as-code tools like Terraform or Azure Resource Manager (ARM)
  • Knowledge of taxonomies, metadata management, and masterdata management
  • Familiarity with data stewardship, ownership, and data quality management
  • Expertise in Big Data technologies and tools :

  • BigData Platforms : HDFS, MapReduce, Pig, Hive
  • General DBMS experience with Oracle, DB2, MySQL, etc
  • No SQL databases such as HBase, Cassandra, DataStax, MongoDB, CouchDB, etc
  • Experience with non-Microsoft reporting and BI tools, such as Qlik, Cognos, MicroStrategy, Tableau, etc
  • About Reply :

  • Reply specializes in the design and implementation of solutions based on new communication channels and digital media.
  • Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things.
  • Reply services include Consulting, System Integration and Digital Services
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Kochi

    Related jobs
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Kottayam, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellify Solutions • Kottayam, IN
    Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • kottayam, kerala, in
    We are looking for a Data Engineer with Python AWS experience.Job Type : Full Time Employment.Understand the domain for which the entities are being created. Understand the entity creation process fr...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Kochi, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Syntasa • Kochi, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Kottayam, IN
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Mastek • Kottayam, IN
    Deep hands-on experience with Unity Catalog — creating and managing catalogs, schemas, and tables.Experience automating data onboarding and metadata registration via Unity Catalog APIs or Databrick...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Kottayam, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Kottayam, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • mount, kerala, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 7 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • mount, kerala, in
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: 7 hours ago • Promoted • New!
    Python Developer

    Python Developer

    Tata Consultancy Services • kochi, kerala, in
    Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Kottayam, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Kochi, Kerala, India
    TCS present an excellent opportunity for Data Engineer.Experience required : 7- 12 yrs.Skills : Python, Pyspark, SQL, GCP. Walk in Interview Date : 22-Nov-25 (Saturday).Address : TCS Center, Infopark Ko...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Kottayam, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 20 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Kochi, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 7 days ago • Promoted
    AI Engineer (Backend) - Python

    AI Engineer (Backend) - Python

    Edstem Technologies • Kochi, IN
    We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients. As an AI Engineer focused on backend development, you'll be in...Show more
    Last updated: 6 days ago • Promoted
    Reply - Data Engineer - Python / Spark

    Reply - Data Engineer - Python / Spark

    VALOREM PVT LTD • Cochin
    Description : - Reply is looking for a Data Engineer with experience building and contributing to the design of database...Show more
    Last updated: 30+ days ago • Promoted