Talent.com
Reveille Technologies - Big Data Engineer
Reveille Technologies - Big Data EngineerReveille Technologies • Pune
Reveille Technologies - Big Data Engineer

Reveille Technologies - Big Data Engineer

Reveille Technologies • Pune
30+ days ago
Job description

Description :

We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data platform on Microsoft Azure. The ideal candidate will be an expert in Azure Databricks and have a strong background in big data processing, data warehousing, and modern DevOps practices. We are hiring for three positions across our major offices.

Role & Compensation Details :

Role : Big Data Engineer / Lead

Experience : 4 - 7 Years (3 Open Positions)

Locations : Bangalore | Chennai | Mumbai | Pune | Noida

Key Responsibilities :

Big Data Application Development :

  • Build, deploy, and optimize scalable Big Data applications and pipelines primarily leveraging Azure Databricks.
  • Design and implement robust data processing jobs using Apache Spark with proficiency in either Scala or Python (PySpark).

Data Warehousing & ETL / ELT :

  • Apply strong SQL expertise for complex data querying, analysis, and optimization within cloud data solutions.
  • Demonstrate strong experience in designing and developing ETL / ELT processes, data ingestion patterns, and modern Data Warehousing concepts.
  • Infrastructure & Automation (DevOps Focus) :

  • Work hands-on with infrastructure-as-code tools like Terraform for provisioning and managing Azure resources.
  • Utilize workflow orchestration tools such as Airflow to design, schedule, and monitor complex data workflows.
  • Familiarity with containerization and orchestration technologies like Kubernetes is highly desirable.
  • Implement and manage robust CI / CD pipelines using tools like Git and Jenkins to ensure automated, reliable deployment of data applications.
  • Data Lifecycle Management :

  • Enable and support the complete data lifecycle, including data collection, efficient storage strategies, scalable data modeling, and timely analysis across various operational systems.
  • Code Quality & Performance :

  • Ensure high standards of code quality, security, and performance optimization for all data processing jobs and infrastructure components.
  • Mandatory Skills :

  • Cloud Data Platform : Expert-level proficiency in Azure Databricks.
  • Data Processing : Strong hands-on experience with Apache Spark (using Scala or Python).
  • Database : Advanced proficiency in SQL (including complex queries, stored procedures, and optimization).
  • Preferred Skills :

  • Experience with Infrastructure as Code (e.g., Terraform).
  • Experience with workflow orchestration tools (e.g., Apache Airflow).
  • Familiarity with CI / CD tools (Git, Jenkins).
  • Knowledge of Azure Data Services (e.g., Azure Data Factory, Azure Synapse, Azure Datalake Storage).
  • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Pune

    Related jobs
    Data Engineer

    Data Engineer

    Recro • Pune, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Developer

    Big Data Developer

    UST • Pune, Maharashtra, India
    The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and o...Show more
    Last updated: 30+ days ago • Promoted
    Big Data Specialist

    Big Data Specialist

    Atomic North • Pune, India
    Long term onsite to Abu Dhabi • •.We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, d...Show more
    Last updated: 12 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EXL • Pune, India
    We are seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions.The ideal candid...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    EXL • Pune, Maharashtra, India
    The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on experience using GCP-native tools.Dataflow, Dataproc, P...Show more
    Last updated: 22 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    INDI Staffing Services • Pune, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 22 days ago • Promoted
    5676 - Data Engineer

    5676 - Data Engineer

    EXL • Pune, Maharashtra, India
    Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show more
    Last updated: 22 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Persistent Systems • Pune, India
    We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more
    Last updated: 10 days ago • Promoted
    Data Engineer

    Data Engineer

    HCLTech • Pune, India
    We’re Expanding Our Digital & Data Talent Pool.Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring i...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Pune, IN
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce Inc • Pune, Maharashtra, India
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITC Infotech • Pune, India
    Location : Banglore / Pune (Hybrid).We are seeking a hands-on Technical Lead to drive the ingestion of high-volume mainframe RPC data into Databricks, enabling scalable machine learning workflows.This...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Pune, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerx • Pune, Maharashtra, India
    We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXL • Pune, Maharashtra, India
    Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer - GCP

    Data Engineer - GCP

    Pixeldust Technologies • Pune, India
    We are seeking a highly skilled Data Engineer - GCP with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP).The ideal candidate ...Show more
    Last updated: 13 days ago • Promoted
    Azure Data Engineer / Data Visualization Lead (Tableau)

    Azure Data Engineer / Data Visualization Lead (Tableau)

    PROADSW3 Relations pvt. ltd. • Pune, Maharashtra, India
    Azure Data Engineer / Data Visualization Lead (Tableau) – AM / DM | 5–8 Years | Budget : 1.Mandate : Databricks Experience. We are seeking a highly skilled Azure Data Engineer – Data Visualization Lead ...Show more
    Last updated: 2 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Capgemini Invent • Pune, Maharashtra, India
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: less than 1 hour ago • Promoted • New!