Talent.com
This job offer is not available in your country.
Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

HARPIndia, India
1 day ago
Job description

Job Description

Profile Summary

  • Data Engineer with 5 years of experience in Big Data technologies.
  • Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark.
  • Proficient in Python programming.
  • Hands-on experience with Databricks, MongoDB, Docker, and Kubernetes.
  • Solid understanding of DevOps practices and tools.

Primary Skills

  • Design, develop, and maintain scalable and reliable data pipelines.
  • Translate business requirements and data models into efficient ETL code.
  • Work independently on Spark-based data processing workflows.
  • Skilled in writing complex business logic using PySpark and Spark SQL.
  • Strong understanding of Spark clusters, distributed computing, and parallel processing.
  • Capable of writing unit test cases to validate ETL logic.
  • Experience in building reusable functions and applying modular programming approaches.
  • Worked with AWS Athena for table creation, indexing, and writing complex SQL queries.
  • Experience working with both relational databases (e.g., Oracle, SQL Server) and NoSQL databases (e.g., MongoDB) for data extraction and loading.
  • Secondary Skills

  • Experience in creating AWS IAM roles and defining access policies.
  • Familiar with Docker image creation and customization.
  • Experience with Camunda for workflow orchestration and automation.
  • Additional Expectations

  • Strong communication skills.
  • Proficient in troubleshooting and problem-solving.
  • Demonstrates a continuous learning mindset.
  • Focused on automating manual tasks through coding wherever feasible.
  • Technical Skills

    Mandatory Skills :

    Python for Data, Apache Spark, Java, Python, Scala, Spark SQL, Databricks

    Create a job alert for this search

    Software • India, India

    Related jobs
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Strobes Security, Inc.Nagpur, IN
    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    RAVSoft Solutions Inc.nagpur, maharashtra, in
    Job Title : Mid-Level AWS Cloud Engineer (AWS Lambda + TypeScript).You will be responsible for building scalable, secure, and high-performance backend systems and infrastructure that power our core ...Show moreLast updated: 14 days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteIndia, India
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 14 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    BrightEdgeNagpur, IN
    Senior Software Engineer, Remote.The Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust ...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Data Engineer ( AWS / Azure)

    Data Engineer ( AWS / Azure)

    Natlov Technologies Pvt Ltdnagpur, maharashtra, in
    Location : Remote | Shift : 6 PM – 3 AM IST.Build and optimize scalable data pipelines & models.Ensure data quality, security, and performance. Collaborate across teams & mentor juniors.Work with mode...Show moreLast updated: 11 hours ago
    • Promoted
    Cloud Engineer Lead (AWS)

    Cloud Engineer Lead (AWS)

    Datapel SystemsNagpur, IN
    The Senior Cloud Engineer (AWS) will be responsible for developing, maintaining, optimising and supporting the cloud infrastructure that supports Datapel’s Warehouse Management System (WMS) and rel...Show moreLast updated: 25 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USANagpur, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    AWS Platform Engineer

    AWS Platform Engineer

    Creyente InfotechIndia
    Job Description – AWS Platform Engineer (Financial Systems).We are seeking a Platform Engineer to take full ownership of mission-critical financial systems within an investment banking environment....Show moreLast updated: 6 hours ago
    • Promoted
    Full Stack Engineer

    Full Stack Engineer

    AideWiser SolTekNagpur, IN
    AWS (EC2, Lambda, S3, RDS, DynamoDB, etc.Design, develop, and maintain backend services using.Net Core / MVC and frontend components using React. Build and scale backend systems on AWS cloud infrastru...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    DBiz.aiNagpur, IN
    We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 15 days ago
    • Promoted
    Sr. Software Engineer

    Sr. Software Engineer

    IntraEdgeIndia, India
    Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake.The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration a...Show moreLast updated: 6 days ago
    • Promoted
    AWS Database Eng

    AWS Database Eng

    Tata Consultancy ServicesIndia
    Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 7 days ago
    • Promoted
    Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

    Software Engineer-(AWS Databricks +Mongo DB) (Full-time at a Fortune 500 tech MNC)

    HARPNagpur, IN
    Data Engineer with 5 years of experience in Big Data technologies.Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark. Proficient in Python programmin...Show moreLast updated: 1 day ago
    • Promoted
    Senior Software Engineer(Generative AI Engineer)

    Senior Software Engineer(Generative AI Engineer)

    VeltrisNagpur, IN
    Senior Software Engineer, AI / ML Engineer (primary focus : AI Agents).Baseline : 8+ years exp, Python / Java, CI / CD (GitHub Actions / Jenkins), cloud (AWS serverless or Kubernetes), IaC (Terraform).Key st...Show moreLast updated: 14 days ago
    • Promoted
    Gen AI Engineer

    Gen AI Engineer

    SkillveraNagpur, IN
    Deep expertise in LangChain, LangGraph, Langflow.Able to write UI in AngularJS / React and UI / UX practices.Hands-on experience with LLM interactions, prompt tuning, OpenAI / AWS Bedrock.C# or Java for ...Show moreLast updated: 11 days ago
    • Promoted
    Senior Software Engineer

    Senior Software Engineer

    AtomicAdsNagpur, IN
    We are seeking a highly skilled Software Development Engineer (SDE) to join our dynamic engineering team.In this role, you will contribute to building and maintaining scalable, high-performance app...Show moreLast updated: 1 day ago
    • Promoted
    Infrastructure Engineer (AWS & Typescript)

    Infrastructure Engineer (AWS & Typescript)

    Crossing HurdlesNagpur, IN
    AWS CDK + TypeScript - Infrastructure Engineer.We are seeking an experienced Infrastructure Engineer specializing in AWS CDK and TypeScript to design, develop, and maintain scalable cloud infrastru...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsNagpur, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 2 days ago
    • Promoted
    Full Stack Engineer

    Full Stack Engineer

    HyqooNagpur, IN
    Design, develop, and maintain responsive, high-quality frontend applications using.Collaborate with backend teams to integrate APIs and ensure smooth data flow. Build reusable, testable, and efficie...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTeknagpur, maharashtra, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 24 days ago