Talent.com
This job offer is not available in your country.
Cloud Data Specialist

Cloud Data Specialist

ConfidentialMumbai, India
8 days ago
Job description

Seaspan teams are goal-driven and share a high-performance culture, focusing on building services offerings to become a leading asset manager. Seaspan provides many of the world&aposs major shipping lines with alternatives to vessel ownership by offering long-term leases on large, modern containerships and pure car, truck carriers (PCTCs) combined with industry leading ship management serves. Seaspan&aposs fleet has evolved over time to meet the varying needs of our customer base. We own vessels in a wide range of sizes, from 2,500 TEU to 24,000 TEU vessels. As a wholly owned subsidiary of Atlas Corp, Seaspan delivers on the company&aposs core strategy as a leading asset management and core infrastructure company.

Position description :

We are seeking a highly skilled and versatile Cloud Data Specialist to join our Data Operations team. Reporting to the Team Lead, Data Operations, the Cloud Data Specialist plays a key role in the development, administration, and support of our Azure-based data platform, with a particular focus on Databricks, data pipeline orchestration using tools like Azure Data Factory (ADF), and environment management using Unity Catalog. A strong foundation in data engineering, cloud data administration, and data governance is essential. Development experience using SQL and Python is required. Knowledge or experience with APIM is nice to have.

Primary responsibilities :

Data Engineering and Platform Management :

  • Design, develop, and optimize scalable data pipelines using Azure Databricks and ADF.
  • Administer Databricks environments, including user access, clusters, and Unity Catalog for data lineage, governance, and security.
  • Support the deployment, scheduling, and monitoring of data workflows and jobs in Databricks and ADF.
  • Implement best practices for CI / CD, version control, and operational monitoring for pipeline deployments.
  • Implement and manage Delta Lake to ensure reliable, performant, and ACID-compliant data operations.

Data Modeling and Integration :

  • Collaborate with business and data engineering teams to design data models that support analytics and reporting use cases.
  • Support integration of data from multiple sources into the enterprise data lake and data warehouse
  • Configure API calls to utilize our Azure APIM platform.
  • Maintain and enhance data quality, structure, and performance within the Lakehouse and warehouse architecture.
  • Collaboration and Stakeholder Engagement :

  • Work cross-functionally with business units, data scientists, BI analysts, and other stakeholders to understand data requirements.
  • Translate technical solutions into business-friendly language and deliver clear documentation and training when required.
  • Required Technical Expertise :

    Apache Spark (on Databricks)

  • Proficient in PySpark and spark SQL
  • Spark optimization techniques (caching, partitioning, broadcast joins)
  • Writing and scheduling notebooks / jobs in Databricks
  • Understanding of Delta Lake architecture and features
  • Working with Databricks Workflows (pipelines and job orchestration)
  • SQL / Python Programming

  • Handling JSON, XML, and other semi-structured formats
  • Experience with API integration using requests, http, etc.
  • Error handling and logging
  • API Ingestion

  • Designing and implementing ingestion pipelines for RESTful API
  • Transforming and loading JSON responses to Spark tables
  • Cloud & Data Platform Skills

  • Databricks on Azure
  • Cluster configuration and management
  • Unity Catalog features (optional but good to have)
  • Azure Data Factory

  • Creating and managing pipelines for orchestration
  • Linked services and datasets for ADLS, Databricks, SQL Server
  • Parameterized and dynamic ADF pipelines
  • Triggering Databricks notebooks from ADF
  • Data Engineering Foundations

  • Data modeling and warehousing concepts
  • ETL / ELT design patterns
  • Data validation and quality checks
  • Working with structured and semi-structured data (JSON, Parquet, Avro)
  • DevOps & CI / CD

  • Git / GitHub for version control
  • CI / CD using Azure DevOps or GitHub Actions for Databricks jobs
  • Infrastructure-as-code (Terraform for Databricks or ADF)
  • Additional Requirements :

  • Bachelor&aposs degree in computer science, information systems, or a related field.
  • 4+ years of experience in a cloud data engineering, data platform, or analytics engineering role.
  • Familiarity with data governance, security principles, and data quality best practices.
  • Excellent analytical thinking and problem-solving skills.
  • Strong communication skills and ability to work collaboratively with technical and non-technical stakeholders.
  • Microsoft certifications in Azure Data Engineer, Power Platform, or related field is desired
  • Experience with Azure APIM is nice to have
  • Knowledge of enterprise data architecture and data warehouse principles (e.g., dimensional modeling) an asset
  • Job Demands and / or Physical Requirements :

  • As Seaspan is a global company, occasional work outside of regular office hours may be required.
  • Compensation and Benefits package :

    Seaspan's total compensation is based on our pay-for-performance philosophy that rewards team members who deliver on and demonstrate our high-performance culture. The exact base salary offered will be commensurate with the incumbent's experience, job-related skills and knowledge, and internal pay equity.

    Seaspan Corporation is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, race, color, religion, gender, sexual orientation, gender identity, national origin, disability, or protected Veteran status. We thank all applicants in advance. If your application is shortlisted to be included in the interview process, one of our team will be in contact with you.

    Please note that while this position is open in both Vancouver and Mumbai, it represents a single headcount. The role will be filled in one of the two locations based on candidate availability and suitability, determined by the hiring team.

    Show more

    Show less

    Skills Required

    Spark SQL, Github, Pyspark, Apache Spark, Azure Databricks, Api Integration, Sql, Git, Azure Data Factory, Terraform, Python

    Create a job alert for this search

    Cloud Data Specialist • Mumbai, India

    Related jobs
    • Promoted
    Cloud Engineer

    Cloud Engineer

    DBiz.aiThane, IN
    We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services.The ideal candidate wil...Show moreLast updated: 7 days ago
    • Promoted
    Senior Cloud Engineer AWS

    Senior Cloud Engineer AWS

    Matrix USAKalyan-Dombivli, IN
    We are seeking an experienced AWS Developer proficient in Python and PySpark to design, develop, and maintain scalable, serverless data processing and workflow automation solutions on AWS.The ideal...Show moreLast updated: 3 days ago
    • Promoted
    Linedata - Senior Azure Cloud Specialist - IaaS / Terraform

    Linedata - Senior Azure Cloud Specialist - IaaS / Terraform

    Gravitas Technology Private LimitedMumbai
    About Us : WHY Linedata ? Linedata is an award-winning software solutions company.We believe finance matters to our society as...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    iVedha Inc.Thane, IN
    Seeking a highly experienced Cloud Architect to design and oversee robust, scalable, and secure.Architect end-to-end cloud solutions (public, private, hybrid) with a focus on reliability, security,...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Strobes Security, Inc.Kalyan-Dombivli, IN
    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 26 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    ValueMomentumdombivli, maharashtra, in
    We are seeking a highly skilled.You will work closely with development, operations, and security teams to ensure continuous delivery, high availability, and optimal performance of our applications....Show moreLast updated: 6 days ago
    • Promoted
    Senior Cloud & AI Sales Specialist / Manager

    Senior Cloud & AI Sales Specialist / Manager

    L&T-Cloudfinitimumbai, maharashtra, in
    We are seeking a motivated and seasoned.This role involves identifying strategic business opportunities, managing large sales pipelines, closing high-value deals, and fostering long-term client rel...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Sharp BrainsMumbai, Maharashtra, India
    Deep understanding of Linux / Windows OS and networking concepts.Experience with Azure, including services, architecture, and best practices. Containerization & Orchestration : .Hands-on experience with...Show moreLast updated: 25 days ago
    • Promoted
    AI Cloud Tech Lead – Path to AI Cloud Solution Architect

    AI Cloud Tech Lead – Path to AI Cloud Solution Architect

    wai technologiesmumbai, maharashtra, in
    From modernizing enterprise systems to designing futuristic apps with our Raaghu design system and AI Pundit tools, we build scalable, intelligent solutions that deliver measurable impact.Join us a...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    Response Informaticsthane, maharashtra, in
    Strong analytical skills to interpret complex data sets.Experience with data visualization tools to present findings effectively. Ability to develop and implement data-driven strategies.Familiarity ...Show moreLast updated: 20 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Mindtreemumbai, maharashtra, in
    Show moreLast updated: 17 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Lemongrassdombivli, maharashtra, in
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 19 days ago
    • Promoted
    Cloud Data Specialist

    Cloud Data Specialist

    Seaspan CorporationMumbai
    Position Description : We are seeking a highly skilled and versatile Cloud Data Specialist to join our Data Operations team. Reporting to the Team Lead, Data Operatio...Show moreLast updated: 20 days ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesMumbai, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Alp Consulting Ltd.thane, maharashtra, in
    Bachelor’s degree in Computer Science, Information Systems, or a related field.Show moreLast updated: 15 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Searce IncMumbai, Maharashtra, India
    The ‘process-first’ AI-native modern tech consultancy that's rewriting the rules.As an engineering-led consultancy, we are dedicated to relentlessly improving the real business outcomes.Our solvers...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteThane, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 7 days ago
    • Promoted
    Senior Cloud Solutions Architect

    Senior Cloud Solutions Architect

    CloudThatmumbai, maharashtra, in
    Strategic architecture role for enterprise-wide cloud system design, governance, and innovation enablement.Define enterprise cloud strategy. Lead high / low-level design documentation.Collaborate with...Show moreLast updated: 25 days ago
    • Promoted
    snowflake Cloud Database Administrator

    snowflake Cloud Database Administrator

    Leading automobile GCCdombivli, maharashtra, in
    Cloud Platform Expertise : Familiarity with leading cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, and Snowflake is essential. Understanding their database offerings, such as AWS...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Infra Manager

    Cloud Infra Manager

    Cogitatenavi mumbai, maharashtra, in
    We are seeking a skilled Cloud Engineer & DevOps Engineer to join our technology team.This dual role combines cloud administration with DevOps responsibilities, focusing on the management, optimiza...Show moreLast updated: 4 days ago