Talent.com
Technical Manager (Databricks Technologies) - Manager - State Street Corporation

Technical Manager (Databricks Technologies) - Manager - State Street Corporation

ConfidentialHyderabad / Secunderabad, Telangana, India
5 days ago
Job description

Role Summary & Role Description :

Technical Manager with specific Oracle, PL / SQL and design, develop, and optimize data workflows on the Databricks platform. The ideal candidate will have deep expertise in Apache Spark, PySpark, Python, job orchestration, and CI / CD integration to support scalable data engineering and analytics solutions. Analyzes, designs, develops and maintains software applications to support business units.

Expected to spend 80% of the time on hands-on development, design and architecture and remaining 20% on guiding the team on technology and removing other impediments Capital Markets Projects experience preferred Provides advanced technical expertise in analyzing, designing, estimating, and developing software applications to project schedule. Oversees systems design and implementation of most complex design components. Creates project plans and deliverables and monitors task deadlines. Oversees, maintains and supports existing software applications. Provides subject matter expertise in reviewing, analyzing, and resolving complex issues. Designs and executes end to end system tests of new installations and / or software prior to release to minimize failures and impact to business and end users. Responsible for resolution, communication, and escalation of critical technical issues. Prepares user and systems documentation as needed. Identifies and recommends Industry best practices. Serves as a mentor to junior staff.

  • Acts as a technical lead / mentor for developers in day to day and overall project areas.
  • Ability to lead a team of agile developers.
  • Worked in a complex deadline driven projects with minimal supervision. Ability to architect / design / develop with minimum requirements by effectively coordinating activities between business analysts, scrum leads, developers and managers.
  • Ability to provide agile status notes on day to day project tasks.

Key Responsibilities :

  • Data Lakehouse Development :
  • Design and implement scalable data Lakehouse solutions using Databricks and Delta Lake.
  • Develop and maintain Delta Lake tables with ACID transactions and schema evolution.
  • Data Ingestion & Autoloaders :
  • Build ingestion pipelines using Databricks Autoloader for real-time and batch data.
  • Integrate data from various sources including cloud storage (e.g., ADLS, S3), databases, APIs, and streaming platforms.
  • ETL & Data Enrichment :
  • Develop ETL workflows to cleanse, transform, and enrich raw data.
  • Implement business logic and data quality checks to ensure reliability and accuracy.
  • Performance Optimization :
  • Optimize Spark jobs for performance and cost-efficiency.
  • Monitor and troubleshoot data pipelines using Databricks tools and logging frameworks.
  • Data Access & Governance :
  • Enable secure and governed access to data using Unity Catalog or other access control mechanisms.
  • Collaborate with data analysts and scientists to ensure data availability and usability.
  • Collaboration & Documentation :
  • Work closely with cross-functional teams including data architects, analysts, and business stakeholders.
  • Document data models, pipeline designs, and operational procedures.
  • Technical Skills :

  • Design and implement robust ETL pipelines using Databricks notebooks and workflows.
  • Strong proficiency in Apache Spark, PySpark, and Databricks.
  • Hands-on experience with Delta Lake, Autoloader, and Structured Streaming.
  • Proficiency in SQL, Python, and cloud platforms (Azure, AWS, or GCP).
  • Experience with ETL frameworks, data modeling, and data warehousing concepts.
  • Familiarity with CI / CD, Git, and DevOps practices in data engineering.
  • Knowledge of data governance, security, and compliance standards.
  • Optimize Spark jobs for performance and cost-efficiency.
  • Develop and manage job orchestration strategies using Databricks Jobs and Workflows.
  • Monitor and troubleshoot production jobs, ensuring reliability and data quality.
  • Implement security and governance best practices including access control and encryption.
  • Strong Practical experience using Scrum, Agile modelling and adaptive software development.
  • Ability to understand and grasp the big picture of system components.
  • Experience building environment and architecture and design guides and architecture and application blueprints.
  • Strong understanding of data modeling, warehousing, and performance tuning.
  • Excellent problem-solving and communication skills.
  • Core / Must have skills :

    Oracle, SQL, PLSQL, Python, Scala, Apache Spark, Spark Streaming, CI CD pipeline,

    AWS cloud experience

    Exposure to real-time data processing and event-driven architectures .

    Good To Have Skills

  • Databricks certifications (e.g., Data Engineer Associate / Professional).
  • Experience with Unity Catalog, MLflow, or Delta Live Tables
  • Work Schedule : 12 PM IST to 9 PM (IST)

    Why this role is important to us :

    Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.

    We offer a collaborative environment where technology skills and innovation are valued in a global organization. We're looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company.

    Join us if you want to grow your technical skills, solve real problems and make your mark on our industry.

    About State Street :

    What we do. State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we're making our mark on the financial services industry. For more than two centuries, we've been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.

    Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary by location, but you may expect generous medical care, insurance and savings plans, among other perks. You'll have access to flexible Work Programs to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.

    Inclusion, Diversity and Social Responsibility. We truly believe our employees' diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.

    State Street is an equal opportunity and affirmative action employer.

    Skills Required

    Compliance, Data Modeling, Oracle Sql, Scala, Apache Spark, Security, Sql, Devops, Git, Spark Streaming, Gcp, Agile, Data Warehousing, Databricks, Scrum, Data Governance, Azure, Python, Aws, Etl

    Create a job alert for this search

    Technical Manager • Hyderabad / Secunderabad, Telangana, India

    Related jobs
    • Promoted
    Purchasing Officer

    Purchasing Officer

    MNR UniversitySangareddy, Telangana, India
    Post Graduate (Any Discipline).Minimum 5 years in purchase operations for a Medical College or Hospital.The Purchase Officer (Medical) will be responsible for managing the procurement process for m...Show moreLast updated: 10 days ago
    • Promoted
    AWS Technical Manager

    AWS Technical Manager

    CBTShyderabad, telangana, in
    CBTS’ Enterprise Service Delivery Center is expanding our Cloud Services Operation and looking to add a Senior AWS Cloud Architect. This role can be performed remotely from inside the Continental US...Show moreLast updated: 1 day ago
    • Promoted
    Technology Manager

    Technology Manager

    ConfidentialHyderabad / Secunderabad, Telangana, India
    At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for o...Show moreLast updated: 5 days ago
    • Promoted
    Technical Manager

    Technical Manager

    ConfidentialHyderabad / Secunderabad, Telangana, India
    We are the leading provider of professional services to the middle market globally, our purpose is to instill confidence in a world of change, empowering our clients and people to realize their ful...Show moreLast updated: 5 days ago
    • Promoted
    Technical Delivery Manager

    Technical Delivery Manager

    BizAcuityHyderabad, Telangana, India
    Job Title : Technical Delivery Manager.Head of Product or VP of Engineering).The Engineering Delivery Lead is a high-impact, non-technical leadership role critical to bridging product strategy with ...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Technical Manager

    Technical Manager

    Client of NeerInfo SolutionsHyderabad, IN
    We are looking a Technology Manager with strong experience in Simulation with simulation tool expertise in Technomatix or Flexsim, or Simio. This person will have good understanding of CPG operation...Show moreLast updated: 8 hours ago
    • Promoted
    Technical Delivery Manager

    Technical Delivery Manager

    IndiHireHyderabad
    Technical Delivery Manager : The Technical Delivery Manager will play a key leadership role within a data-focused solutions delivery team. This role requires hands-on ...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Manager

    Technical Manager

    Votary Softech Solutions Pvt. Ltd.secunderabad, India
    We are seeking an experienced Multimedia Driver Development Lead to architect, design, and lead development of multimedia subsystems — including Camera, Display, Audio, and Video frameworks — for e...Show moreLast updated: 23 hours ago
    • Promoted
    National Technical Manager

    National Technical Manager

    Olive Green ConsultingHyderabad, Telangana, India
    We’re Hiring | National Technical Head – Housing Finance What You’ll Do : Key Roles and Responsibilities 1.Property Valuation and Appraisal • Site Visits and Inspection : Conducting on-site physic...Show moreLast updated: 1 day ago
    • Promoted
    Technical Manager (Databricks Technologies) - Manager

    Technical Manager (Databricks Technologies) - Manager

    ConfidentialHyderabad / Secunderabad, Telangana, India
    Role Summary & Role Description.Technical Manager with specific Oracle, PL / SQL and design, develop, and optimize data workflows on the Databricks platform. The ideal candidate will have deep experti...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Technical Solutions Manager

    Technical Solutions Manager

    NomisoHyderabad, Republic Of India, IN
    Nomiso is a product and services engineering company.We are a team of Software Engineers, Architects, Managers, and Cloud Experts with expertise in Technology and Delivery Management.Our mission is...Show moreLast updated: 21 hours ago
    • Promoted
    Cloud Technical Manager

    Cloud Technical Manager

    CBTShyderabad, telangana, in
    CBTS is a leading technology provider to more than 3,000 organizations in all industries, including dozens of fortune 500 and Global 2000 companies. We provide consulting resources and cloud or on-p...Show moreLast updated: 1 day ago
    • Promoted
    Technical Manager

    Technical Manager

    Backbasehyderabad, telangana, in
    We are looking for a qualified Technical Manager to oversee and own a portfolio of customer accounts.As part of a Customer Success Team you will work with the Customer Success Manager and Delivery ...Show moreLast updated: 20 days ago
    • Promoted
    Technical Manager

    Technical Manager

    Latinem Private LimitedHyderabad, Republic Of India, IN
    Latinem India – Global Capability Centre Latinem is a high-performance Global Capability Centre (GCC) delivering world-class strategic, digital, and operational support to Sobha’s markets across th...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Services Manager

    Technical Services Manager

    TEKsystems Global Services in IndiaHyderabad, Telangana, India
    Technical Service Manager Opportunity at TEKsystems Global Services.Are you a seasoned IT professional ready for a dynamic leadership role?. We're looking for a leader with.Application Development p...Show moreLast updated: 22 days ago
    • Promoted
    Plant Human Resources Manager

    Plant Human Resources Manager

    Ola ElectricGundla Pochampalli, India
    The Plant HR Business Partner (HRBP) will act as a strategic partner to the plant management team, providing HR support and guidance to drive business performance, employee engagement, and complian...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Technical Program Manager, Data Center Network Infrastructure Construction

    Senior Technical Program Manager, Data Center Network Infrastructure Construction

    ConfidentialHyderabad / Secunderabad, Telangana, India
    Bachelor's degree in Telecommunications Engineering or Electrical Engineering, a related field, or equivalent practical experience. Certification in Registered Communications Distribution Designer (...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Team Member - Sourcing (Biologics)

    Team Member - Sourcing (Biologics)

    Aurigene Pharmaceutical Services LimitedShamirpet, Telangana, India
    Team Member - Sourcing (Biologics).Aurigene Pharmaceutical Services Ltd.Are you a procurement specialist who understands the fast-paced demands of the pharmaceutical industry? Can you strategically...Show moreLast updated: 18 hours ago