Talent.com
This job offer is not available in your country.
Sr Specialist Data / AI Engineering

Sr Specialist Data / AI Engineering

AT&THyderabad, Telangana, India
15 hours ago
Job description

Job Description

Key Responsibilities :

Data Engineering & Architecture :

  • Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.
  • Build and manage scalable data ingestion frameworks for batch and real-time data processing.
  • Implement and optimize data lake architecture in Azure Data Lake to support analytics and reporting workloads.
  • Develop and optimize data models and queries in Azure Synapse Analytics to power BI and analytics use cases.

Cloud-Based Data Solutions :

  • Architect and implement modern data lakehouses combining the best of data lakes and data warehouses.
  • Leverage Azure services like Data Factory, Event Hub, and Blob Storage for end-to-end data workflows.
  • Ensure security, compliance, and governance of data through Azure Role-Based Access Control (RBAC) and Data Lake ACLs.
  • ETL / ELT Development :

  • Develop robust ETL / ELT pipelines using Azure Data Factory, Data Bricks notebooks, and PySpark.
  • Perform data transformations, cleansing, and validation to prepare datasets for analysis.
  • Manage and monitor job orchestration, ensuring pipelines run efficiently and reliably.
  • Performance Optimization :

  • Optimize Spark jobs and SQL queries for large-scale data processing.
  • Implement partitioning, caching, and indexing strategies to improve performance and scalability of big data workloads.
  • Conduct capacity planning and recommend infrastructure optimizations for cost-effectiveness.
  • Collaboration & Stakeholder Management :

  • Work closely with business analysts, data scientists, and product teams to understand data requirements and deliver solutions.
  • Participate in cross-functional design sessions to translate business needs into technical specifications.
  • Provide thought leadership on best practices in data engineering and cloud computing.
  • Documentation & Knowledge Sharing :

  • Create detailed documentation for data workflows, pipelines, and architectural decisions.
  • Mentor junior team members and promote a culture of learning and innovation.
  • Required Qualifications :

  • Experience : 7+ years of experience in data engineering, big data, or cloud-based data solutions.Proven expertise with Azure Data Bricks, Azure Data Lake, and Azure Synapse Analytics.
  • Technical Skills : Strong hands-on experience with Apache Spark and distributed data processing frameworks.Advanced proficiency in Python and SQL for data manipulation and pipeline development.Deep understanding of data modeling for OLAP, OLTP, and dimensional data models.Experience with ETL / ELT tools like Azure Data Factory or Informatica.Familiarity with Azure DevOps for CI / CD pipelines and version control.
  • Big Data Ecosystem : Familiarity with Delta Lake for managing big data in Azure.Experience with streaming data frameworks like Kafka, Event Hub, or Spark Streaming.
  • Cloud Expertise : Strong understanding of Azure cloud architecture, including storage, compute, and networking.Knowledge of Azure security best practices, such as encryption and key management.
  • Preferred Skills (Nice to Have) :

  • Experience with machine learning pipelines and frameworks like MLFlow or Azure Machine Learning.
  • Knowledge of data visualization tools such as Power BI for creating dashboards and reports.
  • Familiarity with Terraform or ARM templates for infrastructure as code (IaC).
  • Exposure to NoSQL databases like Cosmos DB or MongoDB.
  • Weekly Hours : 40

    Time Type : Regular

    Location :

    Hyderabad, Andhra Pradesh, India

    It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and / or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.

    Create a job alert for this search

    Engineering Specialist • Hyderabad, Telangana, India

    Related jobs
    • Promoted
    • New!
    Specialist Data / AI Engineering

    Specialist Data / AI Engineering

    AT&THyderabad, Telangana, India
    Data Engineering & Architecture : .Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.Build and manage scalabl...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Senior AI Manager (GenAI)

    Senior AI Manager (GenAI)

    Procter & GambleHyderabad, Telangana, India
    As a Senior AI Engineer, you will collaborate with data scientists, product managers, and infrastructure engineers to design and scale algorithmic products, including Generative AI models and Agent...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Senior AI Engineer

    Senior AI Engineer

    Rockwell AutomationHyderabad, Telangana, India
    Rockwell Automation is a global technology leader focused on helping the world’s manufacturers be more productive, sustainable, and agile. With more than 28,000 employees who make the world better e...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Lead - Responsible AI (RAI)

    Lead - Responsible AI (RAI)

    Warner Bros DiscoveryBegumpet, Telangana, India
    When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr. Manager, Data Science & Applied AI

    Sr. Manager, Data Science & Applied AI

    451 Discovery Comm. IndiaBegumpet, Telangana, India
    When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic ...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Sr.Data And Analytics_AI Manager

    Sr.Data And Analytics_AI Manager

    Anicalls (Pty) LtdHyderabad, Telangana, India
    Excellent Knowledge and expertise in 2 or more of the following areas : Statistical Modelling, Machine Learning, Operations Research, Neural Networks, Deep Learning. Hands-on Experience in coding on ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr Data Analytics Engineer – ATCQE

    Sr Data Analytics Engineer – ATCQE

    MicronHyderabad, Telangana, India
    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr. Data Science Engineer, SMAI

    Sr. Data Science Engineer, SMAI

    MicronHyderabad, Telangana, India
    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    AI / ML Computational Science Sr Analyst

    AI / ML Computational Science Sr Analyst

    AccentureHyderabad, Telangana, India
    Tech for Operations - Artificial Intelligence (AI).AI / ML Computational Science Sr Analyst.Accenture is a global professional services company with leading capabilities in digital, cloud and securit...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Lead AI Engineer

    Lead AI Engineer

    Weekday AIHyderabad, Telangana, India
    This role is for Weekday's client.Additionally, you will play a key role in managing the AI engineering team, fostering innovation, and ensuring successful execution of AI-driven projects.Lead the ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr Associate Big Data Engineering

    Sr Associate Big Data Engineering

    AT&THyderabad, Telangana, India
    Data Engineering & Architecture : .Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.Build and manage scalabl...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr. Software Engineer, Search and AI

    Sr. Software Engineer, Search and AI

    HighspotHyderabad, Andhra Pradesh, India
    Develop highly-available distributed services, including improving existing systems.Experiment with different techniques to improve search quality, relevance and experiences.Help design and develop...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr. Analytics Engineer

    Sr. Analytics Engineer

    Blue YonderHyderabad, Telangana, India
    We are seeking an experienced Senior Analytics Engineer to join our data team and drive the design, implementation, and maintenance of our data architecture and semantic layers.This role combines d...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Solutions Engineer AI

    Solutions Engineer AI

    Anicalls (Pty) LtdHyderabad, Telangana, India
    Installation and configuration of full-stack complex technical environments, including hardware (server, storage, network), OS, and Kubernetes platform layers. Technical design and architect for com...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Senior Lead, AI Engineer

    Senior Lead, AI Engineer

    KyndrylHyderabad, Telangana, India
    At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Lead Data / AI Engineering

    Lead Data / AI Engineering

    AT&THyderabad, Telangana, India
    The Chief Data Office (CDO) at AT&T is responsible for leveraging data as a strategic asset to drive business value.The team focuses on data governance, data engineering, artificial intelligence, a...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    EY - GDS Consulting - AI and DATA - Hadoop - Senior

    EY - GDS Consulting - AI and DATA - Hadoop - Senior

    EYHyderabad, Telangana, India
    We are looking for a Senior Data Engineer for Senior technology Consultant role with 6+ years of hands-on experience in developing and maintaining large-scale data processing systems.Candidate will...Show moreLast updated: 15 hours ago
    • Promoted
    • New!
    Sr. Data Engineer, SIP

    Sr. Data Engineer, SIP

    OppenheimerFunds Distributor, IncHyderabad, Telangana, India
    The SIP (Strategy Innovation & Planning) team is focused on building AI solutions and progressing innovation across our firm. Currently we are working on building and maintaining GenAI based interna...Show moreLast updated: 15 hours ago