Talent.com
This job offer is not available in your country.
Sr Specialist Data / AI Engineering

Sr Specialist Data / AI Engineering

AT&Thyderabad, India
4 hours ago
Job description

Job Description

Key Responsibilities :

Data Engineering & Architecture :

  • Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.
  • Build and manage scalable data ingestion frameworks for batch and real-time data processing.
  • Implement and optimize data lake architecture in Azure Data Lake to support analytics and reporting workloads.
  • Develop and optimize data models and queries in Azure Synapse Analytics to power BI and analytics use cases.

Cloud-Based Data Solutions :

  • Architect and implement modern data lakehouses combining the best of data lakes and data warehouses.
  • Leverage Azure services like Data Factory, Event Hub, and Blob Storage for end-to-end data workflows.
  • Ensure security, compliance, and governance of data through Azure Role-Based Access Control (RBAC) and Data Lake ACLs.
  • ETL / ELT Development :

  • Develop robust ETL / ELT pipelines using Azure Data Factory, Data Bricks notebooks, and PySpark.
  • Perform data transformations, cleansing, and validation to prepare datasets for analysis.
  • Manage and monitor job orchestration, ensuring pipelines run efficiently and reliably.
  • Performance Optimization :

  • Optimize Spark jobs and SQL queries for large-scale data processing.
  • Implement partitioning, caching, and indexing strategies to improve performance and scalability of big data workloads.
  • Conduct capacity planning and recommend infrastructure optimizations for cost-effectiveness.
  • Collaboration & Stakeholder Management :

  • Work closely with business analysts, data scientists, and product teams to understand data requirements and deliver solutions.
  • Participate in cross-functional design sessions to translate business needs into technical specifications.
  • Provide thought leadership on best practices in data engineering and cloud computing.
  • Documentation & Knowledge Sharing :

  • Create detailed documentation for data workflows, pipelines, and architectural decisions.
  • Mentor junior team members and promote a culture of learning and innovation.
  • Required Qualifications :

  • Experience : 7+ years of experience in data engineering, big data, or cloud-based data solutions.Proven expertise with Azure Data Bricks, Azure Data Lake, and Azure Synapse Analytics.
  • Technical Skills : Strong hands-on experience with Apache Spark and distributed data processing frameworks.Advanced proficiency in Python and SQL for data manipulation and pipeline development.Deep understanding of data modeling for OLAP, OLTP, and dimensional data models.Experience with ETL / ELT tools like Azure Data Factory or Informatica.Familiarity with Azure DevOps for CI / CD pipelines and version control.
  • Big Data Ecosystem : Familiarity with Delta Lake for managing big data in Azure.Experience with streaming data frameworks like Kafka, Event Hub, or Spark Streaming.
  • Cloud Expertise : Strong understanding of Azure cloud architecture, including storage, compute, and networking.Knowledge of Azure security best practices, such as encryption and key management.
  • Preferred Skills (Nice to Have) :

  • Experience with machine learning pipelines and frameworks like MLFlow or Azure Machine Learning.
  • Knowledge of data visualization tools such as Power BI for creating dashboards and reports.
  • Familiarity with Terraform or ARM templates for infrastructure as code (IaC).
  • Exposure to NoSQL databases like Cosmos DB or MongoDB.
  • Weekly Hours : 40

    Time Type : Regular

    Location :

    Hyderabad, Andhra Pradesh, India

    It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and / or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.

    Create a job alert for this search

    Engineering Specialist • hyderabad, India

    Related jobs
    • Promoted
    Sr. Full Stack AI Engineer

    Sr. Full Stack AI Engineer

    ContexQHyderabad, IN
    Senior Full Stack Engineer – Enterprise Analytics Platform.Remote (Preference for India-based candidates).Competitive salary + significant equity package. At ContexQ, a Singapore based B2B SaaS AI S...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AI Senior Data Engineer

    AI Senior Data Engineer

    Thomson Reutersmadhapur, India
    We are looking for an AI Senior Data Engineer to design and develop our data transformation initiatives as we build the data foundation to drive our marketing strategy to enhance our internal and e...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Lead Data / AI Engineering

    Lead Data / AI Engineering

    AT&Thyderabad, India
    The Chief Data Office (CDO) at AT&T is responsible for leveraging data as a strategic asset to drive business value.The team focuses on data governance, data engineering, artificial intelligence, a...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr Data Analytics Engineer – ATCQE

    Sr Data Analytics Engineer – ATCQE

    Micronhyderabad, India
    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr Associate Big Data Engineering

    Sr Associate Big Data Engineering

    AT&Thyderabad, India
    Data Engineering & Architecture : .Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.Build and manage scalabl...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    EY - GDS Consulting - AI and DATA - Hadoop - Senior

    EY - GDS Consulting - AI and DATA - Hadoop - Senior

    EYhyderabad, India
    We are looking for a Senior Data Engineer for Senior technology Consultant role with 6+ years of hands-on experience in developing and maintaining large-scale data processing systems.Candidate will...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    EY - GDS Consulting - AI and DATA -Gen AI - Senior

    EY - GDS Consulting - AI and DATA -Gen AI - Senior

    EYhyderabad, India
    At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your u...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr. Analyst I, Enterprise Platforms

    Sr. Analyst I, Enterprise Platforms

    OppenheimerFunds Distributor, Inchyderabad, India
    As Enterprise Platforms continues to expand and take on new platforms, the demand for developing new features and providing ongoing support has significantly increased. This growing demand necessita...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr. Systems Engineer (Big Data)

    Sr. Systems Engineer (Big Data)

    Anicalls (Pty) Ltdhyderabad, India
    The person hired will provide administration and platform support to our Development teams as new Cloud applications are deployed. The person would ensure Code and access to data is optimized, minim...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Senior AI Manager (GenAI)

    Senior AI Manager (GenAI)

    Procter & Gamblehyderabad, India
    As a Senior AI Engineer, you will collaborate with data scientists, product managers, and infrastructure engineers to design and scale algorithmic products, including Generative AI models and Agent...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    EY - GDS Consulting - AI And DATA - Gen AI - Senior

    EY - GDS Consulting - AI And DATA - Gen AI - Senior

    WomenTech Networkhyderabad, India
    At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your u...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr. Software Engineer, Search and AI

    Sr. Software Engineer, Search and AI

    Highspothyderabad, India
    Develop highly-available distributed services, including improving existing systems.Experiment with different techniques to improve search quality, relevance and experiences.Help design and develop...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Lead AI Engineer

    Lead AI Engineer

    Weekday AIhyderabad, India
    This role is for Weekday's client.Additionally, you will play a key role in managing the AI engineering team, fostering innovation, and ensuring successful execution of AI-driven projects.Lead the ...Show moreLast updated: 4 hours ago
    • Promoted
    Sr Engineer, Data [T500-20445]

    Sr Engineer, Data [T500-20445]

    ANSRhyderabad, telangana, in
    ANSR is hiring for one of its clients.NASDAQ : TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flags...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Sr. Data Science Engineer, SMAI

    Sr. Data Science Engineer, SMAI

    Micronhyderabad, India
    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr. Data Scientist Engineer

    Sr. Data Scientist Engineer

    Crunchyrollhyderabad, India
    Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community.We super-serve over 100 million anime and manga fans across 200+ countries and territories, and help the...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr. Data Engineer

    Sr. Data Engineer

    UWorld, LLChyderabad, India
    UWorld is a worldwide leader in online test prep for college entrance, undergraduate, graduate, and professional licensing exams throughout the United States. Since 2003, over 2 million students hav...Show moreLast updated: 4 hours ago
    • Promoted
    • New!
    Sr. Analytics Engineer

    Sr. Analytics Engineer

    Blue Yonderhyderabad, India
    We are seeking an experienced Senior Analytics Engineer to join our data team and drive the design, implementation, and maintenance of our data architecture and semantic layers.This role combines d...Show moreLast updated: 4 hours ago