Talent.com
This job offer is not available in your country.
Specialist Data / AI Engineering

Specialist Data / AI Engineering

AT&THyderabad, Telangana, India
6 hours ago
Job description

Job Description

Key Responsibilities :

Data Engineering & Architecture :

  • Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.
  • Build and manage scalable data ingestion frameworks for batch and real-time data processing.
  • Implement and optimize data lake architecture in Azure Data Lake to support analytics and reporting workloads.
  • Develop and optimize data models and queries in Azure Synapse Analytics to power BI and analytics use cases.

Cloud-Based Data Solutions :

  • Architect and implement modern data lakehouses combining the best of data lakes and data warehouses.
  • Leverage Azure services like Data Factory, Event Hub, and Blob Storage for end-to-end data workflows.
  • Ensure security, compliance, and governance of data through Azure Role-Based Access Control (RBAC) and Data Lake ACLs.
  • ETL / ELT Development :

  • Develop robust ETL / ELT pipelines using Azure Data Factory, Data Bricks notebooks, and PySpark.
  • Perform data transformations, cleansing, and validation to prepare datasets for analysis.
  • Manage and monitor job orchestration, ensuring pipelines run efficiently and reliably.
  • Performance Optimization :

  • Optimize Spark jobs and SQL queries for large-scale data processing.
  • Implement partitioning, caching, and indexing strategies to improve performance and scalability of big data workloads.
  • Conduct capacity planning and recommend infrastructure optimizations for cost-effectiveness.
  • Collaboration & Stakeholder Management :

  • Work closely with business analysts, data scientists, and product teams to understand data requirements and deliver solutions.
  • Participate in cross-functional design sessions to translate business needs into technical specifications.
  • Provide thought leadership on best practices in data engineering and cloud computing.
  • Documentation & Knowledge Sharing :

  • Create detailed documentation for data workflows, pipelines, and architectural decisions.
  • Mentor junior team members and promote a culture of learning and innovation.
  • Required Qualifications :

  • Experience : 7+ years of experience in data engineering, big data, or cloud-based data solutions.Proven expertise with Azure Data Bricks, Azure Data Lake, and Azure Synapse Analytics.
  • Technical Skills : Strong hands-on experience with Apache Spark and distributed data processing frameworks.Advanced proficiency in Python and SQL for data manipulation and pipeline development.Deep understanding of data modeling for OLAP, OLTP, and dimensional data models.Experience with ETL / ELT tools like Azure Data Factory or Informatica.Familiarity with Azure DevOps for CI / CD pipelines and version control.
  • Big Data Ecosystem : Familiarity with Delta Lake for managing big data in Azure.Experience with streaming data frameworks like Kafka, Event Hub, or Spark Streaming.
  • Cloud Expertise : Strong understanding of Azure cloud architecture, including storage, compute, and networking.Knowledge of Azure security best practices, such as encryption and key management.
  • Preferred Skills (Nice to Have) :

  • Experience with machine learning pipelines and frameworks like MLFlow or Azure Machine Learning.
  • Knowledge of data visualization tools such as Power BI for creating dashboards and reports.
  • Familiarity with Terraform or ARM templates for infrastructure as code (IaC).
  • Exposure to NoSQL databases like Cosmos DB or MongoDB.
  • Experience with data governance to

    Weekly Hours : 40

    Time Type : Regular

    Location :

    Hyderabad, Andhra Pradesh, India

    It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and / or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.

    Create a job alert for this search

    Engineering Specialist • Hyderabad, Telangana, India

    Related jobs
    • Promoted
    • New!
    Senior AI Manager (GenAI)

    Senior AI Manager (GenAI)

    Procter & GambleHyderabad, Telangana, India
    As a Senior AI Engineer, you will collaborate with data scientists, product managers, and infrastructure engineers to design and scale algorithmic products, including Generative AI models and Agent...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    AI Operations Engineers

    AI Operations Engineers

    GSPANNHyderabad, Telangana, India
    Description GSPANN is hiring AI Operations Engineers to build monitoring solutions, automate workflows, and apply AIOps practices for reliable, high-performing systems. Expertise in AppDynamics, Sum...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Architect-D&Ai Data Operations

    Architect-D&Ai Data Operations

    PepsiCoHyderabad, Telangana, India
    Seeking an Associate Manager, Data Operations, to support our growing data organization.In this role, you will assist in maintaining data pipelines and corresponding platforms (on-prem and cloud) w...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Principal Applied AI Engineer

    Principal Applied AI Engineer

    MicrosoftHyderabad, Telangana, India
    Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a saf...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Sr Specialist Data / AI Engineering

    Sr Specialist Data / AI Engineering

    AT&THyderabad, Telangana, India
    Data Engineering & Architecture : .Design, develop, and maintain high-performance data pipelines for structured and unstructured data using Azure Data Bricks and Apache Spark.Build and manage scalabl...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Azure Data & AI Architect

    Azure Data & AI Architect

    Coretek ServicesKondapur, Telangana, India
    Coretek Services, a premier consulting and managed solutions provider, is looking for a highly skilled Azure Data & AI architect to join our exciting team. Our success stems from our Core Values of ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead AI Engineer

    Lead AI Engineer

    Weekday AIHyderabad, Telangana, India
    This role is for Weekday's client.Additionally, you will play a key role in managing the AI engineering team, fostering innovation, and ensuring successful execution of AI-driven projects.Lead the ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Data & AI Solution Architect

    Senior Data & AI Solution Architect

    GE Appliances, a Haier companyHyderabad, Telangana, India
    At GE Appliances, a Haier company, we come together to make “good things, for life.As the fastest-growing appliance company in the U. We believe in the power of our people and in giving them the fre...Show moreLast updated: 6 hours ago
    • Promoted
    Lead / Architect Data and AI Platform

    Lead / Architect Data and AI Platform

    AkkodisHyderabad, IN
    Deep experience building on-premises or hybrid data systems (e.Spark, Kafka, Trino, Iceberg, Airflow).Strong understanding of LLM architecture, embeddings, vector search, and agentic workflows.Prov...Show moreLast updated: 22 days ago
    • Promoted
    Data Specialist

    Data Specialist

    Shift Ahead Technologies Pvt. Ltd.Hyderabad, IN
    Shift Ahead is seeking an Independent.AI systems— —that can discuss on client calls, understand needs and plan, reason, learn, and act independently or collaboratively across dynamic real-world or ...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Solutions Engineer AI

    Solutions Engineer AI

    Anicalls (Pty) LtdHyderabad, Telangana, India
    Installation and configuration of full-stack complex technical environments, including hardware (server, storage, network), OS, and Kubernetes platform layers. Technical design and architect for com...Show moreLast updated: 6 hours ago
    • Promoted
    Learning Support Specialist (AI, ML, Data Science, Data Engineering)

    Learning Support Specialist (AI, ML, Data Science, Data Engineering)

    EmeritusHyderabad, IN
    Emeritus is committed to teaching the skills of the future by making high-quality education accessible and affordable to individuals, companies, and governments around the world.It does this by col...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Principal AI Engineer – Generalized Agents and Incubations

    Principal AI Engineer – Generalized Agents and Incubations

    MicrosoftHyderabad, Telangana, India
    Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a saf...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Senior Lead, AI Engineer

    Senior Lead, AI Engineer

    KyndrylHyderabad, Telangana, India
    At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Lead Data / AI Engineering

    Lead Data / AI Engineering

    AT&THyderabad, Telangana, India
    The Chief Data Office (CDO) at AT&T is responsible for leveraging data as a strategic asset to drive business value.The team focuses on data governance, data engineering, artificial intelligence, a...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Architect - D&Ai Data Operations

    Architect - D&Ai Data Operations

    PepsiCoHyderabad, Telangana, India
    Seeking an Associate Manager, Data Operations, to support our growing data organization.In this role, you will assist in maintaining data pipelines and corresponding platforms (on-prem and cloud) w...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    EY - GDS Consulting - AI and DATA - Hadoop - Senior

    EY - GDS Consulting - AI and DATA - Hadoop - Senior

    EYHyderabad, Telangana, India
    We are looking for a Senior Data Engineer for Senior technology Consultant role with 6+ years of hands-on experience in developing and maintaining large-scale data processing systems.Candidate will...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Team Lead / Senior Specialist - Generative AI and LLM

    Team Lead / Senior Specialist - Generative AI and LLM

    BuzzBoardHyderabad, Telangana, India
    Team Lead / Senior Specialist - Generative AI and LLM Job Description : Join our pioneering team at BuzzBoard , a recognized first-mover in enterprise generative AI, as a Team Lead of Generative AI an...Show moreLast updated: 6 hours ago