Talent.com
This job offer is not available in your country.
Data Engineer - Data Pipeline

Data Engineer - Data Pipeline

Creeno Solutions Pvt ltdBangalore
18 days ago
Job description

Job Description :

We are looking for a highly skilled Data Engineer with a strong background in designing, building, and maintaining scalable data pipelines and business intelligence solutions. The ideal candidate should have a solid mix of hands-on experience in Azure cloud services, SQL development, data integration, and reporting tools to support data-driven decision-making across the organization.

Key Responsibilities :

  • Design, develop, and manage end-to-end data pipelines using Azure Data Factory (ADF) for efficient ETL / ELT processes.
  • Develop, deploy, and monitor scalable data solutions using Azure Synapse Analytics or Databricks to support large-scale data processing and analytics.
  • Write optimized SQL Server scripts, stored procedures, and views to support data transformation and integration requirements.
  • Build and maintain insightful dashboards and reports using Power BI, with a focus on usability, performance, and clear data communication.
  • Develop automation scripts using PowerShell for operational and monitoring tasks across Azure services.
  • Create automated workflows using Power Automate to streamline manual tasks and notifications.
  • Leverage Python or PySpark for data manipulation, transformation, and orchestration within Synapse or Databricks environments.
  • Collaborate with business stakeholders, data analysts, and application developers to gather requirements and deliver high-quality solutions.
  • Perform root cause analysis, data validation, and ensure data integrity across systems and processes.
  • Participate in code reviews, design discussions, and documentation efforts to ensure best practices and knowledge sharing.
  • Ensure security, compliance, and governance in all data engineering activities.

Required Skills and Qualifications :

  • 6 - 8 years of experience in data engineering, data analytics, or business intelligence roles.
  • Strong proficiency in Azure Data Factory, SQL Server, and Power BI.
  • 2+ years of hands-on experience with Azure Synapse Analytics or Databricks and Python for data transformation and analysis.
  • Experience with PowerShell scripting for automation and Power Automate for workflow integration.
  • Strong understanding of data warehousing concepts, data modelling, and performance tuning.
  • Excellent analytical and problem-solving abilities.
  • Strong communication skills and ability to effectively engage with both technical and non-technical stakeholders.
  • Preferred Qualifications (Nice to Have) :

  • Experience with Azure Data Lake Storage (ADLS) and Delta Lake.
  • Knowledge of DevOps, CI / CD pipelines, and version control systems (e.g., Git).
  • Familiarity with data governance, security best practices, and compliance standards (e.g., GDPR, HIPAA).
  • Exposure to Agile methodologies and working in cross-functional teams.
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Pipeline Engineer • Bangalore