Description :
Senior Data Engineer / Data Architect
Location : [Indore / Remote / Hybrid as applicable]
Experience : 4+ years
Looking for Immediate Joiner / 15 days notice period.
About the Role :
We are looking for an experienced Data Engineer / Data Architect to take complete ownership of our data architecture strategy and implementation. You will design, optimize, and streamline our data pipelines, ensuring efficient processing, integration, and reporting across multiple sources and systems.
This role requires a problem-solver who can navigate complex, fractured datasets and implement a scalable, cost-effective, and well-documented data ecosystem.
Key Responsibilities :
- Lead the design, development, and optimization of end-to-end data pipelines.
- Work with Redshift, PostgreSQL, DynamoDB, and DocumentDB to manage and integrate data from multiple sources.
- Streamline data cleaning, transformation, and ingestion processes for improved efficiency.
- Analyze and optimize Redshift performance and costs, reducing unnecessary query loads and improving query efficiency.
- Redesign and maintain data schemas and models, ensuring clear lineage, consistency, and scalability.
- Automate data modelling and transformation pipelines using tools such as AWS Glue, Apache Spark, AWS Lambda, and Step Functions.
- Support GoodData reporting and analytics by providing optimized and reliable data structures.
- Implement a standardized approach for data governance, documentation, and schema updates.
- Collaborate with business and analytics teams to understand reporting requirements and deliver actionable insights.
- Handle ad-hoc queries and reporting needs, ensuring timely and accurate information delivery.
Required Skills & Experience :
Strong experience with Redshift / PostgreSQL, DynamoDB, and DocumentDB.Proficiency in Big Data processing frameworks such as AWS Glue or Apache Spark.Solid understanding of ETL pipeline design, automation, and optimization.Experience in data modelling, schema design, and performance tuning.Familiarity with AWS services such as Lambda, Step Functions, and S3.Understanding of data insight and BI platforms (e.g., GoodData, Power BI, Tableau, etc.).Strong problem-solving and analytical skills to work with fractured or inconsistent datasets.Excellent communication and documentation abilities to explain data flows, lineage, and dependencies.(ref : hirist.tech)