Looking for data problems actually worth solving
Most data engineering roles are pipeline maintenance in disguise. You inherit someone else's spaghetti, patch it quietly, and call it a day. At Ideas2IT, you'll build data infrastructure that actually powers things: AI platforms, large-scale cloud-native applications, products that have gone on to become independently funded startups.
What you'll actually do as a Data Engineer with us:
- Design and build robust data pipelines and architectures on AWS or Azure
- Develop and optimize ETL processes that handle large-scale structured and unstructured data from multiple sources
- Work with distributed processing tools like PySpark and Pandas to move and transform data at scale
- Use cloud services hands-on: Glue, Lakeformation, EMR for AWS Datafactory, Synapse, Datalake, Fabric on Azure
- Model and warehouse data that feeds BI tools and supports real analytical decisions
- Write clean Python or Scala to automate, integrate, and build
- Collaborate with analytics and business teams to translate data needs into infrastructure that works
- Contribute to tech stack decisions: your opinion on architecture matters here, not just your execution.
Must-haves:
- Strong SQL and hands-on experience with relational databases: MySQL, PostgreSQL, or SQL Server
- Strong hands-on experience with Cloud data warehouses: AWS Redshift, Snowflake, Azure Synapse Analytics- Experience in at least one cloud environment: AWS or Azure
- Proven experience building large-scale data pipelines and ETL processes
- Proficiency with distributed data processing: PySpark, Pandas, Polars
- Fluency in Python and/or Scala
- Experience with cloud data services (Glue, Lakeformation, EMR for AWS Datafactory, Synapse, Datalake, Fabric on Azure)
- Ability to handle messy, large-scale data from internal and third-party sources and make it usable
Nice-to-haves:
-Experience with data visualization tools: Power BI or Tableau
-Familiarity with orchestration and workflow management tools
-Familiarity with Data quality, testing and observability tools
-Familiarity with Docker and Kubernetes
Why Ideas2IT – and why now
We operate at the intersection of a product studio and a services firm. That means your work spans industries, scales, and problem types, and not the same pipeline in a slightly different color for three years running. We've built data infrastructure for companies like Meta, Bloomberg, and Medtronic. We've also launched six of our own products through IdeaLabs, several of which have become independently funded startups: Element5 (a $50M health-tech platform), LegacyLeap, IdeaRx, PipeCandy, and more.
The shift to AI-native development is changing what great data engineering looks like. The engineers who thrive next aren't just pipeline builders; they're the ones who understand what AI systems need from data, and build infrastructure that delivers it. You'll develop that fluency here, on real products, not in a sandbox.
What that looks like day-to-day:
-Autonomy to contribute to architecture and tech stack choices, not just implement them
-Access to technical PoCs if there's a technology you want to explore
-Internal Shark Tanks and Hackathons if you want to take an idea further
-A culture that prioritises capability over tenure
The hiring process – we mean business & move fast.
-Send us something real: your resume, GitHub, a short note. We're not fussy.
-Do a real-world challenge: a task relevant to the work, not a whiteboard puzzle.
-Talk to the people you'd work with: no HR screening theatre.
-Get a fast answer: yes or no, with a reason either way.
Ideas2IT is an equal opportunity employer. We hire for craft, curiosity, and drive – period.
Learn more at https://www.ideas2it.com/careers
Data Engineer • Chennai, India
This role requires strong technical ownership, solution leadership, and the ability to guide teams in delivering high-quality, analytics-ready data solutions in a client-facing environment.Technica... Show more
Objectways Technologies is looking for an experienced Data Engineer to join our Enterprise Data & AI Platform team.You'll design and build scalable data pipelines on GCP, working on data migration,... Show more
We are looking for a highly experienced Lead Data Engineer with 10+ years of experience in building scalable data platforms and modern data solutions.The ideal candidate will have strong expertise ... Show more
Python, FastAPI, and Azure‑based data platforms.Build and maintain cloud‑native data pipelines on.Develop ETL/ELT workflows using.Python, Azure Data Factory (ADF), Databricks (PySpark).GenAI, ML tr... Show more
Analytics and Modelor Project Role Description :.Analyze and model client, market and key performance data.Use analytical tools and techniques to develop business insights and improve decision-maki... Show more
Data Engineer – Google Cloud Platform (GCP) with SQL.The ideal candidate will be proficient in SQL, GCP services (especially BigQuery, Cloud Storage, Dataflow, and Cloud SQL), and will partner with... Show more
Project Management experience is a big plus.Proven track record of implementing data-driven solutions in areas such as plant automation, operational analytics, quality control, supply chain optimiz... Show more
The ideal candidate will combine strong technical skills with leadership experience, ensuring that agile squads deliver scalable, reliable, and value-driven data products aligned with business goal... Show more
The company fosters innovation, collaboration, and continuous learning, enabling teams to work on cutting-edge data platforms and enterprise-scale systems.We are seeking a highly skilled.Data Engin... Show more
We are looking for a highly skilled and motivated Data Engineer with strong expertise in AWS data services to join our data platform team.The ideal candidate will have hands-on experience designing... Show more
Data Engineer - Palantir Foundry, Workshop, AI Analytics, Pyspark & Typescript.Fully Remote - Long Term (initially 6-9 months) full time contract.We have an immediate requirement for an experienced... Show more
The ideal candidate will have experience working in modern data platforms and analytics engineering environments, enabling a quick ramp-up into the role.Design, build, and maintain scalable and rel... Show more
Notice Period: Immediate Joiner (or within 15 days).Shift: Includes Night Shifts (US Shift).Preferred Candidates: From Chennai only.Data Pipeline Optimization & Tuning.Hadoop Infra / Cloud Platform... Show more
Design, develop, and maintain scalable data pipelines using.Work with large datasets to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.Build automa... Show more
Are you passionate about building scalable data pipelines and enabling AI-driven decision-making across the enterprise? Join.Data Engineer Microsoft Fabric.AI-ready data availability for analytic... Show more
Deploy and validate ADF pipelines Databricks notebooks Key Vault configurations Logic Apps Azure Synapse using Azure Devops CICD Pipelines and SQL scripts via SSMS.Build maintain and enhance CICD p... Show more
Data Engineer- Palantir Foundry.United Arab Emirates, which is one of the largest companies in the region.This position is a contract role with an initial duration of.We are looking for a passionat... Show more
We are looking for a hands-on, senior Databricks Architect to design, build, and govern our Lakehouse data platform from the ground up.You will own the end-to-end architecture of our data infrastru... Show more
Looking for data problems actually worth solving? Most data engineering roles are pipeline maintenance in disguise.You inherit someone else's spaghetti, patch it quietly, and call it a day.At Ideas... Show more
Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de... Show more
