Introduction
Ziroh Labs, the homegrown AI startup, has developed a new computing platform that claims to reduce reliance on costly and scarce GPUs for running large AI models. The system, called Kompact AI, has been built in collaboration with the Indian Institute of Technology (IIT) Madras and is intended to allow advanced artificial intelligence (AI) systems to operate on CPUs found in standard computers. GetMyIndia.com
Kompact AI: Making Advanced AI Work Without Expensive Chips
Kompact AI is a new platform built to run large AI models on everyday CPU-based machines. Developed by Ziroh Labs with support from IIT Madras, the system can handle complex models like Meta’s Llama 2, Alibaba’s Qwen2.5, and DeepSeek without the need for costly GPUs. Instead, it works efficiently on standard processors like Intel Xeon, already used in many office laptops and desktops. Kompact AI aligns with India’s “AI for All” mission, aiming to make AI more accessible, cost-effective, and scalable.
In a recent live demo, Ziroh Labs showed Kompact AI in action on a regular laptop fitted with an Intel Xeon processor. The platform successfully ran queries on high-performing AI models, proving that powerful AI is now possible without specialised hardware. To date, 17 AI models have been optimized to run through Kompact AI. These include some of the most demanding language models available today. Ziroh Labs and IIT Madras jointly carried out performance and accuracy tests to ensure reliability. It has also been tested on popular chips from both Intel and AMD, confirming that it can operate across a wide range of systems already in use.
Traditionally, models of this size required powerful GPUs, such as those offered by Nvidia, which often cost anywhere between INR 10 to INR 20 lakh. These chips are not only expensive but are also hard to source as they remain frequently out of stock due to global demand. For most startups in India, this made it difficult to work with cutting-edge AI.
Kompact AI removes this barrier. It is designed to run offline and doesn’t depend on cloud infrastructure, making it a practical solution for regions with limited or unstable internet. For a country like India, with thousands of startups and many operating in Tier II and III cities, this could be a game-changer. by cutting hardware costs and simplifying AI access, Kompact AI may open the door for more innovation and real-world adoption of AI across sectors like education, healthcare, logistics, and governance. It shows that high-performance AI can be both accessible and affordable.
Key Features of Kompact AI:
- Kompact AI enables AI model development and deployment on CPUs, removing the need for costly GPUs and reducing the infrastructure burden.
- Ziroh Labs has optimized AI models, including DeepSeek, Qwen, and Llama, for efficient execution on CPUs, delivering superior performance at lower costs.
- Kompact AI operates without constant internet connectivity, making it ideal for deployment in remote areas with limited or no access to reliable internet
A Step Towards Accessible and Inclusive AI
The Centre of AI Research, jointly established by IIT Madras and Ziroh Labs, aims to make India a global hub for accessible AI. The goal is not just to develop cutting-edge technology but also to make sure that it reaches a wider base, including startups, students, and enterprises that cannot afford costly infrastructure.
India has over 1.5 lakh startups, and a large number of them are building tech-based solutions but struggling to keep up due to infrastructure costs. With this new development, the playing field is starting to level out. It can surely support more AI-based innovation, enable research and development at universities, and create new opportunities for businesses in Tier 2 and Tier 3 cities. This initiative also strengthens India’s position in the global AI race. Instead of being dependent on costly imports and cloud subscriptions, Indian companies can build and deploy AI models locally, reducing costs and improving data privacy.
A Big Step for India’s Tech Future
This launch is indeed a big-time win for India’s technology and startup sectors. In a world where access to hardware limits who gets to innovate, Kompact AI removes the barrier.
It shows a shift in how India is deciding to solve its own AI challenges, not by running after what is trendy but by focusing on cost-effective, scalable solutions that can work well in the Indian conditions. While global companies dominate the high-end AI race, platforms like Kompact AI open the doors for grassroots AI innovation. With IIT Madras and Ziroh Labs leading the way, this could mark the beginning of a strong new phase in India’s growth story.
Conclusion
Kompact AI is a groundbreaking innovation that eliminates the need for heavy computing chips, making AI accessible even in resource-constrained environments. Developed by Ziroh Labs in collaboration with IIT Madras, it offers a lightweight, energy-efficient solution for running complex AI models on everyday devices. This opens up vast opportunities for deploying AI in industries such as healthcare, automotive, and IoT, where traditional, power-hungry systems might not be viable. By optimizing AI for low-power devices, Kompact AI reduces hardware dependency and enhances the scalability and accessibility of AI-driven technologies. As AI continues to shape the future, innovations like Kompact AI play a pivotal role in ensuring its benefits reach a broader, more diverse range of applications.
Gmicapitals.com RaysVeda.com GetMyStartup.com LawCanal.com ABHAYRAY.COM ZinCob.com
