# Open-source 'Strata' for running 125 billion parameter AI models locally on gaming PCs

- Link: https://github.com/Niko1221/Strata
- Discussion: https://startupxo.com/en/747/
- Posted by startupxo at 2026-10-02T06:47:23.992Z
- 0 points, 0 comments, kind story, origin curated
- Written in ko, machine translated to en

## Summary

- Strata is a free open-source project that enables large AI models with 125 billion parameters (Qwen3.8-Flash-Next) to run on typical gaming PCs running Windows or Linux with NVIDIA or AMD graphics cards of at least 12GB.
- It requires at least 32GB RAM and about 80GB of storage space. During installation, it automatically detects the graphics card and recommends an appropriate model size and settings, supporting download and execution.
- This model overcomes memory limits by utilizing GPU, RAM, CPU, and SSD in a distributed manner, reads long texts at over 1,000 tokens per second, and generates answers at speeds ranging from 53 to 93 tokens per second depending on GPU performance (benchmarks measured by the development team on two gaming PCs).
- Compatible with OpenAI APIs for integration with other apps and coding agents, and since it runs locally, data is not transmitted to external clouds.

## Sources

- Hacker News: https://news.ycombinator.com/item?id=49953495 (216 points, 100 comments, checked 2026-10-04T15:48:51Z)
- GitHub: https://github.com/Niko1221/Strata (16916 points, checked 2026-10-07T20:31:27Z)

## Comments (0)

No comments yet.

JSON: https://startupxo.com/api/v1/item.json?id=747&lang=en
