inferrs
A conservative-memory inference engine for LLMs
winget install --id ericcurtin.inferrs --exact --source winget Latest 0.0.20260403204549
Details
- Homepage
- https://github.com/ericcurtin/inferrs
- License
- Apache-2.0
A conservative-memory inference engine for LLMs
winget install --id ericcurtin.inferrs --exact --source winget