BitLlama Desktop

imonoonoko · imonoonoko.BitLlamaDesktop

Desktop GUI for BitLlama LLM inference engine with Soul learning and model management

BitLlama Desktop is a Tauri 2.0 + Svelte desktop application for local LLM inference. Features include streaming chat, model browser with download, Soul learning (drag & drop, correction learning), TTT adaptive inference, hardware auto-detection, and i18n (EN/JP).

winget install --id imonoonoko.BitLlamaDesktop --exact --source winget

Latest 1.0.0

Release Notes

v1.0.0 — Final Release BitLlama v1.0.0. Development complete. What is BitLlama? A Pure Rust LLM inference engine with Soul learning and hierarchical memory.

  • 7 model architectures: Llama-2/3, Gemma-2/3, Qwen2.5, Mistral, BitNet
  • Soul learning: LoRA fine-tuning from conversations
  • Memory system: 4-layer hierarchical memory + 7-stage Sleep consolidation
  • Desktop GUI: Tauri 2.0 + Svelte 5, Japanese/English i18n
  • Performance: 45.4 tok/s (7B), 90% of llama.cpp
  • 1121 tests, quality score 9.0/10 Changes since v0.16.0
  • CJK memory search fix (character bigram fallback for Japanese queries)
  • Soul learning tests (warmup, chat template, VRAM guard)
  • Chat template application fix for GGUF tokenizer fallback
  • README/ROADMAP updated to reflect project completion Install

Homebrew

brew tap imonoonoko/bitllama && brew install bitllama

winget

winget install imonoonoko.BitLlama

Or download binaries below

Built with Rust by @imonoonoko Full Changelog: v0.16.0...v1.0.0

Installer type: nullsoft

Architecture Scope Download SHA256
x86 Download 7CD1B5DC5F0D94C655561B7548F5354D9BA810A571C4B5773CD2616B3ACBA54B

Details

Homepage
https://github.com/imonoonoko/Bit-TTT-Engine
License
MIT
Publisher
imonoonoko
Support
https://github.com/imonoonoko/Bit-TTT-Engine/issues

Tags

aidesktopguiinferencellmmachine-learning

Older versions (2)

0.16.0
Architecture Scope Download SHA256
x86 Download 2F431E061189905B96C07D46BA249B406FD793A31426498B8C217008ACF1714F
0.15.0
Architecture Scope Download SHA256
x64 Download 8733ADFA628214F725957229F4A3D5E600601C49E911DB4A5D851E64EE3B7BBA