Name: llama-swap
Author: mostlygeek

llama-swap

mostlygeek · mostlygeek.llama-swap

Model swapping for llama.cpp

llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.

winget install --id mostlygeek.llama-swap --exact --source winget

Latest 199

Release Notes

Changelog

8fabc75 docker/unified: vulkan build fixes (#600)
e5e7391 .github,docker/unified: include vulkan build (#599)
2c282dc .github,docker/unified: improve caching and fix bugs (#598)
916d13f .github/workflows,docker/unified: add cuda based unified container (#597)
a3725e7 Update go.mod to 1.26.1 (#593)
15bd55d proxy, ui-svelte: add /sdapi/v1 endpoint support (#587)

Installer type: `zip`

Architecture	Scope	Download	SHA256
`x64`	—	Download	`B2A3E72D30AC1EA43E33F6274758052C7A694FBEFD7AF934EF85A86187536A6A`

Details

Homepage: https://github.com/mostlygeek/llama-swap
License: MIT
Publisher: mostlygeek
Support: https://github.com/mostlygeek/llama-swap/issues
Copyright: Copyright (c) 2024 Benson Wong
Moniker: llama-swap

Older versions (33)

198

Architecture	Scope	Download	SHA256
`x64`	—	Download	`0F03C15DA9BC884F16FC4018B67ED04E0878AA0657F73E6F8A8EF9C0E19900FE`

197

Architecture	Scope	Download	SHA256
`x64`	—	Download	`DD4FCD0CAC02FF3F43846E7007DCB3865C7C53A6F31A469FB1E75C535E405497`

196

Architecture	Scope	Download	SHA256
`x64`	—	Download	`A6B7D0251B73EB48EB30A7A7CA62FBAA1EF3B0EA3A180CD096C7AF325171426A`

195

Architecture	Scope	Download	SHA256
`x64`	—	Download	`476A861AF9FE5277C652BFA2B9B01C50AC6C17AF806933E6618EC51BD402DFF6`

194

Architecture	Scope	Download	SHA256
`x64`	—	Download	`289FEA12C02C1BB3DDF5296C4B981A2068508F9D637C9134468C9EFC7212CF23`

193

Architecture	Scope	Download	SHA256
`x64`	—	Download	`11B14F3F69FE1147033C047382D221ED19F98DE7DD9071C479CF8FBB5D0CBD95`

192

Architecture	Scope	Download	SHA256
`x64`	—	Download	`468F69A2483B3B0743D73F24EC5F058DB5AADCBC6D0408DCA236478E1ABF8C41`

190

Architecture	Scope	Download	SHA256
`x64`	—	Download	`58D9F9AB8717F9946916F9649B3240ED8742CB69A8569AB5BE25B43095697D12`

189

Architecture	Scope	Download	SHA256
`x64`	—	Download	`CCD9901D701B3E8DF4A67A27F9686CBDD59DA486623351B96BD07F2E48DBB682`

188

Architecture	Scope	Download	SHA256
`x64`	—	Download	`12E287CAA7E3D33E0305262D7F7E248FA965CF52F74ED9387C74FFBE32291F92`

187

Architecture	Scope	Download	SHA256
`x64`	—	Download	`15697E3AF6678B10C5E6636B732EBD4217DEE5022FB368BBCFBDFE4C6849D9EA`

186

Architecture	Scope	Download	SHA256
`x64`	—	Download	`CCC8B46094339FB2D626855054EF4ECBF8F1E7BEAAA82CDFEA237BB2B6CCFBB3`

185

Architecture	Scope	Download	SHA256
`x64`	—	Download	`0F44349C7FA6E9C304316B74E533622BD98086B6D4E01A4933481B564941FFD3`

183

Architecture	Scope	Download	SHA256
`x64`	—	Download	`3A26B732EB4B45509A6183A0FC196215031080A06BDDCC1F81E7F53BC05BBC2F`

182

Architecture	Scope	Download	SHA256
`x64`	—	Download	`2AFBA1F6BB31F89EFFB33F54D70669642867058173247FE36421C5A7F02806CD`

180

Architecture	Scope	Download	SHA256
`x64`	—	Download	`2DC1B006B50D0119A0C2241630882BF3D61413DE2DEBA995C9888CA48C7DF523`

179

Architecture	Scope	Download	SHA256
`x64`	—	Download	`CA2D23B54D50CFA4C4591220A6A47AD3EDAFFCCFB571D956885D217E97EAF5EE`

178

Architecture	Scope	Download	SHA256
`x64`	—	Download	`1E28288B3E795F398B874199895DA8C82563E2FC616EC6C6DA71B672E73719C9`

176

Architecture	Scope	Download	SHA256
`x64`	—	Download	`C5DDC0BF22BBE897D616332ADD1A048CC049FA53E973ABD361E3CC61839E5E2C`

174

Architecture	Scope	Download	SHA256
`x64`	—	Download	`9768DB1FC199DA9AA586B6AE1BD64DBAD2E5BAB9930EEDF76950FE5CA76D802A`

173

Architecture	Scope	Download	SHA256
`x64`	—	Download	`FB10D39867A35B9FD9BA0205F929386AF403BBEA6C5532AFC74BA236E6E9A6F3`

172

Architecture	Scope	Download	SHA256
`x64`	—	Download	`A3609077487E5EF3734D6C614CBEA08A7BE0F2E240788FB228BB6E8873C5D9BC`

171

Architecture	Scope	Download	SHA256
`x64`	—	Download	`3B612BC6C660E0B64FC518B809D40C0582700CEF2D77FB7A41133657BFEA2D24`

170

Architecture	Scope	Download	SHA256
`x64`	—	Download	`E4AE895B97974D5A5EE35FBCC6A80729F932BB38DD426151D4C28059711E016E`

169

Architecture	Scope	Download	SHA256
`x64`	—	Download	`E62F0C5FA1822020CC744CED4604B6DA595C1890940C3DAD34E9015821455124`

168

Architecture	Scope	Download	SHA256
`x64`	—	Download	`1DAA2BAE6068F42F432BAEA93F05FBE6B43ABB9A15E6B9F663AE34D84639FF25`

167

Architecture	Scope	Download	SHA256
`x64`	—	Download	`3B0F8F293F6CFA504E55B43C6145BC6308E4E8A9D7AABB73F0AF3F3B3C11C653`

166

Architecture	Scope	Download	SHA256
`x64`	—	Download	`D0B78CD88FADB861ACFBBC657E839686AC6B1F41E332FE976624A60DC6A74A74`

165

Architecture	Scope	Download	SHA256
`x64`	—	Download	`9C0CF6DCA6078D0803DB9BD22315622815089625AEE01215EA2D18D183F8B434`

164

Architecture	Scope	Download	SHA256
`x64`	—	Download	`58CD7E434ADD2ED92C768D6EC5F9F48F9C584AAF11EC4000F3F344B036D34FCF`

163

Architecture	Scope	Download	SHA256
`x64`	—	Download	`301960412CEBD23DA5AF4CA3073D78169D0A972FCF78A6D1863FD9FF4866BD03`

162

Architecture	Scope	Download	SHA256
`x64`	—	Download	`50F434B2EDDCAF44E0EF3D3E68C8FFB82E9E2A5DB577867711B70B6D80F57E6C`

161

Architecture	Scope	Download	SHA256
`x64`	—	Download	`88A576AB378EC693EDFADCB645CA1889E9D272E028A2DE4C4AE5148690812952`

llama-swap

Latest 199

Installer type: zip

Details

Tags

Older versions (33)

Installer type: `zip`