Name: llama-swap
Author: mostlygeek

llama-swap

mostlygeek · mostlygeek.llama-swap

Model swapping for llama.cpp

llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.

winget install --id mostlygeek.llama-swap --exact --source winget

Latest 224

Release Notes

Changelog

0cfe5a6 Makefile,internal: fix websocket regression and other small things (#830)
44e1501 internal/process,server: fix unload regression (#828)
46cea36 proxy: remove legacy code. Thanks champ 🫡 (#822)
ccfba0d docker: fix arm64 cpu image downloading amd64 llama-swap binary (#819)
ddfae90 Change cron schedule for container builds

Installer type: `zip`

Architecture	Scope	Download	SHA256
`x64`	—	Download	`2E8AF2E7675C45456B84E1EDE0F7768755A1A77A69BFD92B3023469382E1D4FE`

Details

Homepage: https://github.com/mostlygeek/llama-swap
License: MIT
Publisher: mostlygeek
Support: https://github.com/mostlygeek/llama-swap/issues
Copyright: Copyright (c) 2024 Benson Wong
Moniker: llama-swap

Older versions (52)

223

Architecture	Scope	Download	SHA256
`x64`	—	Download	`21A6B71F8C38C912FE32FC39C8025BC877690BCE8E95B692621E2712085D2C59`

222

Architecture	Scope	Download	SHA256
`x64`	—	Download	`A75E8DA5999AB2CF899709C52A245E0AD09B78D620E891A127C2B55FAAF38307`

219

Architecture	Scope	Download	SHA256
`x64`	—	Download	`63D7A4FFA82FA0FA616F3E0C3C00493ED5603484CF638D107C39964C21F8243E`

218

Architecture	Scope	Download	SHA256
`x64`	—	Download	`3546312B41DA6CC97D03A0CD658D9A6B08FFADCFD2F5834BDAFF2D4F88419C60`

217

Architecture	Scope	Download	SHA256
`x64`	—	Download	`0A1D1D80DA9A88AE0A3540F753B40D15BE86E980D7A2CD2AF3416C0533E29691`

216

Architecture	Scope	Download	SHA256
`x64`	—	Download	`60074C02718B349B7D91A357699BEF3B7505041EDCDE7E353205C0A02A9F34B4`

214

Architecture	Scope	Download	SHA256
`x64`	—	Download	`C2205CD5E96E7E8836897A0529E1D73F5CB8609DCF72C6A01967923055384C41`

213

Architecture	Scope	Download	SHA256
`x64`	—	Download	`16619112B98BFCCAC3E5EACC5B2FD61F39018853F285BAF323E859207B1A1C7D`

211

Architecture	Scope	Download	SHA256
`x64`	—	Download	`A04E8CB46CB9BD8AAD4C07EABD1D46B61CAF89F4B89AAC543DDAED8F81113A56`

210

Architecture	Scope	Download	SHA256
`x64`	—	Download	`4F51554DE3894DDF18CE20A888DC04AB329071EF465BFF846597D5CCA10B6FC0`

209

Architecture	Scope	Download	SHA256
`x64`	—	Download	`595920C2BC8DE7F8AB57BC8E1D99B954DB1B17F86F1053A8FA044699988522D3`

208

Architecture	Scope	Download	SHA256
`x64`	—	Download	`2D45A00E4009CEAB8A1E94AD27B638C716F88029300FCAA93CCDE5AAF810435C`

207

Architecture	Scope	Download	SHA256
`x64`	—	Download	`9680A8073BE6A1F9F36F5AC23D50DBF35A6BF86C2FF2B1995553D9F0E5A01F1D`

205

Architecture	Scope	Download	SHA256
`x64`	—	Download	`03527B3376E177D40FF6E099F87FFA8C1C3A585C780A5A3F5C0912F6401CA25C`

204

Architecture	Scope	Download	SHA256
`x64`	—	Download	`F617A7D982577E9EE69C54907385600FB1DF3744336C5602F4EA7F41D0538327`

203

Architecture	Scope	Download	SHA256
`x64`	—	Download	`841D802B836EA1B1E0A2DC0873C7EA2DC2AAC01EC15A0C459CE1F1BEAB47AC32`

202

Architecture	Scope	Download	SHA256
`x64`	—	Download	`965BBD2ED1A5FC4E051A7CA8B41504F216FDAA754279B5C0C785FCB542E78E78`

201

Architecture	Scope	Download	SHA256
`x64`	—	Download	`E71ABD2A6EC93BDC8F7F8E0F950A00CE3947268E7264DF5D43EFA580AFDE99C0`

199

Architecture	Scope	Download	SHA256
`x64`	—	Download	`B2A3E72D30AC1EA43E33F6274758052C7A694FBEFD7AF934EF85A86187536A6A`

198

Architecture	Scope	Download	SHA256
`x64`	—	Download	`0F03C15DA9BC884F16FC4018B67ED04E0878AA0657F73E6F8A8EF9C0E19900FE`

197

Architecture	Scope	Download	SHA256
`x64`	—	Download	`DD4FCD0CAC02FF3F43846E7007DCB3865C7C53A6F31A469FB1E75C535E405497`

196

Architecture	Scope	Download	SHA256
`x64`	—	Download	`A6B7D0251B73EB48EB30A7A7CA62FBAA1EF3B0EA3A180CD096C7AF325171426A`

195

Architecture	Scope	Download	SHA256
`x64`	—	Download	`476A861AF9FE5277C652BFA2B9B01C50AC6C17AF806933E6618EC51BD402DFF6`

194

Architecture	Scope	Download	SHA256
`x64`	—	Download	`289FEA12C02C1BB3DDF5296C4B981A2068508F9D637C9134468C9EFC7212CF23`

193

Architecture	Scope	Download	SHA256
`x64`	—	Download	`11B14F3F69FE1147033C047382D221ED19F98DE7DD9071C479CF8FBB5D0CBD95`

192

Architecture	Scope	Download	SHA256
`x64`	—	Download	`468F69A2483B3B0743D73F24EC5F058DB5AADCBC6D0408DCA236478E1ABF8C41`

190

Architecture	Scope	Download	SHA256
`x64`	—	Download	`58D9F9AB8717F9946916F9649B3240ED8742CB69A8569AB5BE25B43095697D12`

189

Architecture	Scope	Download	SHA256
`x64`	—	Download	`CCD9901D701B3E8DF4A67A27F9686CBDD59DA486623351B96BD07F2E48DBB682`

188

Architecture	Scope	Download	SHA256
`x64`	—	Download	`12E287CAA7E3D33E0305262D7F7E248FA965CF52F74ED9387C74FFBE32291F92`

187

Architecture	Scope	Download	SHA256
`x64`	—	Download	`15697E3AF6678B10C5E6636B732EBD4217DEE5022FB368BBCFBDFE4C6849D9EA`

186

Architecture	Scope	Download	SHA256
`x64`	—	Download	`CCC8B46094339FB2D626855054EF4ECBF8F1E7BEAAA82CDFEA237BB2B6CCFBB3`

185

Architecture	Scope	Download	SHA256
`x64`	—	Download	`0F44349C7FA6E9C304316B74E533622BD98086B6D4E01A4933481B564941FFD3`

183

Architecture	Scope	Download	SHA256
`x64`	—	Download	`3A26B732EB4B45509A6183A0FC196215031080A06BDDCC1F81E7F53BC05BBC2F`

182

Architecture	Scope	Download	SHA256
`x64`	—	Download	`2AFBA1F6BB31F89EFFB33F54D70669642867058173247FE36421C5A7F02806CD`

180

Architecture	Scope	Download	SHA256
`x64`	—	Download	`2DC1B006B50D0119A0C2241630882BF3D61413DE2DEBA995C9888CA48C7DF523`

179

Architecture	Scope	Download	SHA256
`x64`	—	Download	`CA2D23B54D50CFA4C4591220A6A47AD3EDAFFCCFB571D956885D217E97EAF5EE`

178

Architecture	Scope	Download	SHA256
`x64`	—	Download	`1E28288B3E795F398B874199895DA8C82563E2FC616EC6C6DA71B672E73719C9`

176

Architecture	Scope	Download	SHA256
`x64`	—	Download	`C5DDC0BF22BBE897D616332ADD1A048CC049FA53E973ABD361E3CC61839E5E2C`

174

Architecture	Scope	Download	SHA256
`x64`	—	Download	`9768DB1FC199DA9AA586B6AE1BD64DBAD2E5BAB9930EEDF76950FE5CA76D802A`

173

Architecture	Scope	Download	SHA256
`x64`	—	Download	`FB10D39867A35B9FD9BA0205F929386AF403BBEA6C5532AFC74BA236E6E9A6F3`

172

Architecture	Scope	Download	SHA256
`x64`	—	Download	`A3609077487E5EF3734D6C614CBEA08A7BE0F2E240788FB228BB6E8873C5D9BC`

171

Architecture	Scope	Download	SHA256
`x64`	—	Download	`3B612BC6C660E0B64FC518B809D40C0582700CEF2D77FB7A41133657BFEA2D24`

170

Architecture	Scope	Download	SHA256
`x64`	—	Download	`E4AE895B97974D5A5EE35FBCC6A80729F932BB38DD426151D4C28059711E016E`

169

Architecture	Scope	Download	SHA256
`x64`	—	Download	`E62F0C5FA1822020CC744CED4604B6DA595C1890940C3DAD34E9015821455124`

168

Architecture	Scope	Download	SHA256
`x64`	—	Download	`1DAA2BAE6068F42F432BAEA93F05FBE6B43ABB9A15E6B9F663AE34D84639FF25`

167

Architecture	Scope	Download	SHA256
`x64`	—	Download	`3B0F8F293F6CFA504E55B43C6145BC6308E4E8A9D7AABB73F0AF3F3B3C11C653`

166

Architecture	Scope	Download	SHA256
`x64`	—	Download	`D0B78CD88FADB861ACFBBC657E839686AC6B1F41E332FE976624A60DC6A74A74`

165

Architecture	Scope	Download	SHA256
`x64`	—	Download	`9C0CF6DCA6078D0803DB9BD22315622815089625AEE01215EA2D18D183F8B434`

164

Architecture	Scope	Download	SHA256
`x64`	—	Download	`58CD7E434ADD2ED92C768D6EC5F9F48F9C584AAF11EC4000F3F344B036D34FCF`

163

Architecture	Scope	Download	SHA256
`x64`	—	Download	`301960412CEBD23DA5AF4CA3073D78169D0A972FCF78A6D1863FD9FF4866BD03`

162

Architecture	Scope	Download	SHA256
`x64`	—	Download	`50F434B2EDDCAF44E0EF3D3E68C8FFB82E9E2A5DB577867711B70B6D80F57E6C`

161

Architecture	Scope	Download	SHA256
`x64`	—	Download	`88A576AB378EC693EDFADCB645CA1889E9D272E028A2DE4C4AE5148690812952`

llama-swap

Latest 224

Installer type: zip

Details

Tags

Older versions (52)

Installer type: `zip`