@unhero I will repost a comment I made on a different package I maintain:

That happens when the package is outdated. I get notified by GitHub for minor releases, not patch releases, so I might take longer to update the package when there's a new patch release.

In the future, you can flag this package as out-of-date if the upstream repo's latest release version is different than this package's version.

@Mr.Smith1974

I have added the .desktop file and icon. The package name hasn't been changed, however this package now uses the nocuda koboldcpp binary. I have created a new koboldcpp-cuda-bin package that uses the cuda1210 binary.

1. need .desktop file and icon
2. I think the package should be called koboldcpp-cuda-bin

@dreieck Those changes have been made. Thanks for the feedback!

Please add koboldcpp=${pkgver} to the provides array and koboldcpp to the conflicts array.

Regards and thanks for maintaining!

@snarfies Please direct issues to koboldcpp's GitHub repository, as the binary is taken directly from it.

If you would like to build from source instead (this would solve the tkinter issue, not sure about horde), it wouldn't be hard to modify koboldcpp-cuda's existing PKGBUILD to use the latest release. Below is a PKGBUILD demonstrating that.

pkgname=koboldcpp-cuda
pkgver=1.58
pkgrel=1
pkgdesc="CUDA build of koboldcpp"
arch=('x86_64')
url="https://github.com/LostRuins/koboldcpp"
license=('AGPL3')
depends=('python' 'cblas' 'openblas' 'cuda')
optdepends=('customtkinter')
source=("$pkgname-$pkgver.tar.gz::https://github.com/LostRuins/koboldcpp/archive/refs/tags/v$pkgver.tar.gz")
md5sums=('6d51ad5f6afaa7112d97302787d03ab0')

build() {
  cd "$srcdir/koboldcpp-$pkgver"
  make LLAMA_OPENBLAS=1 LLAMA_FAST=1 LLAMA_CUBLAS=1
}

package() {
  cd "$srcdir/koboldcpp-$pkgver"

  install -d "$pkgdir/usr/share/koboldcpp"
  cp -a . "$pkgdir/usr/share/koboldcpp"

  echo '#!/bin/sh' > koboldcpp
  echo 'cd /usr/share/koboldcpp && python koboldcpp.py "$@"' >> koboldcpp

  install -Dm755 koboldcpp "$pkgdir/usr/bin/koboldcpp"
}

Edit:

Concerning the ugly UI, tkinter is detected, as if it weren't, there wouldn't be a UI. I've been told that there's an issue with a conflicting or missing X11 dependency, and no solution is known yet.

For Horde, you can also try exporting the SSL certificate directory, like so:

$ export SSL_CERT_DIR=/etc/ssl/certs

Still not fully functioning as of 1.58 update: tkinter is still not being detected/used, still unable to connect to Kobold Horde.

Two issues with the -bin build as opposed to the outdated kobolcpp-cuda:

1) tkinter does not seem to be detected, despite being installed. Minor issue, just makes the GUI ugly.

2) Cannot connect to Kobold Horde: Please connect to custom endpoint at http://localhost:5001 [00:26:58] Embedded Horde Worker 'test' is started. [00:26:58] Error: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:1131)> - Make sure your Horde API key and worker name is valid!