Une Instinct Mi50 AMD / linux et ollama

Je teste en ce moment la Mi50, une carte d’inférence qui a du potentiel et 16 Go de ram

Pour se faire, sous devuan 6 ( Debian 13 )

il faut

  1. Copy & paste all the commands from the quick install https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/quick-start.html
  2. Before rebooting to complete the install, download the 6.4 rocblas from the AUR: https://archlinux.org/packages/extra/x86_64/rocblas/
  3. Extract it 
  4. Copy all tensor files that contain gfx906 in rocblas-6.4.3-3-x86_64.pkg/opt/rocm/lib/rocblas/library to /opt/rocm/lib/rocblas/library
  5. Reboot
  6. Check if it worked by running sudo update-alternatives –display rocm
https://archive.archlinux.org/packages/r/rocblas/rocblas-6.4.3-3-x86_64.pkg.tar.zst