Clear instructions on how to convert a model from huggingface to gguf format. The internet will love it!

Question

Since many hours Im not able to convert the pytorch_model-00001-of-00003.bin to GGUF.

I want to convert this LLM https://huggingface.co/LeoLM/leo-hessianai-13b-chat/tree/main

Please help me. All the files are on the system but not Tutorial worked from the Internet and some are very crazy complicated. I dont want to write 30 input commands to get a file, and dont know what the commands do.

Please help me. All the files are stored locally now.

Compiler is installed here

 Microsoft Windows [Version 10.0.22631.4751]
(c) Microsoft Corporation. Alle Rechte vorbehalten.
C:\Users\TREVOR>gcc --version
gcc (Rev2, Built by MSYS2 project) 14.2.0
Copyright (C) 2024 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
C:\Users\TREVOR>g++ --version
g++ (Rev2, Built by MSYS2 project) 14.2.0
Copyright (C) 2024 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
C:\Users\TREVOR>gdb --version
GNU gdb (GDB) 16.2
Copyright (C) 2024 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
C:\Users\TREVOR>
E:\AI - Models\Language Models GGUF\Git-Files\llama.cpp>pip install -r requirements.txt
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu, https://download.pytorch.org/whl/cpu, https://download.pytorch.org/whl/cpu, https://download.pytorch.org/whl/cpu
Collecting numpy~=1.26.4 (from -r E:\AI - Models\Language Models GGUF\Git-Files\llama.cpp\requirements\requirements-convert_legacy_llama.txt (line 1))
  Using cached numpy-1.26.4.tar.gz (15.8 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... error
  error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [21 lines of output]
      + C:\Users\TREVOR\AppData\Local\Programs\Python\Python313\python.exe C:\Users\TREVOR\AppData\Local\Temp\pip-install-w5qw7jt4\numpy_345357bd54594e48ac32e6f2a001c8cf\vendored-meson\meson\meson.py setup C:\Users\TREVOR\AppData\Local\Temp\pip-install-w5qw7jt4\numpy_345357bd54594e48ac32e6f2a001c8cf C:\Users\TREVOR\AppData\Local\Temp\pip-install-w5qw7jt4\numpy_345357bd54594e48ac32e6f2a001c8cf.mesonpy-2kex42mc -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=C:\Users\TREVOR\AppData\Local\Temp\pip-install-w5qw7jt4\numpy_345357bd54594e48ac32e6f2a001c8cf.mesonpy-2kex42mc\meson-python-native-file.ini
      The Meson build system
      Version: 1.2.99
      Source dir: C:\Users\TREVOR\AppData\Local\Temp\pip-install-w5qw7jt4\numpy_345357bd54594e48ac32e6f2a001c8cf
      Build dir: C:\Users\TREVOR\AppData\Local\Temp\pip-install-w5qw7jt4\numpy_345357bd54594e48ac32e6f2a001c8cf.mesonpy-2kex42mc
      Build type: native build
      Project name: NumPy
      Project version: 1.26.4
      WARNING: Failed to activate VS environment: Could not parse vswhere.exe output
  ..\meson.build:1:0: ERROR: Unknown compiler(s): [['icl'], ['cl'], ['cc'], ['gcc'], ['clang'], ['clang-cl'], ['pgcc']]
  The following exception(s) were encountered:
  Running `icl &quot;&quot;` gave &quot;[WinError 2] Das System kann die angegebene Datei nicht finden&quot;
  Running `cl /?` gave &quot;[WinError 2] Das System kann die angegebene Datei nicht finden&quot;
  Running `cc --version` gave &quot;[WinError 2] Das System kann die angegebene Datei nicht finden&quot;
  Running `gcc --version` gave &quot;[WinError 2] Das System kann die angegebene Datei nicht finden&quot;
  Running `clang --version` gave &quot;[WinError 2] Das System kann die angegebene Datei nicht finden&quot;
  Running `clang-cl /?` gave &quot;[WinError 2] Das System kann die angegebene Datei nicht finden&quot;
  Running `pgcc --version` gave &quot;[WinError 2] Das System kann die angegebene Datei nicht finden&quot;

  A full log can be found at C:\Users\TREVOR\AppData\Local\Temp\pip-install-w5qw7jt4\numpy_345357bd54594e48ac32e6f2a001c8cf\.mesonpy-2kex42mc\meson-logs\meson-log.txt
  [end of output]


note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.