This commit is contained in:
maknee 2023-07-16 23:37:06 -04:00
parent 9721fafbb3
commit 08e9f5ce36
16 changed files with 76 additions and 1 deletions

View File

@ -1,3 +1,33 @@
---
license: mit
license: apache-2.0
tags:
- minigpt4
- ggml
language:
- en
- bg
- ca
- cs
- da
- de
- es
- fr
- hr
- hu
- it
- nl
- pl
- pt
- ro
- ru
- sl
- sr
- sv
- uk
---
These are quantized ggml binary files for minigpt4 13B model.
These files can be used in conjunction with [vicuna v0 ggml models](https://huggingface.co/datasets/maknee/ggml-vicuna-v0-quantized) to get minigpt4 working.
Not all implementations were tested. If there are any issues, use f16.

BIN
minigpt4-13B-f16.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-f32.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q2_k.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q3_k.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q4_0.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q4_1.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q4_k.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q5_0.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q5_1.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q5_k.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q6_k.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q8_0.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q8_1.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
minigpt4-13B-q8_k.bin (Stored with Git LFS) Normal file

Binary file not shown.

BIN
pretrained_minigpt4.pth (Stored with Git LFS) Normal file

Binary file not shown.