drholy/ezrknn-llm
1
0
Fork 0
mirror of https://github.com/DrHo1y/ezrknn-llm.git synced 2026-03-24 01:26:44 +07:00
Code Issues Packages Projects Releases Wiki Activity

New better Docker image, more automated

Browse Source
This commit is contained in:
Pelochus
2024-04-15 18:32:30 +00:00
parent aed0739b77
commit 6c52d4d732
2 changed files with 8 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@@ -39,12 +39,11 @@ Run:
Then, inside the Docker container:
```bash
apt install -y python3-tk # This needs some configuring from your part
```bash
cd ezrknn-llm/rkllm-toolkit/examples/huggingface/
```
Now change the `test.py` with your preferred model. This container provides Qwen-1.8B and LLaMa2 Uncensored. By default, Qwen-1.8B is selected.
Now change the `test.py` with your preferred model. This container provides Qwen-1.8B since it is the best working one and very lightweight.
Before converting the model, remember to run `git lfs pull` to download the model.
To convert the model, run: