drholy/ezrknn-llm
1
0
Fork 0
mirror of https://github.com/DrHo1y/ezrknn-llm.git synced 2026-03-23 17:16:44 +07:00
Code Issues Packages Projects Releases Wiki Activity

Initial entrypoint.sh file

Browse Source
This commit is contained in:
Angel-HF
2024-04-06 11:48:10 +02:00
committed by Pelochus
parent 8d4b40d9ac
commit 0ac0bc54bd
1 changed files with 15 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
docker/entrypoint.sh Normal file
View File

@@ -0,0 +1,15 @@
#!/bin/bash
# Dependencies
apt install -y python3 pip git curl wget nano sudo # python3-tk
# Better than using the default from Rockchip
curl https://raw.githubusercontent.com/Pelochus/ezrknn-llm/master/install.sh | sudo bash
# For running the test.py
pip install /ezrknn-llm/rkllm-toolkit/packages/rkllm_toolkit-1.0.0-cp38-cp38-linux_x86_64.whl
# Clone some compatible LLMs
cd /ezrknn-llm/rkllm-toolkit/examples/huggingface
git clone https://huggingface.co/Qwen/Qwen-1_8B-Chat
git clone https://huggingface.co/georgesung/llama2_7b_chat_uncensored