drholy/ezrknn-llm
1
0
Fork 0
mirror of https://github.com/DrHo1y/ezrknn-llm.git synced 2026-03-23 09:06:47 +07:00
Code Issues Packages Projects Releases Wiki Activity

Added test and original repo link

Browse Source
This commit is contained in:
Angel-HF
2024-04-12 20:12:28 +02:00
committed by Pelochus
parent 50b3aa2d78
commit 5317682f9d
1 changed files with 6 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
README.md
View File

@@ -1,5 +1,8 @@
# ezrknn-llm
This repo tries to make RKNN LLM usage easier for people who don't want to read through Rockchip's docs
This repo tries to make RKNN LLM usage easier for people who don't want to read through Rockchip's docs.
Main repo is https://github.com/Pelochus/ezrknpu where you can find more instructions, documentation... for general use.
This repo is intended for details in RKLLM and how also how to convert models.
## Requirements
Keep in mind this repo is focused for:
@@ -15,10 +18,10 @@ curl https://raw.githubusercontent.com/Pelochus/ezrknn-llm/main/install.sh | sud
```
## Test
Run (cd is required):
Run (assuming your on the folder where your `.rkllm` file is located):
```bash
# TODO
rkllm qwen-chat-1_8B.rkllm # Or any other model you like
```
## Converting LLMs for Rockchip's NPUs