Initial README

This commit is contained in:
Angel-HF
2024-04-03 20:15:06 +02:00
committed by Pelochus
parent 58b783da4b
commit ba5a52f2c1
25 changed files with 30 additions and 7809 deletions

View File

@@ -1,3 +1,32 @@
# ezrknn-toolkit2
This repo tries to make RKNN LLM usage easier
## Requirements
Keep in mind this repo is focused for:
- High-end Rockchip SoCs, mainly the RK3588
- Linux, not Android
- Linux kernels from Rockchip (as of writing 5.10 and 6.1 from Rockchip should work, if your board has one of these it will very likely be Rockchip's kernel)
## Quick Install
Run:
```bash
# TODO
```
## Test
Run (cd is required):
```bash
# TODO
```
# Original README starts below
<hr>
<hr>
<hr>
# Description
RKLLM software stack can help users to quickly deploy AI models to Rockchip chips. The overall framework is as follows:
@@ -108,4 +137,4 @@ https://github.com/airockchip/rknn-toolkit2
- Add support for models such as Llama3, Gemma2, and MiniCPM3.
- Resolve catastrophic forgetting issue when the number of tokens exceeds max_context.
for older version, please refer [CHANGELOG](CHANGELOG.md)
for older version, please refer [CHANGELOG](CHANGELOG.md)