mirror of
https://github.com/DrHo1y/ezrknn-llm.git
synced 2026-03-23 17:16:44 +07:00
Fixed README and renamed
This commit is contained in:
52
rkllm-runtime/examples/rkllm_api_demo/README.md
Normal file
52
rkllm-runtime/examples/rkllm_api_demo/README.md
Normal file
@@ -0,0 +1,52 @@
|
||||
# Aarch64 Linux Demo
|
||||
## Build
|
||||
To execute, run:
|
||||
```bash
|
||||
bash build-linux.sh
|
||||
```
|
||||
|
||||
## Install
|
||||
Push the compiled `llm_demo` file and `librkllmrt.so` file to the device:
|
||||
```bash
|
||||
<<<<<<<< HEAD:rkllm-runtime/examples/rkllm_api_demo/Readme.md
|
||||
adb push build/build_linux_aarch64_Release/llm_demo /userdata/llm
|
||||
adb push ../../runtime/Linux/librkllm_api/aarch64/librkllmrt.so /userdata/llm/lib
|
||||
========
|
||||
cp build/build_linux_aarch64_Release/llm_demo /usr/bin
|
||||
cp ../runtime/Linux/librkllm_api/aarch64/librkllmrt.so /usr/local/lib
|
||||
>>>>>>>> dc2e2bb (Fixed README and renamed):rkllm-runtime/examples/rkllm_api_demo/README.md
|
||||
```
|
||||
|
||||
## Run
|
||||
```bash
|
||||
adb shell
|
||||
cd /userdata/llm
|
||||
export LD_LIBRARY_PATH=./lib
|
||||
taskset f0 ./llm_demo /path/to/your/rkllm/model
|
||||
```
|
||||
|
||||
# Android Demo
|
||||
## Build
|
||||
Ensure the `ANDROID_NDK_PATH` option in the `build-android.sh` script is correctly configured:
|
||||
```sh
|
||||
ANDROID_NDK_PATH=/path/to/your/android-ndk-r18b
|
||||
```
|
||||
To execute, run:
|
||||
```bash
|
||||
bash build-android.sh
|
||||
```
|
||||
|
||||
## Install
|
||||
Push the compiled `llm_demo` file and `librkllmrt.so` file to the device:
|
||||
```bash
|
||||
adb push build/build_android_arm64-v8a_Release/llm_demo /userdata/llm
|
||||
adb push ../../runtime/Android/librkllm_api/arm64-v8a/librkllmrt.so /userdata/llm/lib
|
||||
```
|
||||
|
||||
## Run
|
||||
```bash
|
||||
adb shell
|
||||
cd /userdata/llm
|
||||
export LD_LIBRARY_PATH=./lib
|
||||
taskset f0 ./llm_demo /path/to/your/rkllm/model
|
||||
```
|
||||
Reference in New Issue
Block a user