mirror of
https://github.com/DrHo1y/ezrknn-llm.git
synced 2026-03-23 17:16:44 +07:00
48 lines
1.0 KiB
Markdown
48 lines
1.0 KiB
Markdown
# Aarch64 Linux Demo
|
|
## Build
|
|
To execute, run:
|
|
```bash
|
|
bash build-linux.sh
|
|
```
|
|
|
|
## Install
|
|
Push the compiled `llm_demo` file and `librkllmrt.so` file to the device:
|
|
```bash
|
|
cp build/build_linux_aarch64_Release/llm_demo /usr/bin
|
|
cp ../runtime/Linux/librkllm_api/aarch64/librkllmrt.so /usr/local/lib
|
|
```
|
|
|
|
## Run
|
|
```bash
|
|
adb shell
|
|
cd /userdata/llm
|
|
export LD_LIBRARY_PATH=./lib
|
|
taskset f0 ./llm_demo /path/to/your/rkllm/model
|
|
```
|
|
|
|
# Android Demo
|
|
## Build
|
|
Ensure the `ANDROID_NDK_PATH` option in the `build-android.sh` script is correctly configured:
|
|
```sh
|
|
ANDROID_NDK_PATH=/path/to/your/android-ndk-r18b
|
|
```
|
|
To execute, run:
|
|
```bash
|
|
bash build-android.sh
|
|
```
|
|
|
|
## Install
|
|
Push the compiled `llm_demo` file and `librkllmrt.so` file to the device:
|
|
```bash
|
|
adb push build/build_android_arm64-v8a_Release/llm_demo /userdata/llm
|
|
adb push ../runtime/Android/librkllm_api/arm64-v8a/librkllmrt.so /userdata/llm/lib
|
|
```
|
|
|
|
## Run
|
|
```bash
|
|
adb shell
|
|
cd /userdata/llm
|
|
export LD_LIBRARY_PATH=./lib
|
|
taskset f0 ./llm_demo /path/to/your/rkllm/model
|
|
```
|