Files
ezrknn-llm/rkllm-runtime/examples/rkllm_api_demo
2024-05-09 16:47:54 +02:00
..
2024-05-09 16:47:09 +02:00
2024-05-09 17:31:27 +08:00
2024-05-09 17:31:27 +08:00
2024-05-09 16:47:05 +02:00

Aarch64 Linux Demo

Build

To execute, run:

bash build-linux.sh

Install

Push the compiled llm_demo file and librkllmrt.so file to the device:

<<<<<<<< HEAD:rkllm-runtime/examples/rkllm_api_demo/Readme.md
adb push build/build_linux_aarch64_Release/llm_demo /userdata/llm
adb push ../../runtime/Linux/librkllm_api/aarch64/librkllmrt.so /userdata/llm/lib
========
cp build/build_linux_aarch64_Release/llm_demo /usr/bin
cp ../runtime/Linux/librkllm_api/aarch64/librkllmrt.so /usr/local/lib
>>>>>>>> dc2e2bb (Fixed README and renamed):rkllm-runtime/examples/rkllm_api_demo/README.md

Run

adb shell
cd /userdata/llm
export LD_LIBRARY_PATH=./lib
taskset f0 ./llm_demo /path/to/your/rkllm/model

Android Demo

Build

Ensure the ANDROID_NDK_PATH option in the build-android.sh script is correctly configured:

ANDROID_NDK_PATH=/path/to/your/android-ndk-r18b

To execute, run:

bash build-android.sh

Install

Push the compiled llm_demo file and librkllmrt.so file to the device:

adb push build/build_android_arm64-v8a_Release/llm_demo /userdata/llm
adb push ../../runtime/Android/librkllm_api/arm64-v8a/librkllmrt.so /userdata/llm/lib

Run

adb shell
cd /userdata/llm
export LD_LIBRARY_PATH=./lib
taskset f0 ./llm_demo /path/to/your/rkllm/model