chore: add shared skills catalog (19 skills), installers, manifest, validator

This commit is contained in:
2026-08-26 22:08:40 +07:00
parent 62f31484ea
commit a1050f5502
38 changed files with 1850 additions and 2 deletions

View File

@@ -0,0 +1,56 @@
---
name: lab-speech-to-text
description: Transcribe speech from audio files (wav, mp3, ogg, m4a) using the user's home-lab Whishper speech-to-text server (GPU-backed). Use when the user wants to convert audio/voice to text, transcribe a recording, or subtitle.
---
# Lab Speech-to-Text (Whishper)
The user's home lab runs a Whishper speech-to-text server at `http://192.168.31.159:8082` (server2, CUDA GPU, small model). Use it to transcribe audio into text. No authentication is required — the API is open on the LAN.
## Workflow
Use `run_code` to upload the audio, poll the transcription, then return the recognized text.
### 1. Upload the audio
POST `/api/transcriptions` with multipart form-data. Field `files` = the audio blob (mime: `audio/wav`, `audio/mpeg`, `audio/ogg`, or `audio/mp4`). Optional fields: `language` (e.g. `ru`, `en`), `modelSize`.
Response:
```json
{ "id": "<uuid>", "status": 0, "task": "transcribe", "device": "cuda", "result": { "text": "" } }
```
### 2. Poll for the result
`GET {base}/api/transcriptions/{id}`. A `status` of `-1` means the job is still queued or running. When `status >= 0` and `result.text` is non-empty, transcription is done.
### 3. Return the text
The transcription text is in `result.text`. Return it (trimmed). Also note `result.language` and `result.duration` if useful.
## Policy
- **Timeout:** poll no longer than ~120s for typical clips. Longer audio may exceed that; report a timeout rather than looping forever.
- **File source:** read the audio via `ctx.fs.readBytes(target, signal, maxBytes)` (cap ~20MB). Prefer a local path to the file.
- If the user wants a language hint, pass it as `language` (e.g. `ru`).
### Example (run_code)
```js
const base = 'http://192.168.31.159:8082'
// read the audio file bytes first
const fd = new FormData()
fd.append('files', new Blob([audioBytes], { type: 'audio/wav' }), 'note.wav')
fd.append('language', 'ru') // optional
const up = await (await fetch(base + '/api/transcriptions', { method: 'POST', body: fd })).json()
if (!up.id) throw new Error('no id: ' + JSON.stringify(up))
let text = null
for (let i = 0; i < 80 && !text; i++) {
const s = await (await fetch(base + '/api/transcriptions/' + up.id)).json()
const t = s?.result?.text
if (typeof t === 'string' && t.length > 0 && s.status !== -1) text = t
else await new Promise(sl => setTimeout(sl, 1500))
}
if (!text) throw new Error('Transcription timed out')
return text.trim()
```