deepseek-harness/website/zh-CN/api/harness/llm.md

ctx.llm

LlmService — provided by @deepseek-ai/dsh-llm.

The abstract llm service: an adapter registry plus a streaming model-call surface, interceptable via the llm/stream waterfall.

Source

ctx.llm.registerAdapter(providers, adapter)

/**
 * Register an adapter for the given provider routes. Throws `LlmError` with code
 * `DUPLICATE_ADAPTER` if any provider already has an adapter (all-or-nothing).
 * Disposed with the fiber.
 * @param providers - every provider route this adapter should serve.
 * @param adapter - the adapter that streams calls for those providers.
 * @returns the disposer that unregisters all of them.
 */
registerAdapter(providers: string[], adapter: LlmAdapter): () => void

Register an adapter for the given provider routes. Throws LlmError with code DUPLICATE_ADAPTER if any provider already has an adapter (all-or-nothing). Disposed with the fiber.

• providers — every provider route this adapter should serve.
• adapter — the adapter that streams calls for those providers.

Returns the disposer that unregisters all of them.

Source

ctx.llm.listProviders()

/**
 * Describe provider routes with a registered adapter.
 * @returns detached provider metadata in registration order.
 */
listProviders(): LlmProviderInfo[]

Describe provider routes with a registered adapter.

Returns detached provider metadata in registration order.

Source

ctx.llm.listModels(provider)

/**
 * Discover models advertised by one registered provider. Catalog membership
 * is advisory and never changes routing or request validation.
 * @param provider - registered provider route to inspect.
 * @returns detached model metadata in adapter-preferred order.
 */
async listModels(provider: string): Promise<LlmModelInfo[]>

Discover models advertised by one registered provider. Catalog membership is advisory and never changes routing or request validation.

• provider — registered provider route to inspect.

Returns detached model metadata in adapter-preferred order.

Source

ctx.llm.stream(options)

/**
 * Stream one model call as raw chunks (token-level deltas). Throws
 * `LlmError` with code `NO_ADAPTER` if no adapter is registered for
 * `options.provider`. Replay state is retained only when the same adapter
 * instance owns its historical provider and the target provider. Dispatches
 * through the `llm/stream` waterfall.
 * @param options - the full request; `options.provider` selects the adapter.
 * @returns the chunk stream, possibly wrapped by `llm/stream` listeners.
 */
stream(options: GenerateOptions): AsyncIterable<StreamChunk>

Stream one model call as raw chunks (token-level deltas). Throws LlmError with code NO_ADAPTER if no adapter is registered for options.provider. Replay state is retained only when the same adapter instance owns its historical provider and the target provider. Dispatches through the llm/stream waterfall.

• options — the full request; options.provider selects the adapter.

Returns the chunk stream, possibly wrapped by llm/stream listeners.

Source