refactor(llm): simplify live request telemetry (round 2)
This commit is contained in:
@@ -166,15 +166,15 @@ Source: [`packages/core/agent/src/types.ts:286`](../../packages/core/agent/src/t
|
||||
|
||||
### `agent/model-request` — emit
|
||||
|
||||
One model request constructed its final stream handle and is about to iterate it. This live notification is not durable or replayed; failed or aborted iteration still has a dispatch, while preparation and synchronous stream-construction failures do not. Listener failures are contained and cannot affect the request.
|
||||
One model request obtained its outer `llm/stream` handle and is about to iterate it. This observes an Agent-loop request attempt, not proof that provider I/O began. The notification is live, contained, and not replayed. Preparation or a synchronous outer waterfall failure emits nothing; failures or abortion after the handle returns still count.
|
||||
|
||||
```ts cordis-catalog
|
||||
/**
|
||||
* One model request constructed its final stream handle and is about to
|
||||
* iterate it. This live notification is not durable or replayed; failed or
|
||||
* aborted iteration still has a dispatch, while preparation and
|
||||
* synchronous stream-construction failures do not. Listener failures are
|
||||
* contained and cannot affect the request.
|
||||
* One model request obtained its outer `llm/stream` handle and is about to
|
||||
* iterate it. This observes an Agent-loop request attempt, not proof that
|
||||
* provider I/O began. The notification is live, contained, and not replayed.
|
||||
* Preparation or a synchronous outer waterfall failure emits nothing;
|
||||
* failures or abortion after the handle returns still count.
|
||||
* @param agent - the agent dispatching the model request.
|
||||
* @param turn - the open turn number.
|
||||
* @param step - the request's step number.
|
||||
|
||||
@@ -780,16 +780,14 @@ async prepareCall(config: LlmCallConfig, signal?: AbortSignal): Promise<Prepared
|
||||
* agent-loop request recovery; middleware and nested-call failures remain
|
||||
* untagged for the outer call.
|
||||
* @param options - the full request; `options.provider` selects the adapter.
|
||||
* @param onDispatched - contained Agent-loop notification hook invoked after
|
||||
* a stream handle is constructed and before its adapter is iterated.
|
||||
* @returns the chunk stream, possibly wrapped by `llm/stream` listeners.
|
||||
*/
|
||||
stream(options: GenerateOptions, onDispatched?: () => void): AsyncIterable<StreamChunk>
|
||||
stream(options: GenerateOptions): AsyncIterable<StreamChunk>
|
||||
```
|
||||
|
||||
Types: [GenerateOptions](../core-data-structures/core.md) · [LlmAdapter](../core-data-structures/llm-streaming.md) · [LlmCallConfig](../core-data-structures/core.md) · [LlmModelInfo](../core-data-structures/core.md) · [LlmProviderInfo](../core-data-structures/core.md) · [LlmResolvedModelInfo](../core-data-structures/core.md) · [PreparedLlmCall](../core-data-structures/llm-streaming.md) · [ResolvedRetryPolicy](../core-data-structures/llm-streaming.md) · [StreamChunk](../core-data-structures/llm-streaming.md)
|
||||
|
||||
Source: [`packages/llm/llm/src/index.ts:194`](../../packages/llm/llm/src/index.ts)
|
||||
Source: [`packages/llm/llm/src/index.ts:192`](../../packages/llm/llm/src/index.ts)
|
||||
|
||||
## `ctx.permission` — `PermissionService`
|
||||
|
||||
|
||||
Reference in New Issue
Block a user