Coder/deepseek-harness
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

test(web): disable unreliable DeepSeek search smoke

Browse Source
This commit is contained in:
Tianyi Cui
2026-07-22 12:37:42 +08:00
parent 6646ef04ac
commit 48395a937c
2 changed files with 6 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
.agents/notes/implemented/testing/2026-06-19-real-api-e2e-ci.md
View File

@@ -56,6 +56,8 @@ The repo secret is named `DEEPSEEK_API_KEY_EXTERNAL`; it is mapped to the `DEEPS
The job runs only `test:e2e` on Node 24; keyless gates and version compatibility belong to the main CI workflow. Tests run unbuilt through the workspace paths map with a bounded configurable worker pool, per-test retries, and a job timeout. Superseded PR runs are cancelled, while push and scheduled runs complete for post-merge signal. The job runs only `test:e2e` on Node 24; keyless gates and version compatibility belong to the main CI workflow. Tests run unbuilt through the workspace paths map with a bounded configurable worker pool, per-test retries, and a job timeout. Superseded PR runs are cancelled, while push and scheduled runs complete for post-merge signal.
The DeepSeek native `web_search` probe is registered but skipped. The live Anthropic-compatible endpoint can return a successful response without structured source blocks, so its positive-source assertion is not a reliable merge signal; unit coverage still pins response parsing, but CI does not prove the live source-block wire shape.
## Security ## Security
The repository's first CI secret requires a recorded threat model because access differs between same-repository, fork, and Dependabot pull requests and changes when the repository becomes public. The repository's first CI secret requires a recorded threat model because access differs between same-repository, fork, and Dependabot pull requests and changes when the repository becomes public.

10
packages/web/web-search-deepseek/tests/deepseek.e2e.ts
View File

@@ -9,17 +9,15 @@ import {
} from '@deepseek-ai/dsh-web-search-deepseek' } from '@deepseek-ai/dsh-web-search-deepseek'
/** /**
* Real-API smoke for the DeepSeek search provider. Self-skips without * Disabled real-API probe for the DeepSeek search provider. The live endpoint
* `$DEEPSEEK_API_KEY`, per the with-key e2e policy in docs/testing.md. This * can complete without structured source blocks, so this is not a reliable
* is the only test that proves DeepSeek's Anthropic-compatible endpoint actually * merge signal. Its body remains because mocks cannot confirm the wire shape.
* triggers native `web_search` and returns the structured result blocks the
* provider parses — a mock cannot confirm the wire shape is real.
*/ */
const apiKey = process.env.DEEPSEEK_API_KEY const apiKey = process.env.DEEPSEEK_API_KEY
const maybe = apiKey !== undefined && apiKey.length > 0 ? describe : describe.skip const maybe = apiKey !== undefined && apiKey.length > 0 ? describe : describe.skip
maybe('DeepSeekSearchProvider real API', () => { maybe('DeepSeekSearchProvider real API', () => {
it('returns citeable sources for a live query via native web_search', async () => { it.skip('returns citeable sources for a live query via native web_search', async () => {
const provider = new DeepSeekSearchProvider({ const provider = new DeepSeekSearchProvider({
apiKey: apiKey!, apiKey: apiKey!,
baseURL: process.env.DEEPSEEK_SEARCH_BASE_URL ?? DEEPSEEK_DEFAULT_BASE_URL, baseURL: process.env.DEEPSEEK_SEARCH_BASE_URL ?? DEEPSEEK_DEFAULT_BASE_URL,