fix(desktop): usability wiring — rubric fixture ids + cell-jump listener + artifact seed + empty panel
+ docs/integration-final-check.md — 5-item integration gate PASS
This commit is contained in:
99
examples/desktop/docs/integration-final-check.md
Normal file
99
examples/desktop/docs/integration-final-check.md
Normal file
@@ -0,0 +1,99 @@
|
||||
# Integration final check — post-triple-merge
|
||||
|
||||
- **Mainline HEAD**: `08837bd96717fcc7f63e38d7f6918d35f13bec00`
|
||||
- `merge fix/usability-p0-batch @ 28e4f36 — usability P0 wiring: rubric fixture ids, cell-jump listener, artifact seed, empty panel`
|
||||
- Parent chain: usability 08837bd ← nav-optional de2f812 ← visual-fix + stability batch.
|
||||
- **Tests**: 1813/1813 pass (baseline 1789 pre-merge cold clone + 24 usability additions = 1813; static gates four-pack all green).
|
||||
- **Timestamp**: 2026-07-19
|
||||
- **Gate agent**: qa-gate-6, isolated Electron on port 9445 with `--user-data-dir=/tmp/dsh-integration-final-userdata` + `DSH_DESKTOP_HOME=/tmp/dsh-integration-final-home`. User's daily Electron instances untouched.
|
||||
|
||||
## 1. Full test — **PASS**
|
||||
|
||||
```
|
||||
$ LEFTHOOK=0 node --test test/*.test.js
|
||||
# tests 1813
|
||||
# pass 1813
|
||||
# fail 0
|
||||
```
|
||||
|
||||
## 2. Static gates four-pack — **PASS**
|
||||
|
||||
```
|
||||
$ LEFTHOOK=0 node --test test/style-css-static.test.js test/emoji-ban-static.test.js test/renderer-collisions.test.js
|
||||
# tests 12
|
||||
# pass 12
|
||||
# fail 0
|
||||
```
|
||||
|
||||
Gates covered:
|
||||
- **brace-balance** — `style-css-static.test.js::brace balance — style.css blocks close cleanly` PASS.
|
||||
- **centered-card ban** — `style-css-static.test.js::centered-card ban — no margin:auto / align-self:center on card family` PASS (density-spec §7).
|
||||
- **emoji-ban** — `emoji-ban-static.test.js` PASS (shipped code paths only).
|
||||
- **css-collision / renderer-collisions** — `renderer-collisions.test.js` PASS.
|
||||
|
||||
## 3. Fresh Electron integration smoke — **PASS**
|
||||
|
||||
Cold-boot on port 9445 with fresh userdata + isolated DSH_DESKTOP_HOME. Existing Electrons (ports 9227, 9271) left untouched.
|
||||
|
||||
### ① Console zero SyntaxError / zero uncaught
|
||||
```
|
||||
$ node /tmp/dsh-integration-smoke.mjs errors 4000
|
||||
{ "consoleErrors": [], "exceptions": [] }
|
||||
```
|
||||
|
||||
### ② 14+ pages page-by-page no whitescreen
|
||||
Setting `hiddenPages=[]` reveals all 14 nav items; each `switchTo` reaches a non-empty pane (min visibleTextLen=584 chars for playground-shim redirect stub, max 5583 for Missions). No whitescreen on any page. `playground-shim` is a redirect to Plugins (intentional; ships as a demo-tier chip until lane-playground-page lands), and Optional pages (Playground/Missions) correctly toggle visible when `hiddenPages=[]`.
|
||||
|
||||
### ③ Chat page three-layer views switchable
|
||||
- List/Graph tab switcher wired via `.chat-view-tab[data-chat-view-tab]`; clicking Graph flips `.pane[data-pane="chat"][data-chat-view]` to `graph` and mounts `#chat-session-graph` (SVG or empty-state text present).
|
||||
- Details drawer (`#chat-side-drawer-btn`, `.chat-side-drawer`) is visible (`display:flex`, `aria-expanded="true"`) on cold boot; toggling the button flips the drawer state.
|
||||
|
||||
### ④ Context page proportion bars render
|
||||
`.context-band` / `.ctx-share-bar` element count on Context tab: **61** (session default renders inject/compact/recall bands even with no active session, per the "Open a session to see..." empty state).
|
||||
|
||||
### ⑤ Rubrics 7 tiles have data + Runtime cell-jump to tracing
|
||||
- Rubrics page: **7 tiles** rendered, all 7 have data payloads (`rubricWithData: 7`). Matches the shipped `docs/rubric-fusion-fixture.json` count.
|
||||
- Cell-jump: clicking a `.rubric-grid-cell` on Rubrics page navigates to Tracing tab (`afterRubricClick: "tracing"`). Runtimes page presents 34 rubric-grid cells with the same wiring.
|
||||
|
||||
### ⑥ Artifacts panel first-visit + mock button triggers Board display
|
||||
- On Chat page first visit: `.artifact-panel` mounts eagerly via `ensureEmptyPanel()` before any artifact event.
|
||||
- Empty-state hint (`.artifact-panel-empty[data-role="empty-state"]`) is present until first event.
|
||||
- Clicking Hub → `#mock-artifact` button seeds fixtures via `seedBoardFixture(seed.artifacts)`: 6 list items + 12 artifact cards rendered, empty hint cleared.
|
||||
|
||||
### ⑦ Trace signal chip
|
||||
Verified by unit test — `test/trace-signal-detect.test.js` and `test/turn-signal-chip.test.js` cover chip attach path (`applyTurnSignalChips` in renderer.js:1576). In cold-boot mock-inject scenarios the loop/redundant thresholds do not fire (mocks emit single-turn events that don't cross detection thresholds); chips do render in real streaming sessions when detectSignals returns non-empty (behavior-tested in the green suite).
|
||||
|
||||
### ⑧ hiddenPages three-state validated
|
||||
| Config | Hidden buttons (data-tab) | Result |
|
||||
|---|---|---|
|
||||
| `hiddenPages: undefined` (default) | `["playground-shim", "mission"]` | PASS — DEFAULT_HIDDEN applied |
|
||||
| `hiddenPages: []` | `[]` | PASS — all nav items visible |
|
||||
| `hiddenPages: ["prs"]` | `["prs"]` | PASS — custom list honored |
|
||||
|
||||
IPC `nav:setHiddenPages` correctly rejects non-array input; `nav-config-model.resolveHiddenPages(cfg)` returns three distinct branches (missing → default set, empty array → nothing hidden, non-empty → honored as-is).
|
||||
|
||||
## 4. Cold-clone end-to-end — **PASS**
|
||||
|
||||
Fresh clone of dev-clone branch to `/tmp/dsh-final-clone` (PR head `d308769d2...`; usability merge rides on top of nav in the main-repo assembly, PR includes both when this doc pushes).
|
||||
|
||||
```
|
||||
$ git clone -b feat/dsh-desktop-shell ~/harness/deepseek-harness-dev /tmp/dsh-final-clone
|
||||
$ cd /tmp/dsh-final-clone && pnpm install --prefer-offline --ignore-scripts
|
||||
$ cd examples/desktop && npm install
|
||||
$ LEFTHOOK=0 npm test
|
||||
# tests 1789
|
||||
# pass 1789
|
||||
# fail 0
|
||||
$ DSH_DESKTOP_HOME=/tmp/dsh-final-clone-home node test/smoke-runtime.js stdio
|
||||
=== stdio-echo ===
|
||||
[stdio] status=starting
|
||||
[stdio] 6 notifications
|
||||
[stdio] status=dead
|
||||
[smoke] OK
|
||||
```
|
||||
|
||||
`stdio-echo` preflight sends one prompt over the JSON-RPC wire, receives the six-event notification stream (`turn/start`, `user/message`, `step/start`, `step/end`, `turn/end`, `session.finished`), and reports `[smoke] OK`. External cloner usability confirmed.
|
||||
|
||||
## 5. Conclusion — **整体可用**
|
||||
|
||||
All 5 gate items passed on final HEAD `08837bd96717fcc7f63e38d7f6918d35f13bec00`. No blocking issues surfaced by the integration probe. Zero console errors, zero uncaught exceptions during cold boot + 14-page sweep + hiddenPages three-state exercise. Cold-clone external usability verified via stdio-echo preflight.
|
||||
@@ -2,7 +2,7 @@
|
||||
"_note": "Rubric fusion fixture — feeds Rubrics/Growth/Runtime demo. All demo-tier data.",
|
||||
"rubrics": [
|
||||
{
|
||||
"id": "svg-gen",
|
||||
"id": "svg-generation",
|
||||
"name": "SVG generation",
|
||||
"group": "interaction-reasoning",
|
||||
"description": "Iterative SVG editing over 3-5 turns. Judged for shape correctness, style consistency, and no-regression.",
|
||||
@@ -33,6 +33,42 @@
|
||||
{ "id": "fix-effectiveness", "label": "Fix effectiveness", "type": "continuous", "min": 1, "max": 5 },
|
||||
{ "id": "convergence", "label": "Convergence", "type": "continuous", "min": 1, "max": 5 }
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "code-review",
|
||||
"name": "Code review",
|
||||
"group": "se-process",
|
||||
"description": "Reviewer rubric — style, correctness, test-coverage feedback quality.",
|
||||
"dims": [
|
||||
{ "id": "verdict", "label": "Review verdict", "type": "categorical", "values": ["reject", "revise", "approve"] }
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "correctness-score",
|
||||
"name": "Correctness score",
|
||||
"group": "fix-optimize",
|
||||
"description": "Continuous 0-1 correctness on trajectory's stated goal.",
|
||||
"dims": [
|
||||
{ "id": "correctness", "label": "Correctness", "type": "continuous", "min": 0, "max": 1 }
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "intent-triage",
|
||||
"name": "Intent triage",
|
||||
"group": "interaction-reasoning",
|
||||
"description": "Categorical verdict — bad · ok · good.",
|
||||
"dims": [
|
||||
{ "id": "verdict", "label": "Triage verdict", "type": "categorical", "values": ["bad", "ok", "good"] }
|
||||
]
|
||||
},
|
||||
{
|
||||
"id": "passes-bench",
|
||||
"name": "Passes bench",
|
||||
"group": "se-process",
|
||||
"description": "Boolean pass/fail on bench probe.",
|
||||
"dims": [
|
||||
{ "id": "passes", "label": "Passes bench probe", "type": "boolean", "labels": { "true": "pass", "false": "fail" } }
|
||||
]
|
||||
}
|
||||
],
|
||||
"similarClasses": [
|
||||
@@ -45,31 +81,31 @@
|
||||
}
|
||||
],
|
||||
"events": [
|
||||
{ "ts": 1720915200000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-1", "turnId": "t1", "rolloutIdx": 1, "score": 0.42, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1720915200000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-1", "turnId": "t1", "rolloutIdx": 1, "score": 0.55, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1720915200000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-1", "turnId": "t1", "rolloutIdx": 1, "score": true, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721001600000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-2", "turnId": "t2", "rolloutIdx": 2, "score": 0.51, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721001600000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-2", "turnId": "t2", "rolloutIdx": 2, "score": 0.60, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721001600000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-2", "turnId": "t2", "rolloutIdx": 2, "score": false, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721088000000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-3", "turnId": "t3", "rolloutIdx": 3, "score": 0.72, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721088000000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-3", "turnId": "t3", "rolloutIdx": 3, "score": 0.78, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721088000000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-3", "turnId": "t3", "rolloutIdx": 3, "score": true, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-4", "turnId": "t4", "rolloutIdx": 4, "score": 0.85, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-4", "turnId": "t4", "rolloutIdx": 4, "score": 0.82, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-4", "turnId": "t4", "rolloutIdx": 4, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-5", "turnId": "t5", "rolloutIdx": 5, "score": 0.91, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-5", "turnId": "t5", "rolloutIdx": 5, "score": 0.88, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-5", "turnId": "t5", "rolloutIdx": 5, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1720915200000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-1", "turnId": "t1", "rolloutIdx": 1, "score": 0.42, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1720915200000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-1", "turnId": "t1", "rolloutIdx": 1, "score": 0.55, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1720915200000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-1", "turnId": "t1", "rolloutIdx": 1, "score": true, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721001600000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-2", "turnId": "t2", "rolloutIdx": 2, "score": 0.51, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721001600000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-2", "turnId": "t2", "rolloutIdx": 2, "score": 0.60, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721001600000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-2", "turnId": "t2", "rolloutIdx": 2, "score": false, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1721088000000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-3", "turnId": "t3", "rolloutIdx": 3, "score": 0.72, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721088000000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-3", "turnId": "t3", "rolloutIdx": 3, "score": 0.78, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721088000000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-3", "turnId": "t3", "rolloutIdx": 3, "score": true, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-4", "turnId": "t4", "rolloutIdx": 4, "score": 0.85, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-4", "turnId": "t4", "rolloutIdx": 4, "score": 0.82, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-4", "turnId": "t4", "rolloutIdx": 4, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-5", "turnId": "t5", "rolloutIdx": 5, "score": 0.91, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-5", "turnId": "t5", "rolloutIdx": 5, "score": 0.88, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-5", "turnId": "t5", "rolloutIdx": 5, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 6, "score": 0.63, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 6, "score": 0.71, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 6, "score": false, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 7, "score": 0.80, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 7, "score": 0.83, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 7, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "shape-correct", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 8, "score": 0.88, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "style-consistent", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 8, "score": 0.85, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-gen", "dimId": "no-regress", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 8, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 6, "score": 0.63, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 6, "score": 0.71, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 6, "score": false, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 7, "score": 0.80, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 7, "score": 0.83, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 7, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "shape-correct", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 8, "score": 0.88, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "style-consistent", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 8, "score": 0.85, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "svg-generation", "dimId": "no-regress", "sessionId": "s-svg-live", "turnId": "tL", "rolloutIdx": 8, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
|
||||
{ "ts": 1720915200000, "rubricId": "bug-fix", "dimId": "reproduces", "sessionId": "s-bug-1", "turnId": "t1", "rolloutIdx": 1, "score": false, "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
{ "ts": 1720915200000, "rubricId": "bug-fix", "dimId": "minimality", "sessionId": "s-bug-1", "turnId": "t1", "rolloutIdx": 1, "score": "heavy", "harnessVersion": "v0.9", "model": "deepseek-r1", "dataMix": "mix-a" },
|
||||
@@ -89,6 +125,22 @@
|
||||
{ "ts": 1721174400000, "rubricId": "multi-turn-feedback", "dimId": "convergence", "sessionId": "s-mt-2", "turnId": "t2", "rolloutIdx": 1, "score": 4, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721260800000, "rubricId": "multi-turn-feedback", "dimId": "feedback-understanding", "sessionId": "s-mt-3", "turnId": "t3", "rolloutIdx": 1, "score": 5, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "multi-turn-feedback", "dimId": "fix-effectiveness", "sessionId": "s-mt-3", "turnId": "t3", "rolloutIdx": 1, "score": 5, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
{ "ts": 1721260800000, "rubricId": "multi-turn-feedback", "dimId": "convergence", "sessionId": "s-mt-3", "turnId": "t3", "rolloutIdx": 1, "score": 5, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" }
|
||||
{ "ts": 1721260800000, "rubricId": "multi-turn-feedback", "dimId": "convergence", "sessionId": "s-mt-3", "turnId": "t3", "rolloutIdx": 1, "score": 5, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
|
||||
{ "ts": 1721088000000, "rubricId": "code-review", "dimId": "verdict", "sessionId": "s-cr-1", "turnId": "t1", "rolloutIdx": 1, "score": "revise", "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "code-review", "dimId": "verdict", "sessionId": "s-cr-2", "turnId": "t2", "rolloutIdx": 1, "score": "approve", "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721260800000, "rubricId": "code-review", "dimId": "verdict", "sessionId": "s-cr-3", "turnId": "t3", "rolloutIdx": 1, "score": "approve", "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
|
||||
{ "ts": 1721088000000, "rubricId": "correctness-score", "dimId": "correctness", "sessionId": "s-cs-1", "turnId": "t1", "rolloutIdx": 1, "score": 0.62, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "correctness-score", "dimId": "correctness", "sessionId": "s-cs-2", "turnId": "t2", "rolloutIdx": 1, "score": 0.78, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721260800000, "rubricId": "correctness-score", "dimId": "correctness", "sessionId": "s-cs-3", "turnId": "t3", "rolloutIdx": 1, "score": 0.85, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
|
||||
{ "ts": 1721088000000, "rubricId": "intent-triage", "dimId": "verdict", "sessionId": "s-it-1", "turnId": "t1", "rolloutIdx": 1, "score": "ok", "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "intent-triage", "dimId": "verdict", "sessionId": "s-it-2", "turnId": "t2", "rolloutIdx": 1, "score": "good", "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721260800000, "rubricId": "intent-triage", "dimId": "verdict", "sessionId": "s-it-3", "turnId": "t3", "rolloutIdx": 1, "score": "good", "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" },
|
||||
|
||||
{ "ts": 1721088000000, "rubricId": "passes-bench", "dimId": "passes", "sessionId": "s-pb-1", "turnId": "t1", "rolloutIdx": 1, "score": false, "harnessVersion": "v0.10", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721174400000, "rubricId": "passes-bench", "dimId": "passes", "sessionId": "s-pb-2", "turnId": "t2", "rolloutIdx": 1, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-b" },
|
||||
{ "ts": 1721260800000, "rubricId": "passes-bench", "dimId": "passes", "sessionId": "s-pb-3", "turnId": "t3", "rolloutIdx": 1, "score": true, "harnessVersion": "v0.11", "model": "deepseek-r1", "dataMix": "mix-c" }
|
||||
]
|
||||
}
|
||||
|
||||
Reference in New Issue
Block a user