test(chat): require interactive tool parity across advertised harnesses

This commit is contained in:
2026-10-20 18:12:59 +01:00
parent 68761652cf
commit 855de19a35
5 changed files with 115 additions and 6 deletions
+10
View File
@@ -254,6 +254,16 @@ to it, but the server never lists it and a reload drops it.
## Web interaction recovery (2026-10-20)
Cross-harness contract follow-up: the same browser interaction regression now
runs with OpenCode and Codex identities. Codex additionally accepts prepared
uploads without losing the selected model, retains all native tool/history
items (including structured MCP failures and Code Mode outputs), pages history
with opaque cursors, and exposes running-command/output readback through the
shared background-task UI. Command ownership/output bounds and exact installed
protocol shapes are tested. Read-only live Codex validation passed history,
command listing and model listing without starting/resuming a turn or changing
settings. No real Codex command or permission grant was used for testing.
Typed-tool follow-up: number/integer/boolean/default/conditional/secret and
external-link fields use native controls, preserve JSON types and validate before
sending. `typed-question-controls.png` and the scratch browser regression cover
+6
View File
@@ -146,6 +146,12 @@ try {
await page.waitForSelector('[data-form-id=form_cancel]');
await page.evaluate("[...document.querySelectorAll('[data-form-id=form_cancel] button')].find(button=>button.textContent==='Cancel question').click()");
await eventually(()=>page.evaluate("!document.querySelector('[data-form-id=form_cancel]')"));
assert.equal((await fetch(`http://${target}/fixture-shell`,{method:'POST'})).status,204);
await page.goto(`http://127.0.0.1:${port}/chat/${sessionId}`);
await page.waitForSelector('.chat-bg-task');
await page.click('.chat-bg-task');
await eventually(()=>page.evaluate("document.querySelector('.chat-bg-task-output')?.textContent==='Controlled background output'"));
if(process.env.PIPELINES_CAPTURE_DIR) await page.screenshot(join(process.env.PIPELINES_CAPTURE_DIR,'harness-background-output.png'));
assert.deepEqual(await page.evaluate("window.__errors"), []);
console.log("Model dialog, stable activity mark, keyboard/caret, Back restoration, send-to-bottom and all recovered approvals/questions passed.");
} finally {