test(app): verify deployed chat and stage debugging on both hosts

This commit is contained in:
2026-10-24 02:13:23 +01:00
parent d915f69226
commit 20337f5f6f
2 changed files with 35 additions and 8 deletions
+25 -4
View File
@@ -5,10 +5,10 @@ tests or phone installation are authorized/claimed; deployment is web + APK feed
| Item | Source | Verification | Landing | Deployment |
| --- | --- | --- | --- | --- |
| Send follow-ups while busy | `91854148`: Send beside separate Stop; server queues without interruption | Both hosts: repeated follow-ups, pending-ack duplicate guard, newer draft preservation, 320px/2x text; server queued-prompt regression passes | Main | APK building; web installer next |
| Streamed reasoning | `fa818341` + integration `8e980564`: live inline disclosure, active reply identity survives queued follow-ups | Full integrated check + browser visible streaming/OCR and post-follow-up update pass | Merged main; ancestry verified | APK building; web installer next |
| Collapsed stage input/output | `027be68a`: Summary sections start closed | Both-host regressions fail before fixes; real browser confirms hidden bodies initially | Merged main; ancestry verified | APK building; web installer next |
| Exact-visit raw input/output/memory/session debugging | `28539298`: recorded turn documents in Session with safe viewer | Both-host missing/capture/repair/repeated-visit isolation tests; real browser opens all three exact recorded files | Merged main; ancestry verified | APK building; web installer next |
| Send follow-ups while busy | `91854148`: Send beside separate Stop; server queues without interruption | Both hosts: repeated follow-ups, pending-ack duplicate guard, newer draft preservation, 320px/2x text; server queued-prompt regression passes | Main | Web deployed; APK building |
| Streamed reasoning | `fa818341` + integration `8e980564`: live inline disclosure, active reply identity survives queued follow-ups | Full integrated check + browser visible streaming/OCR and post-follow-up update pass | Merged main; ancestry verified | Web deployed; APK building |
| Collapsed stage input/output | `027be68a`: Summary sections start closed | Both-host regressions fail before fixes; real browser confirms hidden bodies initially | Merged main; ancestry verified | Web deployed; APK building |
| Exact-visit raw input/output/memory/session debugging | `28539298`: recorded turn documents in Session with safe viewer | Both-host missing/capture/repair/repeated-visit isolation tests; real browser opens all three exact recorded files | Merged main; ancestry verified | Web deployed; APK building |
## Integrated acceptance
@@ -27,6 +27,27 @@ tests or phone installation are authorized/claimed; deployment is web + APK feed
- App working agreement updated as requested: authorized installers/APK delivery
are allowed; default testing stays on web and device leases remain required.
## Deployment evidence
- `./install --web-port 8083` succeeded. Quiescence checked before managed restart;
server ping/banner reports `d915f692`, existing database/artifacts and the
operator's OpenCode endpoint retained. The scratch server on 8082 was untouched.
- Atomic copy of the installed bundle preserves existing public 8443/8096 URLs;
rollback: `app/build/web-before-chat-stage-1792804170/`.
- HTTP authentication gates and byte hashes verified at managed localhost:8083
and both public HTTPS URLs. Web JS SHA256:
`f2f91fa94042f971da0b7abff634c00f87e429ee391ab2fa8b10d2e10adb8dc8`.
- Repeated all 17 checks against the installed Docker bundle on both Material
(desktop platform emulation, phone-sized viewport) and Cupertino browser hosts:
`build/chat-stage-debug-deployed-material/` and
`build/chat-stage-debug-deployed-cupertino/`, 10 captures each. Actual Android
device behavior remains unverified; Android-UA browser accessibility activation
was unsuitable for the pointer/AX automation, so it was not claimed as evidence.
- Navigation regression against the installed bundle: 12 checks/9 captures in
`build/chat-stage-debug-navigation-regression/`.
- Replacement `./install --apk` is running with the corrected Docker limits;
publication and authenticated download verification pending.
## Build recovery
The prior navigation APK build failed, not merely timed out: Docker's retained
+10 -4
View File
@@ -46,6 +46,12 @@ try {
const port = await waitForPort(join(profile, 'DevToolsActivePort'));
connection = await connect((await waitForPage(port)).webSocketDebuggerUrl);
await connection.send('Page.enable');
if (process.env.PROBE_PLATFORM === 'material') {
await connection.send('Emulation.setUserAgentOverride', {
userAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/155.0.0.0 Safari/537.36',
platform: 'Win32',
});
}
await connection.send('Emulation.setDeviceMetricsOverride', {
width: 390, height: 844, deviceScaleFactor: 1, mobile: true,
});
@@ -74,6 +80,7 @@ try {
// Flutter web paints SelectableText reasoning/raw documents on its canvas;
// those bodies are not consistently present in Chrome's accessibility tree.
const assertPainted = async (text, label, name) => {
await sleep(300);
await capture(connection, output, log, name);
const { stdout } = await promisify(execFile)('tesseract', [
log.captures.at(-1), 'stdout',
@@ -83,14 +90,14 @@ try {
log.checks.push(label);
};
await visit('/chat/ses_probechat');
await assertName(connection, 'Stored probe answer.', 'stored chat loaded', log);
await assertPainted('Stored probe answer.', 'stored chat loaded', 'chat-stored');
await event({ kind: 'step', step: { status: 'running', turn_id: 'stream-turn' } });
await event({ kind: 'reasoning', message_id: 'live-answer',
part: { id: 'reasoning-0', type: 'reasoning' }, delta: 'Checking the recorded evidence.' });
await event({ kind: 'text', message_id: 'live-answer',
part: { id: 'text-0', type: 'text' }, delta: 'The answer is arriving.' });
await assertPainted('Checking the recorded evidence.', 'reasoning visible while text streams', 'chat-live-reasoning');
await assertName(connection, 'The answer is arriving.', 'streamed answer visible', log);
await assertPainted('The answer is arriving.', 'streamed answer visible', 'chat-live-answer');
const field = (await axNodes(connection)).find(node => node.role?.value === 'textbox');
assert.ok(field, 'composer text field');
const { model } = await connection.send('DOM.getBoxModel', { backendNodeId: field.backendDOMNodeId });
@@ -110,8 +117,7 @@ try {
assert.equal(state.chatInterrupts, 0);
assert.equal(state.chatRunning, true);
log.checks.push('follow-up sent while running, without interrupting');
await assertName(connection, 'Queued', 'server queue acknowledgement visible', log);
await capture(connection, output, log, 'chat-queued-follow-up');
await assertPainted('Queued', 'server queue acknowledgement visible', 'chat-queued-follow-up');
await event({ kind: 'reasoning', message_id: 'live-answer',
part: { id: 'reasoning-0', type: 'reasoning' }, delta: ' The reasoning continues live.' });
await assertPainted('The reasoning continues live.', 'reasoning keeps updating after follow-up', 'chat-reasoning-updated');