Skip to content

reduce event union b removing unused members#1379

Open
juliusmarminge wants to merge 7 commits intomainfrom
t3code/context-window-meter
Open

reduce event union b removing unused members#1379
juliusmarminge wants to merge 7 commits intomainfrom
t3code/context-window-meter

Conversation

@juliusmarminge
Copy link
Member

@juliusmarminge juliusmarminge commented Mar 24, 2026

Summary

  • Surface context window usage in the chat header with a hover popover and tighter ring styling.
  • Render context compaction as standard work log entries so it appears in the conversation timeline.
  • Tighten thread activity and provider runtime schemas around context window usage.
  • Simplify git/server progress plumbing by removing hook-progress streaming paths and related UI wiring.
  • Update PR size labeling to use total changed lines instead of test-file-adjusted counts.

Testing

  • Not run in this summary.
  • Expected project checks: bun fmt, bun lint, bun typecheck, and bun run test.

Note

Medium Risk
Medium risk because the PR tightens runtime/thread activity schemas and removes multiple event variants; any producer/consumer still emitting or expecting legacy event types/payload shapes will now fail decoding or miss UI updates.

Overview
Tightens the contracts around provider runtime + orchestration thread activities by replacing loosely-typed kind/payload fields with a discriminated OrchestrationThreadActivity union (typed payloads, typed OrchestrationThreadActivityKind) and introducing canonical schemas for ThreadTokenUsageSnapshot, CanonicalJsonValue, tool lifecycle data, and ProviderUserInputAnswers.

Simplifies provider runtime event surface area by removing unused event types (e.g. session.configured, turn.aborted, hook/auth/account/MCP/model/config/deprecation/files + realtime events) and updating ClaudeAdapter/CodexAdapter to stop emitting them while normalizing emitted payloads (structured usage snapshots, canonical tool lifecycle data, canonicalized warning/compaction detail).

Updates server/web consumers and tests to decode activities through the schema at snapshot hydration, adjust tool/work-log/context-window derivation to read the new canonical shapes, and tighten user-input answer typing end-to-end.

Written by Cursor Bugbot for commit e95b0de. This will update automatically on new commits. Configure here.

Note

Remove unused event types from the provider runtime event union

  • Removes many event types from ProviderRuntimeEventV2 in providerRuntime.ts, including session.configured, turn.aborted, thread.realtime.*, and numerous hook/auth/account/mcp/model/config events.
  • Introduces new canonical schemas for tool lifecycle data, thread token usage, user input, and JSON values in dedicated contract modules (toolLifecycle, threadUsage, userInput, jsonValue).
  • Tightens payload types: TurnCompletedPayload.usage now requires ThreadTokenUsageSnapshot, ItemLifecyclePayload.data requires CanonicalToolLifecycleData, and UserInputResolvedPayload.answers requires typed string/string-array values.
  • Removes event emission for the dropped types from both ClaudeAdapter and CodexAdapter; tool lifecycle data is now normalized into structured CanonicalToolLifecycleData payloads.
  • Updates session-logic.ts work log derivation to read only from canonical file_change and command_execution tool data, removing legacy nested field traversal.
  • Risk: any consumer that constructs or validates the removed event types will fail schema decode; OrchestrationThreadActivity now rejects unknown kinds at decode time in ProjectionSnapshotQuery.

Macroscope summarized e95b0de.

@coderabbitai
Copy link

coderabbitai bot commented Mar 24, 2026

Important

Review skipped

Auto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Repository UI

Review profile: CHILL

Plan: Pro

Run ID: 91c0870e-536b-4c0a-996b-e204f313e43c

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch t3code/context-window-meter

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions github-actions bot added size:XXL 1,000+ changed lines (additions + deletions). vouch:trusted PR author is trusted by repo permissions or the VOUCHED list. labels Mar 24, 2026
@@ -454,16 +454,18 @@ const makeProjectionSnapshotQuery = Effect.gen(function* () {
for (const row of activityRows) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Medium Layers/ProjectionSnapshotQuery.ts:454

Schema.decodeUnknownSync(OrchestrationThreadActivity) on line 458 throws synchronously on decode failure, becoming an unhandled defect that bypasses the ProjectionRepositoryError error type in the function signature. Consider using Schema.decodeUnknownEffect with toPersistenceDecodeError mapping instead, consistent with line 574.

🚀 Reply "fix it for me" or copy this AI Prompt for your agent:
In file apps/server/src/orchestration/Layers/ProjectionSnapshotQuery.ts around line 454:

`Schema.decodeUnknownSync(OrchestrationThreadActivity)` on line 458 throws synchronously on decode failure, becoming an unhandled defect that bypasses the `ProjectionRepositoryError` error type in the function signature. Consider using `Schema.decodeUnknownEffect` with `toPersistenceDecodeError` mapping instead, consistent with line 574.

Evidence trail:
apps/server/src/orchestration/Layers/ProjectionSnapshotQuery.ts lines 458 (uses Schema.decodeUnknownSync), line 45 (defines decodeReadModel using Schema.decodeUnknownEffect), lines 574-576 (shows proper error mapping pattern with toPersistenceDecodeError); apps/server/src/orchestration/Services/ProjectionSnapshotQuery.ts line 24 (function signature declares ProjectionRepositoryError as error type)

@juliusmarminge juliusmarminge changed the title Add context window meter and simplify git progress plumbing reduce event union b removing unused members Mar 24, 2026
@juliusmarminge juliusmarminge force-pushed the t3code/context-window-meter branch from 2ab0eb0 to 3f48ad2 Compare March 24, 2026 20:36
Copy link
Contributor

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

There are 2 total unresolved issues (including 1 from previous review).

Autofix Details

Bugbot Autofix prepared a fix for the issue found in the latest run.

  • ✅ Fixed: Schema rejects failed task activities at read time
    • Added a second union member makeThreadActivitySchema("task.completed", "error", TaskCompletedActivityPayload) so the schema accepts both "info" and "error" tones for task.completed activities, preventing decode failures on failed tasks.

Create PR

Or push these changes by commenting:

@cursor push fac4623d46
Preview (fac4623d46)
diff --git a/packages/contracts/src/orchestration.ts b/packages/contracts/src/orchestration.ts
--- a/packages/contracts/src/orchestration.ts
+++ b/packages/contracts/src/orchestration.ts
@@ -397,6 +397,7 @@
   makeThreadActivitySchema("task.started", "info", TaskStartedActivityPayload),
   makeThreadActivitySchema("task.progress", "info", TaskProgressActivityPayload),
   makeThreadActivitySchema("task.completed", "info", TaskCompletedActivityPayload),
+  makeThreadActivitySchema("task.completed", "error", TaskCompletedActivityPayload),
   makeThreadActivitySchema("context-compaction", "info", ContextCompactionActivityPayload),
   makeThreadActivitySchema("context-window.updated", "info", ThreadTokenUsageSnapshot),
   makeThreadActivitySchema("tool.updated", "tool", ToolUpdatedActivityPayload),

Copy link
Contributor

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 3 potential issues.

There are 4 total unresolved issues (including 1 from previous review).

Autofix Details

Bugbot Autofix prepared fixes for all 3 issues found in the latest run.

  • ✅ Fixed: Tool lifecycle data computed twice with identical arguments
    • Stored the result of canonicalToolLifecycleData/buildCanonicalToolLifecycleData in a local variable at all four call sites (ClaudeAdapter lines 1543, 1747, 1825 and CodexAdapter line 673) to eliminate redundant computation, matching the existing pattern at line 1890.
  • ✅ Fixed: Identical utility functions duplicated across adapter files
    • Extracted the identical normalizeCommandValue and pushChangedFile functions into a new shared module at apps/server/src/provider/toolDataUtils.ts and updated both adapter files to import from it.
  • ✅ Fixed: toCanonicalJsonValue silently converts null to undefined
    • Removed the ?? undefined nullish coalescing and cast the JSON.parse result directly as CanonicalJsonValue, preserving null as a valid return value.

Create PR

Or push these changes by commenting:

@cursor push 5b3e710759
Preview (5b3e710759)
diff --git a/apps/server/src/orchestration/Layers/ProviderRuntimeIngestion.ts b/apps/server/src/orchestration/Layers/ProviderRuntimeIngestion.ts
--- a/apps/server/src/orchestration/Layers/ProviderRuntimeIngestion.ts
+++ b/apps/server/src/orchestration/Layers/ProviderRuntimeIngestion.ts
@@ -107,10 +107,9 @@
   if (value === undefined) {
     return undefined;
   }
-  const normalized = JSON.parse(
+  return JSON.parse(
     JSON.stringify(value, (_key, nestedValue) => (nestedValue === undefined ? null : nestedValue)),
-  ) as CanonicalJsonValue | null;
-  return normalized ?? undefined;
+  ) as CanonicalJsonValue;
 }
 
 function buildContextWindowActivityPayload(

diff --git a/apps/server/src/provider/Layers/ClaudeAdapter.ts b/apps/server/src/provider/Layers/ClaudeAdapter.ts
--- a/apps/server/src/provider/Layers/ClaudeAdapter.ts
+++ b/apps/server/src/provider/Layers/ClaudeAdapter.ts
@@ -75,6 +75,7 @@
   type ProviderAdapterError,
 } from "../Errors.ts";
 import { ClaudeAdapter, type ClaudeAdapterShape } from "../Services/ClaudeAdapter.ts";
+import { normalizeCommandValue, pushChangedFile } from "../toolDataUtils.ts";
 import { type EventNdjsonLogger, makeEventNdjsonLogger } from "./EventNdjsonLogger.ts";
 
 const PROVIDER = "claudeAgent" as const;
@@ -747,32 +748,6 @@
   }
 }
 
-function normalizeCommandValue(value: unknown): string | undefined {
-  if (typeof value === "string") {
-    const trimmed = value.trim();
-    return trimmed.length > 0 ? trimmed : undefined;
-  }
-  if (!Array.isArray(value)) {
-    return undefined;
-  }
-  const parts = value
-    .map((entry) => (typeof entry === "string" ? entry.trim() : ""))
-    .filter((entry) => entry.length > 0);
-  return parts.length > 0 ? parts.join(" ") : undefined;
-}
-
-function pushChangedFile(target: string[], seen: Set<string>, value: unknown) {
-  if (typeof value !== "string") {
-    return;
-  }
-  const normalized = value.trim();
-  if (normalized.length === 0 || seen.has(normalized)) {
-    return;
-  }
-  seen.add(normalized);
-  target.push(normalized);
-}
-
 function collectChangedFiles(value: unknown, target: string[], seen: Set<string>, depth: number) {
   if (depth > 4 || target.length >= 12) {
     return;
@@ -1540,19 +1515,14 @@
               status: status === "completed" ? "completed" : "failed",
               title: tool.title,
               ...(tool.detail ? { detail: tool.detail } : {}),
-              ...(canonicalToolLifecycleData({
-                itemType: tool.itemType,
-                toolName: tool.toolName,
-                input: tool.input,
-              })
-                ? {
-                    data: canonicalToolLifecycleData({
-                      itemType: tool.itemType,
-                      toolName: tool.toolName,
-                      input: tool.input,
-                    }),
-                  }
-                : {}),
+              ...(() => {
+                const toolData = canonicalToolLifecycleData({
+                  itemType: tool.itemType,
+                  toolName: tool.toolName,
+                  input: tool.input,
+                });
+                return toolData ? { data: toolData } : {};
+              })(),
             },
             providerRefs: nativeProviderRefs(context, { providerItemId: tool.itemId }),
             raw: {
@@ -1744,19 +1714,14 @@
                 status: "inProgress",
                 title: nextTool.title,
                 ...(nextTool.detail ? { detail: nextTool.detail } : {}),
-                ...(canonicalToolLifecycleData({
-                  itemType: nextTool.itemType,
-                  toolName: nextTool.toolName,
-                  input: nextTool.input,
-                })
-                  ? {
-                      data: canonicalToolLifecycleData({
-                        itemType: nextTool.itemType,
-                        toolName: nextTool.toolName,
-                        input: nextTool.input,
-                      }),
-                    }
-                  : {}),
+                ...(() => {
+                  const toolData = canonicalToolLifecycleData({
+                    itemType: nextTool.itemType,
+                    toolName: nextTool.toolName,
+                    input: nextTool.input,
+                  });
+                  return toolData ? { data: toolData } : {};
+                })(),
               },
               providerRefs: nativeProviderRefs(context, { providerItemId: nextTool.itemId }),
               raw: {
@@ -1822,19 +1787,14 @@
               status: "inProgress",
               title: tool.title,
               ...(tool.detail ? { detail: tool.detail } : {}),
-              ...(canonicalToolLifecycleData({
-                itemType: tool.itemType,
-                toolName: tool.toolName,
-                input: toolInput,
-              })
-                ? {
-                    data: canonicalToolLifecycleData({
-                      itemType: tool.itemType,
-                      toolName: tool.toolName,
-                      input: toolInput,
-                    }),
-                  }
-                : {}),
+              ...(() => {
+                const toolData = canonicalToolLifecycleData({
+                  itemType: tool.itemType,
+                  toolName: tool.toolName,
+                  input: toolInput,
+                });
+                return toolData ? { data: toolData } : {};
+              })(),
             },
             providerRefs: nativeProviderRefs(context, { providerItemId: tool.itemId }),
             raw: {

diff --git a/apps/server/src/provider/Layers/CodexAdapter.ts b/apps/server/src/provider/Layers/CodexAdapter.ts
--- a/apps/server/src/provider/Layers/CodexAdapter.ts
+++ b/apps/server/src/provider/Layers/CodexAdapter.ts
@@ -33,6 +33,7 @@
   type ProviderAdapterError,
 } from "../Errors.ts";
 import { CodexAdapter, type CodexAdapterShape } from "../Services/CodexAdapter.ts";
+import { normalizeCommandValue, pushChangedFile } from "../toolDataUtils.ts";
 import {
   CodexAppServerManager,
   type CodexAppServerStartSessionInput,
@@ -111,32 +112,6 @@
   return typeof value === "number" && Number.isFinite(value) ? value : undefined;
 }
 
-function normalizeCommandValue(value: unknown): string | undefined {
-  if (typeof value === "string") {
-    const trimmed = value.trim();
-    return trimmed.length > 0 ? trimmed : undefined;
-  }
-  if (!Array.isArray(value)) {
-    return undefined;
-  }
-  const parts = value
-    .map((entry) => (typeof entry === "string" ? entry.trim() : ""))
-    .filter((entry) => entry.length > 0);
-  return parts.length > 0 ? parts.join(" ") : undefined;
-}
-
-function pushChangedFile(target: string[], seen: Set<string>, value: unknown) {
-  if (typeof value !== "string") {
-    return;
-  }
-  const normalized = value.trim();
-  if (normalized.length === 0 || seen.has(normalized)) {
-    return;
-  }
-  seen.add(normalized);
-  target.push(normalized);
-}
-
 function collectChangedFiles(value: unknown, target: string[], seen: Set<string>, depth: number) {
   if (depth > 4 || target.length >= 12) {
     return;
@@ -670,9 +645,10 @@
       ...(status ? { status } : {}),
       ...(itemTitle(itemType) ? { title: itemTitle(itemType) } : {}),
       ...(detail ? { detail } : {}),
-      ...(buildCanonicalToolLifecycleData(itemType, source, payload ?? {})
-        ? { data: buildCanonicalToolLifecycleData(itemType, source, payload ?? {}) }
-        : {}),
+      ...(() => {
+        const toolData = buildCanonicalToolLifecycleData(itemType, source, payload ?? {});
+        return toolData ? { data: toolData } : {};
+      })(),
     },
   };
 }

diff --git a/apps/server/src/provider/toolDataUtils.ts b/apps/server/src/provider/toolDataUtils.ts
new file mode 100644
--- /dev/null
+++ b/apps/server/src/provider/toolDataUtils.ts
@@ -1,0 +1,25 @@
+export function normalizeCommandValue(value: unknown): string | undefined {
+  if (typeof value === "string") {
+    const trimmed = value.trim();
+    return trimmed.length > 0 ? trimmed : undefined;
+  }
+  if (!Array.isArray(value)) {
+    return undefined;
+  }
+  const parts = value
+    .map((entry) => (typeof entry === "string" ? entry.trim() : ""))
+    .filter((entry) => entry.length > 0);
+  return parts.length > 0 ? parts.join(" ") : undefined;
+}
+
+export function pushChangedFile(target: string[], seen: Set<string>, value: unknown) {
+  if (typeof value !== "string") {
+    return;
+  }
+  const normalized = value.trim();
+  if (normalized.length === 0 || seen.has(normalized)) {
+    return;
+  }
+  seen.add(normalized);
+  target.push(normalized);
+}

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Low

When event.payload.detail is null, the runtime warning payload calls toCanonicalJsonValue(null), which returns undefined via null ?? undefined. This causes detail: undefined to be stored, which is then dropped entirely during JSON serialization. Downstream consumers that distinguish between null and a missing detail will see the key disappear instead of receiving null. Consider preserving null values directly rather than normalizing them through toCanonicalJsonValue.

🚀 Reply "fix it for me" or copy this AI Prompt for your agent:
In file apps/server/src/orchestration/Layers/ProviderRuntimeIngestion.test.ts around line 1693:

When `event.payload.detail` is `null`, the runtime warning payload calls `toCanonicalJsonValue(null)`, which returns `undefined` via `null ?? undefined`. This causes `detail: undefined` to be stored, which is then dropped entirely during JSON serialization. Downstream consumers that distinguish between `null` and a missing `detail` will see the key disappear instead of receiving `null`. Consider preserving `null` values directly rather than normalizing them through `toCanonicalJsonValue`.

Evidence trail:
apps/server/src/orchestration/Layers/ProviderRuntimeIngestion.ts lines 106-116 (toCanonicalJsonValue function), line 298 (usage with event.payload.detail), line 450 (similar usage). The `null ?? undefined` expression at line 115 returns `undefined` when normalized is `null`, and the spread at line 298 creates `{ detail: undefined }` which is dropped during JSON serialization.

@juliusmarminge juliusmarminge force-pushed the t3code/context-window-meter branch from ff581d6 to e02c60c Compare March 25, 2026 06:04
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Low

In stopSessionInternal, the pendingUserInputs map is never cleaned up when a session stops, unlike pendingApprovals which is iterated and resolved. If handleAskUserQuestion is blocked on Deferred.await(answersDeferred) when the session stops, and the abort signal doesn't fire, the deferred never resolves and the waiter hangs indefinitely.

🚀 Reply "fix it for me" or copy this AI Prompt for your agent:
In file apps/server/src/provider/Layers/ClaudeAdapter.ts around line 2331:

In `stopSessionInternal`, the `pendingUserInputs` map is never cleaned up when a session stops, unlike `pendingApprovals` which is iterated and resolved. If `handleAskUserQuestion` is blocked on `Deferred.await(answersDeferred)` when the session stops, and the abort signal doesn't fire, the deferred never resolves and the waiter hangs indefinitely.

Evidence trail:
apps/server/src/provider/Layers/ClaudeAdapter.ts lines 2322-2394 (`stopSessionInternal` function - handles `pendingApprovals` at lines 2331-2350, no handling for `pendingUserInputs`); lines 2459-2550 (`handleAskUserQuestion` - creates deferred at line 2493, stores in `pendingUserInputs` at line 2512, abort handler at lines 2515-2521, awaits deferred at line 2524); line 2450 (creates `pendingUserInputs` map); line 2813 (stores `pendingUserInputs` in context). Commit: REVIEWED_COMMIT

Copy link
Contributor

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

There are 2 total unresolved issues (including 1 from previous review).

Fix All in Cursor

Bugbot Autofix prepared a fix for the issue found in the latest run.

  • ✅ Fixed: Schema missing fields for tool started and completed
    • Added the missing optional status and data fields to ToolStartedOrCompletedActivityPayload so that tool.started and tool.completed activities preserve these fields through schema decoding, matching the existing test expectations and ToolUpdatedActivityPayload shape.

Create PR

Or push these changes by commenting:

@cursor push 8717fe98f1
Preview (8717fe98f1)
diff --git a/packages/contracts/src/orchestration.ts b/packages/contracts/src/orchestration.ts
--- a/packages/contracts/src/orchestration.ts
+++ b/packages/contracts/src/orchestration.ts
@@ -362,7 +362,9 @@
 
 const ToolStartedOrCompletedActivityPayload = Schema.Struct({
   itemType: TrimmedNonEmptyString,
+  status: Schema.optional(TrimmedNonEmptyString),
   detail: Schema.optional(TrimmedNonEmptyString),
+  data: Schema.optional(CanonicalToolLifecycleData),
 });
 
 const ToolUpdatedActivityPayload = Schema.Struct({

juliusmarminge and others added 7 commits March 26, 2026 00:11
- Normalize provider token-usage events into thread activities
- Add a compact context window meter to chat
- Handle context compaction markers in the timeline
- Replace timeline marker treatment with normal grouped work rows
- Switch context window meter to an SVG ring and show auto-compaction
- Model orchestration activities with typed payloads
- Drop obsolete provider runtime event mappings
- Improve context window snapshot derivation
- Canonicalize provider runtime tool data and usage snapshots
- Update work log extraction and user input contracts for the new schema
- Add coverage for the revised lifecycle and ingestion shapes
Co-authored-by: codex <codex@users.noreply.github.com>
- Update live Claude adapter tests to match the current startup event sequence
- Fix stream drain expectations after removing the configured event
Co-authored-by: codex <codex@users.noreply.github.com>
@juliusmarminge juliusmarminge force-pushed the t3code/context-window-meter branch from 0458f4e to e95b0de Compare March 26, 2026 07:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XXL 1,000+ changed lines (additions + deletions). vouch:trusted PR author is trusted by repo permissions or the VOUCHED list.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant