Skip to content

Runtime profile test cases

Use these cases when Agent Context is used by Agent Runtime, Lime AgentRuntime Profile, or an equivalent runtime spine. The goal is to prove that context facts can be referenced by runtime turns without turning Agent Context into a runtime state owner.

Canonical boundary

text
ContextSurface / ContextItem / SourceRef / Selection / Assembly / Compaction / MissingContext
  -> context refs on RuntimeEvent, ThreadReadModel, TaskSnapshot, or EvidencePack
  -> Agent UI and Agent Evidence consume refs and summaries

Agent Context owns what context was available, selected, assembled, injected, omitted, compacted, redacted, or missing. Agent Runtime owns turn status, task status, retries, tool execution, action waits, and recovery.

Runtime correlation fields

Compatible context events and envelopes SHOULD preserve these ids when available:

FieldPurpose
runtime_idRuntime installation or runtime instance.
session_idDurable work container that requested context.
thread_idOrdered execution context.
turn_idTurn whose context was selected or injected.
task_id / run_id / attempt_idManaged task attempt using the context.
step_id / tool_call_idRuntime step or tool call that consumed context.
action_idHuman/policy action that requested more context.
evidence_idEvidence pack or source map that references the context.

Test cases

IDCaseInput factsExpected result
ACTX-AR-ID-001Turn context snapshot keeps idsContext envelope for a submitted turnEnvelope preserves session_id/thread_id/turn_id; runtime can reference context_id.
ACTX-AR-ID-002Task context keeps attempt idsSelection for task retrySelection records preserve task_id/run_id/attempt_id; old attempt context is not overwritten.
ACTX-AR-SEL-001Selected vs omitted are explicitCandidate context set exceeds budgetSelection records include selected and omitted items with reasons.
ACTX-AR-BUDGET-001Budget/window decision is traceableContext window is constrainedBudget record explains truncation; runtime does not guess from prompt text.
ACTX-AR-ASM-001Injection is auditableModel request uses assembled contextAssembly/injection record points to source refs and context item ids.
ACTX-AR-MISSING-001Missing context becomes requestable factRuntime cannot access needed file/sourceMissing-context record includes owner, requested action, and safe user-facing summary.
ACTX-AR-COMPACT-001Compaction preserves boundaryOld thread is compactedSummary references source window and does not replay old reasoning as final answer.
ACTX-AR-POLICY-001Redaction is a context fact with policy refsSensitive item is redactedContext item preserves redaction reason and policy_refs; raw secret is not injected.
ACTX-AR-EVID-001Evidence can cite context refsEvidence pack exports source mapEvidence refs point to context/source refs instead of copying all context payloads.
ACTX-AR-GOV-001Context does not own runtime statusContext event contains runtime idsNo context record declares turn completed, failed, approved, or tool succeeded.

Failure cases

These are incompatible with the boundary:

  1. A context record declares task completion or tool success.
  2. A missing-context record is converted into a permission approval without Agent Policy or runtime confirmation.
  3. Compaction output is treated as final answer text.
  4. Runtime ids are dropped, making evidence unable to join context to turn or task.
  5. Redacted context is reintroduced through summaries, diagnostics, or UI projection.

Minimum validation set

For Agent Runtime-compatible integration, run at least:

  1. ACTX-AR-ID-001 and ACTX-AR-ID-002.
  2. ACTX-AR-SEL-001, ACTX-AR-BUDGET-001, and ACTX-AR-ASM-001.
  3. ACTX-AR-MISSING-001 and ACTX-AR-COMPACT-001.
  4. ACTX-AR-POLICY-001 and ACTX-AR-EVID-001.

Runtime proves the turn/task state. Agent Context proves which context facts were available and why.

Draft standard for portable agent context surfaces, selection, budgets, injection, compaction, and missing-context facts.