Kamiwaza · Principal Product Manager Customer Exercise

Exercise tracker

Swathi's working environment. Times in California (PST). Status: Completed - Nov 3, 2026, ~9:33 PM IST (8:03 AM PST)

Tab 1: the four PDFs word for word, what each asks, the checklist, Q&A and Kamiwaza research. The other tabs are prep drafts built from these PDFs.

REQUIRED - AI use

REQUIRED (AI use): State one AI suggestion accepted and why, one rejected or corrected and why, and how you verified the work. [Candidate Instructions: AI use, Product Brief Template: AI working notes]

Word for word: Candidate Instructions, AI use: “one suggestion you accepted and why;” “one suggestion you rejected or corrected and why; and”. Product Brief Template, AI working notes: “Summarize one AI suggestion you accepted, one you rejected or corrected, and how you verified the work.”

Left empty on purpose: only S's own words from her recorded session go here. Typing here saves in this browser only, and the same boxes fill in on every tab.

Important

  • The instructions require the working session to be recorded continuously (screen, camera, microphone), with AI use visible.
  • They state: “Human assistance is not permitted.” The brief and the mock should be produced by you in your recorded session.
  • They also say: “Start recording before you open the case materials.” If that matters for how you start, the invitation is the place to ask.
  • This tracker is your reference and prep environment, not a draft of the submission.

At a glance

Deliverables
Brief (max 1,000 words) · 4-6 frame mock · full recording · source files (PDF preferred) · optional prototype
Session
60 min target, 90 max, continuous
Team and window
2 engineers + 1 designer for 4 weeks; credible release in 6 weeks; renewal in 10 weeks (E12)
Hard lines
Human approval, source-linked claims and audit record (E06); permission-aware retrieval and exports (E07)
Deadline
Per invitation - confirm
PDF 1

Candidate Instructions

Open original PDF

Exact wording

Principal Product Manager Customer Exercise — Candidate Instructions

Principal Product Manager customer exercise

Purpose

This exercise helps us understand how you turn an ambiguous customer problem into a focused product decision. We are looking at how you use evidence, make tradeoffs, work with AI, and explain what you would ship and learn next. The case is synthetic. There is no hidden answer and no expectation that you know Kamiwaza’s product in advance.

What to submit

Submit all of the following:

  1. A product brief of no more than 1,000 words, using the provided template or a document with the same sections.
  2. A low-fidelity workflow mock with four to six frames. Include at least one uncertainty, failure, or permissions state.
  3. A recording of your complete working session.
  4. Any source files needed to view the brief and mock. PDF is preferred for the final brief and mock.

You may also submit a small working prototype. It is optional but encouraged. We will evaluate it as another way to communicate and test your thinking; the prototype itself is not scored separately.

Recording requirements

Record your full screen, camera, and microphone for the entire working session. We require all three because the working process is a primary part of the assessment.

  • Start recording before you open the case materials.
  • Aim for 60 minutes of recorded work. You may use up to 90 minutes.
  • Upload time does not count toward the limit.
  • Keep the recording continuous whenever possible. Do not edit it into a polished presentation.
  • If recording fails, resume immediately in a clearly numbered second segment and explain what happened.
  • Use a clean desktop and close personal or confidential applications before recording.

AI use

You are required to use an AI tool during the exercise. You may choose the tool. Keep your prompts, the AI’s responses, your edits, and your verification visible in the recording. Talk through:

  • how you give the AI context and constraints;
  • what you delegate and what you decide yourself;
  • how you inspect, challenge, and verify its work;
  • one suggestion you accepted and why;
  • one suggestion you rejected or corrected and why; and
  • any material uncertainty that remains.

REQUIRED - AI use

REQUIRED (AI use): State one AI suggestion accepted and why, one rejected or corrected and why, and how you verified the work. [Candidate Instructions: AI use, Product Brief Template: AI working notes] Fill in the three slots

The quality of a generated document is not enough by itself. We are interested in how effectively you direct the tool and retain ownership of the decisions. Human assistance is not permitted.

Recommended working sequence

  1. Read the customer scenario and evidence pack.
  2. State the customer problem and the evidence you consider most important.
  3. Decide what the first release should and should not do.
  4. Write the brief and create the four-to-six-frame workflow.
  5. Verify the proposal against the technical, compliance, capacity, and timing constraints.
  6. Walk through the result, the key tradeoffs, what you would validate next, and your AI decisions.

Use the evidence IDs when supporting material decisions. Distinguish supplied facts from your assumptions, and explain how an unresolved assumption affects the first-release choice.

Upload

Upload the recording, final brief, mock, and source files to the submission folder in your invitation. Accepted formats are MP4, MOV, PDF, DOCX, PPTX, PNG, JPG, Figma export, HTML, and ZIP. Do not upload credentials, private source material, or dependency directories.

Kamiwaza uses the submission only for hiring evaluation. Access is limited to the hiring team, and the submission is scheduled for deletion 90 days after the final decision. If you need an adjustment or encounter a technical problem, reply to the invitation before the deadline.

What is asked

PDF 2

Evidence Pack

Open original PDF

Exact wording

Evidence IDSourceObservationLimitations
E01Operations analyst interviewsAnalysts spend a median 11.5 hours on each exception case; 4.2 hours are spent locating and reconciling source records.Six interviews from one operations team
E02Pilot telemetry18% of eligible weekly cases used the draft-summary pilot more than once.Eight-week pilot; usage instrumentation does not explain abandonment
E03Pilot quality review84% of sampled summaries were judged materially accurate; 14% contained at least one claim reviewers could not trace to a displayed source.Fifty sampled cases; reviewers used the current manual standard
E04Frontline interviewAnalysts value a starting draft but reopen source systems because the draft does not show why a source was selected or what was omitted.Repeated in four of six interviews
E05Operations leaderStandardize the final review packet and reduce median case cycle time by 40% this quarter. The leader would accept a narrower first release if it is used consistently.Commercial commitment has already been discussed with executives
E06Compliance leadEvery material claim must link to an authorized source. The system must preserve the human approver, source set, model and prompt version, edits, and final disposition in an auditable record.Compliance has not approved automated dispositions
E07Compliance leadA user must not see or retrieve a source they could not access in the underlying system. Exported packets must not reveal restricted source content.Existing access groups are available; a new identity system is not
E08CTOThe six-week executive demo should show ingestion from all five source systems, autonomous research, automatic disposition, and a configurable executive dashboard.No engineering estimate has been completed
E09Engineering discoveryReliable connectors already exist for the case system and document repository. The ticketing, call-recording, and policy systems would each require a new connector and security review.Two engineers are available for four weeks before one moves to another commitment
E10Support observations27% of pilot outputs are manually reformatted before review. Users also copy the final packet into the case system.Based on 63 support-tagged cases
E11Incident reportIn three pilot cases, a revoked document remained in an already generated draft until the user refreshed the evidence set.No customer data was exposed outside authorized users
E12Sales noteNorthstar's renewal sponsor wants proof of measurable adoption and a credible path to broader source coverage, not necessarily all five connectors at launch.The renewal decision is in ten weeks
E13Designer usability sessionUsers missed low-confidence language presented only as a small badge. They noticed an inline explanation and a required confirmation step.Five participants
E14Security architectureThe deployment has on-prem model endpoints, role groups, append-only audit storage, and source-system permission checks. It does not have field-level redaction across all sources.Architecture review is current as of the fictional case date

The PDF has no title above the table; it is reproduced as it appears.

What is asked

PDF 3

Customer Scenario

Open original PDF

Exact wording

Principal Product Manager Customer Scenario

Customer scenario: Northstar operational review

Northstar Financial is a fictional regional financial-services company. It runs Kamiwaza on premises because operational and customer data cannot leave its environment. Northstar wants to improve a recurring operational review in which analysts investigate service exceptions, assemble evidence from several internal systems, recommend a disposition, and send the case to an authorized reviewer.

Each case starts when an operational exception needs a documented decision. An analyst must determine what happened, find and reconcile the relevant records, distinguish reliable evidence from unresolved uncertainty, and prepare a recommendation. An authorized reviewer then checks the evidence, returns the case for more work when needed, and records the final disposition. Today analysts move among several systems, manually assemble the review packet, and copy the outcome back into the case system. Reviewers may need to repeat parts of the investigation when a claim lacks a clear source or the packet does not explain what was omitted.

Northstar wants to shorten the time from exception creation to an authorized, auditable disposition. The first release should reduce the effort spent finding and reconciling evidence, make the review packet more consistent, and let a reviewer verify every material claim without weakening source permissions or human approval. The company also needs measurable adoption and a credible path to broader source coverage before an upcoming renewal decision.

The current pilot can retrieve internal material and draft a case summary. Leadership wants a credible first release in six weeks. The delivery team available for the first four weeks is two engineers and one product designer. Broader integrations, model training, and new identity infrastructure are unavailable in that window.

Your assignment

Define a first release that makes the review materially faster without weakening traceability, access control, or human accountability.

Prepare:

  • a product brief of no more than 1,000 words;
  • a four-to-six-frame low-fidelity workflow mock, including at least one uncertainty, failure, or permissions state; and
  • a recorded explanation of your decisions and AI-assisted working process.

Your brief should make clear the customer problem, target user, evidence, assumptions, first-release requirements, non-goals, workflow, human decision points, enterprise constraints, measures, next validation, and response to commercial pressure. Cite the supplied evidence IDs behind material decisions. You may identify missing evidence and propose how to obtain it. Do not invent customer facts to make the decision easier.

What is asked

PDF 4

Product Brief Template

Open original PDF

Exact wording

Principal Product Manager Product Brief Template

Product brief

Working title:

Primary user:

Decision owner:

Problem and evidence

What problem should the first release solve? Cite the evidence that shaped your view and identify material uncertainty.

First-release proposal

Describe the product behavior and the user outcome. Explain why this scope is the best use of the available capacity and six-week window.

Requirements

List the minimum requirements for the first release.

Non-goals

State what will not be included and why.

Workflow and decision points

Summarize the four-to-six-frame workflow. Identify where permissions, uncertainty, failure handling, and human approval appear.

Technical and enterprise considerations

Explain how the proposal addresses on-premises operation, access control, traceability, security, and implementation constraints.

Measures and validation

Define leading and outcome measures. Describe the next validation step and what evidence would cause you to change direction.

AI working notes

Summarize one AI suggestion you accepted, one you rejected or corrected, and how you verified the work.

What is asked

Deliverables checklist

Everything combined, from all four PDFs plus the later phases you named.

Ask Tab

Ask anything about Kamiwaza, the PDFs, or this tracker. Your question opens in WhatsApp to Tab.

Ask Tab on WhatsApp

Questions answered from the PDFs

What exactly do I have to submit?

Four things: a product brief (max 1,000 words, template sections), a 4-6 frame low-fidelity workflow mock with at least one uncertainty, failure or permissions state, a recording of the complete working session, and any source files needed to view them (PDF preferred). A small working prototype is optional but encouraged.

Source: Candidate Instructions: What to submit

How long should the recorded session be?

Aim for 60 minutes of recorded work; you may use up to 90. Upload time does not count. Keep it continuous and unedited; if it fails, resume immediately in a clearly numbered second segment and explain what happened.

Source: Candidate Instructions: Recording requirements

What must be captured in the recording?

Full screen, camera and microphone, for the entire working session. Start before you open the case materials. Clean desktop, personal and confidential apps closed.

Source: Candidate Instructions: Recording requirements

What do I need to say about AI use?

Six points: how you give the AI context and constraints; what you delegate vs decide; how you inspect, challenge and verify; one suggestion you accepted and why; one you rejected or corrected and why; any material uncertainty that remains. Prompts, responses, edits and verification must be visible.

Source: Candidate Instructions: AI use

Can anyone help me?

No. The instructions say: "Human assistance is not permitted." An AI tool is required, chosen by you.

Source: Candidate Instructions: AI use

When is the deadline?

Not stated in any of the four PDFs. It is in your invitation; the instructions only say to reply to the invitation before the deadline if you need an adjustment.

Source: Candidate Instructions: Upload

What is the delivery capacity I must design for?

Two engineers and one product designer for the first four weeks; one engineer then moves to another commitment (E09 limitation). Leadership wants a credible first release in six weeks. Broader integrations, model training and new identity infrastructure are unavailable in that window.

Source: Customer Scenario; E09

Which source systems can the first release realistically use?

The case system and document repository already have reliable connectors. Ticketing, call-recording and policy systems would each need a new connector and a security review.

Source: E09

What does the CTO want, and how does it compare to the ops leader?

CTO (E08): a six-week executive demo showing ingestion from all five sources, autonomous research, automatic disposition (conflicts with RULE; not planned) and a configurable executive dashboard; no engineering estimate exists. Ops leader (E05): standardize the final review packet and cut median cycle time 40% this quarter, and would accept a narrower first release if used consistently.

Source: E08, E05

Can the product make the disposition automatically?

The evidence says compliance has not approved automated dispositions, and the scenario requires human approval and an authorized reviewer to record the final disposition.

Source: E06; Customer Scenario

What must the audit record contain?

The human approver, source set, model and prompt version, edits, and final disposition, in an auditable record. Every material claim must link to an authorized source.

Source: E06

What are the access-control rules?

A user must not see or retrieve a source they could not access in the underlying system, and exported packets must not reveal restricted source content. Existing access groups are available; a new identity system is not. There is no field-level redaction across all sources.

Source: E07, E14

What happened in the revoked-document incident?

In three pilot cases, a revoked document remained in an already generated draft until the user refreshed the evidence set. No customer data was exposed outside authorized users.

Source: E11

Where does time go for analysts today?

A median 11.5 hours per exception case, of which 4.2 hours go to locating and reconciling source records (six interviews, one team).

Source: E01

Why do analysts not trust the current draft?

They value a starting draft but reopen source systems because it does not show why a source was selected or what was omitted (four of six interviews). 14% of sampled summaries had at least one claim reviewers could not trace to a displayed source.

Source: E04, E03

How well is the pilot being adopted?

18% of eligible weekly cases used the draft-summary pilot more than once over an eight-week pilot; the instrumentation does not explain abandonment, which is missing evidence you can name.

Source: E02

How accurate is the pilot?

84% of fifty sampled summaries were judged materially accurate; 14% contained at least one untraceable claim.

Source: E03

What wastes effort after the draft is produced?

27% of pilot outputs are manually reformatted before review, and users copy the final packet into the case system (63 support-tagged cases).

Source: E10

How should low confidence be shown?

Users missed low-confidence language shown only as a small badge; they noticed an inline explanation and a required confirmation step (five participants).

Source: E13

What does the renewal sponsor need, and when?

Proof of measurable adoption and a credible path to broader source coverage, not necessarily all five connectors at launch. The renewal decision is in ten weeks.

Source: E12

What does the security architecture already provide?

On-prem model endpoints, role groups, append-only audit storage and source-system permission checks. It does not have field-level redaction across all sources.

Source: E14

Why is Northstar on premises?

Operational and customer data cannot leave its environment.

Source: Customer Scenario

What sections does the brief need?

Header: working title, primary user, decision owner. Sections: Problem and evidence; First-release proposal; Requirements; Non-goals; Workflow and decision points; Technical and enterprise considerations; Measures and validation; AI working notes.

Source: Product Brief Template

Can I add facts that make the case easier?

No: "Do not invent customer facts to make the decision easier." You may identify missing evidence and propose how to obtain it, and you must distinguish supplied facts from assumptions.

Source: Customer Scenario; Candidate Instructions

Is there a right answer or do I need to know Kamiwaza's product?

The case is synthetic, there is no hidden answer, and there is no expectation that you know Kamiwaza's product in advance.

Source: Candidate Instructions: Purpose

Kamiwaza company context

Background on the real company, for your later phases. The exercise itself says no prior knowledge of Kamiwaza's product is expected and the case is synthetic.

Compiled 2026-11-03 (UTC ~14:45). Pages fetched and read this session unless marked 'unverified (search snippet only)'. 'Stated on ... page' means the page says so; it does not mean the claim was tested. Crunchbase (403) and Intel customer story (403) could not be read. LinkedIn profile pages are login-walled; only public post text and search snippets were readable. Items marked unverified come from search snippets or could not be confirmed.

Company

Kamiwaza AI (Kamiwaza Corp.) sells a 'secure AI orchestration platform' that runs AI (models, RAG, agents) where enterprise data already lives - on-prem, cloud, edge - instead of centralizing data, with relationship-based access control (ReBAC) and full audit logging. Positioned for regulated industries and federal/government.

Technical chief of staff

Matthew Probst (most likely; unverified as current)

Described as 'KamiwazaAI's Technical Chief of Staff' in a public LinkedIn post by Oliver B. (~1 year old, about Sept 2025) about a panel on 'how AI is supporting transformation of financial institutions' (hosted by IgniteGTM, Supermicro, NVIDIA). His current LinkedIn headline/ZoomInfo title reads 'GM - Kamiwaza Federal & Chief Information Security Officer (CISO)'.

Kamiwaza does not list a Chief of Staff on its own site (About page lists only Luke Norris and Matt Wallace). A Jan 2025 job posting was for a 'Technical Chief of Staff to CTO' - working directly with CTO/co-founder Matt Wallace: code reviews, architecture, technical docs, hands-on development, hiring, prioritizing technical initiatives, managing CTO time; remote, company based in Silverthorne CO (source: https://www.coloradoai.news/featured-ai-job-technical-chief-of-staff-to-cto-at-kamiwaza/). Separately, Chelsea H. lists 'Chief of Staff to CEO at Kamiwaza' (snippet). S should confirm the presenter's name from her invitation/recruiter.

post text stated on the linked page (read Nov 3, 2026); current title unverified (snippets); whether he still holds the Technical CoS role is unverified

https://www.linkedin.com/posts/oliver-b-86102844_great-discussion-with-matthew-probst-kamiwazaais-activity-7378092950154780672-rOVk · https://www.linkedin.com/in/cloudleader · https://www.zoominfo.com/p/Matthew-Probst/1229865199 (may need login / paywalled; snippet only)

Leadership

Funding

  • Total: $11M disclosed: $2.5M pre-seed + $8.5M seed (announced Jan 2025)
  • Lead investors: Seed led by S3 Ventures (Austin) and Pioneer Square Labs (PSL Ventures)
  • Other investors: Ascend, Community Access Fund, Greater Colorado Venture Fund, SVK Capital, FirstMile Ventures (GeekWire); PitchBook snippet also lists Citta Capital, Howdy Partners
  • Sec filing: Form D for Kamiwaza Corp., $8,499,913 sold, filed Jan 8, 2025 (via third-party EDGAR mirror; snippet)
  • Later rounds: No Series A or later round found in any source read as of Nov 3, 2026 (Tracxn snippet still says $11M over 2 rounds)

GeekWire and S3 pages verified; Form D, PitchBook, Tracxn are snippets

https://www.geekwire.com/2025/seattle-vcs-invest-in-kamiwaza-a-new-enterprise-software-startup-helping-companies-adopt-ai/ · https://www.s3vc.com/news-and-insights/kamiwaza-announces-11m-in-back-to-back-funding-rounds-to-power-enterprise-ai-orchestration-at-scale-hkfp8 · https://altstreet.investments/edgar/2042166 (may need login / paywalled; snippet only) · https://pitchbook.com/profiles/company/631203-49 (may need login / paywalled; snippet only) · https://tracxn.com/d/companies/kamiwaza/__e3YsqbZVB2Bo3fH0snXcFeroxaQNG3HHA7S1dpZtJlQ (may need login / paywalled; snippet only)

Products

Platform capabilities

Target customers

Partners

Recent news

Positioning vs competitors

Relevance to the exercise

All sources (42)

Demo (sample data)

The working demo on fictional sample data, end to end: open case, sources, draft packet, submit re-check, reviewer decision, audit and export. Start here when presenting.

Open full screenLive page, shown inside the tracker.

Prototype

The first clickable prototype: Ask (normal, low confidence, revoked, denied), Review packet, Decision log, Audit and Architecture.

Open full screenLive page, shown inside the tracker.

Mockups

Six clean screens in Kamiwaza colours, one action per screen, with the evidence pack (E01-E14) table below the frames.

Open full screenLive page, shown inside the tracker.

Wireframes (dark)

Low-fi wireframes in the dark reference style, six frames with the evidence pack table.

Open full screenLive page, shown inside the tracker.

Deck

The web presentation in Kamiwaza colours: click, use the arrows or the slide index, or switch to scroll mode.

Open full screenLive page, shown inside the tracker.

PRD v2

PRD v2: layered for cross-functional readers

RULE (S): Never fully automatic. In every release, now and in future, disposition is governed by humans in multiple layers. Release 1: a named human records the final disposition; the system never does. Later releases may add assistance, but never remove the human layers. [E06] Full rule and S's words

Version note: v2 (layered for cross-functional readers), v1 kept below/linked. v1 is unchanged and stays on the PRD (v1) tab. Following S's never-overwritten principle, v2 is a new version, not an edit of v1. Draft by Tab for S to review; the submission brief and mock still come from S's own recorded session [Instructions].

How to read: everyone reads Part 1. Then jump to your team. References: E01-E14 are the case evidence, A1-A19 assumptions, N1-N15 unknowns, R1-R15 requirements. Kamiwaza statements are labeled as Kamiwaza's own claims.

1. For everyone

Start here. This part has no jargon. Every other part of the PRD builds on it.

The problem, in one paragraph

Northstar Financial (a fictional regional financial-services company in the case) has analysts who look into "service exceptions", meaning cases where something went wrong for a customer. For each case they gather evidence from several internal systems, write up what happened, suggest an outcome, and send it to a reviewer who signs it off. Today this is slow. A case takes a median of 11.5 hours, and 4.2 of those hours go just to finding and matching up records [E01]. An AI helper was piloted, but people rarely came back to it: only 18% of eligible weekly cases used it more than once [E02]. Reviewers could not always check where a statement came from [E03, E04], and outputs were often retyped by hand [E10].

Who it is for

  • Analysts, who investigate each case and prepare the review packet [Scenario ¶1].
  • Reviewers, who check the evidence, send a case back if needed, and record the final outcome [Scenario ¶2].
  • Around them: the operations leader who wants faster, standard packets [E05], compliance, who protects the audit record and access rules [E06, E07], the CTO, who wants an impressive demo [E08], and the renewal sponsor, who decides in ten weeks whether Northstar keeps buying [E12].

What we build first

A review packet the reviewer can trust without redoing the work. It uses only the two systems that already connect reliably, the case system and the document repository [E09]. In the packet:

  • every important statement links to its source [E03, E06];
  • it shows what was searched, what was used and what was left out, and why [E04];
  • anything uncertain is explained in place and has to be confirmed by a person [E13];
  • people only ever see documents they are already allowed to see, re-checked whenever the packet is opened, submitted or exported [E07, E11];
  • a human always records the final decision. In Release 1 this is a rule, and the process is never 100% automatic [E06, S's rule].

It fits a team of two engineers and one designer for four weeks [Scenario ¶4, E09]. It lands at week 6 as the release and the executive demo, which leaves about four weeks of real use before the renewal decision [E12, A6, A8].

Why it is safe

  • The data never leaves Northstar. Northstar runs Kamiwaza on its own premises because its data cannot leave its environment [Scenario ¶1]. The AI works where the data already sits, on Northstar's own machines, and no central copy is made. (This is how Kamiwaza describes its own Inference Mesh; it is Kamiwaza's claim, read on its site [kamiwaza.com/inference-mesh · Kamiwaza's own claim].)
  • Nobody sees more than they already could. Access follows the permissions people already have in the source systems [E07, E14].
  • Nothing the AI did is quietly rewritten. Every AI assumption, decision, prompt and command is logged and versioned. A change creates a new version that a person approves, and the original is kept [E06, E14, S's principle].
  • People decide. Compliance has not approved automatic decisions [E06], so the final outcome is always recorded by a person.

How we will know it worked

  • More analysts come back to it week after week, from a baseline of 18% [E02].
  • No packet goes out with an untraceable statement (today 14% of sampled summaries had one) [E03].
  • Less retyping and reformatting (today 27% of outputs) [E10].
  • Less time finding and matching records (today 4.2 hours) [E01], and shorter time from case opened to case decided. The operations leader's target is 40% shorter this quarter [E05].
  • Zero cases of someone seeing a document they should not [E11], and a complete audit record on every packet [E06].

Short glossary

  • Permission-aware retrieval: the AI only looks up and shows documents the person asking is already allowed to open in the original system, checked at the moment of asking [E07, E14].
  • Inference Mesh: Kamiwaza's name for running AI models where the data lives, across sites, instead of moving data to one central place. Kamiwaza's own claim: "all Inference Mesh processing happens locally within your secure environment" [kamiwaza.com/inference-mesh · Kamiwaza's own claim].
  • Audit trail: a permanent, append-only record of who did what, when, with which sources, model and prompt version, so it can be checked later and cannot be rewritten [E06, E14].
  • Disposition: the final outcome of a case (for example, approved or resolved), recorded by the authorized reviewer [Scenario ¶2, E06].
  • Confidence: how sure the system is about a finding. Low confidence must be explained in plain words next to the finding and confirmed by a person, not hidden in a small badge [E13].
  • Material claim: a factual statement in the findings or recommendation that a reviewer relies on. This is our working definition, to be confirmed with compliance [A12, N10].
  • Evidence ID (E01-E14): the reference numbers of the facts supplied in the case's evidence pack. A1-A19 are our assumptions and N1-N15 are known unknowns (see the engineering section).

2. Non-tech teams, compliance and audit

What you need to know: what the system will and will not do, what an auditor can check, and where the gaps are.

What the system will never do

  • Record a final disposition without a human, in any release. This is the RULE at the top of this page: never fully automatic; humans govern disposition in multiple layers [E06].
  • Show or export content the person could not open in the source system [E07].
  • Quietly overwrite what the AI produced. Each change is a new version that a person approves, and the original stays in the record [E06, E14, S's principle].
  • Do autonomous research, where the AI goes off and decides alone [E06, E08].

What an auditor can check, per packet

The auditable record keeps, as E06 requires [E06, R9]:

  • the human approver;
  • the source set (which documents, which versions);
  • the model and prompt version used (capture assumed possible, to confirm in week 1) [A9];
  • every edit, with the original kept;
  • the final disposition and who recorded it.

It is written to the append-only audit storage Northstar already has, so history cannot be rewritten [E14].

Controls mapped to the evidence

RiskControl in Release 1Reference
Untraceable statement reaches a reviewerCitation gate: a packet cannot be submitted with an unsourced material claimE03, E06, R3
Someone sees a restricted documentRetrieval runs as the requesting user with existing access groupsE07, E14, R2
Revoked document stays in a draft (happened in 3 pilot cases)Permissions re-checked on open, submit and export; dependent claims flaggedE11, A4, R6
Export leaks restricted contentRestricted sources withheld entirely, and the packet says something was withheldE07, E14, A5, R10
Uncertain finding goes unnoticedInline explanation plus required confirmationE13, R5
AI output silently changedVersioned change control with human approval; original keptE06, R12

Known gaps (said plainly)

  • No field-level redaction across all sources in the deployment [E14], so we withhold whole sources instead [A5].
  • How fast permission changes reach the system is not known [N9]. Kamiwaza claims revocation takes effect immediately because permissions resolve at query time; that is Kamiwaza's claim and unverified.
  • Kamiwaza's own security page says protecting source data does not automatically cover derived data such as embeddings, and logging after the fact does not prevent over-exposure at answer time (Kamiwaza's own statement, page read). Our re-checks and references-not-copies design respond to this [R6, R13, A18].
  • HIPAA and SOC 2 support are Kamiwaza's claims, unverified.

What we need from you (week 1)

  • Confirm what counts as a "material claim" [A12, N10].
  • Confirm the required audit fields [E06].
  • Witness a test of the revoked-document re-check, like the E11 incident [A4, E11].

3. Business teams and investors

What you need to know: the value, how we measure it, and the renewal risk.

The value

  • Time: a median 11.5 analyst hours per case, 4.2 of them spent finding and reconciling records [E01]. That 4.2 hours is the part we target first [A3].
  • Trust that drives reuse: today only 18% of eligible weekly cases use the pilot more than once [E02]. 14% of sampled summaries had a claim reviewers could not trace [E03], and analysts reopen source systems because drafts do not show what was chosen or left out [E04]. We assume trust and rework are the main reasons for low reuse [A2].
  • Rework: 27% of outputs are reformatted by hand, and users copy final packets into the case system [E10].
  • Without new risk: no new identity system, no new connectors, data stays on premises [E07, E09, Scenario ¶1].

The renewal risk (E12)

The renewal decision is in ten weeks. The sponsor wants proof of measurable adoption and a credible path to broader source coverage, not necessarily all five connectors at launch [E12].

  • Release and demo at week 6 leave about four weeks of real usage data before renewal, if both clocks start on the same day [A6, A8]. Calendar dates are not in the case [N7].
  • Biggest risk: chasing the CTO's demo list (all five systems, autonomous research, automatic disposition (conflicts with RULE; not planned), configurable dashboard) with no engineering estimate [E08]. That conflicts with compliance [E06] and connector capacity [E09], and could leave nothing real by week 10.
  • Our answer: demo the real, governed workflow on two sources, with early adoption numbers and a dated connector roadmap with security reviews [E09, E12]. The operations leader already accepts a narrower first release if it is used consistently [E05].
  • The operations leader's 40% cycle-time cut "this quarter" is tied to a commercial commitment discussed with executives [E05]. When the quarter ends and exactly what was promised are not known [N6].

Metrics in plain terms

What we watchTodayGoalReference
Repeat use (cases using it more than once a week)18%Clearly above 18% by week 10 (proposal, to agree)E02, A16
Packets with an untraceable claim14% of sampledZero (enforced)E03
Packets reformatted by hand27%Under 10% (proposal)E10, A16
Hours finding and reconciling4.2 h medianMeasurable drop (proposal)E01, A16
Time from case opened to decisionNot known40% lower (operations leader's target)E05, N3
Permission incidents3 pilot casesZeroE11

Targets other than the 40% are proposals, not customer facts [A16].

Why this matters beyond Northstar

Regulated customers cannot move their data. Kamiwaza positions itself as running AI where data already sits (on-prem, cloud, hybrid, edge) without copying it into one central store; that is Kamiwaza's own positioning, from its site and the research file. A governed, auditable workflow is the proof point such buyers ask for. Northstar itself is fictional [Scenario ¶1].

What we need from you

  • Agree the week-6 demo scope with the CTO in writing, in week 1 [E08, E05].
  • Agree targets with the operations leader [A16].
  • Find out who the renewal sponsor is and what "credible path" means to them [N12].

4. Product team and adjacent teams

What you need to know: the problem statement, the scope decision, what to validate first, and who decides.

Problem statement

An analyst cannot hand a reviewer a packet the reviewer can verify without redoing the work. Evidence is spread across systems [Scenario ¶2, E01], drafts hide why sources were chosen or left out [E04], some claims are untraceable [E03], and packets are reformatted and retyped [E10].

Scope decision and trade-offs

  • In Release 1 (all P0): two-source evidence set, retrieval as the user, claim-level citations with a submit gate, sources panel, inline uncertainty with confirmation, permission re-check, one standard packet, reviewer actions with a human-recorded disposition, audit record, safe export, failure handling, AI change control, references not copies [R1-R13].
  • P1: usage instrumentation with an abandonment-reason prompt and a fixed adoption report [R14]; write-back to the case system if the connector supports it [R15, A11].
  • Out: autonomous research, new connectors, configurable dashboard, field-level redaction, model training, new identity infrastructure [E06, E08, E09, E14, Scenario ¶4].
  • Trade-off: depth and trust on two sources over breadth on five. This serves adoption and renewal [E05, E12] and fits the team [E09].

Shape of the release

Two engineers and one designer for weeks 1-4; one engineer moves after week 4 [E09, Scenario ¶4]. We assume weeks 5-6 are hardening and rollout only, with no new scope [A7]. Week 6 is both the release and the demo [A6]. We assume the pilot's retrieval and drafting can be extended rather than rebuilt [A10].

Validate first (week 1)

  1. Where does each case's evidence live? If mostly outside the two connected systems, the first new connector moves up [A1, N1].
  2. Why did pilot users stop? If it is not about trust or rework, fix that cause first [A2, N2].
  3. Can permission checks run again at open, submit and export? [A4]
  4. What counts as a material claim? [A12]
  5. Can cycle time be measured from case-system timestamps? [A13]

Who decides

The operations leader owns product scope, and the authorized reviewer owns each case's disposition (assumption) [A15].

For adjacent teams

  • Support and customer success: expect less manual reformatting and copy-in work, which today shows up in support cases (E10 draws on 63 support-tagged cases) [E10]. Teach users what "withheld" and "needs confirmation" mean.
  • Sales and solutions: the demo is the governed workflow on two sources plus a dated connector roadmap, not all five systems [E08, E12]. Present Kamiwaza capabilities as Kamiwaza's own claims.
  • Enablement and training: the core habit is to check the sources panel and confirm uncertain findings [E04, E13].
  • Data and analytics: instrument repeat use and abandonment reasons from day one [E02, R14].

5. Design

What you need to know: the states that must be designed, what the evidence says about them, and the rules the UI must keep visible.

What the evidence tells design

  • A small low-confidence badge was missed. An inline explanation plus a required confirmation step was noticed (five participants) [E13].
  • Analysts reopen source systems because the draft does not show why a source was chosen or what was left out [E04].
  • 27% of outputs are reformatted before review, so one standard, copy-ready packet matters [E10].
  • A revoked document stayed in a generated draft until refresh [E11].

States to design (at least one uncertainty, failure or permissions state is required in the mock)

StateWhat the user seesReference
Evidence assembledPacket with a citation on every material claimE06, R3
Sources panelSearched, included, excluded, and whyE04, R4
Low confidencePlain-words explanation in place, plus a Confirm or Change stepE13, R5
Untraced claimSubmit is blocked until the claim is sourced or removedE03, R3
Revoked or out-of-date sourceSource removed, dependent claims flagged, re-approval neededE11, R6
Permission withheld"Something was withheld" notice, no content and no hintsE07, R10, A5
Source failed to loadThe source is named; the packet cannot be marked completeR11
ReviewerVerify each claim in place, return with comments, or approveScenario ¶2, R8
DispositionRecorded by a human only, with an explicit action, never pre-filled as finalE06, S's rule
Version historyEvery AI change as a new version, who approved it, original keptE06, R12, S's principle

Rules the UI must keep visible

  • A person, not the system, records the final disposition [E06, S's rule].
  • Uncertainty is never hidden or auto-resolved [E13].
  • Nothing the AI wrote is replaced without a visible new version and approval [S's principle].
  • Withholding is stated, never silent [E07].

Design capacity

One designer for weeks 1-4; time after week 4 is not stated, so the plan assumes none [Scenario ¶4, A7], so all states above land by week 4. The 4-6 frame low-fi mock is drafted on the Materials tab.

6. Tech and engineering

What you need to know: everything. This section keeps the full v1 PRD content unchanged: every requirement (R1-R15), every Considered fact, every assumption (A1-A19) and every Not in scope / not known item (N1-N15), with all references. Only the anchor names changed so v1 and v2 can sit on the same page.

Key engineering rules, restated:

  • Release 1: a human always records the final disposition; it is never 100% automatic [E06, S's rule].
  • AI assumptions, decisions, prompts and commands are never silently overwritten: logged, versioned, human-approved, original kept [R12, S's principle].
  • Kamiwaza Inference Mesh: data stays put, inference runs locally, no central copy [R13, kamiwaza.com/inference-mesh · Kamiwaza's own claim]. Kamiwaza platform statements below are Kamiwaza's own claims, labeled stated on Kamiwaza's page (read Nov 3, 2026) or unverified.

Prep draft by Tab from the four PDFs, for S to review. Not the submission: the instructions require the brief and mock to come out of S's own recorded session [Instructions: recording, Instructions: AI use].

Considered fact from the PDFs, with its reference Assumed not in the PDFs, with the reason Not in scope / not known excluded or unknown

Principle: AI work is never silently overwritten

Every AI-generated assumption, claim, decision, prompt and command is logged and versioned. A change creates a new version; a human approves it; the original stays in the audit trail. [E06, E14]

  • Revoked document (E11): removing it from a draft creates a new version, flags the claims that relied on it, and needs the analyst's re-approval; the earlier version is kept, with the content itself withheld from anyone who has lost access. [E11, E07]
  • Low confidence (E13): an uncertain finding is confirmed or changed by a person, never auto-resolved; the confirmation is logged. [E13]
  • Security (E14): the record lives in the existing append-only audit storage, so history cannot be rewritten. [E14]
  • Kamiwaza's platform names "Activity Logging and Audit": an audit trail for user actions, system events and AI agent activities with immutable, append-only logging. [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]

Summary

Northstar's analysts lose hours finding and reconciling records [E01], and the pilot's drafts are not trusted enough to reuse [E02, E03, E04]. The first release turns the pilot into a governed review packet built from the two systems that already have reliable connectors [E09]: every material claim is cited [E06], omissions are explained [E04], uncertainty needs confirmation [E13], permissions are re-checked [E07, E11], and a human reviewer records the disposition [Scenario ¶2, E06]. It fits two engineers and one designer for four weeks [Scenario ¶4, E09] and lands as the week-6 release and demo, leaving about four weeks of usage data before the renewal decision [E12, A6, A8].

Working title (a naming choice, not a customer fact): Evidence-linked review packet. Primary user: operations analyst [Scenario ¶1, E01, E04]. Secondary user: authorized reviewer [Scenario ¶2]. Decision owner: operations leader for scope, reviewer for each disposition [A15].

Part A Considered: facts from the PDFs

Customer and context

  • Northstar Financial is a fictional regional financial-services company. [Scenario ¶1]
  • It runs Kamiwaza on premises because operational and customer data cannot leave its environment. [Scenario ¶1]
  • The workflow: analysts investigate service exceptions, assemble evidence from several internal systems, recommend a disposition, and send the case to an authorized reviewer. [Scenario ¶1]
  • The analyst must find and reconcile records and distinguish reliable evidence from unresolved uncertainty; the reviewer checks the evidence, returns the case for more work when needed, and records the final disposition. [Scenario ¶2]
  • Today analysts move among several systems, manually assemble the review packet, and copy the outcome back into the case system. [Scenario ¶2, E10]
  • Reviewers may repeat parts of the investigation when a claim lacks a clear source or the packet does not explain what was omitted. [Scenario ¶2, E04]
  • The current pilot can retrieve internal material and draft a case summary. [Scenario ¶4]

Goal stated by the customer

  • Shorten the time from exception creation to an authorized, auditable disposition. [Scenario ¶3]
  • The first release should reduce effort finding and reconciling evidence, make the packet more consistent, and let a reviewer verify every material claim without weakening source permissions or human approval. [Scenario ¶3]
  • Northstar also needs measurable adoption and a credible path to broader source coverage before an upcoming renewal decision. [Scenario ¶3, E12]
  • The assignment: a first release that makes the review materially faster without weakening traceability, access control, or human accountability. [Scenario: assignment]

Problem evidence

  • Analysts spend a median 11.5 hours per exception case; 4.2 hours go to locating and reconciling source records. Limitation: six interviews from one team. [E01]
  • 18% of eligible weekly cases used the draft-summary pilot more than once. Limitation: eight-week pilot; instrumentation does not explain abandonment. [E02]
  • 84% of sampled summaries were materially accurate; 14% contained at least one claim reviewers could not trace to a displayed source. Limitation: fifty sampled cases; reviewers used the current manual standard. [E03]
  • Analysts value a starting draft but reopen source systems because the draft does not show why a source was selected or what was omitted (four of six interviews). [E04]
  • 27% of pilot outputs are manually reformatted before review; users copy the final packet into the case system (63 support-tagged cases). [E10]
  • In three pilot cases a revoked document stayed in an already generated draft until the user refreshed the evidence set; no customer data was exposed outside authorized users. [E11]
  • Users missed low-confidence language shown only as a small badge; they noticed an inline explanation and a required confirmation step (five participants). [E13]

Stakeholder asks (some conflict)

  • Operations leader: standardize the final review packet and cut median case cycle time by 40% this quarter; would accept a narrower first release if used consistently. A commercial commitment has been discussed with executives. [E05]
  • CTO: the six-week executive demo should show all five source systems, autonomous research, automatic disposition (conflicts with RULE; not planned), and a configurable executive dashboard. No engineering estimate exists. [E08]
  • Renewal sponsor: wants proof of measurable adoption and a credible path to broader source coverage, not necessarily all five connectors at launch. Renewal decision in ten weeks. [E12]

Constraints

  • RULE (S): never fully automatic. In every release, humans govern disposition in multiple layers; in Release 1 a named human records the final disposition and the system never does. [E06, RULE]
  • Every material claim must link to an authorized source; the system must keep the human approver, source set, model and prompt version, edits, and final disposition in an auditable record. Automated dispositions are not approved. [E06]
  • A user must not see or retrieve a source they could not access in the underlying system; exported packets must not reveal restricted content. Existing access groups are available; a new identity system is not. [E07]
  • Reliable connectors exist for the case system and document repository; ticketing, call-recording and policy systems each need a new connector and security review. [E09]
  • Two engineers are available for four weeks before one moves to another commitment. The delivery team for the first four weeks is two engineers and one product designer. [E09, Scenario ¶4]
  • Leadership wants a credible first release in six weeks; broader integrations, model training, and new identity infrastructure are unavailable in that window. [Scenario ¶4]
  • The deployment has on-prem model endpoints, role groups, append-only audit storage, and source-system permission checks; it lacks field-level redaction across all sources. [E14]

What the submission must show (from the instructions)

  • Brief of no more than 1,000 words with the template sections; 4-6 frame low-fi mock with at least one uncertainty, failure or permissions state. [Instructions: what to submit, Brief template]
  • Use evidence IDs for material decisions; distinguish supplied facts from assumptions; explain how an unresolved assumption affects the first-release choice; do not invent customer facts. [Instructions: sequence, Scenario: assignment]

Kamiwaza platform context (real company, not case facts)

The case is synthetic and does not expect product knowledge [Instructions: purpose]. These come from the research file, each with its source and verification label.

  • Kamiwaza supports on-premises deployment as a first-class option. [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza describes permission-aware retrieval: each agent runs in the requesting user's context and permissions resolve at query time. [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza describes an append-only audit trail per agent action (user context, data accessed, permission rule, timestamp). [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza's own security page says protecting source data does not automatically cover derived data such as embeddings, and logging after the fact does not prevent over-exposure at answer time. [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Claim that revocation takes effect immediately because permissions resolve at query time; latency of source-system permission sync is not documented. [Kamiwaza research: source · vendor claim, unverified]
  • HIPAA / SOC 2 support claims. [Kamiwaza research: source · vendor claim, unverified]
  • Kamiwaza's product page names a Distributed Data Engine that processes data where it lives, without migration, and a Connector Framework. [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza's Inference Mesh page: inference is routed to data across distributed systems, and all processing happens locally within the customer's secure environment. [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]

Part B Assumed

Each item is an assumption, not a customer fact. The instructions ask how unresolved assumptions affect the first-release choice [Instructions: sequence]; that is the "effect" line.

  1. Assumption A1 The case system and document repository hold enough of each case's evidence for a two-source release to save meaningful time. [E09, E01]

    Why assumed: E09 limits the release to these two connectors, but no PDF says what share of evidence lives in each system.

    Effect on first release: If false, the release saves less than the 4.2 hours in E01 and a new connector moves up. Validate in week 1 by sampling recent cases.

  2. Assumption A2 Low repeat use is driven mainly by trust and rework (untraced claims, unexplained omissions, reformatting), not by access, training or case mix. [E02, E03, E04, E10]

    Why assumed: E03, E04 and E10 point at trust and rework, but E02's instrumentation does not explain abandonment.

    Effect on first release: If wrong, traceability features will not lift adoption. Validate with interviews of users who stopped and an abandonment-reason prompt.

  3. Assumption A3 Locating and reconciling (4.2 h) is the most addressable part of the 11.5 h case time. [E01]

    Why assumed: It is the only component E01 breaks out; the rest of the 11.5 h is not itemized.

    Effect on first release: Sets the analyst-time measure. Reviewer time is not measured anywhere (N4).

  4. Assumption A4 Source-system permission checks can be called again when a draft is opened, submitted and exported, not only when evidence is first retrieved. [E14, E11]

    Why assumed: E14 lists permission checks; E11 shows a generated draft can outlive a permission.

    Effect on first release: Core to the permissions design. If checks only run at retrieval, re-check needs extra engineering in weeks 2-3.

  5. Assumption A5 Without field-level redaction, the safe export behavior is to withhold a restricted source entirely and show that something was withheld. [E07, E14]

    Why assumed: E07 forbids revealing restricted content and E14 says field-level redaction does not exist.

    Effect on first release: Exports may be less complete for some recipients; the reviewer still sees what they are authorized to see.

  6. Assumption A6 The six-week executive demo and the credible first release are the same week-6 milestone. [E08, Scenario ¶4]

    Why assumed: Both are stated as six weeks (E08, Scenario) but never linked explicitly.

    Effect on first release: The plan converges on one week-6 deliverable instead of two.

  7. Assumption A7 After week 4 one engineer remains; designer availability after week 4 is not stated; the plan assumes none. [E09, Scenario ¶4]

    Why assumed: E09 says one of two engineers moves after four weeks; the Scenario only describes the team for the first four weeks.

    Effect on first release: Weeks 5-6 carry hardening and rollout only, no new scope.

  8. Assumption A8 The six-week and ten-week clocks start on the same day. [E12, E14]

    Why assumed: No calendar dates appear in the PDFs; the case date is fictional (E14).

    Effect on first release: Leaves about four weeks of real usage between release (week 6) and renewal (week 10).

  9. Assumption A9 The deployment can record the model and prompt version used for each draft. [E06, E14]

    Why assumed: E06 requires it and E14 lists on-prem model endpoints, but capture is not confirmed.

    Effect on first release: If not, audit-record work grows in week 1-2.

  10. Assumption A10 The current pilot's retrieval and drafting can be extended rather than rebuilt. [Scenario ¶4]

    Why assumed: The Scenario says the pilot already retrieves internal material and drafts a summary.

    Effect on first release: Makes the four-week build feasible. If the pilot must be rebuilt, scope shrinks.

  11. Assumption A11 The case-system connector reads reliably; whether it can write the packet or disposition back is unknown. [E09, E10]

    Why assumed: E09 says the connector is reliable but not what it supports; E10 says users copy the packet in by hand.

    Effect on first release: Release produces a copy-ready packet; automatic write-back is a stretch item.

  12. Assumption A12 A material claim means any factual statement in the findings or recommendation that a reviewer relies on. [E06]

    Why assumed: E06 uses the term without defining it.

    Effect on first release: Defines what the citation gate blocks. Confirm with compliance in week 1.

  13. Assumption A13 Cycle time can be measured from case-system timestamps (exception created to disposition recorded). [Scenario ¶3, E05]

    Why assumed: The Scenario defines the goal this way; data availability is not stated.

    Effect on first release: Needed for the outcome measure and the E05 target.

  14. Assumption A14 The delivery team (two engineers, one designer) is the team building this release; whose employees they are is not stated. [Scenario ¶4]

    Why assumed: The Scenario names the team without an employer.

    Effect on first release: Does not change scope; matters for who runs the week-1 validation.

  15. Assumption A15 Product decision owner is the operations leader; each case's disposition owner is the authorized reviewer. [E05, Scenario ¶2, Brief template]

    Why assumed: The template asks for a decision owner but the PDFs name none for the product.

    Effect on first release: Shapes who signs off scope in week 1.

  16. Assumption A16 Proposed targets for measures (where shown) are proposals, not customer facts. [E05]

    Why assumed: The PDFs give baselines (E01, E02, E03, E10, E11) and one target (E05), nothing else.

    Effect on first release: Targets should be agreed with the operations leader in week 1.

  17. Assumption A17 The role groups and source-system permission checks in E14 can be enforced through Kamiwaza's Secure AI Authorization (ReBAC). [E14, E07]

    Why assumed: The case names role groups and permission checks; the product page names ReBAC. How they connect at Northstar is not stated.

    Effect on first release: If they don't connect, retrieval must call each source system's own check, which costs engineering time in weeks 2-3.

  18. Assumption A18 A packet can store references (source IDs, versions, passage locations) instead of copies, and render passages in place at view time. [Scenario ¶1, E10]

    Why assumed: This follows the decentralized model (no central copy) and S's architecture direction; nothing in the case says the review process requires stored copies.

    Effect on first release: If the case system needs full-text packets (E10), the export step copies only what the recipient may see.

  19. Assumption A19 Northstar's Kamiwaza deployment includes the product components the plan uses (Distributed Data Engine, Retrieval Service, Inference Mesh, authorization, audit, Model Management). [Scenario ¶1, E14]

    Why assumed: The case says Northstar runs Kamiwaza on premises but lists only the components in E14.

    Effect on first release: If a component is missing, scope moves to what the deployment has. Check in week 1.

Part C Not in scope, and not known

Not in scope for the first release

ExcludedWhyReference
Autonomous researchEvery material claim must trace to an authorized source and the review stays human-led; no estimate exists for it.[E06, E08]
Ticketing, call-recording and policy connectorsEach needs a new connector and security review; broader integrations are unavailable in the window. Kept on the roadmap.[E09, Scenario ¶4]
Configurable executive dashboardNot needed for the renewal ask; replaced by a fixed adoption report.[E08, E12]
Field-level redactionThe deployment does not have it across sources.[E14]
Model training or fine-tuningUnavailable in the window.[Scenario ¶4]
New identity infrastructureUnavailable; existing access groups only.[E07, Scenario ¶4]

Not known (gaps in the evidence)

  1. N1 How much of each case's evidence lives in each of the five systems. [E09]
  2. N2 Why pilot users stopped using the draft summary. [E02]
  3. N3 Absolute baseline for median case cycle time (only analyst hours are given). [E01, E05]
  4. N4 Reviewer time per case and how often cases are returned. [Scenario ¶2]
  5. N5 Case volume per week, and the number of analysts and reviewers. [E02]
  6. N6 When "this quarter" ends for the 40% target, and what was committed to executives. [E05]
  7. N7 Calendar dates for the six-week release, demo and ten-week renewal. [Scenario ¶4, E08, E12, E14]
  8. N8 Whether the case-system connector supports write-back. [E09, E10]
  9. N9 How fast source-system permission changes propagate. [E11, E14]
  10. N10 Compliance's definition of a material claim. [E06]
  11. N11 Designer and engineering capacity after week 4 (beyond one engineer leaving). [E09, Scenario ¶4]
  12. N12 Who the renewal sponsor is and what counts as a credible path. [E12]
  13. N13 The submission deadline for this exercise (not in the PDFs; per invitation). [Instructions: upload]
  14. N14 Whether Northstar's systems sit in one data center or several (mesh nodes). [Scenario ¶1]
  15. N15 Which Kamiwaza components and edition Northstar has deployed. [Scenario ¶1, E14]

Proposal (built on Parts A to C)

Problem statement

An analyst cannot hand a reviewer a packet the reviewer can verify without redoing the work. Evidence is spread across systems [Scenario ¶2, E01], drafts hide why sources were chosen or omitted [E04], some claims are untraceable [E03], and packets are reformatted and retyped [E10].

Users

  • Operations analyst (primary): investigates, reconciles, drafts and recommends [Scenario ¶1, Scenario ¶2].
  • Authorized reviewer: verifies, returns or approves, records the disposition [Scenario ¶2].
  • Operations leader: wants a standard packet and shorter cycle time [E05].
  • Compliance lead: traceability, audit record, access rules [E06, E07].
  • CTO and renewal sponsor: demo and renewal evidence [E08, E12].

Goals

Requirements

IDRequirementPriorityReference
R1Start from an exception in the case system and assemble an evidence set from the case system and document repository only.P0[E09, E01, Scenario ¶3]
R2Retrieve as the requesting user, using source-system permission checks and existing access groups; inaccessible sources never appear.P0[E07, E14]
R3Claim-level citations: every material claim links to its source passage; an untraced claim blocks submission until sourced or removed.P0[E03, E06, A12]
R4Sources panel: what was searched, included, excluded, and why.P0[E04, Scenario ¶2]
R5Inline uncertainty: low-confidence or unreconciled findings explained in place and requiring the analyst's confirmation.P0[E13, Scenario ¶2]
R6Permission and revocation re-check when a draft is opened, submitted and exported; revoked sources removed and dependent claims flagged.P0[E11, A4]
R7One standard packet template, copy-ready for the case system.P0[E05, E10]
R8Reviewer actions: verify each claim in place, return with comments, approve; disposition recorded by a human only.P0[Scenario ¶2, E06]
R9Audit record per packet: approver, source set, model and prompt version, edits, disposition, written to append-only storage.P0[E06, E14, A9]
R10Export withholds restricted sources entirely and states that something was withheld.P0[E07, E14, A5]
R11Failure handling: a source that fails to load is named and the packet cannot be marked complete.P0[Scenario ¶2, E04]
R12AI change control: no AI-generated assumption, claim, decision, prompt or command is silently overwritten; each change is a new version with the original kept, a human approves it, and the audit log records who, what and why.P0[E06, E11, E13, E14]
R13References, not copies: the packet stores source IDs, versions and passage locations; passages are read in place under the viewer's permissions; no central copy of source data.P0[Scenario ¶1, E07, E11, A18]
R14Usage instrumentation and an abandonment-reason prompt; fixed adoption report for the operations leader and renewal sponsor.P1[E02, E12, E05]
R15Write-back of packet or disposition to the case system, if the connector supports it.P1[E10, A11]

The constraints, changes and AI decisions are logged on the Constraints tab. User stories for each evidence item are on the Evidence to user stories tab; the frame-by-frame workflow is on Materials to send.

Solution architecture on Kamiwaza's secure, decentralized model

S's direction (Nov 3): follow Kamiwaza's product architecture and its secure, decentralized Inference Mesh. That fits the case: Northstar's data cannot leave its environment [Scenario ¶1].

  • Data stays where it lives. The Distributed Data Engine and Connector Framework query the case system and document repository in place; there is no central copy or data lake. [A18 (design choice)] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Inference runs locally. Inference Mesh runs drafting on Northstar's on-prem model endpoints; "all Inference Mesh processing happens locally within your secure environment". [E14] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Packets hold references, not copies. A packet stores source IDs, versions and passage locations; passages are read in place when someone views the packet, under that viewer's permissions. This is a design choice (A18), and it supports the re-check in E11. [E07, E11, A18]
  • Conflicts are shown, not merged away. The mesh's "result synthesis" merges responses and resolves conflicts; for review packets, conflicting records stay visible and need a person's confirmation. [E13, Scenario ¶2] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Authorization and audit across every layer. Secure AI Authorization (ReBAC) and Activity Logging and Audit. [E07, E06, A17] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]

The component-by-component map is on the Client environment tab. Which Kamiwaza components Northstar has deployed is not stated in the case [A19, N15].

Non-functional

  • Runs entirely on Northstar's on-prem deployment and model endpoints [Scenario ¶1, E14].
  • No new identity system or connectors [E07, E09, Scenario ¶4].
  • Audit writes to existing append-only storage [E14].
  • Response time and scale targets: not known; set once case volume is known [N5].

Measures

TypeMeasureBaselineTargetReference
LeadingShare of eligible weekly cases using the packet more than once18% (draft-summary pilot)Agree with operations leader in week 1 (proposal: clearly above 18% in the pilot team by week 10)[E02]
LeadingShare of submitted packets with an untraced material claim14% of sampled summaries had oneZero, enforced by the citation gate (R3)[E03]
LeadingShare of packets reformatted before review27% of pilot outputsProposal: under 10% (assumption)[E10]
LeadingReviewer returns per case, and reviewer re-opens of source systemsNot known (N4)Set baseline in weeks 1-5[Scenario ¶2, E04]
OutcomeMedian time from exception creation to authorized dispositionNot known (N3)Operations leader's target: 40% lower this quarter (E05)[Scenario ¶3, E05]
OutcomeAnalyst hours locating and reconciling per case4.2 h median (of 11.5 h)Proposal: measurable drop in pilot team (assumption)[E01]
GuardrailPermission incidents (revoked or restricted content shown)3 pilot cases with revoked documentZero[E11]
GuardrailPackets with complete audit recordRequirement100%[E06]

Response to commercial pressure

The CTO's demo ask (five systems, autonomous research, automatic disposition (conflicts with RULE; not planned), configurable dashboard) has no estimate [E08] and conflicts with compliance [E06] and connector capacity [E09]. The operations leader will accept a narrower release used consistently [E05], and the renewal sponsor does not need all five connectors at launch [E12]. Proposed demo: the real governed workflow on two sources, early adoption numbers, and a dated connector roadmap with security reviews [E09, E12]. Agree this scope with the CTO in week 1, in writing.

Next validation and what would change direction

  • Sample recent cases to see where the evidence lives; if most of it sits outside the two connected systems, the first new connector and its security review move into the plan [A1, E09].
  • Interview pilot users who stopped; if abandonment is not about trust or rework, fix that cause first [A2, E02].
  • Confirm with compliance what counts as a material claim and which audit fields are required [A12, E06].
  • Test the permission re-check against a revoked document, as in the incident [A4, E11].
Tab 2

PRD v1 (kept): evidence-linked review packet

RULE (S): Never fully automatic. In every release, now and in future, disposition is governed by humans in multiple layers. Release 1: a named human records the final disposition; the system never does. Later releases may add assistance, but never remove the human layers. [E06]

S's words (email, Nov 3, 2026, 9:10 PM IST): "Even in future releases it is never fully automatic, it should be governed by humans in multiple layers. Highlight this in red as a RULE." Earlier (8:52 PM IST): "this should be in release 1 - Humans record final disposition is always a priority. Even in automatic disposition, the interactions are layers with humans and it is never fully 100% automatic, as it will increase the turn around time to mitigate risk or catch on right time. This is a RULE"

Fits the PDFs: compliance requires the final disposition in the auditable record and has not approved automated dispositions [E06]. This is a permanent product rule, not a scope item: it is never out of scope, never deferred and never removed. Logged as C34.

Version: v1, kept unchanged. The layered version for cross-functional readers is PRD v2. Prep draft by Tab from the four PDFs, for S to review. Not the submission: the instructions require the brief and mock to come out of S's own recorded session [Instructions: recording, Instructions: AI use].

Considered fact from the PDFs, with its reference Assumed not in the PDFs, with the reason Not in scope / not known excluded or unknown

Principle: AI work is never silently overwritten

Every AI-generated assumption, claim, decision, prompt and command is logged and versioned. A change creates a new version; a human approves it; the original stays in the audit trail. [E06, E14]

  • Revoked document (E11): removing it from a draft creates a new version, flags the claims that relied on it, and needs the analyst's re-approval; the earlier version is kept, with the content itself withheld from anyone who has lost access. [E11, E07]
  • Low confidence (E13): an uncertain finding is confirmed or changed by a person, never auto-resolved; the confirmation is logged. [E13]
  • Security (E14): the record lives in the existing append-only audit storage, so history cannot be rewritten. [E14]
  • Kamiwaza's platform names "Activity Logging and Audit": an audit trail for user actions, system events and AI agent activities with immutable, append-only logging. [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]

Summary

Northstar's analysts lose hours finding and reconciling records [E01], and the pilot's drafts are not trusted enough to reuse [E02, E03, E04]. The first release turns the pilot into a governed review packet built from the two systems that already have reliable connectors [E09]: every material claim is cited [E06], omissions are explained [E04], uncertainty needs confirmation [E13], permissions are re-checked [E07, E11], and a human reviewer records the disposition [Scenario ¶2, E06]. It fits two engineers and one designer for four weeks [Scenario ¶4, E09] and lands as the week-6 release and demo, leaving about four weeks of usage data before the renewal decision [E12, A6, A8].

Working title (a naming choice, not a customer fact): Evidence-linked review packet. Primary user: operations analyst [Scenario ¶1, E01, E04]. Secondary user: authorized reviewer [Scenario ¶2]. Decision owner: operations leader for scope, reviewer for each disposition [A15].

Part A Considered: facts from the PDFs

Customer and context

  • Northstar Financial is a fictional regional financial-services company. [Scenario ¶1]
  • It runs Kamiwaza on premises because operational and customer data cannot leave its environment. [Scenario ¶1]
  • The workflow: analysts investigate service exceptions, assemble evidence from several internal systems, recommend a disposition, and send the case to an authorized reviewer. [Scenario ¶1]
  • The analyst must find and reconcile records and distinguish reliable evidence from unresolved uncertainty; the reviewer checks the evidence, returns the case for more work when needed, and records the final disposition. [Scenario ¶2]
  • Today analysts move among several systems, manually assemble the review packet, and copy the outcome back into the case system. [Scenario ¶2, E10]
  • Reviewers may repeat parts of the investigation when a claim lacks a clear source or the packet does not explain what was omitted. [Scenario ¶2, E04]
  • The current pilot can retrieve internal material and draft a case summary. [Scenario ¶4]

Goal stated by the customer

  • Shorten the time from exception creation to an authorized, auditable disposition. [Scenario ¶3]
  • The first release should reduce effort finding and reconciling evidence, make the packet more consistent, and let a reviewer verify every material claim without weakening source permissions or human approval. [Scenario ¶3]
  • Northstar also needs measurable adoption and a credible path to broader source coverage before an upcoming renewal decision. [Scenario ¶3, E12]
  • The assignment: a first release that makes the review materially faster without weakening traceability, access control, or human accountability. [Scenario: assignment]

Problem evidence

  • Analysts spend a median 11.5 hours per exception case; 4.2 hours go to locating and reconciling source records. Limitation: six interviews from one team. [E01]
  • 18% of eligible weekly cases used the draft-summary pilot more than once. Limitation: eight-week pilot; instrumentation does not explain abandonment. [E02]
  • 84% of sampled summaries were materially accurate; 14% contained at least one claim reviewers could not trace to a displayed source. Limitation: fifty sampled cases; reviewers used the current manual standard. [E03]
  • Analysts value a starting draft but reopen source systems because the draft does not show why a source was selected or what was omitted (four of six interviews). [E04]
  • 27% of pilot outputs are manually reformatted before review; users copy the final packet into the case system (63 support-tagged cases). [E10]
  • In three pilot cases a revoked document stayed in an already generated draft until the user refreshed the evidence set; no customer data was exposed outside authorized users. [E11]
  • Users missed low-confidence language shown only as a small badge; they noticed an inline explanation and a required confirmation step (five participants). [E13]

Stakeholder asks (some conflict)

  • Operations leader: standardize the final review packet and cut median case cycle time by 40% this quarter; would accept a narrower first release if used consistently. A commercial commitment has been discussed with executives. [E05]
  • CTO: the six-week executive demo should show all five source systems, autonomous research, automatic disposition (conflicts with RULE; not planned), and a configurable executive dashboard. No engineering estimate exists. [E08]
  • Renewal sponsor: wants proof of measurable adoption and a credible path to broader source coverage, not necessarily all five connectors at launch. Renewal decision in ten weeks. [E12]

Constraints

  • RULE (S): never fully automatic. In every release, humans govern disposition in multiple layers; in Release 1 a named human records the final disposition and the system never does. [E06, RULE]
  • Every material claim must link to an authorized source; the system must keep the human approver, source set, model and prompt version, edits, and final disposition in an auditable record. Automated dispositions are not approved. [E06]
  • A user must not see or retrieve a source they could not access in the underlying system; exported packets must not reveal restricted content. Existing access groups are available; a new identity system is not. [E07]
  • Reliable connectors exist for the case system and document repository; ticketing, call-recording and policy systems each need a new connector and security review. [E09]
  • Two engineers are available for four weeks before one moves to another commitment. The delivery team for the first four weeks is two engineers and one product designer. [E09, Scenario ¶4]
  • Leadership wants a credible first release in six weeks; broader integrations, model training, and new identity infrastructure are unavailable in that window. [Scenario ¶4]
  • The deployment has on-prem model endpoints, role groups, append-only audit storage, and source-system permission checks; it lacks field-level redaction across all sources. [E14]

What the submission must show (from the instructions)

  • Brief of no more than 1,000 words with the template sections; 4-6 frame low-fi mock with at least one uncertainty, failure or permissions state. [Instructions: what to submit, Brief template]
  • Use evidence IDs for material decisions; distinguish supplied facts from assumptions; explain how an unresolved assumption affects the first-release choice; do not invent customer facts. [Instructions: sequence, Scenario: assignment]

Kamiwaza platform context (real company, not case facts)

The case is synthetic and does not expect product knowledge [Instructions: purpose]. These come from the research file, each with its source and verification label.

  • Kamiwaza supports on-premises deployment as a first-class option. [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza describes permission-aware retrieval: each agent runs in the requesting user's context and permissions resolve at query time. [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza describes an append-only audit trail per agent action (user context, data accessed, permission rule, timestamp). [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza's own security page says protecting source data does not automatically cover derived data such as embeddings, and logging after the fact does not prevent over-exposure at answer time. [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Claim that revocation takes effect immediately because permissions resolve at query time; latency of source-system permission sync is not documented. [Kamiwaza research: source · vendor claim, unverified]
  • HIPAA / SOC 2 support claims. [Kamiwaza research: source · vendor claim, unverified]
  • Kamiwaza's product page names a Distributed Data Engine that processes data where it lives, without migration, and a Connector Framework. [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kamiwaza's Inference Mesh page: inference is routed to data across distributed systems, and all processing happens locally within the customer's secure environment. [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]

Part B Assumed

Each item is an assumption, not a customer fact. The instructions ask how unresolved assumptions affect the first-release choice [Instructions: sequence]; that is the "effect" line.

  1. Assumption A1 The case system and document repository hold enough of each case's evidence for a two-source release to save meaningful time. [E09, E01]

    Why assumed: E09 limits the release to these two connectors, but no PDF says what share of evidence lives in each system.

    Effect on first release: If false, the release saves less than the 4.2 hours in E01 and a new connector moves up. Validate in week 1 by sampling recent cases.

  2. Assumption A2 Low repeat use is driven mainly by trust and rework (untraced claims, unexplained omissions, reformatting), not by access, training or case mix. [E02, E03, E04, E10]

    Why assumed: E03, E04 and E10 point at trust and rework, but E02's instrumentation does not explain abandonment.

    Effect on first release: If wrong, traceability features will not lift adoption. Validate with interviews of users who stopped and an abandonment-reason prompt.

  3. Assumption A3 Locating and reconciling (4.2 h) is the most addressable part of the 11.5 h case time. [E01]

    Why assumed: It is the only component E01 breaks out; the rest of the 11.5 h is not itemized.

    Effect on first release: Sets the analyst-time measure. Reviewer time is not measured anywhere (N4).

  4. Assumption A4 Source-system permission checks can be called again when a draft is opened, submitted and exported, not only when evidence is first retrieved. [E14, E11]

    Why assumed: E14 lists permission checks; E11 shows a generated draft can outlive a permission.

    Effect on first release: Core to the permissions design. If checks only run at retrieval, re-check needs extra engineering in weeks 2-3.

  5. Assumption A5 Without field-level redaction, the safe export behavior is to withhold a restricted source entirely and show that something was withheld. [E07, E14]

    Why assumed: E07 forbids revealing restricted content and E14 says field-level redaction does not exist.

    Effect on first release: Exports may be less complete for some recipients; the reviewer still sees what they are authorized to see.

  6. Assumption A6 The six-week executive demo and the credible first release are the same week-6 milestone. [E08, Scenario ¶4]

    Why assumed: Both are stated as six weeks (E08, Scenario) but never linked explicitly.

    Effect on first release: The plan converges on one week-6 deliverable instead of two.

  7. Assumption A7 After week 4 one engineer remains; designer availability after week 4 is not stated; the plan assumes none. [E09, Scenario ¶4]

    Why assumed: E09 says one of two engineers moves after four weeks; the Scenario only describes the team for the first four weeks.

    Effect on first release: Weeks 5-6 carry hardening and rollout only, no new scope.

  8. Assumption A8 The six-week and ten-week clocks start on the same day. [E12, E14]

    Why assumed: No calendar dates appear in the PDFs; the case date is fictional (E14).

    Effect on first release: Leaves about four weeks of real usage between release (week 6) and renewal (week 10).

  9. Assumption A9 The deployment can record the model and prompt version used for each draft. [E06, E14]

    Why assumed: E06 requires it and E14 lists on-prem model endpoints, but capture is not confirmed.

    Effect on first release: If not, audit-record work grows in week 1-2.

  10. Assumption A10 The current pilot's retrieval and drafting can be extended rather than rebuilt. [Scenario ¶4]

    Why assumed: The Scenario says the pilot already retrieves internal material and drafts a summary.

    Effect on first release: Makes the four-week build feasible. If the pilot must be rebuilt, scope shrinks.

  11. Assumption A11 The case-system connector reads reliably; whether it can write the packet or disposition back is unknown. [E09, E10]

    Why assumed: E09 says the connector is reliable but not what it supports; E10 says users copy the packet in by hand.

    Effect on first release: Release produces a copy-ready packet; automatic write-back is a stretch item.

  12. Assumption A12 A material claim means any factual statement in the findings or recommendation that a reviewer relies on. [E06]

    Why assumed: E06 uses the term without defining it.

    Effect on first release: Defines what the citation gate blocks. Confirm with compliance in week 1.

  13. Assumption A13 Cycle time can be measured from case-system timestamps (exception created to disposition recorded). [Scenario ¶3, E05]

    Why assumed: The Scenario defines the goal this way; data availability is not stated.

    Effect on first release: Needed for the outcome measure and the E05 target.

  14. Assumption A14 The delivery team (two engineers, one designer) is the team building this release; whose employees they are is not stated. [Scenario ¶4]

    Why assumed: The Scenario names the team without an employer.

    Effect on first release: Does not change scope; matters for who runs the week-1 validation.

  15. Assumption A15 Product decision owner is the operations leader; each case's disposition owner is the authorized reviewer. [E05, Scenario ¶2, Brief template]

    Why assumed: The template asks for a decision owner but the PDFs name none for the product.

    Effect on first release: Shapes who signs off scope in week 1.

  16. Assumption A16 Proposed targets for measures (where shown) are proposals, not customer facts. [E05]

    Why assumed: The PDFs give baselines (E01, E02, E03, E10, E11) and one target (E05), nothing else.

    Effect on first release: Targets should be agreed with the operations leader in week 1.

  17. Assumption A17 The role groups and source-system permission checks in E14 can be enforced through Kamiwaza's Secure AI Authorization (ReBAC). [E14, E07]

    Why assumed: The case names role groups and permission checks; the product page names ReBAC. How they connect at Northstar is not stated.

    Effect on first release: If they don't connect, retrieval must call each source system's own check, which costs engineering time in weeks 2-3.

  18. Assumption A18 A packet can store references (source IDs, versions, passage locations) instead of copies, and render passages in place at view time. [Scenario ¶1, E10]

    Why assumed: This follows the decentralized model (no central copy) and S's architecture direction; nothing in the case says the review process requires stored copies.

    Effect on first release: If the case system needs full-text packets (E10), the export step copies only what the recipient may see.

  19. Assumption A19 Northstar's Kamiwaza deployment includes the product components the plan uses (Distributed Data Engine, Retrieval Service, Inference Mesh, authorization, audit, Model Management). [Scenario ¶1, E14]

    Why assumed: The case says Northstar runs Kamiwaza on premises but lists only the components in E14.

    Effect on first release: If a component is missing, scope moves to what the deployment has. Check in week 1.

Part C Not in scope, and not known

Not in scope for the first release

ExcludedWhyReference
Autonomous researchEvery material claim must trace to an authorized source and the review stays human-led; no estimate exists for it.[E06, E08]
Ticketing, call-recording and policy connectorsEach needs a new connector and security review; broader integrations are unavailable in the window. Kept on the roadmap.[E09, Scenario ¶4]
Configurable executive dashboardNot needed for the renewal ask; replaced by a fixed adoption report.[E08, E12]
Field-level redactionThe deployment does not have it across sources.[E14]
Model training or fine-tuningUnavailable in the window.[Scenario ¶4]
New identity infrastructureUnavailable; existing access groups only.[E07, Scenario ¶4]

Not known (gaps in the evidence)

  1. N1 How much of each case's evidence lives in each of the five systems. [E09]
  2. N2 Why pilot users stopped using the draft summary. [E02]
  3. N3 Absolute baseline for median case cycle time (only analyst hours are given). [E01, E05]
  4. N4 Reviewer time per case and how often cases are returned. [Scenario ¶2]
  5. N5 Case volume per week, and the number of analysts and reviewers. [E02]
  6. N6 When "this quarter" ends for the 40% target, and what was committed to executives. [E05]
  7. N7 Calendar dates for the six-week release, demo and ten-week renewal. [Scenario ¶4, E08, E12, E14]
  8. N8 Whether the case-system connector supports write-back. [E09, E10]
  9. N9 How fast source-system permission changes propagate. [E11, E14]
  10. N10 Compliance's definition of a material claim. [E06]
  11. N11 Designer and engineering capacity after week 4 (beyond one engineer leaving). [E09, Scenario ¶4]
  12. N12 Who the renewal sponsor is and what counts as a credible path. [E12]
  13. N13 The submission deadline for this exercise (not in the PDFs; per invitation). [Instructions: upload]
  14. N14 Whether Northstar's systems sit in one data center or several (mesh nodes). [Scenario ¶1]
  15. N15 Which Kamiwaza components and edition Northstar has deployed. [Scenario ¶1, E14]

Proposal (built on Parts A to C)

Problem statement

An analyst cannot hand a reviewer a packet the reviewer can verify without redoing the work. Evidence is spread across systems [Scenario ¶2, E01], drafts hide why sources were chosen or omitted [E04], some claims are untraceable [E03], and packets are reformatted and retyped [E10].

Users

  • Operations analyst (primary): investigates, reconciles, drafts and recommends [Scenario ¶1, Scenario ¶2].
  • Authorized reviewer: verifies, returns or approves, records the disposition [Scenario ¶2].
  • Operations leader: wants a standard packet and shorter cycle time [E05].
  • Compliance lead: traceability, audit record, access rules [E06, E07].
  • CTO and renewal sponsor: demo and renewal evidence [E08, E12].

Goals

Requirements

IDRequirementPriorityReference
R1Start from an exception in the case system and assemble an evidence set from the case system and document repository only.P0[E09, E01, Scenario ¶3]
R2Retrieve as the requesting user, using source-system permission checks and existing access groups; inaccessible sources never appear.P0[E07, E14]
R3Claim-level citations: every material claim links to its source passage; an untraced claim blocks submission until sourced or removed.P0[E03, E06, A12]
R4Sources panel: what was searched, included, excluded, and why.P0[E04, Scenario ¶2]
R5Inline uncertainty: low-confidence or unreconciled findings explained in place and requiring the analyst's confirmation.P0[E13, Scenario ¶2]
R6Permission and revocation re-check when a draft is opened, submitted and exported; revoked sources removed and dependent claims flagged.P0[E11, A4]
R7One standard packet template, copy-ready for the case system.P0[E05, E10]
R8Reviewer actions: verify each claim in place, return with comments, approve; disposition recorded by a human only.P0[Scenario ¶2, E06]
R9Audit record per packet: approver, source set, model and prompt version, edits, disposition, written to append-only storage.P0[E06, E14, A9]
R10Export withholds restricted sources entirely and states that something was withheld.P0[E07, E14, A5]
R11Failure handling: a source that fails to load is named and the packet cannot be marked complete.P0[Scenario ¶2, E04]
R12AI change control: no AI-generated assumption, claim, decision, prompt or command is silently overwritten; each change is a new version with the original kept, a human approves it, and the audit log records who, what and why.P0[E06, E11, E13, E14]
R13References, not copies: the packet stores source IDs, versions and passage locations; passages are read in place under the viewer's permissions; no central copy of source data.P0[Scenario ¶1, E07, E11, A18]
R14Usage instrumentation and an abandonment-reason prompt; fixed adoption report for the operations leader and renewal sponsor.P1[E02, E12, E05]
R15Write-back of packet or disposition to the case system, if the connector supports it.P1[E10, A11]

The constraints, changes and AI decisions are logged on the Constraints tab. User stories for each evidence item are on the Evidence to user stories tab; the frame-by-frame workflow is on Materials to send.

Solution architecture on Kamiwaza's secure, decentralized model

S's direction (Nov 3): follow Kamiwaza's product architecture and its secure, decentralized Inference Mesh. That fits the case: Northstar's data cannot leave its environment [Scenario ¶1].

  • Data stays where it lives. The Distributed Data Engine and Connector Framework query the case system and document repository in place; there is no central copy or data lake. [A18 (design choice)] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Inference runs locally. Inference Mesh runs drafting on Northstar's on-prem model endpoints; "all Inference Mesh processing happens locally within your secure environment". [E14] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Packets hold references, not copies. A packet stores source IDs, versions and passage locations; passages are read in place when someone views the packet, under that viewer's permissions. This is a design choice (A18), and it supports the re-check in E11. [E07, E11, A18]
  • Conflicts are shown, not merged away. The mesh's "result synthesis" merges responses and resolves conflicts; for review packets, conflicting records stay visible and need a person's confirmation. [E13, Scenario ¶2] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Authorization and audit across every layer. Secure AI Authorization (ReBAC) and Activity Logging and Audit. [E07, E06, A17] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]

The component-by-component map is on the Client environment tab. Which Kamiwaza components Northstar has deployed is not stated in the case [A19, N15].

Non-functional

  • Runs entirely on Northstar's on-prem deployment and model endpoints [Scenario ¶1, E14].
  • No new identity system or connectors [E07, E09, Scenario ¶4].
  • Audit writes to existing append-only storage [E14].
  • Response time and scale targets: not known; set once case volume is known [N5].

Measures

TypeMeasureBaselineTargetReference
LeadingShare of eligible weekly cases using the packet more than once18% (draft-summary pilot)Agree with operations leader in week 1 (proposal: clearly above 18% in the pilot team by week 10)[E02]
LeadingShare of submitted packets with an untraced material claim14% of sampled summaries had oneZero, enforced by the citation gate (R3)[E03]
LeadingShare of packets reformatted before review27% of pilot outputsProposal: under 10% (assumption)[E10]
LeadingReviewer returns per case, and reviewer re-opens of source systemsNot known (N4)Set baseline in weeks 1-5[Scenario ¶2, E04]
OutcomeMedian time from exception creation to authorized dispositionNot known (N3)Operations leader's target: 40% lower this quarter (E05)[Scenario ¶3, E05]
OutcomeAnalyst hours locating and reconciling per case4.2 h median (of 11.5 h)Proposal: measurable drop in pilot team (assumption)[E01]
GuardrailPermission incidents (revoked or restricted content shown)3 pilot cases with revoked documentZero[E11]
GuardrailPackets with complete audit recordRequirement100%[E06]

Response to commercial pressure

The CTO's demo ask (five systems, autonomous research, automatic disposition (conflicts with RULE; not planned), configurable dashboard) has no estimate [E08] and conflicts with compliance [E06] and connector capacity [E09]. The operations leader will accept a narrower release used consistently [E05], and the renewal sponsor does not need all five connectors at launch [E12]. Proposed demo: the real governed workflow on two sources, early adoption numbers, and a dated connector roadmap with security reviews [E09, E12]. Agree this scope with the CTO in week 1, in writing.

Next validation and what would change direction

  • Sample recent cases to see where the evidence lives; if most of it sits outside the two connected systems, the first new connector and its security review move into the plan [A1, E09].
  • Interview pilot users who stopped; if abandonment is not about trust or rework, fix that cause first [A2, E02].
  • Confirm with compliance what counts as a material claim and which audit fields are required [A12, E06].
  • Test the permission re-check against a revoked document, as in the incident [A4, E11].
Tab 3

Client working environment

Northstar Financial as described in the Customer Scenario and Evidence Pack, shown on Kamiwaza's product architecture (S's direction, Nov 3). Everything here is referenced; gaps are marked as not known or as assumptions from the PRD.

Northstar's operational review on Kamiwaza's product architecture Analysts and reviewers use a proposed review packet app built on Kamiwaza's Apps and Tools, Orchestration Engine and Security and Compliance layers, reaching five Northstar source systems on premises. Two sources are connected; three need new connectors and security review. NORTHSTAR ON-PREM ENVIRONMENT (Scenario ¶1) PEOPLE (Scenario ¶2) Operations analystdrafts, confirms, submits Authorized reviewerverifies, returns, decides Review packet app (proposed first release)citations · sources panel · confirmations · audit APPS AND TOOLS Model Managementmodel versions (E06) SDK & APIhow it is built Kaizen, Tool Shedout of first release ORCHESTRATION ENGINE Retrieval Serviceevidence set (E01) Semantic Searchfind, then cite Embedding/Vectorre-check perms Data Enginedata stays put Context Managerassess, week 1 Inference Meshon-prem models SECURITY AND COMPLIANCE (all layers) ReBAC authzaccess (E07, E14) Audit logappend-only (E06) Workroomslater, assess CONNECTOR FRAMEWORK (E09) Case systemreliable connector Document repositoryreliable connector Ticketingneeds connector Call recordingneeds connector Policy systemneeds connector Dashed: out of first release, or needs work (E09). Tap a component for its source (kamiwaza.com/product). TODAY, WITHOUT THE APP (Scenario ¶2, E10) Packets assembled by hand; outcome copied back into the case system. DELIVERY CONSTRAINTS 2 engineers + 1 designer, weeks 1-4 (¶4, E09)Then 1 engineer; designer after week 4 not statedRelease + executive demo: week 6 (¶4, E08)Renewal decision: week 10 (E12)No broader integrations, model training, new identity (¶4)
Northstar's review workflow running on Kamiwaza's product architecture. Solid: in the first release. Dashed: later, out of scope, or needs a new connector (E09). Layers as grouped on kamiwaza.com/product; "¶" = Customer Scenario paragraph.

Current workflow (as is)

  1. An operational exception needs a documented decision; a case starts. [Scenario ¶2]
  2. The analyst works out what happened, moving among several systems. [Scenario ¶2]
  3. The analyst finds and reconciles the relevant records and separates reliable evidence from uncertainty. [Scenario ¶2, E01]
  4. The analyst assembles the review packet by hand (pilot users may start from a drafted summary, then reformat it). [Scenario ¶2, Scenario ¶4, E10]
  5. The analyst recommends a disposition and sends the case to an authorized reviewer. [Scenario ¶1]
  6. The reviewer checks the evidence and may repeat parts of the investigation, or returns the case for more work. [Scenario ¶2, E04]
  7. The reviewer records the final disposition. [Scenario ¶2]
  8. The outcome is copied back into the case system. [Scenario ¶2, E10]

Pain points

  • 11.5 h median per case; 4.2 h locating and reconciling [E01].
  • Draft reuse low: 18% of eligible weekly cases used it more than once [E02].
  • 14% of sampled summaries had an untraceable claim [E03].
  • Analysts reopen source systems; omissions are not explained [E04].
  • 27% of outputs reformatted; packets retyped into the case system [E10].
  • Revoked documents stayed in three generated drafts until refresh [E11].
  • Small low-confidence badges were missed [E13].

Architecture: Kamiwaza's secure, decentralized model

S asked (Nov 3) that the client environment follow Kamiwaza's product architecture and its secure, decentralized Inference Mesh. The case itself only says Northstar runs Kamiwaza on premises and lists the components in E14 [Scenario ¶1, E14]; mapping Northstar onto the full product is Tab's interpretation [A19].

How the decentralized model applies here

  • Data stays where it lives; no central copy or data lake. [Scenario ¶1] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Inference runs locally on Northstar's on-prem model endpoints; nothing goes to a service outside its control. [Scenario ¶1, E14] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Routing finds which systems hold relevant data and queries them in place; for the first release that is the case system and document repository. [E09] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Boundaries are preserved: each system's own permissions apply where its data sits. [E07, E14] [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]

Component map

Each component as named on Kamiwaza's product page, with its role in Northstar's review and whether the first release uses it. Nothing here was marked unverified: every component was read on the page on Nov 3, 2026.

ComponentLayer (as grouped on the page)What the page saysRole in Northstar's reviewFirst releaseReference
Distributed Data EngineOrchestration EngineConnects to enterprise data sources and processes data where it lives, without migration.Reaches the case system and document repository inside Northstar's environment; data does not leave.Release 1[Scenario ¶1, E09] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Connector FrameworkApps and ToolsStandardized connector architecture (Microsoft 365, S3, SharePoint, Outlook, Gmail, Slack, and more).Hosts the two reliable connectors; ticketing, call-recording and policy connectors come later, each with a security review.Release 1 (2 connectors); roadmap for 3[E09] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Tool ShedApps and ToolsCatalog of secure connectors that let agents interact with databases, mainframes, APIs and operational tools.Not needed for the first release: no agent takes actions in Northstar systems.Out of first release[E06, E08] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Retrieval ServiceOrchestration EngineOne unified service for retrieval from any connected source, without managing adapters.Builds the evidence set for each case, as the requesting user.Release 1[E01, E07] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Semantic SearchOrchestration EngineSemantic search, keyword matching and knowledge-graph traversal with automatic summarization.Finds candidate records; every summary claim must still cite a source passage.Release 1[E03, E04] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Embedding and Vector ServiceOrchestration EngineText-to-vector conversion and vector database management for semantic search.Supports search. Derived data such as embeddings is not automatically protected by source permissions (Kamiwaza's own security page [Kamiwaza research: source · stated on Kamiwaza's page (read Nov 3, 2026)]), so results are re-checked against source permissions before display.Release 1[E07, E14] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Context ManagerOrchestration EngineDiscovers data and maps relationships across the enterprise to create a living ontology.Could help reconcile related records. Its "always up to date" claim is the vendor's; E11 shows a pilot draft kept a revoked document, so the packet re-checks permissions regardless.Assess in week 1; not relied on for permissions[E01, E11] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Inference MeshOrchestration EngineSilicon-agnostic orchestration that routes AI workloads to data across cloud, on-prem and edge.Runs drafting on Northstar's on-prem model endpoints.Release 1[E14, Scenario ¶1] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Model ManagementApps and ToolsModel repository with lifecycle management, including versioning.Source of the model version recorded in each packet's audit record.Release 1[E06] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Secure AI Authorization (ReBAC)Security and ComplianceRelationship-based access control with a unified graph engine and full auditability.Enforces that users see only sources they can access. The case names role groups and source-system permission checks, not ReBAC; how they map is an assumption (A17).Release 1[E07, E14] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Activity Logging and AuditSecurity and ComplianceAudit trail for user actions, system events and AI agent activities, with immutable, append-only logging.Holds the packet audit record: approver, sources, model and prompt version, edits, disposition, and every AI change with its original.Release 1[E06, E14] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
WorkroomsSecurity and ComplianceIsolated multi-tenant execution spaces with compartmentalized access controls and ephemeral sessions.Possible per-case review space later; not needed to meet the first-release goal.Later (assess)[E07] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
KaizenApps and ToolsConversational agent that can take multi-step actions inside the firewall.Autonomous multi-step actions are out of scope (traceable human review). Disposition is never automatic, by the RULE.Out of first release[E06, E08] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
App GardenApps and ToolsLibrary of production-ready AI applications that deploy to secure infrastructure.Where the review-packet app could be deployed; whether a suitable app exists is not known.Assess in week 1[Scenario ¶4] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
Observability and MonitoringDeveloper ExperienceMonitoring to detect anomalies, investigate incidents and demonstrate compliance.Usage and adoption measures, incident checks.Release 1[E02, E11, E12] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
SDK & APIDeveloper ExperienceOpenAI-compatible APIs, MCP extensibility, Python SDK.How the two engineers build the packet app on the platform.Release 1[E09] [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]

People and roles

RoleWhat they do or wantReference
Operations analystsInvestigate service exceptions, find and reconcile records, separate reliable evidence from uncertainty, assemble the packet, recommend a disposition. Spend a median 11.5 h per case, 4.2 h locating and reconciling.[Scenario ¶1, Scenario ¶2, E01, E04]
Authorized reviewerChecks the evidence, returns the case for more work when needed, records the final disposition. Repeats investigation when claims lack sources.[Scenario ¶2]
Operations leaderWants a standard final packet and 40% lower median cycle time this quarter; accepts a narrower release used consistently. Has discussed a commercial commitment with executives.[E05]
Compliance leadRequires claim-to-source links, an audit record (approver, sources, model and prompt version, edits, disposition), source-level access rules and safe exports. Has not approved automated dispositions.[E06, E07]
CTOWants a six-week executive demo with five systems, autonomous research, automatic disposition (conflicts with RULE; not planned) and a configurable dashboard. No estimate exists.[E08]
Renewal sponsorWants proof of measurable adoption and a credible path to broader coverage before the renewal decision in ten weeks.[E12]
EngineeringTwo engineers for four weeks, then one moves to another commitment. Found reliable connectors for two systems only.[E09]
Product designerPart of the first-four-weeks team. A designer usability session (five participants) found that small badges are missed (E13); who ran it is not stated.[Scenario ¶4, E13]
SupportObserved reformatting and copying into the case system across 63 support-tagged cases.[E10]
Security architectureDocumented the deployment's components and the lack of field-level redaction.[E14]

Not known: how many analysts and reviewers there are, case volume, and who employs the delivery team [N5, A14].

Systems and connectors

SystemStateReference
Case systemHolds the case record; outcomes are copied back by hand (Scenario ¶2, E10); where exceptions are first raised is not stated. Reliable connector exists; write-back support unknown.[Scenario ¶2, E09, E10, A11]
Document repositoryReliable connector exists.[E09]
Ticketing systemNeeds a new connector and security review.[E09]
Call-recording systemNeeds a new connector and security review.[E09]
Policy systemNeeds a new connector and security review.[E09]
Kamiwaza (on premises)Hosts the pilot that retrieves internal material and drafts a case summary.[Scenario ¶1, Scenario ¶4]
Platform componentsOn-prem model endpoints, role groups, append-only audit storage, source-system permission checks. No field-level redaction across sources.[E14]
IdentityExisting access groups available; no new identity system.[E07, Scenario ¶4]

Compliance and security constraints

  • Operational and customer data cannot leave Northstar's environment [Scenario ¶1].
  • Every material claim links to an authorized source [E06].
  • Audit record keeps approver, source set, model and prompt version, edits, final disposition [E06].
  • No automated dispositions (not approved) [E06].
  • No user sees or retrieves a source they could not access in the underlying system; exports do not reveal restricted content [E07].
  • No field-level redaction across sources [E14].

Delivery team and timeline

  • Two engineers and one product designer for the first four weeks [Scenario ¶4]; one engineer moves to another commitment after four weeks [E09].
  • Credible first release in six weeks [Scenario ¶4]; executive demo at six weeks [E08]; treated as one milestone [A6].
  • Renewal decision in ten weeks [E12]; both clocks assumed to start together [A8].
  • 40% cycle-time reduction wanted "this quarter"; quarter end not known [E05, N6].
  • Broader integrations, model training and new identity infrastructure are unavailable in the window [Scenario ¶4].
  • Calendar dates: not in the PDFs; the case date is fictional [E14, N7].
Tab 4

Evidence to user stories

One row per evidence item. The problem column restates the evidence; the user story and the "what is being solved" column are product interpretations by Tab, tied to the PRD requirements (R1 to R15 on the PRD tab).

EvidenceUser storyProblemWhat is being solvedThemeReference
E01As an operations analyst, I want the relevant records from the case system and document repository gathered and lined up for me, so that I spend less of each case locating and reconciling sources.Median 11.5 h per case, 4.2 h of it locating and reconciling records (six interviews, one team).Evidence set assembled from the two connected systems, with matching and conflicting records shown side by side (R1).Analyst time[E01, Scenario ¶2, E09]
E02As an operations leader, I want to see how many eligible cases use the packet and why people stop, so that adoption is measurable and abandonment can be fixed.Only 18% of eligible weekly cases used the pilot more than once; instrumentation does not explain why.Usage instrumentation, an abandonment-reason prompt, and interviews in week 1 (R14).Adoption[E02, E12]
E03As an authorized reviewer, I want every material claim linked to the source passage behind it, so that I can verify the packet without redoing the investigation.14% of sampled summaries had a claim reviewers could not trace to a displayed source.Claim-level citations; an untraced claim blocks submission until sourced or removed (R3).Traceability[E03, E06, Scenario ¶2]
E04As an operations analyst, I want the draft to show why each source was selected and what was searched but left out, so that I don't have to reopen the source systems to check.Analysts reopen source systems because the draft hides selection and omissions (four of six interviews).Sources panel: searched, included, excluded, and why (R4).Traceability[E04, Scenario ¶2]
E05As an operations leader, I want every case to produce the same standard review packet, so that reviews are consistent and median cycle time drops.Packets are not standard; the leader wants 40% lower cycle time this quarter and accepts a narrower release used consistently.One fixed packet template; a narrow release aimed at consistent use (R7).Consistency[E05, E10]
E06As a compliance lead, I want each packet's approver, source set, model and prompt version, edits and disposition kept in an auditable record, with a human recording the disposition, so that every disposition is accountable.Required by compliance; automated dispositions are not approved.Audit record to append-only storage; disposition only by a human reviewer (R8, R9).Accountability[E06, E14]
E07As a compliance lead, I want users to see only sources they can open in the source system, and exports to hide restricted content, so that the tool never widens access.Access rules must hold in retrieval and in exports; only existing access groups are available.Retrieval as the requesting user; exports withhold restricted sources entirely (R2, R10).Permissions[E07, E14]
E08As a CTO, I want a six-week executive demo that shows a credible end-to-end workflow and the path to all five systems, so that leadership sees real progress.The demo ask (five systems, autonomous research, automatic disposition (conflicts with RULE; not planned), configurable dashboard) has no estimate and conflicts with E06 and E09.Demo of the governed two-source workflow, adoption numbers and a dated connector roadmap; scope agreed in writing in week 1. (This story reframes the CTO's ask: an interpretation.)Commercial[E08, E06, E09, E12]
E09As a delivery team (two engineers, one designer), I want the first release built on the two connectors that already work, so that we ship within capacity without new security reviews.Three systems need new connectors and security reviews; one engineer leaves after four weeks.Scope limited to case system and document repository; other connectors on the roadmap.Capacity[E09, Scenario ¶4]
E10As an operations analyst, I want the packet produced in the final review format and ready to put into the case system, so that I don't reformat or retype it.27% of pilot outputs are reformatted before review; users copy the final packet into the case system.Standard template output, copy-ready; write-back only if the connector supports it (R7, R15).Consistency[E10, A11]
E11As an analyst or reviewer, I want sources re-checked for revocation whenever a draft is opened, submitted or exported, so that a revoked document never stays in a packet.In three pilot cases a revoked document stayed in a generated draft until refresh.Permission re-check at open, submit and export; revoked sources removed and dependent claims flagged, with the earlier version kept (R6, R12).Permissions[E11, E07, A4]
E12As a Northstar renewal sponsor, I want proof of measurable adoption and a credible plan for broader source coverage, so that I can support the renewal.Renewal decision in ten weeks; all five connectors are not required at launch.Adoption report from the week-6 release; connector roadmap with security reviews sequenced by evidence (R14).Commercial[E12, E09]
E13As an operations analyst, I want low-confidence or unreconciled findings explained inline and requiring my confirmation, so that I don't miss them.Users missed low-confidence language shown only as a small badge (five participants).Inline explanation plus a required confirmation step, logged (R5, R12).Uncertainty[E13, Scenario ¶2]
E14As a security architect, I want the release to use only what the deployment already has and not depend on field-level redaction, so that it passes review without new infrastructure.The deployment has on-prem endpoints, role groups, append-only audit and permission checks, but no field-level redaction.Design uses existing components; withholds whole sources instead of redacting fields (R2, R9, R10).Permissions[E14, E07]
Tab 5

Mind map

The goal in the middle, linked to the problem, personas, evidence, user stories, constraints and solution themes. Tap a branch to jump to its detail below; evidence IDs open the original row, story text opens the user story.

Mind map overview: the central goal linked to problem, personas, evidence, user stories, constraints and solution themes Customer problem1 core problemPersonas8 rolesEvidence E01-E14grouped by themeUser stories14, one per itemConstraints8 limitsSolution themes6 themes Faster, auditableexception reviewScenario ¶3, assignment
Faster, auditable exception review, without weakening traceability, access control or human accountability [Scenario ¶3, Scenario: assignment]

Customer problem

  • Analyst cannot hand the reviewer a packet the reviewer can verify without redoing the work [Scenario ¶2]
    • 11.5 h per case, 4.2 h locating and reconciling [E01]
    • Pilot reuse only 18% [E02]
    • 14% of summaries had an untraced claim [E03]
    • Omissions not explained; analysts reopen systems [E04]
    • 27% reformatted; retyped into case system [E10]

Personas

Solution themes, with evidence and user stories

Constraints

  • 2 engineers + 1 designer for 4 weeks [Scenario ¶4]
  • One engineer leaves after week 4 [E09]
  • Release and demo at week 6 [Scenario ¶4, E08]
  • Renewal decision at week 10 [E12]
  • RULE (S): never fully automatic; humans govern disposition in every release; Release 1: a named human records it [E06, RULE]
  • No automated disposition [E06]
  • Existing access groups only [E07]
  • No field-level redaction [E14]
  • No broader integrations, model training or new identity infrastructure in the window [Scenario ¶4]

Kamiwaza architecture (secure, decentralized)

  • Inference Mesh: inference runs locally, data stays put [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Distributed Data Engine + Connector Framework [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
    • 2 sources now, 3 later [E09]
  • Retrieval Service, Semantic Search [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
    • Evidence set, cited claims [E01, E03]
  • ReBAC authorization, Activity Logging and Audit [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
  • Kaizen, Tool Shed: out of first release [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)]
    • No autonomous actions or dispositions [E06, E08]

Principle: AI work never silently overwritten

  • Logged, versioned, human-approved, original kept [E06, E14]
    • Revoked document: new version, re-approval [E11]
    • Low confidence: person confirms [E13]
    • Append-only audit storage [E14]

Out of scope (first release)

  • Autonomous research [E06, E08]
  • Ticketing, call-recording, policy connectors (roadmap) [E09]
  • Configurable executive dashboard [E08, E12]
Draft for S to review and rewrite in her own recorded session
Tab 6

Materials to send

The instructions require the brief and mock to be produced in a recorded session with AI use visible, and do not permit human assistance [Instructions: recording, Instructions: AI use]. Treat these as a prep reference, not as files to upload. Upload formats: PDF preferred for the brief and mock [Instructions: what to submit, Instructions: upload].

1. Product brief (draft)

Word count: 988 of 1,000 maximum (counted live, headings included). Last updated: 2026-11-03 7:50 AM PST. The AI working notes still need S's own words: keep them short or trim elsewhere.

Product brief

Working title: Evidence-linked review packet

Primary user: Northstar operations analyst preparing exception cases (E01, E04)

Decision owner: the authorized reviewer owns each case disposition (Customer Scenario); the operations leader owns first-release scope (E05). (Assumption: the PDFs name no product owner.)

Problem and evidence

Analysts spend a median 11.5 hours per exception case, 4.2 of them locating and reconciling source records (E01). The pilot drafts summaries, but only 18% of eligible weekly cases used it more than once (E02). The barrier looks like trust, not drafting: 14% of sampled summaries had a claim reviewers could not trace to a displayed source (E03), analysts reopen source systems because the draft does not show why a source was chosen or what was omitted (E04), and 27% of outputs are reformatted before review (E10).

The first release should solve one problem: an analyst cannot hand a reviewer a packet the reviewer can verify without redoing the work.

Material uncertainty: E01 is six interviews from one team; E02 does not explain abandonment; and nothing shows how much evidence lives in the two connected systems (E09). If most of it sits in ticketing, call recordings or policy, a two-source release saves less time than expected.

First-release proposal

From an exception in the case system, the analyst gets an evidence set assembled from the case system and document repository under their own permissions. The draft packet uses one standard template. Every material claim links to its source passage, and the packet lists sources searched, included and excluded, with reasons. Unreconciled or low-confidence findings appear inline with an explanation and need the analyst's confirmation. The reviewer verifies claims in place, returns the case or approves it, and records the disposition.

Outcome: faster evidence work, fewer repeated checks, consistent packets.

Why this scope: both systems already have reliable connectors (E09), so two engineers and a designer can spend four weeks on trust and workflow instead of connectors and security reviews. It extends the current pilot rather than replacing it (Customer Scenario). The operations leader accepts a narrower release if it is used consistently (E05), and the renewal sponsor does not need all five connectors at launch (E12).

Requirements

  1. Retrieve only from the case system and document repository, using source-system permission checks and existing access groups (E07, E09, E14).
  2. Claim-level citations; a material claim without an authorized source cannot be submitted until it is sourced or removed (E03, E06).
  3. Sources panel: searched, included, excluded, and why (E04).
  4. Inline uncertainty with required confirmation, not a badge (E13).
  5. Re-check permissions and revocation at open, submit and export; remove revoked sources and flag dependent claims (E11).
  6. One standard packet template, copy-ready for the case system (E05, E10).
  7. Reviewer actions: verify, return with comments, approve; disposition by a human only (E06).
  8. Audit record: approver, source set, model and prompt version, edits, disposition, in append-only storage; AI changes are versioned and human-approved, never silently overwritten (E06, E14).
  9. Exports withhold restricted sources entirely (E07, E14).
  10. Usage instrumentation with an abandonment-reason prompt (E02, E12).

Rule: never fully automatic; humans govern disposition in every release (E06).

Non-goals

  • Autonomous research: conflicts with traceable human review; no estimate exists (E06, E08).
  • Ticketing, call-recording and policy connectors: each needs a new connector and security review (E09), and broader integrations are unavailable in the window. They lead the roadmap.
  • Configurable executive dashboard: replaced by a fixed adoption report (E08, E12).
  • Field-level redaction, model training, new identity infrastructure (E14, Customer Scenario).

Workflow and decision points

  1. Open case: the evidence set builds; a source that fails to load is named and blocks completion (failure).
  2. Sources panel: included and excluded, with reasons; inaccessible sources never appear (permissions).
  3. Draft packet: cited claims; an unreconciled finding shows inline and needs confirmation (uncertainty, human decision).
  4. Submit: the re-check finds a revoked document, removes it and flags dependent claims (permissions, failure).
  5. Reviewer: verifies claims, returns or approves, records the disposition (human approval).
  6. Audit and export: the audit record is written; the export withholds restricted sources.

Technical and enterprise considerations

Following Kamiwaza's decentralized model, data stays in place and inference runs on Northstar's on-prem endpoints (Customer Scenario, E14). Retrieval runs as the requesting user, and checks repeat at open, submit and export because E11 shows a generated draft can outlive a permission. Traceability is enforced by the product, not by reviewer effort (E06). Audit uses existing append-only storage (E14). Because field-level redaction does not exist, exports withhold whole sources (E14). No new identity system or connector is needed (E07, E09). Capacity: two engineers for four weeks, then one (E09), so weeks 5-6 only harden and roll out.

Measures and validation

Leading: share of eligible weekly cases using the packet more than once (baseline 18%, E02); share of submitted packets with an untraced material claim (14% of summaries today, E03; zero by design); share reformatted before review (27%, E10); reviewer returns per case (baseline unknown).

Outcome: median time from exception creation to authorized disposition (E05 target: 40% lower; baseline unknown); analyst hours locating and reconciling (4.2, E01); permission incidents (three in the pilot, E11; target zero).

Next validation (week 1): sample recent cases to measure how much evidence comes from each system; interview pilot users who stopped (E02); confirm with compliance what counts as a material claim.

Change direction if most evidence lives outside the two connected systems (move the first new connector and its security review up) or abandonment has another cause (fix that first).

Response to commercial pressure

The CTO's demo asks for five systems, autonomous research, automatic disposition (conflicts with RULE; not planned) and a configurable dashboard, with no estimate (E08). I would demo the real governed workflow on two sources, early adoption numbers, and a connector roadmap with security reviews scheduled. This matches the renewal sponsor's ask (E12) and what compliance allows (E06).

AI working notes

To be written by S from her recorded session: one AI suggestion accepted and why, one rejected or corrected and why, and how she verified the work.

REQUIRED - AI use

REQUIRED (AI use): State one AI suggestion accepted and why, one rejected or corrected and why, and how you verified the work. [Candidate Instructions: AI use, Product Brief Template: AI working notes] AI working notes in the brief

Left empty on purpose: only S's own words from her recorded session go here. Typing here saves in this browser only, and the same boxes fill in on every tab.

2. Low-fidelity workflow mock: 6 frames

Whimsical mockups: open in Whimsical.

  1. 1 Open case (failure state) E01 E09 E14
  2. 2 Sources (permissions) E04 E07 E14
  3. 3 Draft packet (low confidence) E03 E06 E10 E13
  4. 4 Submit re-check (revoked doc, blocked) E07 E11
  5. 5 Reviewer decision (human records final disposition) Scenario E05 E06
  6. 6 Audit + export (permissions) E06 E07 E10 E14

States covered: failure (frames 1, 4), permissions (2, 4, 6), uncertainty (3), human approval (5). Bracketed values are placeholders; the dates, counts and document names inside the frames are illustrative examples, not case facts [Scenario: assignment].

Frame 1 · Open case: evidence set buildsFailure state
Case EX-[id] Exception
Building evidence set as you
  • Done Case system: 6 records
  • Failed Document repository: did not respond Retry
  • Ticketing, call recording, policy: not connected in this release
Packet cannot be marked complete while a source is missing.

A source that fails is named, retry is offered, and completion is blocked. [Scenario ¶2, E09]

Frame 2 · Sources panelPermissions state
Included (8)
  • Case record, status history why: same exception ID
  • Account letter, 12 Mar why: cited in case notes
Searched, not used (3)
  • Older policy memo why: superseded
Only sources you can open in the source system are searched or shown.

Shows why each source was chosen and what was left out; inaccessible sources never appear. [E04, E07, E14]

Frame 3 · Draft packetUncertainty state
Findings Standard template
  • Payment reversed on 14 Mar [1]
  • Customer notified by letter [2]
  • No source found for: "Fee waived by branch." Add source Remove
Unreconciled: case system says 14 Mar, branch memo says 16 Mar. Explain which is reliable.
I have checked this and confirm my explanation

Claims carry citations, an untraced claim blocks submission, and uncertainty is inline and needs confirmation. Analyst edits create a new version; the AI's original text is kept in the audit log, never silently overwritten. [E03, E06, E13]

Frame 4 · Submit: permission re-checkPermissions and failure state
Checking sources before submit
1 source was revoked after this draft was generated: "Account letter, 12 Mar". It has been removed. 2 claims that relied on it are flagged for review.
  • Done All remaining claims sourced
  • Done 1 uncertainty confirmed
  • Open 2 flagged claims
Send to reviewer (enabled when flags are resolved)

Re-check at submit removes revoked content and blocks the send until flags are resolved. The removal is logged as a new version; the earlier draft is kept in the audit trail and the analyst re-approves. [E11, E07]

Frame 5 · Reviewer decisionHuman approval
Review: EX-[id] Recommended: [disposition]
  • Claim 1 [1] open source verified
  • Claim 2 [2] open source verified
Return with comments Approve and record disposition
Disposition is recorded by you. The system never decides.

The reviewer verifies each claim in place, then returns or approves; only a human records the disposition. [Scenario ¶2, E06]

Frame 6 · Audit record and exportPermissions state
Audit record (append-only)
  • Approver: [reviewer]
  • Source set: 7 sources
  • Model and prompt version: [version]
  • Edits: 3 by analyst
  • Versions: AI draft v1, analyst v2 (originals kept)
  • Disposition: [value]
Export packet
1 source withheld: the recipient's access does not include it. Content not shown.
Copy to case system

Audit fields required by compliance, plus every version with its original; restricted sources withheld whole because there is no field-level redaction. [E06, E14, E07, E10]

3. Recording session outline

Requirements: screen, camera and microphone for the whole session; start recording before opening the case materials; aim for 60 minutes, up to 90; keep it continuous; numbered second segment if recording fails; clean desktop [Instructions: recording].

MinutesWhatReference
0-10 minRead the scenario and evidence pack; note constraints.[Instructions: sequence, Step 1]
10-15State the problem and the evidence that matters most.[Instructions: sequence, Step 2]
15-25Decide what the first release does and does not do.[Instructions: sequence, Step 3]
25-45Write the brief with the AI; keep prompts and edits visible.[Instructions: sequence, Step 4]
45-55Build the 4-6 frames.[Instructions: sequence, Step 4]
55-60+Verify against constraints; walk through tradeoffs, next validation and AI decisions.[Instructions: sequence, Steps 5-6]

Talking points for the AI-use items [Instructions: AI use]

  1. How you give the AI context and constraints. Paste the scenario and evidence pack; state the hard limits up front: two connectors (E09), compliance rules (E06, E07), 2 engineers + 1 designer for 4 weeks (Scenario), week-6 release, week-10 renewal (E12). Ask it to cite evidence IDs and to label anything not in the PDFs as an assumption.
  2. What you delegate and what you decide. Delegate: first-pass summaries of the evidence, draft user stories, a first brief draft, word counts, a consistency check against the template. Decide yourself: the primary user, the problem statement, first-release scope, non-goals, and the response to the CTO (E08).
  3. How you inspect, challenge and verify. Check every evidence ID and number against the pack (11.5 h and 4.2 h, 18%, 84% and 14%, 27%, three revoked-document cases). Ask the AI which statements are not supported by the PDFs. Check the brief against capacity, compliance and timing (recommended step 5).
  4. One suggestion you accepted, and why. Watch for a real one in your session. Example of the kind: making the sources panel show omissions, because E04 says that is why analysts reopen systems.
  5. One suggestion you rejected or corrected, and why. Watch for a real one. A likely candidate: if the AI proposes automatic disposition for low-risk cases, reject it because compliance has not approved automated dispositions (E06).
  6. Material uncertainty that remains. Where the evidence lives across the five systems (E09); why pilot users stopped (E02); the absolute cycle-time baseline (E05); whether the case system supports write-back (E10).
Tab 7

Release planning

RULE (S): Never fully automatic. In every release, now and in future, disposition is governed by humans in multiple layers. Release 1: a named human records the final disposition; the system never does. Later releases may add assistance, but never remove the human layers. [E06] Full rule and S's words

Human checkpoint layers in every release (R0-R3)

Every release keeps human checkpoint layers, and no release removes them (RULE, E06). Later releases may add assistance; a named human still records every final disposition. The checkpoints below are this plan's proposal, drawn from the PDFs.

ReleaseHuman checkpoint layersReference
R0: Validate (week 1)People set the rules before anything is built: compliance definitions are agreed with compliance, the operations leader signs off the written demo scope and targets. No user-facing build.[E05, E06, A15]
R1: Internal alpha (weeks 2-4)1. The analyst confirms or corrects each low-confidence claim. 2. The analyst re-approves a draft after a revoked source is removed. 3. A person approves every AI change as a new version; the original is kept. 4. A named reviewer records the final disposition; the system never does.[E13, E11, E06, E14]
R2: First release and demo (weeks 5-6)All R1 layers stay through hardening and the pilot-team rollout. The executive demo shows the human-recorded disposition, not an automatic one.[E06, E08]
R3: Adoption proof (weeks 7-10)All R1 layers stay. People review the usage readouts and choose the fixes. Any added assistance only suggests; the human layers are never removed.[E12, E06]

A plan for the Northstar first release within the stated constraints. Changes and decisions are logged on the Constraints tab. Prep material for S; numbers and dates come only from the PDFs, and everything else is labeled.

Fixed constraints

  • 2 engineers + 1 designer for weeks 1-4 [Scenario ¶4]; one engineer moves on after four weeks [E09].
  • Credible first release in six weeks [Scenario ¶4]; executive demo at six weeks [E08]; treated as one milestone [A6].
  • Renewal decision in ten weeks [E12].
  • No broader integrations, model training or new identity infrastructure in the window [Scenario ¶4].
  • Operations leader wants 40% lower median cycle time this quarter [E05].
Dates. The PDFs give no calendar dates for Northstar's plan (the case date is fictional, E14), so weeks are counted from release kickoff and shown as W1-W10 [N7, A8]. The only real PST dates are S's own prep dates on the left timeline (from Tue Nov 3, 2026). The exercise submission deadline is not in the PDFs: per invitation, confirm.

Week by week

WeekTeamEngineeringDesignProduct and validationExit / milestoneReference
W12 engineers + designerSpike: permission re-check at open, submit and export (A4); confirm model and prompt version capture (A9); connector read paths for case system and repository.Packet template from the current final review format; citation and sources-panel patterns.Sample recent cases for source mix (A1); interview pilot users who stopped (E02); compliance definition of material claim and audit fields (E06); agree demo scope with CTO in writing (E08); agree targets with operations leader (E05); confirm which Kamiwaza components are deployed (A19). S's rule: define the human disposition step and its review layers with compliance (E06, S's rule).Scope signed off by operations leader and compliance.[E09, E06, E08, E05, E02]
W22 engineers + designerEvidence set builder on the two connectors; claim-citation model; sources panel data. S's rule: final disposition field is written only by a named human; the AI can suggest, never record (E06, S's rule).Draft packet and inline-uncertainty frames; usability plan.Baseline capture plan from case-system timestamps (A13).A cited packet generated for test cases.[E09, E03, E04, E13]
W32 engineers + designerUntraced-claim gate; inline confirmation; revocation re-check and removal; audit record writes. S's rule: human checkpoint layers in the alpha (analyst confirms, reviewer approves, human records disposition) (E06, S's rule).Reviewer view; usability session with pilot users (E13 method).Recruit pilot analysts and reviewers.Internal alpha with pilot analysts.[E03, E11, E06, E14, E13]
W42 engineers + designerReviewer actions (return, approve, record disposition); export with withheld sources; usage instrumentation. S's rule: human-recorded final disposition shipped and audited (who recorded it, when, on which sources) (E06, S's rule).Fixes from usability; final template.Training material; demo script draft.Feature complete. One engineer moves on after this week.[E09, E07, E14, E02, Scenario ¶4]
W51 engineerHardening on on-prem endpoints; bug fixes; no new scope (A7).Not stated in the PDFs (N11).Pilot rollout prep; confirm metrics dashboards are fixed views, not configurable.Release candidate.[E09, A7]
W61 engineerRelease to pilot team; support.Not stated.Executive demo: governed two-source workflow, first usage numbers, dated connector roadmap.First release live; demo delivered.[Scenario ¶4, E08, E12, A6]
W7Not stated (N11)Fix top issues if capacity exists.Not stated.Weekly adoption readout; abandonment reasons reviewed.Adoption trend visible.[E02, E12]
W8Not statedStart security review for the next connector chosen by week-1 source mix, if staffed.Not stated.Mid-point check against agreed targets.Go / adjust decision on targets.[E09, A1]
W9Not statedAs capacity allows.Not stated.Renewal pack: adoption, cycle-time trend, permission incidents, connector roadmap.Renewal pack ready.[E12, E05, E11]
W10Not statedNone planned.None planned.Renewal decision.Renewal decision.[E12]

What is in and out of each release

ReleaseInOutReference
Release 0: Validate (week 1)Source-mix sample, abandonment interviews, compliance definitions, written demo scope, agreed targets, technical spikes.Any build of user-facing features.[E02, E05, E06, E08, E09]
Release 1: Internal alpha (weeks 2-4)Evidence set (2 sources), claim citations and gate, sources panel, inline uncertainty, revocation re-check, audit record, reviewer actions, export withholding, instrumentation. Human records the final disposition, always a priority (S's rule, E06).New connectors, autonomous research, configurable dashboard, write-back (unless connector supports it).[E03, E04, E06, E07, E09, E11, E13, E14]
Release 2: First release and demo (weeks 5-6)Hardening, pilot-team rollout, executive demo with roadmap.New scope of any kind (one engineer, A7).[Scenario ¶4, E08, E09, E12]
Release 3: Adoption proof (weeks 7-10)Usage readouts, top fixes if staffed, next-connector security review if staffed, renewal pack.Five-system coverage at launch (not required by sponsor).[E12, E02, E09]

Architecture by release (Kamiwaza's decentralized model)

Every release keeps data where it lives and runs inference locally [kamiwaza.com/inference-mesh · stated on Kamiwaza's page (read Nov 3, 2026)]. Components as named on the product page [kamiwaza.com/product · stated on Kamiwaza's page (read Nov 3, 2026)].

ReleaseKamiwaza components usedNot used yetReference
R0 ValidateConfirm which components Northstar has deployed; check role groups against ReBAC authorization; check model and prompt version capture in Model Management.-[A19, A17, A9]
R1 AlphaDistributed Data Engine and Connector Framework (case system, document repository), Retrieval Service, Semantic Search, Embedding and Vector Service (with permission re-check), Inference Mesh on on-prem endpoints, ReBAC authorization, Activity Logging and Audit, Model Management, SDK & API.Context Manager (assess), Workrooms, Kaizen, Tool Shed.[E09, E07, E06, E14, E11]
R2 Release + demoSame as R1, plus Observability and Monitoring for usage and incident checks.Kaizen autonomous actions.[E02, E06, E08]
R3 AdoptionConnector Framework: security review for the next connector chosen from the week-1 source mix, if staffed.Remaining connectors until reviewed.[E09, E12, A1]

Risks

RiskLevel (assumption)MitigationReference
Demo expectations: the CTO expects five systems, autonomous research and automatic disposition (conflicts with RULE; not planned).HighWritten demo scope in week 1; show the roadmap and why each item waits.[E08, E06, E09]
Two connected systems hold too little of the evidence.MediumWeek-1 source-mix sample; if low, the next connector's security review moves up.[E09, A1]
Adoption stays low because the cause is not trust or rework.MediumAbandonment interviews and reason prompt from week 1.[E02, A2]
A revoked document stays in a generated draft.MediumRe-check at open, submit and export; test with a revoked document before release.[E11, A4]
Compliance sign-off on claims or audit fields arrives late.MediumRaise in week 1; release blocked until signed off.[E06, A12]
Capacity drops to one engineer after week 4.CertainFeature complete by week 4; weeks 5-6 hardening only.[E09, A7]
No field-level redaction makes exports less complete.LowWithhold whole sources and say so; reviewer sees what they are authorized to see.[E14, E07, A5]
The 40% cycle-time target this quarter may not be reachable from one release.UnknownAgree baseline and target in week 1; report the trend honestly.[E05, N3, N6]
Small samples behind key evidence (6 interviews, 5 participants, 50 cases).MediumTreat as directional; confirm with pilot instrumentation.[E01, E13, E03]
A Kamiwaza component the plan relies on is not in Northstar's deployment.UnknownConfirm in week 1; plan around what exists.[A19, N15]
An AI change overwrites an earlier claim or decision without a trace.MediumVersioned changes, human approval, originals kept in append-only audit (R12).[E06, E14, E11, E13]

Success metrics

Same measures as the PRD, by release. Targets marked "proposal" are not from the PDFs.

ReleaseMeasureBaselineSuccessReference
R0Source mix known; abandonment reasons known; targets agreedUnknownDone by end of week 1[E09, E02, E05]
R1Submitted packets with an untraced material claim14% of summariesZero (gate)[E03, E06]
R1Usability: users notice and act on uncertaintyBadge missedProposal: all participants confirm the inline item[E13]
R2Permission incidents3 pilot casesZero[E11]
R2Packets with complete audit recordRequirement100%[E06]
R3Eligible weekly cases using the packet more than once18%Proposal: clearly above baseline and rising each week[E02, E12]
R3Packets reformatted before review27%Proposal: under 10%[E10]
R3Median time from exception creation to dispositionNot knownTrend toward the 40% target[E05, Scenario ¶3]
Tab 8

Constraints, changes and decisions log

RULE (S): Never fully automatic. In every release, now and in future, disposition is governed by humans in multiple layers. Release 1: a named human records the final disposition; the system never does. Later releases may add assistance, but never remove the human layers. [E06] Full rule and S's words

REQUIRED - AI use

REQUIRED (AI use): State one AI suggestion accepted and why, one rejected or corrected and why, and how you verified the work. [Candidate Instructions: AI use, Product Brief Template: AI working notes] Fill in the three slots

A running log: constraints, assumptions, decisions, changes and AI decisions, each with a PST timestamp, a reference and a status. Entries are appended, never edited or removed; a later entry supersedes an earlier one. This follows the principle that AI work is never silently overwritten (E06, E14). Last updated: 2026-11-03 7:50 AM PST. Source file: constraints.json. In older entries, CS1 means Customer Scenario ¶1.

Technical (7)

constraintReliable connectors exist only for the case system and document repository; ticketing, call-recording and policy systems each need a new connector and security review.

C01 · 2026-11-03 7:15 AM PST · Ref: E09 active

constraintDeployment has on-prem model endpoints, role groups, append-only audit storage and source-system permission checks; no field-level redaction across sources.

C02 · 2026-11-03 7:15 AM PST · Ref: E14 active

decisionArchitecture follows Kamiwaza's secure, decentralized Inference Mesh: data stays where it lives, inference runs locally, no central copy of source data. Direction from S at 7:14 AM PST (8:44 PM IST).

C03 · 2026-11-03 7:14 AM PST · Ref: S, Nov 3; kamiwaza.com/inference-mesh (verified page read); CS1 (Customer Scenario ¶1) decided (S)

decisionClient environment mapped onto Kamiwaza's product architecture (Distributed Data Engine, Inference Mesh, Retrieval Service, ReBAC authorization, Activity Logging and Audit, Model Management, Connector Framework). Direction from S at 7:05 AM PST (8:35 PM IST).

C04 · 2026-11-03 7:05 AM PST · Ref: S, Nov 3; kamiwaza.com/product (verified page read) decided (S)

assumptionPackets store references (source IDs, versions, passage locations), not copies; passages are read in place under the viewer's permissions.

C05 · 2026-11-03 7:15 AM PST · Ref: A18; CS1 (Customer Scenario ¶1); E07; E11 assumption - validate week 1

assumptionNorthstar's deployment includes the Kamiwaza components the plan uses; the case lists only E14's components.

C06 · 2026-11-03 7:15 AM PST · Ref: A19; CS1 (Customer Scenario ¶1); E14 assumption - validate week 1

assumptionRole groups and source-system permission checks can be enforced through Kamiwaza's ReBAC authorization.

C07 · 2026-11-03 7:15 AM PST · Ref: A17; E07; E14; kamiwaza.com/product assumption - validate week 1

Compliance (7)

constraintEvery material claim links to an authorized source; audit record keeps approver, source set, model and prompt version, edits and final disposition.

C08 · 2026-11-03 7:15 AM PST · Ref: E06 active

constraintAutomated dispositions are not approved; a human records every disposition.

C09 · 2026-11-03 7:15 AM PST · Ref: E06; Scenario ¶2 active

constraintNo user sees or retrieves a source they cannot access in the underlying system; exports never reveal restricted content.

C10 · 2026-11-03 7:15 AM PST · Ref: E07 active

decisionExports withhold restricted sources entirely, because field-level redaction does not exist.

C11 · 2026-11-03 7:15 AM PST · Ref: E07; E14; A5 proposal

principleAI work is never silently overwritten: every assumption, claim, decision, prompt and command is logged and versioned, a human approves any change, and the original is kept in the audit trail.

C12 · 2026-11-03 7:09 AM PST · Ref: E06; E11; E13; E14; Kamiwaza Activity Logging and Audit (kamiwaza.com/product, verified) active (S)

ruleS's RULE, Release 1: humans record the final disposition, always a priority. Even in automatic disposition the interactions are layered with humans and it is never fully 100% automatic, to mitigate risk and catch issues at the right time. In PRD (Considered), Release 1 and W1-W4; never out of scope or later. S's words: "this should be in release 1 - Humans record final disposition is always a priority. Even in automatic disposition, the interactions are layers with humans and it is never fully 100% automatic, as it will increase the turn around time to mitigate risk or catch on right time. This is a RULE"

C32 · 2026-11-03 7:22 AM PST · Ref: E06; S's rule (S email 8:52 PM IST / 7:22 AM PST) in force

ruleS clarified 9:10 PM Nov 3: never fully automatic in any release; human governance in multiple layers; shown in red as a RULE. Supersedes the out-of-scope wording in C33: "fully automatic disposition with no human layer" is removed from every out-of-scope / not-doing list (PRD v1, PRD v2, release plan, mind map, brief, presenter prep), because it is a permanent product rule, not a scope item. Red RULE banner added at the top of PRD v2, PRD v1, Constraints and Release plan; release plan states every release (R0-R3) keeps human checkpoint layers and none removes them. CTO ask (E08) rows kept, marked "(conflicts with RULE; not planned)". S's words: "This is not out of scope right? Even in future releases it is never fully automatic, it should be governed by humans in multiple layers. Highlight this in red as a RULE"

C34 · 2026-11-03 7:40 AM PST · Ref: E06; S's RULE (S email 9:10 PM IST / 7:40 AM PST); supersedes C33 wording; builds on C32 in force

Capacity (3)

constraintTwo engineers and one product designer for the first four weeks; one engineer moves to another commitment after week 4.

C13 · 2026-11-03 7:15 AM PST · Ref: Scenario ¶4; E09 active

assumptionDesigner time after week 4 is not available; weeks 5-6 are hardening and rollout only.

C14 · 2026-11-03 7:15 AM PST · Ref: A7; E09 assumption

constraintBroader integrations, model training and new identity infrastructure are unavailable in the window.

C15 · 2026-11-03 7:15 AM PST · Ref: Scenario ¶4 active

Timing (3)

constraintCredible first release in six weeks; executive demo at six weeks (treated as one milestone).

C16 · 2026-11-03 7:15 AM PST · Ref: Scenario ¶4; E08; A6 active

constraintRenewal decision in ten weeks.

C17 · 2026-11-03 7:15 AM PST · Ref: E12 active

openCalendar dates are not in the PDFs (fictional case date); plan uses W1-W10. Exercise submission deadline: per invitation, confirm.

C18 · 2026-11-03 7:15 AM PST · Ref: E14; Instructions: upload; N7 open

Tradeoffs (3)

decisionFirst release limited to two connected sources; the other three lead the roadmap.

C19 · 2026-11-03 7:15 AM PST · Ref: E09; E12; E05 proposal

decisionCTO demo shows the governed two-source workflow, adoption numbers and a dated connector roadmap, not five systems, autonomous research, automatic disposition or a configurable dashboard.

C20 · 2026-11-03 7:15 AM PST · Ref: E08; E06; E09; E12 proposal

decisionKaizen autonomous actions and Tool Shed actions are out of the first release.

C21 · 2026-11-03 7:15 AM PST · Ref: E06; E08; kamiwaza.com/product proposal

Next validation (4)

openSample recent cases to see how much evidence lives in each of the five systems.

C22 · 2026-11-03 7:15 AM PST · Ref: A1; E09 open - week 1

openInterview pilot users who stopped using the draft summary.

C23 · 2026-11-03 7:15 AM PST · Ref: A2; E02 open - week 1

openConfirm with compliance what counts as a material claim and which audit fields are required.

C24 · 2026-11-03 7:15 AM PST · Ref: A12; E06 open - week 1

openTest the permission re-check with a revoked document, as in the incident.

C25 · 2026-11-03 7:15 AM PST · Ref: A4; E11 open - weeks 2-3

AI decisions (7)

logTab (AI) drafted the PRD, client environment, user stories, mind map, materials, release plan and this log from the four PDFs and the Kamiwaza research. Every item is pending S's review; nothing here is final until S approves it.

C26 · 2026-11-03 7:15 AM PST · Ref: Instructions: AI use pending S review

logDraft brief kept under 1,000 words (980 at this version) so S's own AI working notes fit.

C27 · 2026-11-03 7:20 AM PST · Ref: Instructions: what to submit; Brief template pending S review

logLow-fi frames are described on this site; the Whimsical mockups are being made separately and the link appears in the top bar when ready.

C28 · 2026-11-03 7:01 AM PST · Ref: S, Nov 3 (7:01 AM PST) in progress

changev1: tracker with PDFs word for word, checklist, Q&A, research.

C29 · 2026-11-03 6:45 AM PST · Ref: - done

changev2: tabs added (PRD, client environment, evidence to stories, mind map, materials, release plan).

C30 · 2026-11-03 7:15 AM PST · Ref: S email 6:59 AM PST done

changev3: Kamiwaza architecture, Constraints log, Presentation tab, Mockups link, brief loaded from its own file, AI change-control principle.

C31 · 2026-11-03 7:20 AM PST · Ref: S, 7:01-7:14 AM PST done

changev4: Prototype link in the top bar, Presenter prep tab, S's rule (C32) added to PRD, release plan and mind map; out-of-scope rows reworded to "fully automatic disposition with no human layer" so the rule never reads as out of scope.

C33 · 2026-11-03 7:30 AM PST · Ref: E06; S's rule done

Tab 9

Presentation

Draft deck for S to review, built separately from the same PDFs and research. Like the other drafts, it is prep material for S's own work.

Download the presentation (PPTX) Updated Nov 3, 7:20 AM PST

Slide 1
Slide 1
Slide 2
Slide 2
Slide 3
Slide 3
Slide 4
Slide 4
Slide 5
Slide 5
Slide 6
Slide 6
Slide 7
Slide 7
Slide 8
Slide 8
Slide 9
Slide 9
Slide 10
Slide 10
Slide 11
Slide 11
Slide 12
Slide 12
Slide 13
Slide 13
Slide 14
Slide 14
Tab 10

Presenter prep

Talk track, the 25 hardest questions with answers, how to show AI work is never silently overwritten, and the explainer-video outline. Draft for S to rehearse and rewrite in her own words.

For S (Swathi Perumalla). Prepared Nov 3, 2026. Draft for S to review, rehearse and rewrite in her own words.

RULE (S): Never fully automatic. In every release, humans govern disposition in multiple layers. Release 1: a named human records the final disposition; the system never does. [E06]

REQUIRED - AI use

REQUIRED (AI use): State one AI suggestion accepted and why, one rejected or corrected and why, and how you verified the work. [Candidate Instructions: AI use, Product Brief Template: AI working notes]

REQUIRED (AI use) The candidate instructions, word for word: “one suggestion you accepted and why;” “one suggestion you rejected or corrected and why;” and “how you inspect, challenge, and verify its work;”. The brief template’s AI working notes: “Summarize one AI suggestion you accepted, one you rejected or corrected, and how you verified the work.”

  1. Accepted + why: [S to write in her own words]
  2. Rejected or corrected + why: [S to write in her own words]
  3. How verified: [S to write in her own words]

How to read this page. Every customer fact cites the evidence pack (E01-E14) or the Customer Scenario. Anything not in those PDFs is marked Assumption. Kamiwaza company facts come from public pages read on Nov 3, 2026; a claim made only by Kamiwaza's own marketing is marked Kamiwaza claim, and anything seen only in a search snippet is marked Unverified.

Audience. Kamiwaza's technical chief of staff. Research points to Matthew Probst: a LinkedIn post from about Sept 2025 calls him "KamiwazaAI's Technical Chief of Staff", but his current headline reads "GM - Kamiwaza Federal & CISO". Unverified Confirm the name and title from the invitation or the recruiter before the session. A Jan 2025 Kamiwaza job ad for "Technical Chief of Staff to CTO" described the role as working with the CTO (Matt Wallace) on code reviews, architecture, prioritization and the CTO's time (coloradoai.news). Expect architecture-level questions and hard questions about estimates and priorities, not only product framing. If it is Probst, his CISO background means security and leakage questions will be sharp.

One rule to keep straight. The "CTO" in E08 is a Northstar stakeholder in the case, not Kamiwaza's CTO. Assumption The evidence pack is about Northstar; it does not say whose CTO explicitly. Say "Northstar's CTO" once at the start so the room stays aligned.

Recording rules still apply. The Candidate Instructions require a continuous recording of the working session with AI use visible, and say "Human assistance is not permitted". This pack prepares the later presentation; the brief and mock you submit should come from your own recorded session.

Numbers to know cold

FactValueSourceLimitation to admit
Analyst time per exception case11.5 h median; 4.2 h locating and reconciling recordsE01Six interviews, one team
Repeat pilot use18% of eligible weekly cases used the pilot more than onceE02Eight weeks; does not explain abandonment
Summary quality84% materially accurate; 14% had a claim reviewers could not traceE0350 sampled cases
Why analysts reopen sourcesDraft does not show why a source was selected or what was omittedE04Four of six interviews
Ops leader goalStandard review packet; median cycle time down 40% this quarter; accepts a narrower first release if used consistentlyE05Commitment already discussed with executives
Compliance: traceabilityEvery material claim links to an authorized source; record approver, source set, model and prompt version, edits, dispositionE06Automated dispositions not approved
Compliance: accessNo user sees or retrieves a source they could not access; exports must not reveal restricted contentE07Existing access groups only; no new identity system
Northstar CTO demo askAll five systems, autonomous research, automatic disposition (conflicts with RULE; not planned), configurable dashboard at the six-week demoE08No engineering estimate
ConnectorsReliable: case system, document repository. New connector + security review each: ticketing, call recording, policyE09Two engineers for four weeks, then one moves
Reformatting27% of outputs reformatted before review; final packet copied into case systemE1063 support-tagged cases
Revoked document incident3 pilot cases kept a revoked document in a generated draft until refreshE11No data exposed outside authorized users
RenewalSponsor wants measurable adoption and a credible path to broader coverage, not necessarily five connectors at launchE12Decision in ten weeks
Low-confidence UXSmall badge missed; inline explanation plus required confirmation noticedE13Five participants
Security architectureOn-prem model endpoints, role groups, append-only audit storage, source-system permission checks; no field-level redaction across all sourcesE14Current as of the fictional case date
Team and window2 engineers + 1 designer for the first four weeks; credible first release in six weeks; no broader integrations, model training or new identity infrastructure in that windowScenarioStaffing after week 4 beyond E09 is not stated

Unknown in the PDFs, so never state as fact: the baseline cycle time; the share of evidence living in each system; how "material claim" is defined; the date the six-week clock started; the submission deadline; how revocation is signalled by source systems; whether the pilot uses a vector index.

10-minute talk track

Ten sections, about one minute each. Suggested words are in italics; say them your way. If you are cut short, sections 3, 4, 5 and 7 carry the decision.

0:00 - 0:45   1. Open with the decision

"Northstar's pilot drafts summaries that are mostly accurate, yet analysts don't come back to it. My recommendation is a first release that makes every claim in the review packet verifiable, on the two systems we can already connect safely, with a human approving every disposition."
  • State the three non-negotiables from the assignment: traceability, access control, human accountability (Scenario).
  • Say once: E08's CTO is Northstar's CTO.

0:45 - 2:00   2. The problem is trust, not drafting

  • 11.5 hours per case, 4.2 of them finding and reconciling records [E01].
  • 84% of summaries are materially accurate [E03], yet only 18% of eligible cases used the pilot more than once [E02].
  • Why: 14% carry a claim reviewers cannot trace [E03]; analysts reopen sources because the draft hides why a source was chosen and what was left out [E04]; 27% get reformatted [E10].
"Better prose won't move adoption. A packet a reviewer can verify without redoing the work will."

Name the uncertainty yourself before they do: E01 is six interviews from one team, E02 does not explain abandonment, and nothing tells us how much evidence sits in the two connected systems.

2:00 - 2:45   3. User and decision owner

  • Primary user: the operations analyst preparing exception cases [E01, E04].
  • Second user: the authorized reviewer who verifies, returns or records the disposition (Scenario).
  • Decision owner for first-release scope: the operations leader [E05]. Assumption The PDFs name no product owner.

2:45 - 4:00   4. The first release: evidence-linked review packet

  • From an exception, assemble evidence from the case system and document repository under the analyst's own permissions [E07, E09, E14].
  • One standard packet template, copy-ready for the case system [E05, E10].
  • Claim-level citations; a material claim without an authorized source cannot be submitted [E03, E06].
  • A sources panel: searched, included, excluded, and why [E04].
  • Inline uncertainty with required confirmation, not a badge [E13].
  • Permission and revocation re-checks at open, submit and export [E11].
  • Reviewer verify, return, approve; disposition by a human only; audit record in append-only storage [E06, E14].
"Why this scope: both sources already have reliable connectors, so the team spends four weeks on trust and workflow, not on three new connectors and three security reviews."
[E09]

4:00 - 6:00   5. Walk the workflow (mock or prototype)

  1. Open case: evidence set builds. A source that fails to load is named and completion is blocked (failure state) [E09].
  2. Sources panel: included and excluded with reasons; sources the analyst cannot access never appear (permissions) [E04, E07].
  3. Draft packet: every claim cited; an unreconciled finding shows inline and needs the analyst's confirmation (uncertainty) [E03, E13].
  4. Submit: the re-check finds a revoked document, removes it, flags the claims that depended on it, and logs the change [E11].
  5. Reviewer: verifies claims in place, returns or approves, records the disposition (human approval) [E06].
  6. Audit and export: audit record written; export withholds restricted sources whole, because there is no field-level redaction [E07, E14].

Spend the most time on frames 3 and 4. They are where E11 and E13 live, and where a technical audience will probe.

6:00 - 7:00   6. Governance: nothing is silently overwritten

  • Every AI output, assumption, prompt and command is a versioned record; edits create a new version, the original is kept, and a human approves any change to approved content (detail in section 4).
  • This is what E06 already demands (approver, source set, model and prompt version, edits, disposition), stored in the append-only audit store Northstar already has [E06, E14].
  • Fit with Kamiwaza: everything runs on Northstar's on-prem endpoints (Scenario, E14); inference stays local and data is not centralized, in line with the Inference Mesh model. Kamiwaza claim

7:00 - 8:15   7. Commercial pressure: Northstar's CTO and the renewal

  • The CTO's demo list [E08] has no estimate, includes automatic disposition that compliance has not approved [E06] (conflicts with RULE; not planned), and needs three new connectors with security reviews [E09].
  • The renewal sponsor asks for measurable adoption and a credible path to coverage, not five connectors at launch [E12]. The ops leader accepts a narrower release if it is used [E05].
"So the six-week demo is the real governed workflow on two sources, early adoption numbers, and a dated connector roadmap with the security reviews scheduled. That answers the person who decides the renewal, and it never shows Northstar something compliance would have to switch off."

8:15 - 9:15   8. Measures and next validation

  • Leading: repeat use of eligible weekly cases (baseline 18%, [E02]); submitted packets with an untraced material claim (14% of summaries today, [E03]; zero by design); share reformatted (27%, [E10]); reviewer returns per case (baseline unknown).
  • Outcome: median time from exception to authorized disposition (target 40% lower, [E05]; baseline unknown); hours locating and reconciling (4.2, [E01]); permission incidents (3 in the pilot, [E11]; target zero).
  • Week 1 validation: sample recent cases to see how much evidence comes from each system; interview pilot users who stopped [E02]; confirm with compliance what counts as a material claim [E06].
  • Change direction if most evidence lives outside the two connected systems (pull the first new connector and its security review forward) or if abandonment has another cause.

9:15 - 10:00   9. How I worked with AI, and close

  • One suggestion accepted and why; one rejected or corrected and why; how you verified. Use your real examples from the recorded session; the slots are in the REQUIRED (AI use) box.
  • The remaining uncertainty: evidence distribution across systems, and the cause of abandonment.
"In short: make the packet verifiable, keep it inside the permissions Northstar already has, keep a human on every disposition, and use the six-week demo to prove adoption rather than breadth."

The 25 hardest questions, with answers

Grouped by topic. Each answer is meant to be said in under a minute. Lead with the decision, then the evidence ID.

A. Problem and scope

1. The summaries are 84% accurate. Why isn't the answer just a better model or better prompts?

Because accuracy is not what is blocking use. 84% are materially accurate [E03], yet only 18% of eligible cases used the pilot more than once [E02]. What analysts and reviewers cannot do is verify: 14% contain a claim nobody can trace [E03], and analysts reopen source systems because the draft hides selection and omission [E04]. A better model still leaves the reviewer redoing the work. The first release targets verifiability.

Caveat to say out loud: E02 does not explain abandonment, so trust is my best-supported hypothesis, not a proven cause. Exit interviews with lapsed users are week-1 validation.

2. Your evidence is six interviews and five usability participants. Isn't this scope built on thin data?

Partly, and I designed for that. The interview findings [E01, E04] and the usability finding [E13] are small samples, but they point the same way as the larger signals: 50 sampled summaries [E03], eight weeks of telemetry [E02] and 63 support cases [E10]. The release is also cheap to be wrong about: it reuses existing connectors [E09] and existing permission and audit infrastructure [E14]. I named the two unknowns that would change the plan (where evidence lives, and why users abandoned) and put them in week 1.

3. What exactly is out of scope, and who did you disappoint?

Out: autonomous research (no estimate, and it conflicts with traceable human review, [E06, E08]); ticketing, call-recording and policy connectors (each needs a new connector and security review, [E09]); a configurable executive dashboard, replaced by a fixed adoption report [E08, E12]; field-level redaction, model training and new identity infrastructure [E14] (Scenario). Automatic disposition is not on this list because it is not a scope item: never fully automatic is a permanent RULE, in every release [E06]. The person disappointed is Northstar's CTO [E08]. The renewal sponsor [E12] and the ops leader [E05] both accept this scope.

RULE (S): Never fully automatic. In every release, humans govern disposition in multiple layers. Release 1: a named human records the final disposition; the system never does. [E06] See the rule

B. Permission-aware retrieval and leakage

4. Walk me through permission-aware retrieval. Where exactly is the access check?

Retrieval runs as the requesting analyst, never as a service account. Northstar already has source-system permission checks and role groups [E14], and compliance says existing access groups are available [E07]. So: the user's identity goes with every query; candidates come only from the two connected systems [E09]; each candidate is checked against the source system's own permission before it is shown, cited or passed to the model; anything that fails is dropped and never appears in the sources panel [E07].

Assumption I would filter before generation as well as before display, so the model never sees content the user cannot see. The PDFs do not describe the pilot's retrieval internals, so the exact mechanism is an engineering decision for week 1.

5. Pre-filter or post-filter? Post-filtering an index leaks through ranking and snippets.

Both, layered. Pre-filter by the user's access groups so restricted chunks are never retrieved at all; then a live source-system check on each surviving item before it is used, because group membership in an index can be stale [E07, E14]. Nothing is summarised, ranked into a visible list, or counted for the user before both checks pass. Assumption The cost is some latency per query; I would rather pay that than repeat the E11 pattern of content outliving permission [E11].

6. Embeddings and other derived data: can a vector index, cache or summary leak restricted content?

Yes, if you treat derived data as less sensitive than its source. My rule: any derived artifact (embedding, chunk, cached draft, summary) inherits the permissions of the source it came from, and is filtered the same way at query time [E07]. Generated drafts are the derived data the evidence already shows leaking past a permission change: a revoked document stayed in drafts until refresh [E11]. So drafts are re-checked at open, submit and export.

Kamiwaza's own security page makes the same point: protecting source data "does not automatically cover metadata, embeddings, or other derived knowledge assets" (kamiwaza.com/security-and-compliance, read Nov 3). Assumption Whether the pilot keeps a shared vector index is not in the PDFs; if it does, I would scope it per access group or tag every vector with its source ACL, and I would ask engineering in week 1.

7. Can the generated summary leak restricted content even if the source panel hides it?

Only if the model saw it, which is why the filter runs before generation, not just before display. The model gets only sources the analyst is authorized for [E07]. Exports are the second risk: there is no field-level redaction [E14], so an export withholds a restricted source entirely rather than trying to mask fields, and any claim that cites it is flagged [E07]. Compliance's requirement is that exported packets must not reveal restricted source content [E07], and whole-source withholding is the only way to guarantee that with today's architecture.

8. The analyst can see a source but the reviewer can't. What happens?

The PDFs do not cover this case, so this is my design. Assumption The reviewer sees the claim, sees that a cited source exists that they cannot open, and cannot see its content [E07]. The packet cannot be approved on a claim the reviewer cannot verify, so the reviewer either returns it or it is routed to a reviewer with access. I would confirm the routing rule with compliance, because E06 says every material claim must link to an authorized source, and "authorized for whom" needs their answer [E06].

C. Revoked documents (E11) and low confidence (E13)

9. E11: a revoked document stayed in drafts. What does your release do differently?

Permissions and revocation are re-checked at three moments: when the packet opens, when it is submitted and when it is exported [E11]. If a source has been revoked, it is removed, every claim that depended on it is flagged for the analyst, and the removal is written to the audit record as a visible change, not a silent edit [E06, E14]. The packet cannot be submitted while a flagged claim is unresolved. That closes the exact gap in E11, where the draft held the document until the user refreshed.

10. What if a document is revoked after the reviewer approved, or after the packet was copied into the case system?

The approved record is not rewritten. The audit record keeps the source set as it was at approval [E06], which is what makes it auditable. Assumption On the next open or export, the re-check flags the revoked source and the claims that rely on it, and notifies the case owner to decide whether the disposition needs review. A copy already pasted into the case system [E10] cannot be recalled by us; the PDFs do not say who owns that, so I would raise it with compliance as an open question.

11. How do you even learn that a document was revoked? Polling, events?

The PDFs don't say whether source systems emit revocation events, so I don't depend on one. The design is check-on-use: the source-system permission check [E14] runs at open, submit and export [E11]. That works with whatever exists today. Assumption If the case system or repository can push revocation events, that is a later improvement that shortens exposure between checks. Week-1 question for engineering.

12. E13: how do you define low confidence? Model self-confidence is unreliable.

Agreed, so I would not rely on it. Assumption In the first release, low confidence means signals we can explain: two sources disagree and were not reconciled; a material claim has only weak or partial support in the cited passage; or a source failed to load, so the evidence set is incomplete. The PDFs do not define it, so this definition is mine and would be checked with compliance and the reviewers. How it is shown is evidence-based: an inline explanation and a required confirmation step, because a small badge was missed [E13].

13. Required confirmations get clicked through. How do you stop confirmation fatigue?

Three things. Confirmations appear only on material claims with an explainable issue, not on every sentence, so they stay rare. The confirmation asks for an action (pick the source you trust, or remove the claim) rather than an OK button. And it is measured: confirmation rate, time to confirm, and how often reviewers return a packet on a claim the analyst confirmed. E13 is five participants [E13], so I treat the design as a starting point and watch those numbers from week 1 of use. Assumption The thresholds are my design, not case facts.

D. Security and audit (E14)

14. What new attack surface does this add on an on-prem deployment?

Mostly the model reading untrusted document content. Assumption A document in the repository could contain instructions aimed at the model. Mitigations: the model only drafts, it cannot take actions or change dispositions [E06]; it only receives content the user is already authorized for [E07]; every claim must cite a source the reviewer can open [E06]; and every prompt and output is logged [E14]. Everything stays on Northstar's on-prem endpoints, so no data leaves the environment (Scenario, [E14]). I would ask Northstar's security team for a review in week 1; the PDFs do not describe one for this release.

15. What exactly goes in the audit record, and why should I believe it is tamper-evident?

What compliance asked for: the human approver, the source set, the model and prompt version, the edits and the final disposition [E06]. I add the permission re-check results and any revoked-source removals [E11]. It goes into Northstar's existing append-only audit storage [E14], so the release does not build a new store. Tamper evidence comes from append-only storage; Assumption whether it is also hash-chained is not in the PDFs and would be a week-1 question.

16. Compliance said no automated dispositions. Would you push for it later, for low-risk cases?

No. It is a permanent rule, not a scope item: never fully automatic, in any release [E06]. Later releases may add assistance, such as a suggested disposition on low-risk cases, but a named human still records the final disposition and the human review layers stay. The release collects the evidence that would justify more assistance: how often reviewers agree with the analyst's recommendation, return rates, and audit completeness. That is also my honest answer to E08’s request.

RULE (S): Never fully automatic. In every release, now and in future, disposition is governed by humans in multiple layers. Release 1: a named human records the final disposition; the system never does. Later releases may add assistance, but never remove the human layers. [E06, RULE]

E. Connectors (E09) and capacity

17. Why only two connectors when the CTO asked for five?

Because those two already have reliable connectors and the other three each need a new connector and a security review [E09]. With two engineers for four weeks, then one [E09], three new connectors would consume the whole window and leave nothing for the traceability work that the evidence says drives adoption [E03, E04]. The renewal sponsor explicitly does not need all five at launch, only a credible path [E12]. So the release ships two and a dated roadmap for the next three.

18. What if most of the evidence actually lives in ticketing, call recordings or policy?

Then my scope saves less time than I expect, and I would change it. This is the biggest unknown: E01 measures time spent locating records but not where they are [E01]. Week 1: sample recent cases and count which system each piece of evidence came from. If most of it sits outside the two connected systems, the first new connector and its security review move forward, and the packet work shrinks to fit [E09].

19. Two engineers and one designer for four weeks. Give me the cut list.

Weeks 1-4 (2 engineers + 1 designer, [E09], Scenario): retrieval under user permissions and the sources panel; claim citations and the material-claim gate; inline uncertainty with confirmation; re-check at open, submit, export; reviewer actions; audit record; one packet template. Weeks 5-6 (one engineer, [E09]): harden, roll out, instrument adoption. Assumption The designer's availability after week 4 is not stated.

If we slip, cut in this order: export polish (keep whole-source withholding), the copy-to-case-system formatting, then reviewer comments (keep approve and return). Never cut: permission checks, the revocation re-check, the material-claim gate, human disposition, audit. Assumption I have not had an engineering estimate; this order is my judgement and would be validated with the engineers in week 1.

F. Renewal (E12) and the CTO versus ops leader tension (E08/E05)

20. Northstar's CTO wants all of E08 at the six-week demo. How do you handle that conversation?

Respect the goal, not the list. The CTO wants a demo that impresses executives and secures the renewal. I would show them that the renewal sponsor wants adoption and a credible path to coverage, not five connectors at launch [E12]; that automatic disposition is something compliance has not approved [E06] (conflicts with RULE; not planned); and that there is no engineering estimate for the list [E08]. Then offer what the demo will show: the governed workflow working on real cases, early adoption numbers, and a connector roadmap with security reviews dated. I would have that conversation with the ops leader present, because they own the outcome [E05].

RULE (S): Never fully automatic. In every release, humans govern disposition in multiple layers. Release 1: a named human records the final disposition; the system never does. [E06] See the rule

21. The ops leader and the CTO disagree. Who decides, and whose side are you on?

I am on the side of the renewal and of what compliance allows. The ops leader owns the operational outcome and accepts a narrower release if it is used [E05]; the CTO's list conflicts with compliance on disposition [E06] and with capacity on connectors [E09]. Assumption The PDFs do not name a final decision owner, so I would bring the trade-off to both with the E12 sponsor's criteria as the tiebreaker, and record the decision. Note that the ops leader's commitment has already been discussed with executives [E05], so missing the 40% target is also a commercial risk, not just the CTO's demo.

22. The renewal is in ten weeks. What will you have to show, and is four weeks of usage enough?

By week 10 [E12]: about four weeks of real use after the six-week release Assumption, which is enough for leading measures (repeat use against the 18% baseline [E02], untraced claims against 14% [E03], reformatting against 27% [E10]) but probably not for a stable cycle-time result against the 40% goal [E05]. So the renewal story is adoption plus trust measures, plus a dated plan for the next connector with its security review underway. That is exactly what the sponsor asked for [E12]. Risk: the 40% cycle-time target was promised for this quarter [E05], and I would say plainly that the evidence for it will be early.

G. Measures, platform fit and AI process

23. You don't know the baseline cycle time. How can you commit to 40%?

I don't commit to it; the ops leader set it [E05]. The PDFs give no baseline, so instrumenting cycle time from exception creation to authorized disposition starts on day one of the release. Until then I track the parts we do have baselines for: 4.2 hours locating records [E01], 18% repeat use [E02], 14% untraced claims [E03], 27% reformatting [E10]. If we can pull historic timestamps from the case system, we get a baseline sooner. Assumption Whether those timestamps exist is not stated.

24. What part of this is Kamiwaza product and what is custom work for Northstar? How does it fit our architecture?

The platform pieces: on-prem model endpoints and local inference (Scenario, [E14]); per-user permissioned retrieval and an append-only audit trail. Kamiwaza's public pages describe matching capabilities: ReBAC authorization with audit, immutable append-only activity logging, a retrieval service, and an Inference Mesh that keeps inference inside the customer's environment without centralizing data Kamiwaza claim (kamiwaza.com/product and /inference-mesh, read Nov 3). The Northstar-specific parts are the packet template, the material-claim rule and the reviewer workflow. Assumption The generic pieces (claim-level citation, re-check at submit and export, the never-overwrite decision log) look reusable for other regulated customers; I would validate that with the product team rather than assume it.

25. How did you use AI on this exercise, and where did you overrule it?

Answer from your own recording. The instructions ask for: how you gave the AI context and constraints; what you delegated and what you decided; how you verified; one suggestion accepted and why; one rejected or corrected and why; and the uncertainty that remains (Candidate Instructions, AI use). A strong pattern to show: the AI drafted, you checked every evidence ID against the pack, and you rejected any claim that was not in the PDFs. If you have a real example of the AI proposing a broader scope (for example, more connectors) that you cut back to E09's constraint, that is an ideal rejected suggestion. Do not use an example that did not happen in your session.

Showing that AI work is never silently overwritten

Your principle: AI assumptions, decisions, prompts and commands are never silently overwritten. Every change is logged, versioned and human-approved, and the original is kept. In the case, this is not just a preference: compliance already requires the record to preserve the human approver, the source set, the model and prompt version, the edits and the final disposition [E06], and Northstar already has append-only audit storage [E14]. The design choices below beyond that are yours. Assumption

The rules (say these four lines)

  1. Logged. Every AI output, assumption, prompt, command and human edit is an event in the append-only audit store, with who (person or model), when, model version and prompt version [E06, E14].
  2. Versioned. A change never replaces a record in place; it creates version n+1 that points to version n, with a diff and a reason.
  3. Human-approved. The AI can propose a change to anything a human has approved, but only a named person can accept it. Dispositions are human-only [E06].
  4. Original kept. Version 1 is always retrievable. Superseded items are marked "superseded", never deleted. A revoked source removed at re-check is logged as a change, not erased silently [E11].

What gets versioned

ItemExample in the workflowWhat the log keeps
Assumption"Two sources disagree; using the case record date"Original wording, who confirmed or changed it, reason
DecisionAnalyst recommendation; reviewer return or approvalDecision, actor, time, source set at that moment [E06]
PromptPacket-drafting prompt templatePrompt version ID used for each draft [E06]
Command"Re-run retrieval", "remove claim", "export"Who issued it, inputs, result, permission check outcome
ClaimA cited sentence in the packetEvery edit as a new version with diff; the citation it rested on
Source setIncluded and excluded sourcesThe set at draft, submit, approval and export, and revocation removals [E04, E11]

How to show it in the presentation (90 seconds)

  1. Open a packet on the prototype or mock and point to a claim's version marker (for example, "v2, edited by analyst").
  2. Open its history: v1 is the AI draft, v2 is the analyst's correction with the reason. Show that v1 is still there.
  3. Show a pending AI suggestion on an approved claim: it sits as "proposed", the approved text is unchanged until a person accepts it.
  4. Trigger the revoked-document state: the claim is flagged, the source removal appears as a logged event, not a silent disappearance [E11].
  5. Close on the audit record: approver, source set, model and prompt version, edits, disposition [E06].
"Nothing the AI says can quietly change something a person already decided. It can only propose. The person approves, the log keeps both versions, and compliance can replay exactly what the reviewer saw."

Questions this invites, and short answers

  • Doesn't keeping everything create storage and privacy risk? The log lives in the existing append-only store [E14], inside Northstar's environment (Scenario). Versions carry the same permissions as the source they cite [E07]. Assumption Retention is a compliance decision the PDFs do not state.
  • Won't approval steps slow analysts down? Approval is needed only to change something already approved, and for the disposition. Drafting and editing before approval are free. Measure time-to-submit to check.
  • How does a reviewer see what changed? A diff between the AI draft and the submitted packet, which also answers E04's "why was this chosen, what was omitted".

Kamiwaza fit: its product page lists "immutable, append-only logging" for user actions, system events and AI agent activities, and model management with versioning (kamiwaza.com/product, read Nov 3). Kamiwaza claim

Your own session: the same principle applies to how you worked. In the recording, keep your prompts and the AI's answers visible, and when you change an AI suggestion, say what it said and why you changed it. That is the accepted and rejected suggestion the instructions ask for (Candidate Instructions, AI use).

Explainer video outline (3-5 minutes)

REQUIRED (AI use) The required working-session recording (not this explainer) must talk through one suggestion accepted and why, one rejected or corrected and why, and how S verified the work. Slots: top of this page.

Keep this separate from the required recording. The Candidate Instructions require a continuous, unedited recording of the working session with screen, camera and microphone, and say not to edit it into a polished presentation. This explainer is an extra video you asked for. Whether to submit it alongside is your call; label it clearly as a separate summary so it is not mistaken for the working-session recording.

Setup: camera and screen, clean desktop, quiet room. Have the brief, the mock or prototype, and the evidence pack open in tabs before you start. Target 4 minutes.

TimeOn screenWhat you say
0:00-0:20CameraWho you are, the exercise, and the one-sentence recommendation: a verifiable review packet on the two connected systems, human approval on every disposition.
0:20-1:00Evidence packThe problem is trust, not drafting: 84% accurate [E03] but 18% repeat use [E02]; 14% untraceable claims [E03]; analysts reopen sources [E04]. Name the uncertainty (E01 sample, E02 does not explain abandonment).
1:00-1:40Brief, first-release sectionWhat ships and why this scope: reliable connectors exist for two systems [E09]; ops leader accepts narrower if used [E05]; renewal sponsor wants adoption and a path, not five connectors [E12]. What does not ship and why [E06, E08, E09].
1:40-2:50Mock or prototypeWalk the frames. Stop on three states: a source fails to load (failure), the low-confidence inline confirmation [E13], the revoked document caught at submit [E11]. Point out that restricted sources never appear [E07].
2:50-3:20Decision log / history viewNothing is silently overwritten: v1 kept, edits versioned, AI proposes and a person approves, all in the audit record [E06, E14].
3:20-3:50Brief, commercial sectionNorthstar's CTO asked for everything [E08]; the demo shows the governed workflow, early adoption and a dated connector roadmap instead, which matches the renewal sponsor [E12] and compliance [E06].
3:50-4:30CameraHow you used AI: one suggestion accepted, one rejected, how you verified (from your real session). Measures and the week-1 validation. Close with the recommendation again.

Tips: one take per row is fine; read nothing word for word; say evidence IDs aloud ("that's E11"); do not mention any customer fact not in the PDFs; if you show the prototype, say "synthetic data".

Kamiwaza facts you may reference

Use sparingly; the exercise says there is no expectation that you know Kamiwaza's product in advance (Candidate Instructions). Each line was read on the named page on Nov 3, 2026 unless marked.

  • Positioning: a "secure enterprise AI orchestration platform" that gives agents access to data where it already lives (kamiwaza.com/product). Kamiwaza claim
  • Inference Mesh: "All Inference Mesh processing happens locally within your secure environment"; routes inference to where data resides, across CPUs and GPUs from several vendors (kamiwaza.com/inference-mesh). Kamiwaza claim
  • Security features listed: ReBAC authorization with auditability; immutable, append-only activity logging; Workrooms with compartmentalized access; Chainguard hardened containers; retrieval service; embedding and vector service; model management with versioning (kamiwaza.com/product). Kamiwaza claim
  • Their security page says protecting source data "does not automatically cover metadata, embeddings, or other derived knowledge assets", and that logging after the fact does not prevent overexposure at answer time (kamiwaza.com/security-and-compliance). A useful line for questions 6 and 7.
  • Company: founded 2023 by Luke Norris (CEO) and Matt Wallace (CTO); Kamiwaza 1.0 general availability May 1, 2026, positioned for regulated industries (kamiwaza.ai/about; PRWeb release).
  • Technical chief of staff: likely Matthew Probst, current headline "GM - Kamiwaza Federal & CISO". Unverified Confirm before the session.

Full research with every source URL: research.md and research.json in the Kamiwaza task folder, and the Kamiwaza context section of the tracker.