← Tactical Air

Research progress and open questions

The experiments measure adaptation, team learning and memory tied to observable situations. Whether these mechanisms improve human play remains a separate question.

Completed in 0.3.0

Completed: first synthetic lab

See the lab. These tested families now serve as regression cases; they cannot remain an untouched validation set after guiding future changes.

Unmeasured: human enjoyment

No human-player data has been collected. The human-fixed-v1 protocol specifies a formative study with 6–10 participants. Keep incomplete sessions and reports of confusion. Analyze unaided explanations, deliberate counterplay, fairness, enjoyment and frustration alongside combat outcomes. No human finding is established by automated QA.

The question is whether players can recognize and enjoy the mechanic, with specific examples and failures. If the signal is unclear, revise telegraphs, tactical differences or the study length under a new version before adding scope.

Completed: switch-boundary control and retention test

Completed: individual, team, situation and history screens

The six-direction program completes individual adaptation, joint team choices with matched reward, observable terrain memory with a capacity control, A–B–A return histories, scripted misleading histories and training selection at a fixed total encounter budget. It adds 72,000 scored fights, plus 3,584 action-table diagnostic fights. All reproduce exactly. The fieldbook displays preselected real replays, odds, score changes and aggregate curves. The headless kit passed clean-extraction checks: 87 checksums, 15 tests, 4,724 direct combat reconstructions and a byte-identical regenerated 35-recording viewer.

No improvement candidate passed its locked gates. The solo effect is positive but small; joint choices do not beat independent choices; terrain memory adds no damage; return memory adds no clear advantage; hardness selection does not beat uniform training. The baiting test passes its harm margin but has no audited switch requiring a different optimum, so no deception-resistance claim is warranted. The original team learner still gains +6.05 HP over frozen memory in a secondary comparison.

Completed: validated opportunities and recovery

The new study enumerates every action before learning, retains all 3,072 candidates, and requires bidirectional damage/reward separation. It adds 46,080 reserved encounters plus 4,608 development encounters, all reproduced exactly. Three isolated roles and two public-terrain memory hosts pass their declared gates. Joint squad choices remain inconclusive and trail independent choices with matched reward in a secondary comparison.

Recovery and cumulative regret now have explicit, reproducible definitions. Most solo learners recover within 32 encounters, but stale memory slows them compared with externally timed reset. Context memory helps when a public feature predicts what works. The viewer makes the state changes, action opportunities, real choices and aggregate curves inspectable; even the preselected vanguard seed's admission failure is retained. The headless kit passed clean-extraction validation.

Completed: noisy change detection and forgetting

The change-detection study adds 69,120 scored fights, all replayed exactly, across three isolated roles, five memory rules and abrupt, gradual, recurring and stationary histories. All 48 role/seed cases qualify. Both a full-reset detector and action-specific forgetting fail all improvement and stability gates; their only passing check is sample size. Stable false alarms occur 2.93–6.05 times per 100 fights. The original learner remains useful against abrupt changes; this forgetting heuristic makes it worse.

The fieldbook exposes actual fights, rewards, alarms and discarded scores beside all-seed results. Cached development, every rejected admission candidate, independent detector reconstruction and a reusable headless kit are preserved. This is a measured rejection, not a new game feature.

Completed: conservative intervention development

The follow-up completes deterioration-only evidence, half-strength score interventions and separate observation batches on longer known histories. Stress tests cover outliers, saturation, sparse observations and ignored feedback. All three candidates fail the benefit gates; none consumes fresh validation. The original learner remains unchanged. The recorded viewer, complete transition record and downloadable kit preserve the negative result.

Next: context transfer and team sample allocation

  1. Test the useful public-context rule on reserved unfamiliar layouts and less exact repetitions. Keep pooled and shuffled-label capacity controls. Current terrain evidence does not establish transfer.
  2. Separate squad sample allocation from representation under matched shared reward and total cost. Keep independent roles as a baseline and account for their different induced exploration distribution.
  3. Require a new mechanism-level hypothesis before another forgetting study. Use known stable and recurring histories for development first; reserve fresh validation only after a candidate earns it.
  4. Revisit curriculum selection by learning progress after these mechanisms are better understood. Preserve all failed cases and budget every extra probe.

Additional questions

For each iteration: define a hypothesis and success criterion, freeze the protocol, change one mechanism, retain all outcomes, verify provenance, play it, and record the decision in research status.