Each test isolates a different claim about Compounding Expertise. Together they are designed to show where the theory works, where it breaks, and where other forms of Power may dominate.
Canonical question: Can repeated, economically consequential, objectively graded decisions create expertise that a capable challenger cannot quickly reproduce?
What this test isolates: Does CE work under favorable conditions?
Principal decisionDispute / fraud / exception resolution action.Grade objectivityRelatively highFeedback speedRelatively fast - days/weeks as an archetype assumptionCase frequencyHigh / repeated workflowPrimary Power hypothesisCompounding Expertise, potentially reinforcing Network Economies and Process Power.Synthetic case count28 rows
Company basisPublic-company archetype; source verification pending.Archetype assumptionsCanonical metadata is analytical test-fixture metadata, not verified company measurement.Case dataSYNTHETIC ILLUSTRATIVE DATA - Synthetic disputes scorebook, not Casap data
Secondary detail
Economic stakes: High
Transfer potential: Plausibly high but requires evidence
Historical dependence: Potentially important
Expected behavior: Compounding Expertise should be plausible if cross-customer transfer and resistance to compression are demonstrated.
Lab failure condition: If the Lab rejects CE merely because case count is modest, or accepts CE without testing transferability/compressibility, the framework is behaving poorly.
Competing Power hypothesis: Workflow distribution, process execution, or data rights may matter as much as the scorebook.
Canonical question: Is accumulated proprietary knowledge the same thing as accumulated graded expertise?
What this test isolates: When is accumulated knowledge not graded expertise?
Principal decisionResearch insight / recommendation used to support later product, marketing, or strategy decisions.Grade objectivityLow-to-medium / often indirectFeedback speedDelayed and sometimes ambiguousCase frequencyPotentially high research volume, but not necessarily high graded-decision volumePrimary Power hypothesisPotentially valuable proprietary knowledge / filing cabinet rather than a true scorebook.Synthetic case count24 rows
Company basisPublic-company archetype; source verification pending.Archetype assumptionsCanonical metadata is analytical test-fixture metadata, not verified company measurement.Case dataSYNTHETIC ILLUSTRATIVE DATA - Synthetic research/listening scorebook, not Listen Labs data
Secondary detail
Economic stakes: Medium / context-dependent
Transfer potential: Uncertain
Historical dependence: Questionable
Expected behavior: The Lab should not infer strong CE merely from large amounts of proprietary research or customer knowledge.
Lab failure condition: If interview/research volume alone creates a strong CE conclusion without an observable decision/outcome/grade loop, the Lab has confused the filing cabinet with the scorebook.
Competing Power hypothesis: Brand, workflow ownership, research distribution, or proprietary access may dominate.
Canonical question: Can sufficiently capable models or simulation substitute for real-world experience that historically had to be accumulated case by case?
What this test isolates: Can model/simulation capability substitute for accumulated experience?
Principal decisionPrediction/simulation of likely human or market response to a proposed action.Grade objectivityPotentially high when simulation predictions are later compared with actual outcomesFeedback speedDepends on prediction horizonCase frequencyPotentially high through simulationPrimary Power hypothesisModel/simulation capability may compress the value of historical scorebooks.Synthetic case count22 rows
Company basisPublic-company archetype; source verification pending.Archetype assumptionsCanonical metadata is analytical test-fixture metadata, not verified company measurement.Case dataSYNTHETIC ILLUSTRATIVE DATA - Synthetic model-first research scorebook, not Aaru data
Secondary detail
Economic stakes: Use-case dependent
Transfer potential: Potentially central
Historical dependence: Core question - potentially lower if model priors/simulation substitute for experience
Expected behavior: Increasing base-model/simulation capability should be capable of reducing the modeled advantage of historical experience.
Lab failure condition: If the Lab always rewards the larger historical scorebook and cannot represent model/simulation substitution, the theory test is incomplete.
Competing Power hypothesis: Base model capability, simulation quality, or synthetic data generation may dominate proprietary experience.
Canonical question: Does an AI company need Compounding Expertise at all, or can durable Power reside in deterministic domain infrastructure?
What this test isolates: Can durable Power reside somewhere other than CE?
Principal decisionStructured fund/finance calculation or controlled operational action.Grade objectivityVery highFeedback speedImmediate/shortCase frequencyRepeated but not necessarily strategically important for learningPrimary Power hypothesisDeterministic rails, Process Power, Switching Costs, domain infrastructure.Synthetic case count26 rows
Company basisPublic-company archetype; source verification pending.Archetype assumptionsCanonical metadata is analytical test-fixture metadata, not verified company measurement.Case dataSYNTHETIC ILLUSTRATIVE DATA - Synthetic deterministic-rails scorebook, not Maybern data
Secondary detail
Economic stakes: High
Transfer potential: Not necessarily the primary strategic variable
Historical dependence: Potentially secondary
Expected behavior: The Lab should be capable of concluding weak/modest CE but potentially strong business Power elsewhere.
Lab failure condition: If weak CE automatically produces a weak-company conclusion, the Lab is improperly treating CE as the only form of Power.
Competing Power hypothesis: Compounding Expertise may be weak/modest while business Power resides elsewhere.
Canonical question: When can enormous volumes of apparently graded data fail to create durable expertise?
What this test isolates: Can huge volumes of apparently graded data still fail to create durable expertise?
Principal decisionCreative / message / audience / campaign allocation choice.Grade objectivitySuperficially measurable but causally noisyFeedback speedFast for clicks/conversions; slower for durable economic outcomesCase frequencyVery highPrimary Power hypothesisPossibly none from CE alone.Synthetic case count32 rows
Company basisEntirely synthetic archetype.Archetype assumptionsCanonical metadata is analytical test-fixture metadata, not verified company measurement.Case dataSYNTHETIC ILLUSTRATIVE DATA - Synthetic creative marketing agent scorebook
Secondary detail
Economic stakes: Medium
Transfer potential: Potentially broad but highly context-sensitive
Historical dependence: Large datasets may exist but contain substantial redundancy
Expected behavior: Large data volume should not automatically produce strong CE when outcomes are confounded, nonstationary, redundant, or easily learned by frontier models.
Lab failure condition: If the Lab declares strong CE primarily from volume and fast click feedback, the analytical framework has failed its negative control.
Competing Power hypothesis: Workflow distribution, brand, media buying economics, or creative process may matter more.