Failure Taxonomy

STR / SEM / PRA / EPI — the four failure domains, twenty-four failure modes, and five severity levels for classifying validation findings.

Overview

UluOps classifies validation findings into four failure domains with twenty-four failure modes for consistent categorization across validators. This taxonomy ensures that findings from different validators can be compared, aggregated, and tracked using a shared vocabulary.

Each finding receives a failure code in the format DOMAIN-MODE/SEVERITY — for example, STR-OMI/C means a critical structural omission.

The Four Domains

STR — Structural

Failures related to the form, format, or organization of an artifact. Structural failures concern whether required elements are present, whether elements are well-formed, and whether elements are consistently organized.

SEM — Semantic

Failures related to the meaning, correctness, or logical consistency of an artifact. Semantic failures concern whether content is factually correct, logically coherent, and free from ambiguity.

PRA — Pragmatic

Failures related to the fitness of an artifact for its intended purpose and context. Pragmatic failures concern whether an artifact serves its stated goals, matches its audience, and remains maintainable over time.

EPI — Epistemic

Failures related to claims, confidence levels, and evidentiary support. Epistemic failures concern whether assertions are appropriately calibrated to available evidence.

Severity Codes

Each failure code ends with a severity indicator:

Mode Disambiguation

These pairs are commonly confused:

Terminology: Findings, Recommendations, and Issues

These three terms describe the same data at different lifecycle stages:

A validator produces findings, which are encoded as recommendations in the API payload, which become tracked issues in the database.

Using the Taxonomy

When saving validation runs, include failure codes in recommendations for cross-agent analytics:

recommendations: [{
  agent: 'code-validator',
  title: 'Missing null check on API response',
  priority: 'suggested',
  severity: 'high',
  failureCode: 'SEM-INC/H',
  failureDomain: 'SEM',
  failureMode: 'INC',
  filePath: 'src/api/client.ts',
  lineNumber: 42,
}]

Compound Code Format

The compound code pattern is {MODE}/{SEVERITY}:

STR-OMI/C   → Critical structural omission
SEM-INC/H   → High-severity semantic incorrectness
PRA-FRA/M   → Medium-severity pragmatic fragility
EPI-OVR/I   → Informational epistemic overclaim

The failure domain is always derivable from the mode prefix — STR-* → STR, SEM-* → SEM, etc.

Distribution in Practice

The taxonomy distribution across the UluOps ecosystem shows a consistent pattern:

Source: UluOps Tracker get_analytics({ metric: "taxonomy_distribution" }), 90-day window as of March 2026.

The STR+SEM dominance (~69%) reflects that most validation agents focus on code quality — where structural and semantic issues are the primary failure modes. The EPI domain is smaller because fewer agents operate in epistemic evaluation (primarily the cognitive lens agents like hume-analyst and popper-analyst). As the agent ecosystem grows to include more analysts and forecasters, expect the EPI share to increase.

Domain Portability

The taxonomy was developed for software validation but is designed to be domain-portable. The four domains (STR/SEM/PRA/EPI) map to any artifact type — a legal contract has structural omissions, semantic ambiguities, pragmatic misalignment, and epistemic overclaims just as code does.

How Portability Works

UluOps uses domain profiles (Domain Profile Schema v1.0.0) to decouple domain vocabulary from the universal taxonomy:

• Each domain defines its own issue types (e.g., legal: deficiency, ambiguity, compliance-gap)
• A tracker mapping resolves domain types to universal types for persistence
• Domain-specific severity descriptions and edge cases replace software defaults
• Terminology adapts to the domain (e.g., artifact → "contract", review_unit → "clause")

The failure domains themselves (STR/SEM/PRA/EPI) remain constant across domains — they describe universal categories of how things go wrong, not domain-specific vocabularies.

Falsifiability

This test has not yet been executed. All current data (4,400+ classified issues) comes from software validation. The domain profile schema and type mapping infrastructure are implemented, but no non-software agents have been deployed in production. Until cross-domain data exists, the portability claim remains a design hypothesis, not an empirical finding.

Analytics

The taxonomy enables cross-cutting analytics:

• Domain breakdown — What percentage of issues are structural vs semantic?
• Agent matrix — Which agents catch which failure modes? Where are blind spots?
• Trend analysis — Are semantic issues decreasing over time?

Use get_full_taxonomy_analytics (MCP) or client.analytics.getTaxonomy() (SDK) to query taxonomy-level metrics.