Research notesVRN-001 / Method note

Measuring secure communication pilots without confusing comfort with security

A reproducible measurement model for identity, devices, core workflow, controlled disruption and evidenced decisions.

12 minutesBIBTEXRIS

Methodological working paper. This publication reports no completed study, customer measurement or institutional partnership.

01

Research question

Which minimum measures show whether a team can complete a critical communication workflow under control and resume safely after disruption? The question is intentionally narrower than a general product assessment.

02

Unit of analysis

The unit is one complete workflow from defined start state to confirmed closure. Clicks and message volume are contextual only; correct outcome, time, assistance, failure and safe abort are primary.

  • One team with explicit roles
  • One critical workflow
  • One permitted test-data model
03

Measurement gates

Gate 1 tests identity and targeted revocation. Gate 2 measures the core workflow as a timeline. Gate 3 adds controlled friction. Gate 4 checks recovery and context integrity. A gate passes only against a pre-defined target.

04

Evidence matrix

Each finding separates expectation, visible observation, impact, reproducibility and decision. This keeps usability friction distinct from a security-relevant blocker. Average scores must not conceal individual blockers.

05

Stop criteria

The pilot pauses on ambiguous identity, ineffective revocation, data loss, uncontrolled authorisation or prohibited data. A stop is a successful control point: preserve cause, evidence correction and re-run the gate.

06

Replication package

A future field study should publish its charter, workflow script, data dictionary, anonymised evidence matrix, analysis logic and deviation log. Without these artefacts results are difficult to compare.