Early access. The sandbox is open now; production keys open at launch. How going live works

Three good questions beat thirty mediocre ones

By Zak Fenton, MSc Workplace Health and Wellbeing (University of Nottingham), Alltoogether · Published 12 July 2026 · Last reviewed 28 September 2026 · Every claim is sourced; report errors and we fix them visibly.

Definition. A matrix-sampled pulse (also called a planned missing-data or split-questionnaire design) asks each person a small, rotating subset of a larger question pool, so the organisation covers many constructs while no individual ever faces a long survey. The Intelligent Wellbeing Engine asks 3 questions per fortnight: the same 2 anchors every time, plus 1 drawn from a rotating pool of 10. There are 12 questions in the set.
TL;DR: Done properly, asking three questions is a recognised measurement design with decades of literature behind it. The word "properly" is doing the work, because the design's guarantees come from well-chosen items, controlled rotation and honest reporting of uncertainty. Brevity on its own guarantees nothing. This page explains what three questions can honestly measure, and what they cannot.

1. Single items measure more than you think

The reflex objection to short surveys is that one question cannot measure a construct. For narrow, self-evident constructs, the evidence says otherwise: Wanous, Reichers and Hudy (1997, Journal of Applied Psychology) meta-analysed 17 studies covering 7,682 people and found single-item measures of overall job satisfaction correlated 0.67 (corrected) with full multi-item scales, and 0.72 against the best-constructed ones. Later single-item validations concur (Dolbier et al, 2005). The UK's own harmonised standard makes the same bet: the ONS-4 personal wellbeing questions, used across national statistics, are four single items.

Single items cannot decompose a construct into facets (which aspect of satisfaction, which source of demand). That is a real limitation. It is why deep-dive instruments are planned as a separate opt-in layer (coming, not sold yet), and no honest short survey should claim otherwise.

2. Long questionnaires pay for their length in quality

The length trade is not free in either direction. Galesic and Bosnjak (2009, Public Opinion Quarterly) randomised announced survey length and found participation fell as stated length grew, and that answer quality decayed within the questionnaire: answers to later questions were faster, shorter and more uniform. A 30-item battery gives less than 10 times the information of 3 items, because each added item brings less information while the participation cost compounds. Rolstad, Adler and Rydén (2011, Value in Health) add the caveat that content matters as much as length, so the three questions have to be the right three.

3. The design that makes 3 of 12 work

Covering a set of 12 questions with 3 per person per fortnight is a planned missing-data design, formalised by Raghunathan and Grizzle (1995) and developed through the three-form design literature (Graham et al, 2006): every respondent answers a common core (our 2 anchors, every cycle), and the third item rotates through a pool of 10 on a deterministic schedule: each person gets the pool item they answered least recently. Over about 20 weeks a person answers all 12. (The Alltoogether platform runs a nine-question configuration of the same design.) Because the engine decides who sees which item when, the question a person is not asked never depends on how they would have answered it. Planned missing-data designs rely on that control (Rhemtulla and Hancock, 2016), and Raghunathan and Grizzle found that little was lost by giving each person only part of a questionnaire.

The engine then reports what it can support, round by round. Each fortnightly round gets its own result with its own 95% confidence interval: the anchors from everyone who answered, and each rotating question from the people who were asked it that round. Trends are those results plotted round by round, each with its interval. Because a rotating question reaches only part of the workforce in any one round, its results rest on fewer people, carry wider intervals and are withheld more often.

"The set is twelve questions. The check-in is three. The rotation carries the difference, and because the engine schedules it, the question a person misses never depends on how they would have answered."

4. What we will not claim for it

We publish the design's limits here.

5. What to ask any vendor about a short survey

Which validated instrument does each item come from? Who decides the rotation, and is it deterministic and auditable? How do you estimate across cycles: one model over all observed answers, or cycle-by-cycle averages? What do you refuse to report because the design cannot support it? (The last one is the tell. Every measurement design has unsupportable claims; the honest vendor can list theirs, and ours are in the honesty rules.)

See it running

The interactive demo shows the pulse and its refusals live. Free for any employer at alltoogether.com · the method at openworkplacehealth.org · building it into your product is what this site is for.

References. Wanous JP, Reichers AE, Hudy MJ (1997) J Applied Psychology 82(2):247-252, doi:10.1037/0021-9010.82.2.247 · Galesic M, Bosnjak M (2009) Public Opinion Quarterly 73(2):349-360, doi:10.1093/poq/nfp031 · Rolstad S, Adler J, Rydén A (2011) Value in Health 14(8):1101-1108, doi:10.1016/j.jval.2011.06.003 · Graham JW et al (2006) Psychological Methods 11(4):323-343, doi:10.1037/1082-989X.11.4.323 · Rhemtulla M, Hancock GR (2016) Educational Psychologist 51(3-4):305-316, doi:10.1080/00461520.2016.1208094 · Raghunathan TE, Grizzle JE (1995) Journal of the American Statistical Association 90(429):54-63, doi:10.1080/01621459.1995.10476488 · Dolbier CL, Webster JA, McCalister KT, Mallon MW, Steinhardt MA (2005) American Journal of Health Promotion 19(3):194-198, doi:10.4278/0890-1171-19.3.194 · ONS harmonised personal wellbeing standard (ONS-4).
Written by Zak Fenton, MSc Workplace Health and Wellbeing (University of Nottingham), founder of Alltoogether. Published 12 July 2026 · last reviewed 28 September 2026.