| Evaluation | Evaluator | Timing | Authority to change rules | What it measures |
|---|---|---|---|---|
| Participant surveys and exit polls each phase | Internal team | Every cycle | Advisory | Reach and participation, Process quality |
| City cycle summary reports | Internal team | Every cycle | Advisory | Reach and participation, Money and distribution, Projects and delivery, Downstream and institutional effects |
| Research Board (PBP and UC Berkeley) | Partner-led | One-time | Advisory | Reach and participation, Process quality |
| Stanford Crowdsourced Democracy Team analysis | Fully external academic body | Multi-cycle | Advisory | Reach and participation, Process quality |
| Steering Committee rulebook review | Partner-led | Every cycle | Advisory with required response | Process quality, Projects and delivery |
| City Council review and rulebook approval | Internal team | Every cycle | Binding | Projects and delivery, Money and distribution |
| Chapin thesis (CSU Sacramento) | Fully external academic body | One-time | Informational only | Process quality |
The loop that worked was procedural: the Steering Committee proposes rulebook changes (three-quarters vote in Cycle 1, a quorum afterwards) and the Council approves or changes them by majority vote, so every cycle got a new rulebook. Rules traceable to findings include the three-stage vetting after the Cycle 2 outcry, the CDBG program-and-service pot after Cycle 1 projects ran into public-funds law, nonprofit prequalification after partners without capacity stalled projects, the Cycle 3 focus on 20 to 34 year olds and online voting after two cycles of under-representation, lowering the voting age to 14 in Cycle 4, targeting assemblies at areas where fewer residents voted, and slimming the ballot from 33 to 12 proposals. The measurement was anonymous surveys and exit polls at assemblies, delegate meetings and polls, compared at p=0.01 with Census and ACS data, written up by the City for Cycles 1 to 3 only; no summary report, Research Board output or survey data exists in the archive after Cycle 3, and the Cycle 2 and 3 reports were both published in May 2016, well after the cycles. Cycle 3 evaluation also found something the convener did not want: online voting made representation less proportional, which the City answered with Stanford-designed targeted online advertising rather than a rule change.
Guest book
Notes left on Feedback Loops.
No notes yet. Be the first to leave one on this node.