| Evaluation | Evaluator | Timing | Authority to change rules | What it measures |
|---|---|---|---|---|
| A People's Budget research and evaluation | Partner-led | Every cycle | Advisory | Reach and participation, Money and distribution, Process quality, Downstream and institutional effects |
| District evaluation meeting after the vote | Participants themselves | Every cycle | Advisory | Process quality |
| Citywide Committee rulebook review | Partner-led | Every cycle | Advisory | Process quality |
| Public Agenda national PB metrics (2014-15, 2015-16) | Arms-length partner | Every cycle | Informational only | Reach and participation, Money and distribution, Process quality |
| Project status tracking on the Open Data Portal | Internal team | Every cycle | Informational only | Projects and delivery |
The main evaluation was run by the Community Development Project at the Urban Justice Center with a PBNYC Research Team and an academic advisory board, funded by foundations, for Cycles 1 to 4 (over 5,000 surveys, 35 interviews and 91 observations in the pilot; nearly 9,000 surveys, 104 interviews, 53 observations and 12,613 centrally counted ballots in Cycle 3; over 22,000 voter surveys, 264 staff and facilitator implementation surveys and 13 interviews with contracted outreach organizations in Cycle 4). CDP sat on the Steering Committee, so it is partner-led rather than arms-length. Its findings were advisory, but several became rules: the pilot report recommended lowering the voting age to 16 and the Cycle 2 rulebook did so; the Cycle 3 report recommended online or SMS voting, attaching the voter survey to the ballot, a searchable project database and central staffing, and later rulebooks brought digital voting, central ballot counting and project status updates on the Open Data Portal. Public Agenda folded CDP's data into two national reports on the 2014-15 and 2015-16 cycles using its 15 key metrics; it had no authority over NYC's rules. The rulebook itself is the second loop: it is 'revised annually through input from stakeholders and staff', and each district must hold an evaluation meeting after the vote. Who can change rules shifted: in Cycles 3 to 6 the Steering Committee changed the rulebook by a 66 percent vote; in Cycle 7 the Advisory Committee decided by 50.1 percent; by Cycle 9 the Citywide Committee 'gives feedback on the PB rulebook' and the Council revises it. Whether CDP-style evaluation continued after Cycle 4 is not documented in these sources; the Council's later press releases report turnout and dollars but no demographics beyond youth share and ballot language.
Guest book
Notes left on Feedback Loops.
No notes yet. Be the first to leave one on this node.