clockworklabs_spacetimedb/docs/llms/docs-benchmark-summary.json
Tyler Cloutier 504b13ba4a
Small docs improvement (#4071)
# Description of Changes

  Two documentation improvements:

1. **Reducers documentation**: Clarified that using global/static
variables in reducers is **undefined behavior**, not just "values won't
persist". Added six specific reasons why this is undefined:
     - Fresh execution environments
     - Module updates
     - Concurrent execution
     - Crash recovery
     - Non-transactional updates
     - Replay safety

2. **Access permissions documentation**: Replaced the "Combining Both
Techniques" example that used indexes on Option fields (which
SpacetimeDB doesn't support) with a working example that filters by a
required `department` field instead.

  # API and ABI breaking changes

  None. Documentation only.

  # Expected complexity level and risk

  1 - Documentation changes only.

  # Testing

  - [ ] Verify the reducers warning is clear and accurate
  - [ ] Verify the access permissions example compiles and makes sense

---------

Signed-off-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>
Co-authored-by: clockwork-labs-bot <clockwork-labs-bot@users.noreply.github.com>
Co-authored-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Zeke Foppa <bfops@users.noreply.github.com>
2026-01-27 21:37:11 +00:00

113 lines
3.3 KiB
JSON
Generated

{
"version": 1,
"generated_at": "2026-01-27T20:01:19.767Z",
"by_language": {
"csharp": {
"modes": {
"docs": {
"hash": "e3621eaacfd5238fb514ff8c09c277ccd66170773959e5b391507110bf3ac17b",
"models": {
"GPT-5": {
"categories": {
"basics": {
"tasks": 12,
"total_tests": 27,
"passed_tests": 27,
"pass_pct": 100.0,
"task_pass_equiv": 12.0,
"task_pass_pct": 100.0
},
"schema": {
"tasks": 10,
"total_tests": 34,
"passed_tests": 25,
"pass_pct": 73.52941,
"task_pass_equiv": 7.3666663,
"task_pass_pct": 73.666664
}
},
"totals": {
"tasks": 22,
"total_tests": 61,
"passed_tests": 52,
"pass_pct": 85.2459,
"task_pass_equiv": 19.366667,
"task_pass_pct": 88.030304
}
}
}
}
}
},
"rust": {
"modes": {
"docs": {
"hash": "d1bf0b033db905c668d016082c762eb4b91edd1299f7b8d4bcc6def5398610f9",
"models": {
"GPT-5": {
"categories": {
"basics": {
"tasks": 12,
"total_tests": 27,
"passed_tests": 5,
"pass_pct": 18.518518,
"task_pass_equiv": 1.3333334,
"task_pass_pct": 11.111112
},
"schema": {
"tasks": 10,
"total_tests": 32,
"passed_tests": 8,
"pass_pct": 25.0,
"task_pass_equiv": 2.05,
"task_pass_pct": 20.5
}
},
"totals": {
"tasks": 22,
"total_tests": 59,
"passed_tests": 13,
"pass_pct": 22.033897,
"task_pass_equiv": 3.3833334,
"task_pass_pct": 15.378788
}
}
}
},
"rustdoc_json": {
"hash": "2a0f4ec42cac03fb3da542793b311e4b399845c688bb0660a6c231c82e96c56a",
"models": {
"GPT-5": {
"categories": {
"basics": {
"tasks": 12,
"total_tests": 27,
"passed_tests": 26,
"pass_pct": 96.296295,
"task_pass_equiv": 11.0,
"task_pass_pct": 91.66667
},
"schema": {
"tasks": 10,
"total_tests": 34,
"passed_tests": 23,
"pass_pct": 67.64706,
"task_pass_equiv": 6.5333333,
"task_pass_pct": 65.33333
}
},
"totals": {
"tasks": 22,
"total_tests": 61,
"passed_tests": 49,
"pass_pct": 80.327866,
"task_pass_equiv": 17.533335,
"task_pass_pct": 79.696976
}
}
}
}
}
}
}
}