Run 0ba4d5bc
- Date
- Build
- 0.6.0-preDiffers from the v0.6.0 release only in comments, mock-only code and the version stamp.
- Used in the results page
- No
- Geode source
- de79ff4b26f0d707d273c76e3273fd55208d76f8
Load, save and release
Live Roblox serversEach run loads five fresh profiles, saves each, releases each after a change, loads them again and releases them again, with the steps on one key at least 8 seconds apart. Times are seconds from calling the library until its DataStore request finished.
Load, new profile
Median (the upright tick) and min to max of every sample (the bar). Medians less than one timing step (16.7 ms (1/60 s)) apart are ties.
Table: Time
| Subject | Median | Min | Max | n | Failed | Tie with |
|---|---|---|---|---|---|---|
| Geode | 0.32 s | 0.23 s | 0.32 s | 5 | 0 | – |
| Geode, mailbox = true | 0.57 s | 0.45 s | 1.22 s | 5 | 0 | – |
| ProfileStore | 0.73 s | 0.72 s | 0.80 s | 5 | 0 | – |
| ProfileService | 0.25 s | 0.23 s | 0.32 s | 5 | 0 | – |
| DataStore2, Standard saving | 0.08 s | 0.08 s | 0.10 s | 5 | 0 | – |
Requests per sample, by method. A range means the count varied between samples. 2 methods used.
| Subject | UpdateAsync | GetAsync | n | Counts |
|---|---|---|---|---|
| Geode | 1 | – | 5 | Same in every sample |
| Geode, mailbox = true | 1 | 1 | 5 | Same in every sample |
| ProfileStore | 1 | – | 5 | Same in every sample |
| ProfileService | 1 | – | 5 | Same in every sample |
| DataStore2, Standard saving | – | 1 | 5 | Same in every sample |
Load, stored profile
Median (the upright tick) and min to max of every sample (the bar). Medians less than one timing step (16.7 ms (1/60 s)) apart are ties.
Table: Time
| Subject | Median | Min | Max | n | Failed | Tie with |
|---|---|---|---|---|---|---|
| Geode | 250 ms | 216 ms | 283 ms | 5 | 0 | ProfileService |
| Geode, mailbox = true | 450 ms | 433 ms | 500 ms | 5 | 0 | – |
| ProfileStore | 733 ms | 733 ms | 783 ms | 5 | 0 | – |
| ProfileService | 266 ms | 216 ms | 283 ms | 5 | 0 | Geode |
| DataStore2, Standard saving | 33 ms | 33 ms | 33 ms | 5 | 0 | – |
Requests per sample, by method. A range means the count varied between samples. 2 methods used.
| Subject | UpdateAsync | GetAsync | n | Counts |
|---|---|---|---|---|
| Geode | 1 | – | 5 | Same in every sample |
| Geode, mailbox = true | 1 | 1 | 5 | Same in every sample |
| ProfileStore | 1 | – | 5 | Same in every sample |
| ProfileService | 1 | – | 5 | Same in every sample |
| DataStore2, Standard saving | – | 1 | 5 | Same in every sample |
Save
Median (the upright tick) and min to max of every sample (the bar). Medians less than one timing step (16.7 ms (1/60 s)) apart are ties.
Table: Time
| Subject | Median | Min | Max | n | Failed | Tie with |
|---|---|---|---|---|---|---|
| Geode | 266 ms | 200 ms | 283 ms | 5 | 0 | – |
| Geode, mailbox = true | 466 ms | 450 ms | 483 ms | 5 | 0 | – |
| ProfileStore | 700 ms | 683 ms | 766 ms | 5 | 0 | – |
| ProfileService | 216 ms | 199 ms | 300 ms | 5 | 0 | – |
| DataStore2, Standard saving | 283 ms | 266 ms | 334 ms | 5 | 0 | – |
Requests per sample, by method. A range means the count varied between samples. 1 method used.
| Subject | UpdateAsync | n | Counts |
|---|---|---|---|
| Geode | 1 | 5 | Same in every sample |
| Geode, mailbox = true | 1 | 5 | Same in every sample |
| ProfileStore | 1 | 5 | Same in every sample |
| ProfileService | 1 | 5 | Same in every sample |
| DataStore2, Standard saving | 1 | 5 | Same in every sample |
Release
Median (the upright tick) and min to max of every sample (the bar). Medians less than one timing step (16.7 ms (1/60 s)) apart are ties.
Table: Time
| Subject | Median | Min | Max | n | Failed | Tie with |
|---|---|---|---|---|---|---|
| Geode | 267 ms | 216 ms | 300 ms | 5 | 0 | DataStore2, Standard saving |
| Geode, mailbox = true | 467 ms | 433 ms | 517 ms | 5 | 0 | – |
| ProfileStore | 733 ms | 733 ms | 766 ms | 5 | 0 | – |
| ProfileService | 250 ms | 200 ms | 283 ms | 5 | 0 | – |
| DataStore2, Standard saving | 283 ms | 267 ms | 283 ms | 5 | 0 | Geode |
Requests per sample, by method. A range means the count varied between samples. 1 method used.
| Subject | UpdateAsync | n | Counts |
|---|---|---|---|
| Geode | 1 | 5 | Same in every sample |
| Geode, mailbox = true | 1 | 5 | Same in every sample |
| ProfileStore | 1 | 5 | Same in every sample |
| ProfileService | 1 | 5 | Same in every sample |
| DataStore2, Standard saving | 1 | 5 | Same in every sample |
Server hops
Live Roblox serversTwo Luau Execution tasks at once play the old and the new server. The old server loads a profile, saves 777, waits 8 seconds, then changes it to 888 (999 when it keeps the profile) without saving. Times are seconds from the new server's load call until it has the data.
Old server releases
The old server releases when the new one starts loading, the way a server releases when a player leaves for another one.
| Subject | Saw the final save |
|---|---|
| Geode | 3 of 3 |
| Geode, mailbox = true | 3 of 3 |
| ProfileStore | 3 of 3 |
| ProfileService | 3 of 3 |
| DataStore2, Standard saving | 0 of 3 |
Median (the upright tick) and min to max of every sample (the bar). Medians less than one timing step (16.7 ms (1/60 s)) apart are ties.
Table: Time
| Subject | Median | Min | Max | n | Failed | Tie with |
|---|---|---|---|---|---|---|
| Geode | 1.33 s | 0.98 s | 2.60 s | 3 | 0 | – |
| Geode, mailbox = true | 0.75 s | 0.70 s | 0.77 s | 3 | 0 | – |
| ProfileStore | 1.12 s | 0.70 s | 1.18 s | 3 | 0 | – |
| ProfileService | 7.32 s | 7.30 s | 7.38 s | 3 | 0 | – |
| DataStore2, Standard saving | 0.03 s | 0.03 s | 0.03 s | 3 | 0 | – |
Requests per sample, by method. A range means the count varied between samples. 3 methods used.
| Subject | UpdateAsync | GetAsync | GetAsync past the cache | n | Counts |
|---|---|---|---|---|---|
| Geode | 1 to 2 | – | 0 to 1 | 3 | Varied between samples |
| Geode, mailbox = true | 2 | 2 | 1 | 3 | Same in every sample |
| ProfileStore | 1 | – | – | 3 | Same in every sample |
| ProfileService | 2 | – | – | 3 | Same in every sample |
| DataStore2, Standard saving | – | 1 | – | 3 | Same in every sample |
Old server keeps it
The old server never releases on its own. 999 means the library got it to hand the profile over with its last change, 777 means the new server went ahead without it.
| Subject | Value seen |
|---|---|
| Geode | 999 in 1 of 1 |
| Geode, mailbox = true | 999 in 1 of 1 |
| ProfileStore | 999 in 1 of 1 |
| ProfileService | 999 in 1 of 1 |
| DataStore2, Standard saving | 777 in 1 of 1 |
Median (the upright tick) and min to max of every sample (the bar). Medians less than one timing step (16.7 ms (1/60 s)) apart are ties.
Table: Time
| Subject | Median | Min | Max | n | Failed | Tie with |
|---|---|---|---|---|---|---|
| Geode | 1.87 s | 1.87 s | 1.87 s | 1 | 0 | – |
| Geode, mailbox = true | 0.73 s | 0.73 s | 0.73 s | 1 | 0 | – |
| ProfileStore | 6.47 s | 6.47 s | 6.47 s | 1 | 0 | – |
| ProfileService | 21.30 s | 21.30 s | 21.30 s | 1 | 0 | – |
| DataStore2, Standard saving | 0.03 s | 0.03 s | 0.03 s | 1 | 0 | – |
Requests per sample, by method. A range means the count varied between samples. 3 methods used.
| Subject | UpdateAsync | GetAsync | GetAsync past the cache | n | Counts |
|---|---|---|---|---|---|
| Geode | 2 | – | 1 | 1 | Same in every sample |
| Geode, mailbox = true | 2 | 2 | 1 | 1 | Same in every sample |
| ProfileStore | 2 | – | – | 1 | Same in every sample |
| ProfileService | 4 | – | – | 1 | Same in every sample |
| DataStore2, Standard saving | – | 1 | – | 1 | Same in every sample |
Throttling
Live Roblox serversA burst of 160 or 161 UpdateAsync calls on throwaway keys uses up the server's request budget, then the library loads, saves and releases one profile back to back. One sample per run.
Load
Shown as a range only: the shortest and longest sample, no median.
Table: Time
| Subject | Min | Max | n | Failed |
|---|---|---|---|---|
| Geode | 32.91 s | 32.91 s | 1 | 0 |
| Geode, mailbox = true | 33.77 s | 33.77 s | 1 | 0 |
| ProfileStore | 31.74 s | 31.74 s | 1 | 0 |
| ProfileService | 31.34 s | 31.34 s | 1 | 0 |
| DataStore2, Standard saving | 31.04 s | 31.04 s | 1 | 0 |
Requests per sample, by method. A range means the count varied between samples. 2 methods used.
| Subject | UpdateAsync | GetAsync | n | Counts |
|---|---|---|---|---|
| Geode | 1 | – | 1 | Same in every sample |
| Geode, mailbox = true | 1 | 1 | 1 | Same in every sample |
| ProfileStore | 2 | – | 1 | Same in every sample |
| ProfileService | 1 | – | 1 | Same in every sample |
| DataStore2, Standard saving | – | 61 | 1 | Same in every sample |
Save
Shown as a range only: the shortest and longest sample, no median.
Table: Time
| Subject | Min | Max | n | Failed |
|---|---|---|---|---|
| Geode | 1.15 s | 1.15 s | 1 | 0 |
| Geode, mailbox = true | 1.17 s | 1.17 s | 1 | 0 |
| ProfileStore | 0.45 s | 0.45 s | 1 | 0 |
| ProfileService | 0.25 s | 0.25 s | 1 | 0 |
| DataStore2, Standard saving | 1.15 s | 1.15 s | 1 | 0 |
Requests per sample, by method. A range means the count varied between samples. 1 method used.
| Subject | UpdateAsync | n | Counts |
|---|---|---|---|
| Geode | 1 | 1 | Same in every sample |
| Geode, mailbox = true | 1 | 1 | Same in every sample |
| ProfileStore | 1 | 1 | Same in every sample |
| ProfileService | 1 | 1 | Same in every sample |
| DataStore2, Standard saving | 1 | 1 | Same in every sample |
Release
Shown as a range only: the shortest and longest sample, no median.
Table: Time
| Subject | Min | Max | n | Failed |
|---|---|---|---|---|
| Geode | 0.20 s | 0.20 s | 1 | 0 |
| Geode, mailbox = true | 0.18 s | 0.18 s | 1 | 0 |
| ProfileStore | 0.50 s | 0.50 s | 1 | 0 |
| ProfileService | 7.05 s | 7.05 s | 1 | 0 |
| DataStore2, Standard saving | 0.22 s | 0.22 s | 1 | 0 |
Requests per sample, by method. A range means the count varied between samples. 1 method used.
| Subject | UpdateAsync | n | Counts |
|---|---|---|---|
| Geode | 1 | 1 | Same in every sample |
| Geode, mailbox = true | 1 | 1 | Same in every sample |
| ProfileStore | 1 | 1 | Same in every sample |
| ProfileService | 1 | 1 | Same in every sample |
| DataStore2, Standard saving | 1 | 1 | Same in every sample |
Libraries
| Library | Version | Commit | Licence |
|---|---|---|---|
| ProfileStore | no releases, latest commit on main (2025-07-31) | MadStudioRoblox/ProfileStore@45c9847 | Apache-2.0 |
| ProfileService | no releases, latest commit on master (2024-10-13) | MadStudioRoblox/ProfileService@d736800 | Apache-2.0 |
| Lapis | v0.3.3 | nezuo/lapis@f140aca | MIT |
| Promise | v4.0.0, the version Lapis 0.3.3 asks for | evaera/roblox-lua-promise@2c6f433 | MIT |
| DataStore2 | ds2-1.4.0 | Kampfkarren/Roblox@ab81664 | custom: copying and changing allowed, changes to a published game's copy must be shared |
Couldn't run
- Lapis, Load, save and release
- RunService.PostSimulation didn't fire in this task, and Lapis sends its DataStore requests from that event
- Lapis, Server hops
- RunService.PostSimulation didn't fire in this task, and Lapis sends its DataStore requests from that event
- Lapis, Throttling
- RunService.PostSimulation didn't fire in this task, and Lapis sends its DataStore requests from that event
