Runtime estimation report
This is a snapshot of the latest archived evm-gasfit run. All numerical tables and regression summaries are retained. Plots are omitted. Runtime estimates do not depend on the gas anchor. See the supporting report for the source details and gas estimates at 75 Mgas/s.
This report fits test_runtime_ms against opcount using nonnegative least squares (NNLS). Each row covers one target opcode, test, model configuration, and client.
Contents
SLOAD
test_sload_bloated: combo False
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.974 |
0.01016 |
1.00e-03 |
[0.009943, 0.01038] |
erigon |
231 |
0.9914 |
0.003528 |
1.00e-03 |
[0.003484, 0.003576] |
ethrex |
165 |
0.8544 |
0.001865 |
1.00e-03 |
[0.001758, 0.001981] |
geth |
286 |
0.9723 |
0.0217 |
1.00e-03 |
[0.02126, 0.02217] |
nethermind |
209 |
0.8464 |
0.002533 |
1.00e-03 |
[0.002382, 0.002685] |
reth |
209 |
0.9803 |
0.005326 |
1.00e-03 |
[0.005223, 0.005439] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 220 RMSE: 48.86
Df Residuals: 218 MAE: 39.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 192.8576 10.1407 0.001 172.2782 212.6350
opcount 0.0102 0.0001 0.001 0.0099 0.0104
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.991
Model: NNLS Adj. R-squared: 0.991
No. Observations: 231 RMSE: 9.68
Df Residuals: 229 MAE: 6.62
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.7396 1.9378 0.001 5.8426 13.2907
opcount 0.0035 0.0000 0.001 0.0035 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.854
Model: NNLS Adj. R-squared: 0.853
No. Observations: 165 RMSE: 22.67
Df Residuals: 163 MAE: 18.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 160.5968 5.9996 0.001 149.1483 171.5477
opcount 0.0019 0.0001 0.001 0.0018 0.0020
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 286 RMSE: 107.91
Df Residuals: 284 MAE: 87.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 569.6012 20.6284 0.001 529.1801 608.1148
opcount 0.0217 0.0002 0.001 0.0213 0.0222
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.846
Model: NNLS Adj. R-squared: 0.846
No. Observations: 209 RMSE: 31.77
Df Residuals: 207 MAE: 26.20
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 68.2940 6.5472 0.001 55.8875 81.3843
opcount 0.0025 0.0001 0.001 0.0024 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 209 RMSE: 22.24
Df Residuals: 207 MAE: 17.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 121.0869 4.6623 0.001 111.8756 130.3419
opcount 0.0053 0.0001 0.001 0.0052 0.0054
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_sload_bloated: combo True
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9791 |
0.0163 |
1.00e-03 |
[0.01596, 0.01662] |
erigon |
231 |
0.9952 |
0.00382 |
1.00e-03 |
[0.003785, 0.003852] |
ethrex |
165 |
0.9711 |
0.007433 |
1.00e-03 |
[0.007241, 0.007642] |
geth |
286 |
0.9736 |
0.0219 |
1.00e-03 |
[0.02142, 0.02236] |
nethermind |
209 |
0.9631 |
0.007617 |
1.00e-03 |
[0.007413, 0.007819] |
reth |
209 |
0.9808 |
0.005397 |
1.00e-03 |
[0.005299, 0.005491] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 220 RMSE: 70.04
Df Residuals: 218 MAE: 56.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 527.2150 15.1789 0.001 498.1693 560.4275
opcount 0.0163 0.0002 0.001 0.0160 0.0166
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 231 RMSE: 7.80
Df Residuals: 229 MAE: 5.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 15.4975 1.5903 0.001 12.4585 18.8637
opcount 0.0038 0.0000 0.001 0.0038 0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.971
No. Observations: 165 RMSE: 37.73
Df Residuals: 163 MAE: 31.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 188.9535 9.7678 0.001 169.8363 207.6871
opcount 0.0074 0.0001 0.001 0.0072 0.0076
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 286 RMSE: 106.08
Df Residuals: 284 MAE: 85.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 537.1295 20.9914 0.001 498.0687 577.1506
opcount 0.0219 0.0002 0.001 0.0214 0.0224
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.963
Model: NNLS Adj. R-squared: 0.963
No. Observations: 209 RMSE: 43.87
Df Residuals: 207 MAE: 33.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 117.7130 9.1662 0.001 100.3695 135.3325
opcount 0.0076 0.0001 0.001 0.0074 0.0078
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 209 RMSE: 22.23
Df Residuals: 207 MAE: 16.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 130.4682 4.5499 0.001 121.8800 139.2844
opcount 0.0054 0.0000 0.001 0.0053 0.0055
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_sload_same_key_benchmark
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.2923 |
0.0002257 |
1.00e-03 |
[0.00019, 0.0002645] |
erigon |
462 |
0.1139 |
1.248e-05 |
1.00e-03 |
[9.097e-06, 1.563e-05] |
ethrex |
330 |
0.828 |
3.723e-05 |
1.00e-03 |
[3.526e-05, 3.904e-05] |
geth |
572 |
0.9063 |
6.716e-05 |
1.00e-03 |
[6.547e-05, 6.892e-05] |
nethermind |
418 |
0.4998 |
8.555e-05 |
1.00e-03 |
[7.735e-05, 9.385e-05] |
reth |
418 |
0.8022 |
1.15e-05 |
1.00e-03 |
[1.096e-05, 1.203e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.292
Model: NNLS Adj. R-squared: 0.291
No. Observations: 440 RMSE: 221.90
Df Residuals: 438 MAE: 209.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 199.8512 32.6570 0.001 130.6942 263.3670
opcount 0.0002 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.114
Model: NNLS Adj. R-squared: 0.112
No. Observations: 462 RMSE: 21.99
Df Residuals: 460 MAE: 20.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 17.4879 2.9091 0.001 11.9885 23.5220
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.828
Model: NNLS Adj. R-squared: 0.827
No. Observations: 330 RMSE: 10.72
Df Residuals: 328 MAE: 8.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 16.1986 1.7645 0.001 13.0230 19.7824
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.906
Model: NNLS Adj. R-squared: 0.906
No. Observations: 572 RMSE: 13.65
Df Residuals: 570 MAE: 10.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.9686 1.7188 0.001 23.3663 30.3539
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.500
Model: NNLS Adj. R-squared: 0.499
No. Observations: 418 RMSE: 54.07
Df Residuals: 416 MAE: 41.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 40.2594 7.4111 0.001 26.2271 55.1666
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.802
Model: NNLS Adj. R-squared: 0.802
No. Observations: 418 RMSE: 3.61
Df Residuals: 416 MAE: 2.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 8.0896 0.5299 0.001 7.0802 9.0886
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE
test_sstore_bloated: combo False: presets[cold_storage_sstore_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9681 |
0.01902 |
1.00e-03 |
[0.01854, 0.01951] |
erigon |
231 |
0.992 |
0.003485 |
1.00e-03 |
[0.003436, 0.003523] |
ethrex |
165 |
0.9256 |
0.001889 |
1.00e-03 |
[0.001806, 0.001973] |
geth |
286 |
0.9699 |
0.0215 |
1.00e-03 |
[0.02103, 0.02195] |
nethermind |
209 |
0.8542 |
0.002504 |
1.00e-03 |
[0.002352, 0.002653] |
reth |
209 |
0.9819 |
0.005329 |
1.00e-03 |
[0.005226, 0.005423] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.968
Model: NNLS Adj. R-squared: 0.968
No. Observations: 220 RMSE: 102.17
Df Residuals: 218 MAE: 87.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 491.0841 22.1858 0.001 445.9863 534.6586
opcount 0.0190 0.0002 0.001 0.0185 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.992
No. Observations: 231 RMSE: 9.25
Df Residuals: 229 MAE: 6.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.5965 2.0136 0.001 5.9969 13.8952
opcount 0.0035 0.0000 0.001 0.0034 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.926
Model: NNLS Adj. R-squared: 0.925
No. Observations: 165 RMSE: 15.84
Df Residuals: 163 MAE: 12.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 154.8243 3.6977 0.001 147.3949 162.1697
opcount 0.0019 0.0000 0.001 0.0018 0.0020
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.970
Model: NNLS Adj. R-squared: 0.970
No. Observations: 286 RMSE: 112.10
Df Residuals: 284 MAE: 92.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 586.4551 21.5896 0.001 546.0509 630.8404
opcount 0.0215 0.0002 0.001 0.0210 0.0220
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.854
Model: NNLS Adj. R-squared: 0.853
No. Observations: 209 RMSE: 30.61
Df Residuals: 207 MAE: 24.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 74.1325 6.4905 0.001 62.2391 86.4837
opcount 0.0025 0.0001 0.001 0.0024 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 209 RMSE: 21.42
Df Residuals: 207 MAE: 16.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 119.2851 4.4968 0.001 110.4970 128.6628
opcount 0.0053 0.0000 0.001 0.0052 0.0054
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_sstore_bloated: combo True: presets[cold_storage_sstore_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9755 |
0.0244 |
1.00e-03 |
[0.02387, 0.02496] |
erigon |
231 |
0.9975 |
0.003851 |
1.00e-03 |
[0.003827, 0.003873] |
ethrex |
165 |
0.9858 |
0.007478 |
1.00e-03 |
[0.007341, 0.007626] |
geth |
286 |
0.9763 |
0.02199 |
1.00e-03 |
[0.02149, 0.02239] |
nethermind |
209 |
0.956 |
0.007784 |
1.00e-03 |
[0.007534, 0.008017] |
reth |
209 |
0.9806 |
0.005472 |
1.00e-03 |
[0.005369, 0.005572] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.975
No. Observations: 220 RMSE: 114.36
Df Residuals: 218 MAE: 95.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 679.7662 25.1594 0.001 628.1006 728.1234
opcount 0.0244 0.0003 0.001 0.0239 0.0250
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.998
Model: NNLS Adj. R-squared: 0.998
No. Observations: 231 RMSE: 5.69
Df Residuals: 229 MAE: 4.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.8651 1.1446 0.001 7.6560 12.1860
opcount 0.0039 0.0000 0.001 0.0038 0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 165 RMSE: 26.53
Df Residuals: 163 MAE: 22.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 175.2746 6.4827 0.001 161.6532 187.6948
opcount 0.0075 0.0001 0.001 0.0073 0.0076
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 286 RMSE: 101.48
Df Residuals: 284 MAE: 81.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 524.8916 19.5615 0.001 490.6055 566.4099
opcount 0.0220 0.0002 0.001 0.0215 0.0224
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.956
Model: NNLS Adj. R-squared: 0.956
No. Observations: 209 RMSE: 49.39
Df Residuals: 207 MAE: 36.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 100.5868 9.5979 0.001 81.9654 120.0470
opcount 0.0078 0.0001 0.001 0.0075 0.0080
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 209 RMSE: 22.78
Df Residuals: 207 MAE: 17.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 126.4415 4.5064 0.001 117.9899 135.3254
opcount 0.0055 0.0001 0.001 0.0054 0.0056
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_sstore_bloated: combo False: presets[cold_storage_sstore_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9034 |
0.1107 |
1.00e-03 |
[0.1056, 0.1154] |
erigon |
231 |
0.997 |
0.1674 |
1.00e-03 |
[0.1661, 0.1686] |
ethrex |
165 |
0 |
0 |
1.00e+00 |
[0, 0] |
geth |
286 |
0.9193 |
0.1529 |
1.00e-03 |
[0.1478, 0.158] |
nethermind |
209 |
0.6348 |
0.09007 |
1.00e-03 |
[0.07989, 0.09886] |
reth |
209 |
0.9832 |
0.1209 |
1.00e-03 |
[0.1187, 0.123] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.903
Model: NNLS Adj. R-squared: 0.903
No. Observations: 220 RMSE: 23.38
Df Residuals: 218 MAE: 17.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.4186 5.3086 0.001 122.4416 143.4076
opcount 0.1107 0.0025 0.001 0.1056 0.1154
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 231 RMSE: 5.90
Df Residuals: 229 MAE: 4.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 105.5243 1.3796 0.001 102.9042 108.4007
opcount 0.1674 0.0006 0.001 0.1661 0.1686
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.000
Model: NNLS Adj. R-squared: -0.006
No. Observations: 165 RMSE: 501.05
Df Residuals: 163 MAE: 484.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 946.7481 38.8619 0.001 872.3785 1020.6378
opcount 0.0000 0.0000 1.000 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.919
Model: NNLS Adj. R-squared: 0.919
No. Observations: 286 RMSE: 29.27
Df Residuals: 284 MAE: 21.86
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 68.9117 5.2748 0.001 58.3914 79.8553
opcount 0.1529 0.0026 0.001 0.1478 0.1580
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.635
Model: NNLS Adj. R-squared: 0.633
No. Observations: 209 RMSE: 44.12
Df Residuals: 207 MAE: 36.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 67.0142 8.8793 0.001 50.6918 85.5246
opcount 0.0901 0.0048 0.001 0.0799 0.0989
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 209 RMSE: 10.20
Df Residuals: 207 MAE: 7.63
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 60.7876 1.9911 0.001 56.8936 64.6931
opcount 0.1209 0.0011 0.001 0.1187 0.1230
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_sstore_bloated: combo True: presets[cold_storage_sstore_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9601 |
0.08925 |
1.00e-03 |
[0.08677, 0.09162] |
erigon |
231 |
0.9989 |
0.1104 |
1.00e-03 |
[0.1099, 0.1109] |
ethrex |
165 |
0.7008 |
0.02241 |
1.00e-03 |
[0.02031, 0.02417] |
geth |
286 |
0.9887 |
0.1102 |
1.00e-03 |
[0.1089, 0.1115] |
nethermind |
209 |
0.6625 |
0.07888 |
1.00e-03 |
[0.07023, 0.08645] |
reth |
209 |
0.9391 |
0.08332 |
1.00e-03 |
[0.08059, 0.0863] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 220 RMSE: 94.70
Df Residuals: 218 MAE: 77.63
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 385.6765 18.8714 0.001 348.4412 423.1744
opcount 0.0893 0.0012 0.001 0.0868 0.0916
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.999
Model: NNLS Adj. R-squared: 0.999
No. Observations: 231 RMSE: 18.71
Df Residuals: 229 MAE: 13.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 398.4491 4.1186 0.001 390.5434 406.7400
opcount 0.1104 0.0002 0.001 0.1099 0.1109
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.701
Model: NNLS Adj. R-squared: 0.699
No. Observations: 165 RMSE: 76.19
Df Residuals: 163 MAE: 60.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 671.4231 19.3066 0.001 636.9461 711.8754
opcount 0.0224 0.0010 0.001 0.0203 0.0242
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.989
Model: NNLS Adj. R-squared: 0.989
No. Observations: 286 RMSE: 61.26
Df Residuals: 284 MAE: 46.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 373.5914 10.3771 0.001 353.2976 393.0977
opcount 0.1102 0.0007 0.001 0.1089 0.1115
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.663
Model: NNLS Adj. R-squared: 0.661
No. Observations: 209 RMSE: 292.88
Df Residuals: 207 MAE: 217.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 246.6617 60.6940 0.001 130.9695 367.1790
opcount 0.0789 0.0040 0.001 0.0702 0.0865
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.939
Model: NNLS Adj. R-squared: 0.939
No. Observations: 209 RMSE: 110.40
Df Residuals: 207 MAE: 90.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 273.2022 20.6356 0.001 233.5135 312.4730
opcount 0.0833 0.0015 0.001 0.0806 0.0863
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE
test_ext_account_query_warm: combo BALANCE
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.857 |
0.0001281 |
1.00e-03 |
[0.0001212, 0.0001347] |
erigon |
231 |
0.7315 |
1.908e-05 |
1.00e-03 |
[1.761e-05, 2.054e-05] |
ethrex |
165 |
0.7873 |
2.257e-05 |
1.00e-03 |
[2.072e-05, 2.446e-05] |
geth |
286 |
0.8207 |
4.097e-05 |
1.00e-03 |
[3.874e-05, 4.347e-05] |
nethermind |
209 |
0.7331 |
7.612e-05 |
1.00e-03 |
[6.975e-05, 8.231e-05] |
reth |
209 |
0.8524 |
1.731e-05 |
1.00e-03 |
[1.636e-05, 1.831e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.857
Model: NNLS Adj. R-squared: 0.856
No. Observations: 220 RMSE: 30.60
Df Residuals: 218 MAE: 25.11
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 194.3702 6.6539 0.001 181.7343 207.9987
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.731
Model: NNLS Adj. R-squared: 0.730
No. Observations: 231 RMSE: 6.76
Df Residuals: 229 MAE: 5.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 18.9802 1.3559 0.001 16.3468 21.6636
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.787
Model: NNLS Adj. R-squared: 0.786
No. Observations: 165 RMSE: 6.86
Df Residuals: 163 MAE: 5.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.6343 1.6277 0.001 6.4918 12.9782
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.821
Model: NNLS Adj. R-squared: 0.820
No. Observations: 286 RMSE: 11.20
Df Residuals: 284 MAE: 8.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 21.5452 2.0900 0.001 16.9039 25.5046
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.733
Model: NNLS Adj. R-squared: 0.732
No. Observations: 209 RMSE: 26.87
Df Residuals: 207 MAE: 18.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 23.9121 5.6341 0.001 13.8334 35.3068
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.852
Model: NNLS Adj. R-squared: 0.852
No. Observations: 209 RMSE: 4.21
Df Residuals: 207 MAE: 3.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 10.9523 0.9463 0.001 9.1637 12.8478
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo BALANCE_AccountMode.EXISTING_EOA
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9722 |
0.01584 |
1.00e-03 |
[0.0156, 0.01608] |
erigon |
462 |
0.9899 |
0.003897 |
1.00e-03 |
[0.003862, 0.003933] |
ethrex |
330 |
0.4885 |
0.01817 |
1.00e-03 |
[0.01627, 0.01948] |
geth |
572 |
0.9773 |
0.0209 |
1.00e-03 |
[0.02062, 0.02114] |
nethermind |
418 |
0.8342 |
0.00349 |
1.00e-03 |
[0.003338, 0.003656] |
reth |
418 |
0.9679 |
0.004819 |
1.00e-03 |
[0.004737, 0.004906] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 440 RMSE: 55.29
Df Residuals: 438 MAE: 45.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 301.6649 7.9685 0.001 285.9325 316.6907
opcount 0.0158 0.0001 0.001 0.0156 0.0161
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 462 RMSE: 8.13
Df Residuals: 460 MAE: 6.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 27.7557 1.0802 0.001 25.6143 29.8476
opcount 0.0039 0.0000 0.001 0.0039 0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.488
Model: NNLS Adj. R-squared: 0.487
No. Observations: 330 RMSE: 384.01
Df Residuals: 328 MAE: 319.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 51.2810 48.3785 0.214 0.0000 160.4338
opcount 0.0182 0.0009 0.001 0.0163 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 572 RMSE: 65.77
Df Residuals: 570 MAE: 52.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 287.4098 8.5475 0.001 271.2405 304.4366
opcount 0.0209 0.0001 0.001 0.0206 0.0211
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.834
Model: NNLS Adj. R-squared: 0.834
No. Observations: 418 RMSE: 32.12
Df Residuals: 416 MAE: 23.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 129.5521 4.5798 0.001 120.3596 138.5449
opcount 0.0035 0.0001 0.001 0.0033 0.0037
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.968
Model: NNLS Adj. R-squared: 0.968
No. Observations: 418 RMSE: 18.13
Df Residuals: 416 MAE: 14.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 104.8034 2.6393 0.001 99.5781 109.6692
opcount 0.0048 0.0000 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9725 |
0.01521 |
1.00e-03 |
[0.01496, 0.01544] |
erigon |
462 |
0.9852 |
0.003516 |
1.00e-03 |
[0.003469, 0.003559] |
ethrex |
330 |
0.9406 |
0.00251 |
1.00e-03 |
[0.002438, 0.002573] |
geth |
572 |
0.9733 |
0.01991 |
1.00e-03 |
[0.01966, 0.02017] |
nethermind |
418 |
0.7999 |
0.003076 |
1.00e-03 |
[0.002936, 0.003237] |
reth |
418 |
0.97 |
0.004848 |
1.00e-03 |
[0.004774, 0.004932] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 440 RMSE: 52.83
Df Residuals: 438 MAE: 43.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 145.5019 7.5384 0.001 131.1175 160.2500
opcount 0.0152 0.0001 0.001 0.0150 0.0154
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.985
No. Observations: 462 RMSE: 8.88
Df Residuals: 460 MAE: 6.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 21.0033 1.3660 0.001 18.4991 23.7702
opcount 0.0035 0.0000 0.001 0.0035 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.941
Model: NNLS Adj. R-squared: 0.940
No. Observations: 330 RMSE: 13.02
Df Residuals: 328 MAE: 10.54
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.5781 2.0795 0.001 18.5187 26.7410
opcount 0.0025 0.0000 0.001 0.0024 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 572 RMSE: 68.14
Df Residuals: 570 MAE: 54.54
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 301.2828 8.4787 0.001 284.5874 318.5849
opcount 0.0199 0.0001 0.001 0.0197 0.0202
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.800
Model: NNLS Adj. R-squared: 0.799
No. Observations: 418 RMSE: 31.77
Df Residuals: 416 MAE: 24.11
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 77.6395 4.6766 0.001 68.0605 86.2529
opcount 0.0031 0.0001 0.001 0.0029 0.0032
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.970
Model: NNLS Adj. R-squared: 0.970
No. Observations: 418 RMSE: 17.62
Df Residuals: 416 MAE: 13.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 99.1659 2.5864 0.001 94.2275 104.1695
opcount 0.0048 0.0000 0.001 0.0048 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo BALANCE_AccountMode.EXISTING_CONTRACT_DIFF_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8545 |
0.02292 |
1.00e-03 |
[0.02199, 0.02383] |
erigon |
462 |
0.9574 |
0.004269 |
1.00e-03 |
[0.004194, 0.004348] |
ethrex |
330 |
0.6499 |
0.01027 |
1.00e-03 |
[0.009433, 0.01111] |
geth |
572 |
0.896 |
0.01737 |
1.00e-03 |
[0.01675, 0.01799] |
nethermind |
418 |
0.6028 |
0.003018 |
1.00e-03 |
[0.002779, 0.003275] |
reth |
418 |
0.9258 |
0.005009 |
1.00e-03 |
[0.004869, 0.005149] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.855
Model: NNLS Adj. R-squared: 0.854
No. Observations: 440 RMSE: 192.25
Df Residuals: 438 MAE: 158.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 760.1962 29.7252 0.001 704.5879 818.8375
opcount 0.0229 0.0005 0.001 0.0220 0.0238
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.957
Model: NNLS Adj. R-squared: 0.957
No. Observations: 462 RMSE: 18.31
Df Residuals: 460 MAE: 13.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 158.4946 2.7501 0.001 153.2169 163.5302
opcount 0.0043 0.0000 0.001 0.0042 0.0043
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.650
Model: NNLS Adj. R-squared: 0.649
No. Observations: 330 RMSE: 153.24
Df Residuals: 328 MAE: 136.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 234.8451 23.5866 0.001 186.7050 281.0338
opcount 0.0103 0.0004 0.001 0.0094 0.0111
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.896
Model: NNLS Adj. R-squared: 0.896
No. Observations: 572 RMSE: 120.30
Df Residuals: 570 MAE: 91.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 383.8543 17.7189 0.001 348.2970 420.9969
opcount 0.0174 0.0003 0.001 0.0167 0.0180
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.603
Model: NNLS Adj. R-squared: 0.602
No. Observations: 418 RMSE: 49.80
Df Residuals: 416 MAE: 36.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 128.2560 6.9035 0.001 114.3340 141.7153
opcount 0.0030 0.0001 0.001 0.0028 0.0033
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.926
Model: NNLS Adj. R-squared: 0.926
No. Observations: 418 RMSE: 28.82
Df Residuals: 416 MAE: 22.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 109.7604 4.5769 0.001 101.1498 119.7067
opcount 0.0050 0.0001 0.001 0.0049 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo BALANCE_AccountMode.EXISTING_CONTRACT_MINIMAL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9608 |
0.01242 |
1.00e-03 |
[0.01219, 0.01265] |
erigon |
462 |
0.9085 |
0.003537 |
1.00e-03 |
[0.003433, 0.003641] |
ethrex |
330 |
0.7885 |
0.002601 |
1.00e-03 |
[0.002442, 0.002733] |
geth |
572 |
0.9723 |
0.01999 |
1.00e-03 |
[0.01971, 0.02027] |
nethermind |
418 |
0.5749 |
0.002749 |
1.00e-03 |
[0.002504, 0.002988] |
reth |
418 |
0.9647 |
0.004652 |
1.00e-03 |
[0.004568, 0.004734] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.961
Model: NNLS Adj. R-squared: 0.961
No. Observations: 440 RMSE: 51.01
Df Residuals: 438 MAE: 41.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 269.1706 7.0031 0.001 255.3677 283.0551
opcount 0.0124 0.0001 0.001 0.0122 0.0126
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.908
Model: NNLS Adj. R-squared: 0.908
No. Observations: 462 RMSE: 22.83
Df Residuals: 460 MAE: 17.67
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 159.4972 3.5283 0.001 152.7364 166.8311
opcount 0.0035 0.0001 0.001 0.0034 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.789
Model: NNLS Adj. R-squared: 0.788
No. Observations: 330 RMSE: 27.39
Df Residuals: 328 MAE: 21.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 106.8853 5.3561 0.001 97.5156 118.4386
opcount 0.0026 0.0001 0.001 0.0024 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 572 RMSE: 68.64
Df Residuals: 570 MAE: 55.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 267.4351 8.6312 0.001 251.3250 284.8305
opcount 0.0200 0.0001 0.001 0.0197 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.575
Model: NNLS Adj. R-squared: 0.574
No. Observations: 418 RMSE: 48.07
Df Residuals: 416 MAE: 35.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 139.7422 7.0208 0.001 126.3551 153.9011
opcount 0.0027 0.0001 0.001 0.0025 0.0030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.965
Model: NNLS Adj. R-squared: 0.965
No. Observations: 418 RMSE: 18.09
Df Residuals: 416 MAE: 14.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 91.8047 2.6216 0.001 86.7758 97.1325
opcount 0.0047 0.0000 0.001 0.0046 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo BALANCE_AccountMode.EXISTING_CONTRACT_SAME_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9625 |
0.01271 |
1.00e-03 |
[0.01245, 0.01296] |
erigon |
462 |
0.8286 |
0.003903 |
1.00e-03 |
[0.003729, 0.004072] |
ethrex |
330 |
0.7831 |
0.002676 |
1.00e-03 |
[0.002528, 0.002827] |
geth |
572 |
0.9732 |
0.01968 |
1.00e-03 |
[0.01942, 0.01996] |
nethermind |
418 |
0.5991 |
0.00291 |
1.00e-03 |
[0.002653, 0.003163] |
reth |
418 |
0.9634 |
0.004633 |
1.00e-03 |
[0.004546, 0.004737] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.963
Model: NNLS Adj. R-squared: 0.962
No. Observations: 440 RMSE: 50.98
Df Residuals: 438 MAE: 41.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 252.2517 7.5654 0.001 237.9532 267.6941
opcount 0.0127 0.0001 0.001 0.0124 0.0130
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.829
Model: NNLS Adj. R-squared: 0.828
No. Observations: 462 RMSE: 36.08
Df Residuals: 460 MAE: 30.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 107.1801 5.6912 0.001 96.2873 118.2866
opcount 0.0039 0.0001 0.001 0.0037 0.0041
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.783
Model: NNLS Adj. R-squared: 0.782
No. Observations: 330 RMSE: 28.63
Df Residuals: 328 MAE: 22.95
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 104.2464 5.2339 0.001 93.8205 114.2018
opcount 0.0027 0.0001 0.001 0.0025 0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 572 RMSE: 66.35
Df Residuals: 570 MAE: 51.33
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 283.3158 8.4580 0.001 266.5982 299.7972
opcount 0.0197 0.0001 0.001 0.0194 0.0200
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.599
Model: NNLS Adj. R-squared: 0.598
No. Observations: 418 RMSE: 48.40
Df Residuals: 416 MAE: 35.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.4717 7.0582 0.001 119.2074 146.3470
opcount 0.0029 0.0001 0.001 0.0027 0.0032
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.963
Model: NNLS Adj. R-squared: 0.963
No. Observations: 418 RMSE: 18.36
Df Residuals: 416 MAE: 14.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 95.1428 2.8382 0.001 89.3795 100.6948
opcount 0.0046 0.0000 0.001 0.0045 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL
test_ext_account_query_warm: combo CALL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9267 |
0.0007088 |
1.00e-03 |
[0.0006793, 0.0007359] |
erigon |
231 |
0.7724 |
9.583e-05 |
1.00e-03 |
[8.934e-05, 0.0001025] |
ethrex |
165 |
0.9212 |
0.0001313 |
1.00e-03 |
[0.0001258, 0.0001372] |
geth |
286 |
0.922 |
0.0001857 |
1.00e-03 |
[0.0001795, 0.000192] |
nethermind |
209 |
0.5385 |
0.0002259 |
1.00e-03 |
[0.0001996, 0.000256] |
reth |
209 |
0.9549 |
7.936e-05 |
1.00e-03 |
[7.695e-05, 8.169e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.927
Model: NNLS Adj. R-squared: 0.926
No. Observations: 220 RMSE: 100.76
Df Residuals: 218 MAE: 77.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 603.1789 22.3011 0.001 561.9603 648.5309
opcount 0.0007 0.0000 0.001 0.0007 0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.772
Model: NNLS Adj. R-squared: 0.771
No. Observations: 231 RMSE: 26.29
Df Residuals: 229 MAE: 23.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 33.0276 4.7601 0.001 23.6501 41.8423
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.921
Model: NNLS Adj. R-squared: 0.921
No. Observations: 165 RMSE: 19.41
Df Residuals: 163 MAE: 16.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 29.0113 4.5035 0.001 20.4301 37.2148
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.922
Model: NNLS Adj. R-squared: 0.922
No. Observations: 286 RMSE: 27.29
Df Residuals: 284 MAE: 23.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 36.5652 4.9933 0.001 26.4883 46.1421
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.538
Model: NNLS Adj. R-squared: 0.536
No. Observations: 209 RMSE: 105.71
Df Residuals: 207 MAE: 87.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 146.3243 21.5238 0.001 102.8054 187.2641
opcount 0.0002 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.955
Model: NNLS Adj. R-squared: 0.955
No. Observations: 209 RMSE: 8.71
Df Residuals: 207 MAE: 7.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 24.8972 1.8839 0.001 21.2794 28.7923
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_EOA: presets[cold_account_nocode_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9693 |
0.01859 |
1.00e-03 |
[0.01825, 0.01893] |
erigon |
462 |
0.9883 |
0.004259 |
1.00e-03 |
[0.004214, 0.004297] |
ethrex |
330 |
0.492 |
0.01846 |
1.00e-03 |
[0.0163, 0.0197] |
geth |
572 |
0.9803 |
0.02118 |
1.00e-03 |
[0.02096, 0.02141] |
nethermind |
418 |
0.8222 |
0.003798 |
1.00e-03 |
[0.003629, 0.003966] |
reth |
418 |
0.9726 |
0.005283 |
1.00e-03 |
[0.0052, 0.005365] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.969
Model: NNLS Adj. R-squared: 0.969
No. Observations: 440 RMSE: 67.95
Df Residuals: 438 MAE: 55.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 399.7802 10.0226 0.001 381.1756 419.7260
opcount 0.0186 0.0002 0.001 0.0183 0.0189
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.988
No. Observations: 462 RMSE: 9.50
Df Residuals: 460 MAE: 7.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 23.8601 1.3036 0.001 21.4310 26.5846
opcount 0.0043 0.0000 0.001 0.0042 0.0043
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.492
Model: NNLS Adj. R-squared: 0.490
No. Observations: 330 RMSE: 385.20
Df Residuals: 328 MAE: 319.69
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 44.9753 48.4848 0.180 0.0000 165.3696
opcount 0.0185 0.0009 0.001 0.0163 0.0197
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 572 RMSE: 61.58
Df Residuals: 570 MAE: 48.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 289.5571 7.9974 0.001 274.2908 304.5609
opcount 0.0212 0.0001 0.001 0.0210 0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.822
Model: NNLS Adj. R-squared: 0.822
No. Observations: 418 RMSE: 36.27
Df Residuals: 416 MAE: 28.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 128.9802 5.0312 0.001 119.0257 139.1252
opcount 0.0038 0.0001 0.001 0.0036 0.0040
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 418 RMSE: 18.20
Df Residuals: 416 MAE: 13.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 102.7476 2.6355 0.001 97.9147 107.8638
opcount 0.0053 0.0000 0.001 0.0052 0.0054
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.NON_EXISTING_ACCOUNT: presets[cold_account_nocode_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9631 |
0.01884 |
1.00e-03 |
[0.01849, 0.01918] |
erigon |
462 |
0.9815 |
0.003656 |
1.00e-03 |
[0.003611, 0.003699] |
ethrex |
330 |
0.9549 |
0.002627 |
1.00e-03 |
[0.002568, 0.002689] |
geth |
572 |
0.9769 |
0.02074 |
1.00e-03 |
[0.0205, 0.021] |
nethermind |
418 |
0.8191 |
0.003382 |
1.00e-03 |
[0.003233, 0.003541] |
reth |
418 |
0.9728 |
0.004984 |
1.00e-03 |
[0.004898, 0.005066] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.963
Model: NNLS Adj. R-squared: 0.963
No. Observations: 440 RMSE: 75.73
Df Residuals: 438 MAE: 62.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 352.6104 10.6612 0.001 332.2004 373.7348
opcount 0.0188 0.0002 0.001 0.0185 0.0192
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 462 RMSE: 10.32
Df Residuals: 460 MAE: 7.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 19.6224 1.3846 0.001 16.8838 22.3009
opcount 0.0037 0.0000 0.001 0.0036 0.0037
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.955
Model: NNLS Adj. R-squared: 0.955
No. Observations: 330 RMSE: 11.73
Df Residuals: 328 MAE: 9.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.9150 1.9117 0.001 19.2709 26.6315
opcount 0.0026 0.0000 0.001 0.0026 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 572 RMSE: 65.47
Df Residuals: 570 MAE: 52.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 274.1818 8.2226 0.001 256.6185 290.3613
opcount 0.0207 0.0001 0.001 0.0205 0.0210
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.819
Model: NNLS Adj. R-squared: 0.819
No. Observations: 418 RMSE: 32.63
Df Residuals: 416 MAE: 25.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 73.3421 4.5954 0.001 64.4190 82.1190
opcount 0.0034 0.0001 0.001 0.0032 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 418 RMSE: 17.13
Df Residuals: 416 MAE: 13.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.9339 2.5887 0.001 93.9460 104.2401
opcount 0.0050 0.0000 0.001 0.0049 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_EOA: presets[cold_account_nocode_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9552 |
0.09162 |
1.00e-03 |
[0.08975, 0.09348] |
erigon |
462 |
0.9971 |
0.06202 |
1.00e-03 |
[0.06167, 0.06236] |
ethrex |
330 |
0.9391 |
0.04057 |
1.00e-03 |
[0.03975, 0.04094] |
geth |
572 |
0.9898 |
0.1075 |
1.00e-03 |
[0.1067, 0.1084] |
nethermind |
418 |
0.5605 |
0.05265 |
1.00e-03 |
[0.04832, 0.05691] |
reth |
418 |
0.9804 |
0.09933 |
1.00e-03 |
[0.098, 0.1007] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.955
Model: NNLS Adj. R-squared: 0.955
No. Observations: 440 RMSE: 87.22
Df Residuals: 438 MAE: 70.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 504.0334 13.0512 0.001 479.1140 530.1196
opcount 0.0916 0.0010 0.001 0.0897 0.0935
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 462 RMSE: 14.61
Df Residuals: 460 MAE: 10.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 174.3324 2.2393 0.001 170.1822 178.7685
opcount 0.0620 0.0002 0.001 0.0617 0.0624
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.939
Model: NNLS Adj. R-squared: 0.939
No. Observations: 330 RMSE: 45.81
Df Residuals: 328 MAE: 38.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 2.3992 1.000 0.0000 9.1174
opcount 0.0406 0.0003 0.001 0.0398 0.0409
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 572 RMSE: 47.95
Df Residuals: 570 MAE: 36.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.7682 6.1534 0.001 120.6597 144.9824
opcount 0.1075 0.0005 0.001 0.1067 0.1084
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.561
Model: NNLS Adj. R-squared: 0.559
No. Observations: 418 RMSE: 204.89
Df Residuals: 416 MAE: 170.31
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 285.4152 28.3491 0.001 227.9835 342.3836
opcount 0.0526 0.0022 0.001 0.0483 0.0569
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 418 RMSE: 61.73
Df Residuals: 416 MAE: 46.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 292.1170 8.5862 0.001 276.0554 308.6210
opcount 0.0993 0.0007 0.001 0.0980 0.1007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.NON_EXISTING_ACCOUNT: presets[cold_account_nocode_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9137 |
0.1999 |
1.00e-03 |
[0.1939, 0.2059] |
erigon |
462 |
0.995 |
0.1933 |
1.00e-03 |
[0.192, 0.1946] |
ethrex |
330 |
0.6691 |
0.02946 |
1.00e-03 |
[0.02727, 0.03153] |
geth |
572 |
0.8554 |
0.121 |
1.00e-03 |
[0.1171, 0.1252] |
nethermind |
418 |
0.6811 |
0.1036 |
1.00e-03 |
[0.09696, 0.11] |
reth |
418 |
0.9784 |
0.1545 |
1.00e-03 |
[0.1523, 0.1567] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.914
Model: NNLS Adj. R-squared: 0.914
No. Observations: 440 RMSE: 21.16
Df Residuals: 438 MAE: 16.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 82.7590 3.0554 0.001 76.8134 88.7385
opcount 0.1999 0.0030 0.001 0.1939 0.2059
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 462 RMSE: 4.73
Df Residuals: 460 MAE: 3.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 67.9997 0.7172 0.001 66.5938 69.4314
opcount 0.1933 0.0007 0.001 0.1920 0.1946
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.669
Model: NNLS Adj. R-squared: 0.668
No. Observations: 330 RMSE: 7.14
Df Residuals: 328 MAE: 6.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.3920 1.1163 0.001 7.3799 11.7229
opcount 0.0295 0.0011 0.001 0.0273 0.0315
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.855
Model: NNLS Adj. R-squared: 0.855
No. Observations: 572 RMSE: 17.14
Df Residuals: 570 MAE: 12.50
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 29.1488 2.2356 0.001 24.7556 33.3924
opcount 0.1210 0.0021 0.001 0.1171 0.1252
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.681
Model: NNLS Adj. R-squared: 0.680
No. Observations: 418 RMSE: 24.42
Df Residuals: 416 MAE: 21.20
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 30.8429 3.3670 0.001 24.3639 37.4274
opcount 0.1036 0.0034 0.001 0.0970 0.1100
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 418 RMSE: 7.92
Df Residuals: 416 MAE: 6.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.2352 1.0821 0.001 24.0924 28.2731
opcount 0.1545 0.0011 0.001 0.1523 0.1567
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX: presets[cold_account_code_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8656 |
0.02817 |
1.00e-03 |
[0.02705, 0.02918] |
erigon |
462 |
0.5371 |
0.01534 |
1.00e-03 |
[0.01398, 0.01658] |
ethrex |
330 |
0.6415 |
0.01018 |
1.00e-03 |
[0.009383, 0.01101] |
geth |
572 |
0.7813 |
0.04589 |
1.00e-03 |
[0.04393, 0.04793] |
nethermind |
418 |
0.4636 |
0.02119 |
1.00e-03 |
[0.01906, 0.02336] |
reth |
418 |
0.4003 |
0.04179 |
1.00e-03 |
[0.0366, 0.04549] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.866
Model: NNLS Adj. R-squared: 0.865
No. Observations: 440 RMSE: 224.39
Df Residuals: 438 MAE: 184.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 795.3012 33.5365 0.001 733.3787 863.2617
opcount 0.0282 0.0005 0.001 0.0270 0.0292
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.537
Model: NNLS Adj. R-squared: 0.536
No. Observations: 462 RMSE: 287.89
Df Residuals: 460 MAE: 263.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 370.3540 37.4137 0.001 300.0278 444.8001
opcount 0.0153 0.0007 0.001 0.0140 0.0166
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.641
Model: NNLS Adj. R-squared: 0.640
No. Observations: 330 RMSE: 153.94
Df Residuals: 328 MAE: 131.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 245.2347 24.2629 0.001 197.5963 292.9527
opcount 0.0102 0.0004 0.001 0.0094 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.781
Model: NNLS Adj. R-squared: 0.781
No. Observations: 572 RMSE: 490.95
Df Residuals: 570 MAE: 432.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1439.5324 70.3203 0.001 1291.8556 1570.9316
opcount 0.0459 0.0010 0.001 0.0439 0.0479
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.464
Model: NNLS Adj. R-squared: 0.462
No. Observations: 418 RMSE: 460.84
Df Residuals: 416 MAE: 403.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 735.8755 69.8530 0.001 602.3160 864.0874
opcount 0.0212 0.0011 0.001 0.0191 0.0234
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.400
Model: NNLS Adj. R-squared: 0.399
No. Observations: 418 RMSE: 1034.23
Df Residuals: 416 MAE: 982.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 160.9066 131.0486 0.142 0.0000 444.5238
opcount 0.0418 0.0024 0.001 0.0366 0.0455
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL: presets[cold_account_code_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9484 |
0.01348 |
1.00e-03 |
[0.01321, 0.01381] |
erigon |
462 |
0.9441 |
0.004231 |
1.00e-03 |
[0.004136, 0.004324] |
ethrex |
330 |
0.7949 |
0.002742 |
1.00e-03 |
[0.002592, 0.002887] |
geth |
572 |
0.9786 |
0.02057 |
1.00e-03 |
[0.02033, 0.02082] |
nethermind |
418 |
0.6282 |
0.003231 |
1.00e-03 |
[0.002959, 0.003469] |
reth |
418 |
0.9728 |
0.005187 |
1.00e-03 |
[0.005108, 0.00527] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.948
Model: NNLS Adj. R-squared: 0.948
No. Observations: 440 RMSE: 63.54
Df Residuals: 438 MAE: 51.31
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 400.6219 9.7193 0.001 380.0488 418.7781
opcount 0.0135 0.0002 0.001 0.0132 0.0138
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.944
Model: NNLS Adj. R-squared: 0.944
No. Observations: 462 RMSE: 20.82
Df Residuals: 460 MAE: 16.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 171.5333 3.1363 0.001 165.4267 177.5191
opcount 0.0042 0.0000 0.001 0.0041 0.0043
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.795
Model: NNLS Adj. R-squared: 0.794
No. Observations: 330 RMSE: 28.16
Df Residuals: 328 MAE: 22.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 108.5237 5.4108 0.001 98.2239 119.0271
opcount 0.0027 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 572 RMSE: 61.45
Df Residuals: 570 MAE: 47.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 268.5780 7.8683 0.001 253.5731 283.9563
opcount 0.0206 0.0001 0.001 0.0203 0.0208
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.628
Model: NNLS Adj. R-squared: 0.627
No. Observations: 418 RMSE: 50.26
Df Residuals: 416 MAE: 38.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 155.2070 7.4582 0.001 142.1225 170.1170
opcount 0.0032 0.0001 0.001 0.0030 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 418 RMSE: 17.53
Df Residuals: 416 MAE: 13.88
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.1293 2.4431 0.001 87.2723 96.7439
opcount 0.0052 0.0000 0.001 0.0051 0.0053
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX: presets[cold_account_code_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9505 |
0.0135 |
1.00e-03 |
[0.0132, 0.01381] |
erigon |
462 |
0.8421 |
0.004562 |
1.00e-03 |
[0.004384, 0.004761] |
ethrex |
330 |
0.7958 |
0.002754 |
1.00e-03 |
[0.002592, 0.002908] |
geth |
572 |
0.976 |
0.02047 |
1.00e-03 |
[0.0202, 0.02072] |
nethermind |
418 |
0.6412 |
0.003174 |
1.00e-03 |
[0.002929, 0.003413] |
reth |
418 |
0.9696 |
0.005212 |
1.00e-03 |
[0.005118, 0.005297] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.950
Model: NNLS Adj. R-squared: 0.950
No. Observations: 440 RMSE: 62.31
Df Residuals: 438 MAE: 51.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 398.9702 9.9092 0.001 380.9992 418.8128
opcount 0.0135 0.0002 0.001 0.0132 0.0138
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.842
Model: NNLS Adj. R-squared: 0.842
No. Observations: 462 RMSE: 39.95
Df Residuals: 460 MAE: 34.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 122.5352 6.2504 0.001 109.7696 134.3744
opcount 0.0046 0.0001 0.001 0.0044 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.796
Model: NNLS Adj. R-squared: 0.795
No. Observations: 330 RMSE: 28.21
Df Residuals: 328 MAE: 22.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 107.4062 5.6630 0.001 96.2898 118.5655
opcount 0.0028 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 572 RMSE: 64.92
Df Residuals: 570 MAE: 50.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 277.8302 7.9897 0.001 262.6587 294.0500
opcount 0.0205 0.0001 0.001 0.0202 0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.641
Model: NNLS Adj. R-squared: 0.640
No. Observations: 418 RMSE: 48.02
Df Residuals: 416 MAE: 36.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 157.4161 6.9763 0.001 144.4364 171.9217
opcount 0.0032 0.0001 0.001 0.0029 0.0034
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.970
Model: NNLS Adj. R-squared: 0.969
No. Observations: 418 RMSE: 18.67
Df Residuals: 416 MAE: 14.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.9437 2.7030 0.001 87.9105 98.5049
opcount 0.0052 0.0000 0.001 0.0051 0.0053
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX: presets[cold_account_code_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9254 |
0.1043 |
1.00e-03 |
[0.1012, 0.1072] |
erigon |
462 |
0.9499 |
0.0757 |
1.00e-03 |
[0.07409, 0.07724] |
ethrex |
330 |
0.9112 |
0.03467 |
1.00e-03 |
[0.03344, 0.03596] |
geth |
572 |
0.907 |
0.1521 |
1.00e-03 |
[0.1479, 0.1564] |
nethermind |
418 |
0.6689 |
0.07954 |
1.00e-03 |
[0.07449, 0.08476] |
reth |
418 |
0.8719 |
0.1334 |
1.00e-03 |
[0.1286, 0.1384] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.925
Model: NNLS Adj. R-squared: 0.925
No. Observations: 440 RMSE: 129.68
Df Residuals: 438 MAE: 105.33
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 432.5010 18.5901 0.001 396.4141 468.6442
opcount 0.1043 0.0015 0.001 0.1012 0.1072
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.950
Model: NNLS Adj. R-squared: 0.950
No. Observations: 462 RMSE: 76.17
Df Residuals: 460 MAE: 62.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 304.8201 10.2320 0.001 285.6897 326.1120
opcount 0.0757 0.0008 0.001 0.0741 0.0772
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.911
Model: NNLS Adj. R-squared: 0.911
No. Observations: 330 RMSE: 47.42
Df Residuals: 328 MAE: 36.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 62.2018 7.5403 0.001 46.9132 76.9203
opcount 0.0347 0.0006 0.001 0.0334 0.0360
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.907
Model: NNLS Adj. R-squared: 0.907
No. Observations: 572 RMSE: 213.28
Df Residuals: 570 MAE: 197.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 261.7549 26.9316 0.001 206.7213 313.4300
opcount 0.1521 0.0021 0.001 0.1479 0.1564
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.669
Model: NNLS Adj. R-squared: 0.668
No. Observations: 418 RMSE: 245.16
Df Residuals: 416 MAE: 198.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 271.1241 33.7857 0.001 206.8217 337.5854
opcount 0.0795 0.0027 0.001 0.0745 0.0848
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.872
Model: NNLS Adj. R-squared: 0.872
No. Observations: 418 RMSE: 223.93
Df Residuals: 416 MAE: 203.30
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 352.5772 31.2452 0.001 291.8305 411.7448
opcount 0.1334 0.0026 0.001 0.1286 0.1384
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL: presets[cold_account_code_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.936 |
0.07655 |
1.00e-03 |
[0.07474, 0.07836] |
erigon |
462 |
0.973 |
0.05748 |
1.00e-03 |
[0.05651, 0.05847] |
ethrex |
330 |
0.9187 |
0.02543 |
1.00e-03 |
[0.02467, 0.02571] |
geth |
572 |
0.9886 |
0.1072 |
1.00e-03 |
[0.1063, 0.1083] |
nethermind |
418 |
0.556 |
0.05236 |
1.00e-03 |
[0.04785, 0.05672] |
reth |
418 |
0.9796 |
0.09928 |
1.00e-03 |
[0.09788, 0.1008] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.936
Model: NNLS Adj. R-squared: 0.936
No. Observations: 440 RMSE: 87.70
Df Residuals: 438 MAE: 69.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 448.1901 12.7737 0.001 423.6259 472.5995
opcount 0.0765 0.0010 0.001 0.0747 0.0784
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 462 RMSE: 41.91
Df Residuals: 460 MAE: 33.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 222.1575 6.1930 0.001 210.1527 234.8458
opcount 0.0575 0.0005 0.001 0.0565 0.0585
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.919
Model: NNLS Adj. R-squared: 0.918
No. Observations: 330 RMSE: 33.14
Df Residuals: 328 MAE: 27.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.6693 3.0355 0.446 0.0000 10.5553
opcount 0.0254 0.0003 0.001 0.0247 0.0257
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.989
Model: NNLS Adj. R-squared: 0.989
No. Observations: 572 RMSE: 50.47
Df Residuals: 570 MAE: 39.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 114.9825 6.5411 0.001 102.2859 127.6101
opcount 0.1072 0.0005 0.001 0.1063 0.1083
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.556
Model: NNLS Adj. R-squared: 0.555
No. Observations: 418 RMSE: 204.96
Df Residuals: 416 MAE: 169.31
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 276.7032 29.1963 0.001 221.8225 330.1101
opcount 0.0524 0.0023 0.001 0.0479 0.0567
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 418 RMSE: 62.71
Df Residuals: 416 MAE: 48.05
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 284.4788 9.2155 0.001 265.3435 301.8615
opcount 0.0993 0.0007 0.001 0.0979 0.1008
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX: presets[cold_account_code_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9424 |
0.07569 |
1.00e-03 |
[0.07393, 0.07749] |
erigon |
462 |
0.6863 |
0.0666 |
1.00e-03 |
[0.06246, 0.07076] |
ethrex |
330 |
0.9149 |
0.0252 |
1.00e-03 |
[0.02442, 0.02572] |
geth |
572 |
0.9893 |
0.1075 |
1.00e-03 |
[0.1066, 0.1085] |
nethermind |
418 |
0.5601 |
0.05286 |
1.00e-03 |
[0.04824, 0.05718] |
reth |
418 |
0.9804 |
0.09977 |
1.00e-03 |
[0.0984, 0.101] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.942
Model: NNLS Adj. R-squared: 0.942
No. Observations: 440 RMSE: 81.95
Df Residuals: 438 MAE: 66.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 442.2498 11.7159 0.001 419.8806 465.7366
opcount 0.0757 0.0009 0.001 0.0739 0.0775
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.686
Model: NNLS Adj. R-squared: 0.686
No. Observations: 462 RMSE: 197.24
Df Residuals: 460 MAE: 189.69
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 275.6270 27.7764 0.001 222.4888 329.6449
opcount 0.0666 0.0021 0.001 0.0625 0.0708
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.915
Model: NNLS Adj. R-squared: 0.915
No. Observations: 330 RMSE: 33.67
Df Residuals: 328 MAE: 28.19
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 4.5059 4.3043 0.206 0.0000 14.2562
opcount 0.0252 0.0003 0.001 0.0244 0.0257
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.989
Model: NNLS Adj. R-squared: 0.989
No. Observations: 572 RMSE: 48.97
Df Residuals: 570 MAE: 38.88
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 111.7746 6.2140 0.001 99.5230 124.3181
opcount 0.1075 0.0005 0.001 0.1066 0.1085
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.560
Model: NNLS Adj. R-squared: 0.559
No. Observations: 418 RMSE: 205.19
Df Residuals: 416 MAE: 168.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 275.2323 28.5280 0.001 219.9082 331.6944
opcount 0.0529 0.0023 0.001 0.0482 0.0572
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 418 RMSE: 61.84
Df Residuals: 416 MAE: 47.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 282.1465 8.5776 0.001 266.1846 299.4461
opcount 0.0998 0.0007 0.001 0.0984 0.1010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE
test_ext_account_query_warm: combo CALLCODE
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9209 |
0.000627 |
1.00e-03 |
[0.0006049, 0.0006495] |
erigon |
231 |
0.7854 |
6.199e-05 |
1.00e-03 |
[5.805e-05, 6.619e-05] |
ethrex |
165 |
0.9144 |
0.0001291 |
1.00e-03 |
[0.0001221, 0.0001354] |
geth |
286 |
0.9336 |
0.0002304 |
1.00e-03 |
[0.0002233, 0.0002379] |
nethermind |
209 |
0.3616 |
0.0001378 |
1.00e-03 |
[0.0001144, 0.0001619] |
reth |
209 |
0.9657 |
7.897e-05 |
1.00e-03 |
[7.708e-05, 8.085e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.921
Model: NNLS Adj. R-squared: 0.921
No. Observations: 220 RMSE: 92.89
Df Residuals: 218 MAE: 72.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 627.1910 17.6779 0.001 593.8502 661.7313
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.785
Model: NNLS Adj. R-squared: 0.784
No. Observations: 231 RMSE: 16.38
Df Residuals: 229 MAE: 14.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 28.9532 2.9643 0.001 22.8333 34.7989
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.914
Model: NNLS Adj. R-squared: 0.914
No. Observations: 165 RMSE: 19.97
Df Residuals: 163 MAE: 16.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 27.7074 5.1281 0.001 17.9531 37.8054
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.934
Model: NNLS Adj. R-squared: 0.933
No. Observations: 286 RMSE: 31.06
Df Residuals: 284 MAE: 25.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 53.8119 5.5305 0.001 42.4663 65.2220
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.362
Model: NNLS Adj. R-squared: 0.359
No. Observations: 209 RMSE: 92.54
Df Residuals: 207 MAE: 84.24
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 83.5980 18.7005 0.001 47.7897 119.6449
opcount 0.0001 0.0000 0.001 0.0001 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.966
Model: NNLS Adj. R-squared: 0.966
No. Observations: 209 RMSE: 7.52
Df Residuals: 207 MAE: 5.78
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 24.6133 1.5122 0.001 21.6310 27.5744
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_EOA: presets[cold_account_nocode_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9736 |
0.01728 |
1.00e-03 |
[0.01701, 0.01755] |
erigon |
462 |
0.9893 |
0.003745 |
1.00e-03 |
[0.003712, 0.003781] |
ethrex |
330 |
0.4968 |
0.01854 |
1.00e-03 |
[0.01642, 0.0197] |
geth |
572 |
0.9801 |
0.02111 |
1.00e-03 |
[0.02085, 0.02134] |
nethermind |
418 |
0.8197 |
0.003617 |
1.00e-03 |
[0.003443, 0.003783] |
reth |
418 |
0.9708 |
0.004882 |
1.00e-03 |
[0.004798, 0.004963] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 440 RMSE: 58.38
Df Residuals: 438 MAE: 47.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 368.5417 8.5404 0.001 351.8328 384.3804
opcount 0.0173 0.0001 0.001 0.0170 0.0175
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.989
Model: NNLS Adj. R-squared: 0.989
No. Observations: 462 RMSE: 8.00
Df Residuals: 460 MAE: 6.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.6866 1.1254 0.001 20.5073 24.9866
opcount 0.0037 0.0000 0.001 0.0037 0.0038
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.497
Model: NNLS Adj. R-squared: 0.495
No. Observations: 330 RMSE: 383.12
Df Residuals: 328 MAE: 318.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 36.9067 46.9300 0.296 0.0000 158.0680
opcount 0.0185 0.0009 0.001 0.0164 0.0197
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 572 RMSE: 61.78
Df Residuals: 570 MAE: 47.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 298.9100 8.1503 0.001 283.4301 315.1360
opcount 0.0211 0.0001 0.001 0.0209 0.0213
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.820
Model: NNLS Adj. R-squared: 0.819
No. Observations: 418 RMSE: 34.84
Df Residuals: 416 MAE: 26.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 129.8064 5.0056 0.001 120.3629 139.8764
opcount 0.0036 0.0001 0.001 0.0034 0.0038
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.971
No. Observations: 418 RMSE: 17.38
Df Residuals: 416 MAE: 13.99
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 102.6715 2.7699 0.001 97.2980 108.2030
opcount 0.0049 0.0000 0.001 0.0048 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT: presets[cold_account_nocode_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9597 |
0.01537 |
1.00e-03 |
[0.01508, 0.01566] |
erigon |
462 |
0.9901 |
0.003461 |
1.00e-03 |
[0.003433, 0.003488] |
ethrex |
330 |
0.9587 |
0.00259 |
1.00e-03 |
[0.00253, 0.002652] |
geth |
572 |
0.9793 |
0.02111 |
1.00e-03 |
[0.02088, 0.02136] |
nethermind |
418 |
0.7946 |
0.00324 |
1.00e-03 |
[0.003077, 0.003392] |
reth |
418 |
0.9728 |
0.004911 |
1.00e-03 |
[0.004835, 0.004983] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 440 RMSE: 64.65
Df Residuals: 438 MAE: 53.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 325.6603 9.7759 0.001 307.1552 343.9177
opcount 0.0154 0.0002 0.001 0.0151 0.0157
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 462 RMSE: 7.12
Df Residuals: 460 MAE: 5.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 14.9811 0.8464 0.001 13.3902 16.6886
opcount 0.0035 0.0000 0.001 0.0034 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.959
Model: NNLS Adj. R-squared: 0.959
No. Observations: 330 RMSE: 11.04
Df Residuals: 328 MAE: 8.95
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 24.8984 1.9055 0.001 21.1929 28.5769
opcount 0.0026 0.0000 0.001 0.0025 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 572 RMSE: 62.99
Df Residuals: 570 MAE: 50.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 296.6283 8.2217 0.001 280.2511 311.8909
opcount 0.0211 0.0001 0.001 0.0209 0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.795
Model: NNLS Adj. R-squared: 0.794
No. Observations: 418 RMSE: 33.82
Df Residuals: 416 MAE: 25.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 75.2720 4.6288 0.001 66.3321 84.9859
opcount 0.0032 0.0001 0.001 0.0031 0.0034
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 418 RMSE: 16.86
Df Residuals: 416 MAE: 13.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.4290 2.4011 0.001 94.1899 103.0981
opcount 0.0049 0.0000 0.001 0.0048 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_EOA: presets[cold_account_nocode_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8637 |
0.02127 |
1.00e-03 |
[0.02056, 0.02202] |
erigon |
462 |
0.9585 |
0.003864 |
1.00e-03 |
[0.00379, 0.003943] |
ethrex |
330 |
0.5654 |
0.01729 |
1.00e-03 |
[0.01522, 0.01908] |
geth |
572 |
0.9407 |
0.02976 |
1.00e-03 |
[0.02921, 0.03037] |
nethermind |
418 |
0.8784 |
0.008059 |
1.00e-03 |
[0.007757, 0.008351] |
reth |
418 |
0.9501 |
0.00686 |
1.00e-03 |
[0.006705, 0.007017] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.864
Model: NNLS Adj. R-squared: 0.863
No. Observations: 440 RMSE: 37.13
Df Residuals: 438 MAE: 30.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 246.3307 5.1515 0.001 236.6524 256.5171
opcount 0.0213 0.0004 0.001 0.0206 0.0220
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.959
Model: NNLS Adj. R-squared: 0.958
No. Observations: 462 RMSE: 3.53
Df Residuals: 460 MAE: 2.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 18.9610 0.5657 0.001 17.8151 20.0887
opcount 0.0039 0.0000 0.001 0.0038 0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.565
Model: NNLS Adj. R-squared: 0.564
No. Observations: 330 RMSE: 66.62
Df Residuals: 328 MAE: 41.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 67.2901 10.6438 0.001 47.9751 89.7578
opcount 0.0173 0.0010 0.001 0.0152 0.0191
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.941
Model: NNLS Adj. R-squared: 0.941
No. Observations: 572 RMSE: 32.85
Df Residuals: 570 MAE: 26.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 57.7493 3.8735 0.001 50.1635 64.7338
opcount 0.0298 0.0003 0.001 0.0292 0.0304
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.878
Model: NNLS Adj. R-squared: 0.878
No. Observations: 418 RMSE: 13.18
Df Residuals: 416 MAE: 10.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 45.9303 2.1211 0.001 42.0193 50.1441
opcount 0.0081 0.0002 0.001 0.0078 0.0084
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.950
Model: NNLS Adj. R-squared: 0.950
No. Observations: 418 RMSE: 6.91
Df Residuals: 416 MAE: 5.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 40.2185 1.0466 0.001 38.1589 42.2690
opcount 0.0069 0.0001 0.001 0.0067 0.0070
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT: presets[cold_account_nocode_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8481 |
0.02166 |
1.00e-03 |
[0.02081, 0.02252] |
erigon |
462 |
0.9434 |
0.00337 |
1.00e-03 |
[0.003294, 0.003449] |
ethrex |
330 |
0.8745 |
0.003234 |
1.00e-03 |
[0.003088, 0.003372] |
geth |
572 |
0.9392 |
0.0297 |
1.00e-03 |
[0.0291, 0.03034] |
nethermind |
418 |
0.8375 |
0.005989 |
1.00e-03 |
[0.005735, 0.006244] |
reth |
418 |
0.9512 |
0.006831 |
1.00e-03 |
[0.006687, 0.006988] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.848
Model: NNLS Adj. R-squared: 0.848
No. Observations: 440 RMSE: 40.28
Df Residuals: 438 MAE: 32.50
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 197.5454 5.6406 0.001 185.9625 209.2722
opcount 0.0217 0.0004 0.001 0.0208 0.0225
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.943
Model: NNLS Adj. R-squared: 0.943
No. Observations: 462 RMSE: 3.63
Df Residuals: 460 MAE: 2.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 17.9244 0.5399 0.001 16.9176 19.0096
opcount 0.0034 0.0000 0.001 0.0033 0.0034
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.875
Model: NNLS Adj. R-squared: 0.874
No. Observations: 330 RMSE: 5.38
Df Residuals: 328 MAE: 4.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 4.2873 0.9574 0.001 2.4192 6.2700
opcount 0.0032 0.0001 0.001 0.0031 0.0034
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.939
Model: NNLS Adj. R-squared: 0.939
No. Observations: 572 RMSE: 33.21
Df Residuals: 570 MAE: 26.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 65.1487 4.1424 0.001 57.1295 73.1616
opcount 0.0297 0.0003 0.001 0.0291 0.0303
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.838
Model: NNLS Adj. R-squared: 0.837
No. Observations: 418 RMSE: 11.59
Df Residuals: 416 MAE: 9.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 33.2912 1.7694 0.001 29.6654 36.7174
opcount 0.0060 0.0001 0.001 0.0057 0.0062
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.951
No. Observations: 418 RMSE: 6.80
Df Residuals: 416 MAE: 5.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 39.5484 1.0687 0.001 37.4163 41.5146
opcount 0.0068 0.0001 0.001 0.0067 0.0070
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX: presets[cold_account_code_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8645 |
0.02697 |
1.00e-03 |
[0.02589, 0.02801] |
erigon |
462 |
0.5354 |
0.01486 |
1.00e-03 |
[0.0136, 0.01616] |
ethrex |
330 |
0.6358 |
0.01024 |
1.00e-03 |
[0.009391, 0.01107] |
geth |
572 |
0.7858 |
0.04579 |
1.00e-03 |
[0.04383, 0.04768] |
nethermind |
418 |
0.4749 |
0.02187 |
1.00e-03 |
[0.01981, 0.02406] |
reth |
418 |
0.3905 |
0.04071 |
1.00e-03 |
[0.0354, 0.0445] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.864
Model: NNLS Adj. R-squared: 0.864
No. Observations: 440 RMSE: 215.91
Df Residuals: 438 MAE: 177.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 785.2184 34.4525 0.001 720.8395 855.9531
opcount 0.0270 0.0005 0.001 0.0259 0.0280
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.535
Model: NNLS Adj. R-squared: 0.534
No. Observations: 462 RMSE: 279.82
Df Residuals: 460 MAE: 260.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 355.1924 37.8898 0.001 284.3346 427.0898
opcount 0.0149 0.0007 0.001 0.0136 0.0162
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.636
Model: NNLS Adj. R-squared: 0.635
No. Observations: 330 RMSE: 156.63
Df Residuals: 328 MAE: 134.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 242.9907 24.0927 0.001 196.7577 290.1811
opcount 0.0102 0.0004 0.001 0.0094 0.0111
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.786
Model: NNLS Adj. R-squared: 0.785
No. Observations: 572 RMSE: 483.42
Df Residuals: 570 MAE: 425.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1440.9143 69.7227 0.001 1309.7983 1583.9390
opcount 0.0458 0.0010 0.001 0.0438 0.0477
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.475
Model: NNLS Adj. R-squared: 0.474
No. Observations: 418 RMSE: 465.00
Df Residuals: 416 MAE: 408.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 706.9559 70.0819 0.001 570.9478 840.1114
opcount 0.0219 0.0011 0.001 0.0198 0.0241
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.391
Model: NNLS Adj. R-squared: 0.389
No. Observations: 418 RMSE: 1028.38
Df Residuals: 416 MAE: 977.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 165.0664 132.6081 0.136 0.0000 460.1887
opcount 0.0407 0.0024 0.001 0.0354 0.0445
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL: presets[cold_account_code_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9543 |
0.01306 |
1.00e-03 |
[0.01278, 0.01334] |
erigon |
462 |
0.9197 |
0.003825 |
1.00e-03 |
[0.003731, 0.003923] |
ethrex |
330 |
0.7955 |
0.002796 |
1.00e-03 |
[0.002637, 0.002948] |
geth |
572 |
0.9771 |
0.02045 |
1.00e-03 |
[0.0202, 0.02069] |
nethermind |
418 |
0.6247 |
0.0033 |
1.00e-03 |
[0.003047, 0.003569] |
reth |
418 |
0.966 |
0.004775 |
1.00e-03 |
[0.004694, 0.004853] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.954
Model: NNLS Adj. R-squared: 0.954
No. Observations: 440 RMSE: 57.80
Df Residuals: 438 MAE: 46.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 374.0039 9.1517 0.001 355.6287 391.5901
opcount 0.0131 0.0001 0.001 0.0128 0.0133
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.920
Model: NNLS Adj. R-squared: 0.920
No. Observations: 462 RMSE: 22.86
Df Residuals: 460 MAE: 19.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 160.0113 3.1471 0.001 153.8744 166.1488
opcount 0.0038 0.0001 0.001 0.0037 0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.796
Model: NNLS Adj. R-squared: 0.795
No. Observations: 330 RMSE: 28.66
Df Residuals: 328 MAE: 23.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 105.1415 5.4112 0.001 95.2113 116.3756
opcount 0.0028 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 572 RMSE: 63.26
Df Residuals: 570 MAE: 50.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 266.4444 7.8864 0.001 251.5974 282.3471
opcount 0.0205 0.0001 0.001 0.0202 0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.625
Model: NNLS Adj. R-squared: 0.624
No. Observations: 418 RMSE: 51.73
Df Residuals: 416 MAE: 39.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 153.5226 7.4848 0.001 138.3039 168.5645
opcount 0.0033 0.0001 0.001 0.0030 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.966
Model: NNLS Adj. R-squared: 0.966
No. Observations: 418 RMSE: 18.12
Df Residuals: 416 MAE: 14.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 89.4621 2.4363 0.001 85.0626 94.0964
opcount 0.0048 0.0000 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX: presets[cold_account_code_access]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9551 |
0.01313 |
1.00e-03 |
[0.01288, 0.01342] |
erigon |
462 |
0.8216 |
0.004066 |
1.00e-03 |
[0.003894, 0.004235] |
ethrex |
330 |
0.8032 |
0.002879 |
1.00e-03 |
[0.002718, 0.003038] |
geth |
572 |
0.9775 |
0.02045 |
1.00e-03 |
[0.02019, 0.02069] |
nethermind |
418 |
0.6228 |
0.003161 |
1.00e-03 |
[0.002945, 0.003406] |
reth |
418 |
0.9621 |
0.004759 |
1.00e-03 |
[0.004668, 0.004851] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.955
Model: NNLS Adj. R-squared: 0.955
No. Observations: 440 RMSE: 57.56
Df Residuals: 438 MAE: 47.56
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 372.1505 8.9626 0.001 354.3518 389.2936
opcount 0.0131 0.0001 0.001 0.0129 0.0134
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.822
Model: NNLS Adj. R-squared: 0.821
No. Observations: 462 RMSE: 38.30
Df Residuals: 460 MAE: 32.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.8675 5.7788 0.001 104.7949 127.5010
opcount 0.0041 0.0001 0.001 0.0039 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.803
Model: NNLS Adj. R-squared: 0.803
No. Observations: 330 RMSE: 28.82
Df Residuals: 328 MAE: 23.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 100.3421 5.5449 0.001 89.5053 110.9011
opcount 0.0029 0.0001 0.001 0.0027 0.0030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 572 RMSE: 62.75
Df Residuals: 570 MAE: 50.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 275.4616 7.8388 0.001 261.0870 290.9290
opcount 0.0204 0.0001 0.001 0.0202 0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.623
Model: NNLS Adj. R-squared: 0.622
No. Observations: 418 RMSE: 49.74
Df Residuals: 416 MAE: 38.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 161.9207 6.9775 0.001 147.9848 175.1996
opcount 0.0032 0.0001 0.001 0.0029 0.0034
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.962
Model: NNLS Adj. R-squared: 0.962
No. Observations: 418 RMSE: 19.09
Df Residuals: 416 MAE: 15.05
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.7422 2.7725 0.001 87.5459 98.2764
opcount 0.0048 0.0000 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX: presets[cold_account_code_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8464 |
0.04158 |
1.00e-03 |
[0.03988, 0.04343] |
erigon |
462 |
0.801 |
0.02162 |
1.00e-03 |
[0.02059, 0.02262] |
ethrex |
330 |
0.6654 |
0.0151 |
1.00e-03 |
[0.01392, 0.01632] |
geth |
572 |
0.6861 |
0.07357 |
1.00e-03 |
[0.06938, 0.07767] |
nethermind |
418 |
0.6409 |
0.03647 |
1.00e-03 |
[0.0339, 0.03899] |
reth |
418 |
0.4115 |
0.04275 |
1.00e-03 |
[0.03741, 0.04748] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.846
Model: NNLS Adj. R-squared: 0.846
No. Observations: 440 RMSE: 77.61
Df Residuals: 438 MAE: 64.63
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 247.4670 12.6635 0.001 222.7823 272.1073
opcount 0.0416 0.0009 0.001 0.0399 0.0434
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.801
Model: NNLS Adj. R-squared: 0.801
No. Observations: 462 RMSE: 47.20
Df Residuals: 460 MAE: 41.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 177.1275 6.5452 0.001 164.7200 189.9443
opcount 0.0216 0.0005 0.001 0.0206 0.0226
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.665
Model: NNLS Adj. R-squared: 0.664
No. Observations: 330 RMSE: 46.89
Df Residuals: 328 MAE: 35.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 155.2505 7.2743 0.001 141.5276 170.1197
opcount 0.0151 0.0006 0.001 0.0139 0.0163
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.686
Model: NNLS Adj. R-squared: 0.686
No. Observations: 572 RMSE: 218.00
Df Residuals: 570 MAE: 201.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 238.1260 26.2608 0.001 187.3089 288.9627
opcount 0.0736 0.0021 0.001 0.0694 0.0777
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.641
Model: NNLS Adj. R-squared: 0.640
No. Observations: 418 RMSE: 119.58
Df Residuals: 416 MAE: 102.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 117.4383 17.0007 0.001 85.6426 150.0605
opcount 0.0365 0.0013 0.001 0.0339 0.0390
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.411
Model: NNLS Adj. R-squared: 0.410
No. Observations: 418 RMSE: 223.96
Df Residuals: 416 MAE: 212.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 90.7999 32.1637 0.001 30.9968 158.1345
opcount 0.0428 0.0027 0.001 0.0374 0.0475
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL: presets[cold_account_code_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8762 |
0.01856 |
1.00e-03 |
[0.01795, 0.01924] |
erigon |
462 |
0.8271 |
0.007625 |
1.00e-03 |
[0.007304, 0.007946] |
ethrex |
330 |
0.3361 |
0.003761 |
1.00e-03 |
[0.003107, 0.004346] |
geth |
572 |
0.9446 |
0.02767 |
1.00e-03 |
[0.02714, 0.02821] |
nethermind |
418 |
0.8378 |
0.008074 |
1.00e-03 |
[0.007738, 0.008422] |
reth |
418 |
0.9466 |
0.006568 |
1.00e-03 |
[0.006418, 0.006721] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.876
Model: NNLS Adj. R-squared: 0.876
No. Observations: 440 RMSE: 30.56
Df Residuals: 438 MAE: 24.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 175.2380 4.7580 0.001 166.1153 184.3997
opcount 0.0186 0.0003 0.001 0.0179 0.0192
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.827
Model: NNLS Adj. R-squared: 0.827
No. Observations: 462 RMSE: 15.27
Df Residuals: 460 MAE: 12.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 68.5479 2.2086 0.001 64.2878 72.8203
opcount 0.0076 0.0002 0.001 0.0073 0.0079
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.336
Model: NNLS Adj. R-squared: 0.334
No. Observations: 330 RMSE: 23.15
Df Residuals: 328 MAE: 16.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 89.0334 3.8539 0.001 82.2602 96.6881
opcount 0.0038 0.0003 0.001 0.0031 0.0043
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.945
Model: NNLS Adj. R-squared: 0.945
No. Observations: 572 RMSE: 29.35
Df Residuals: 570 MAE: 23.33
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 60.6074 3.6255 0.001 53.5516 67.5389
opcount 0.0277 0.0003 0.001 0.0271 0.0282
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.838
Model: NNLS Adj. R-squared: 0.837
No. Observations: 418 RMSE: 15.56
Df Residuals: 416 MAE: 12.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 54.9624 2.4029 0.001 50.4328 59.7221
opcount 0.0081 0.0002 0.001 0.0077 0.0084
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.947
Model: NNLS Adj. R-squared: 0.946
No. Observations: 418 RMSE: 6.84
Df Residuals: 416 MAE: 5.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 33.5315 0.9745 0.001 31.6432 35.5723
opcount 0.0066 0.0001 0.001 0.0064 0.0067
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX: presets[cold_account_code_write]
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8803 |
0.01849 |
1.00e-03 |
[0.01782, 0.01911] |
erigon |
462 |
0.5144 |
0.006445 |
1.00e-03 |
[0.005895, 0.007014] |
ethrex |
330 |
0.3181 |
0.003569 |
1.00e-03 |
[0.002999, 0.004221] |
geth |
572 |
0.9467 |
0.02846 |
1.00e-03 |
[0.02793, 0.02901] |
nethermind |
418 |
0.8358 |
0.008121 |
1.00e-03 |
[0.007739, 0.008497] |
reth |
418 |
0.94 |
0.006614 |
1.00e-03 |
[0.006444, 0.006776] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.880
Model: NNLS Adj. R-squared: 0.880
No. Observations: 440 RMSE: 29.88
Df Residuals: 438 MAE: 24.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 177.6349 4.5629 0.001 168.4267 186.5280
opcount 0.0185 0.0003 0.001 0.0178 0.0191
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.514
Model: NNLS Adj. R-squared: 0.513
No. Observations: 462 RMSE: 27.43
Df Residuals: 460 MAE: 23.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 62.7134 3.5892 0.001 56.1639 69.5915
opcount 0.0064 0.0003 0.001 0.0059 0.0070
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.318
Model: NNLS Adj. R-squared: 0.316
No. Observations: 330 RMSE: 22.89
Df Residuals: 328 MAE: 16.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.2120 3.7938 0.001 84.2075 98.9834
opcount 0.0036 0.0003 0.001 0.0030 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.947
Model: NNLS Adj. R-squared: 0.947
No. Observations: 572 RMSE: 29.59
Df Residuals: 570 MAE: 23.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 53.9756 3.6452 0.001 46.5268 60.7636
opcount 0.0285 0.0003 0.001 0.0279 0.0290
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.836
Model: NNLS Adj. R-squared: 0.835
No. Observations: 418 RMSE: 15.77
Df Residuals: 416 MAE: 12.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.1986 2.5362 0.001 50.2093 60.5705
opcount 0.0081 0.0002 0.001 0.0077 0.0085
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.940
Model: NNLS Adj. R-squared: 0.940
No. Observations: 418 RMSE: 7.32
Df Residuals: 416 MAE: 5.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 34.5131 1.1750 0.001 32.4178 36.9307
opcount 0.0066 0.0001 0.001 0.0064 0.0068
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL
test_ext_account_query_warm: combo DELEGATECALL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9053 |
0.0005729 |
1.00e-03 |
[0.0005495, 0.0005944] |
erigon |
231 |
0.7643 |
5.765e-05 |
1.00e-03 |
[5.345e-05, 6.212e-05] |
ethrex |
165 |
0.9107 |
0.0001248 |
1.00e-03 |
[0.0001186, 0.000131] |
geth |
286 |
0.9304 |
0.000205 |
1.00e-03 |
[0.0001985, 0.0002108] |
nethermind |
209 |
0.5719 |
0.0004025 |
1.00e-03 |
[0.0003509, 0.0004496] |
reth |
209 |
0.9536 |
7.374e-05 |
1.00e-03 |
[7.15e-05, 7.592e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.905
Model: NNLS Adj. R-squared: 0.905
No. Observations: 220 RMSE: 95.98
Df Residuals: 218 MAE: 75.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 612.6006 18.3155 0.001 578.5827 647.2691
opcount 0.0006 0.0000 0.001 0.0005 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.764
Model: NNLS Adj. R-squared: 0.763
No. Observations: 231 RMSE: 16.58
Df Residuals: 229 MAE: 14.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 31.6421 3.1988 0.001 25.3986 37.7979
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.911
Model: NNLS Adj. R-squared: 0.910
No. Observations: 165 RMSE: 20.23
Df Residuals: 163 MAE: 17.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 32.8015 5.2116 0.001 22.8456 42.8559
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.930
Model: NNLS Adj. R-squared: 0.930
No. Observations: 286 RMSE: 29.04
Df Residuals: 284 MAE: 23.62
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 46.6518 5.1927 0.001 36.8316 56.8836
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.572
Model: NNLS Adj. R-squared: 0.570
No. Observations: 209 RMSE: 180.32
Df Residuals: 207 MAE: 155.30
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 147.8354 35.7771 0.001 80.9443 217.3353
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.954
Model: NNLS Adj. R-squared: 0.953
No. Observations: 209 RMSE: 8.42
Df Residuals: 207 MAE: 6.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.1257 1.7183 0.001 22.9012 29.6332
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo DELEGATECALL_AccountMode.EXISTING_EOA
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9724 |
0.01729 |
1.00e-03 |
[0.017, 0.01756] |
erigon |
462 |
0.9918 |
0.003749 |
1.00e-03 |
[0.003718, 0.003781] |
ethrex |
330 |
0.4959 |
0.01854 |
1.00e-03 |
[0.01631, 0.01966] |
geth |
572 |
0.9809 |
0.02143 |
1.00e-03 |
[0.0212, 0.02168] |
nethermind |
418 |
0.8295 |
0.003905 |
1.00e-03 |
[0.003735, 0.004074] |
reth |
418 |
0.9727 |
0.004967 |
1.00e-03 |
[0.004887, 0.005049] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 440 RMSE: 59.90
Df Residuals: 438 MAE: 49.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 360.7091 8.7874 0.001 343.9761 378.7367
opcount 0.0173 0.0001 0.001 0.0170 0.0176
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.992
No. Observations: 462 RMSE: 7.00
Df Residuals: 460 MAE: 5.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.9509 1.0074 0.001 20.9722 25.0032
opcount 0.0037 0.0000 0.001 0.0037 0.0038
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.496
Model: NNLS Adj. R-squared: 0.494
No. Observations: 330 RMSE: 384.22
Df Residuals: 328 MAE: 318.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 36.8229 47.0682 0.265 0.0000 157.3161
opcount 0.0185 0.0009 0.001 0.0163 0.0197
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 572 RMSE: 61.54
Df Residuals: 570 MAE: 47.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 268.9391 8.0262 0.001 253.6994 284.1314
opcount 0.0214 0.0001 0.001 0.0212 0.0217
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.830
Model: NNLS Adj. R-squared: 0.829
No. Observations: 418 RMSE: 36.39
Df Residuals: 416 MAE: 28.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 127.6652 5.2578 0.001 117.4392 137.7064
opcount 0.0039 0.0001 0.001 0.0037 0.0041
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 418 RMSE: 17.09
Df Residuals: 416 MAE: 13.44
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 97.6442 2.6546 0.001 92.6531 102.9705
opcount 0.0050 0.0000 0.001 0.0049 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9609 |
0.01554 |
1.00e-03 |
[0.01527, 0.01584] |
erigon |
462 |
0.9895 |
0.00343 |
1.00e-03 |
[0.003403, 0.003457] |
ethrex |
330 |
0.9582 |
0.002598 |
1.00e-03 |
[0.002538, 0.00266] |
geth |
572 |
0.9812 |
0.02131 |
1.00e-03 |
[0.02107, 0.02155] |
nethermind |
418 |
0.8123 |
0.003603 |
1.00e-03 |
[0.003448, 0.003774] |
reth |
418 |
0.9736 |
0.005005 |
1.00e-03 |
[0.00493, 0.005073] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.961
Model: NNLS Adj. R-squared: 0.961
No. Observations: 440 RMSE: 64.43
Df Residuals: 438 MAE: 53.24
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 308.2249 9.5261 0.001 289.8812 327.3010
opcount 0.0155 0.0001 0.001 0.0153 0.0158
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.989
Model: NNLS Adj. R-squared: 0.989
No. Observations: 462 RMSE: 7.26
Df Residuals: 460 MAE: 5.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 16.8187 0.9121 0.001 15.0158 18.5922
opcount 0.0034 0.0000 0.001 0.0034 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.958
Model: NNLS Adj. R-squared: 0.958
No. Observations: 330 RMSE: 11.15
Df Residuals: 328 MAE: 8.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 23.7567 1.9495 0.001 19.8657 27.6299
opcount 0.0026 0.0000 0.001 0.0025 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 572 RMSE: 60.62
Df Residuals: 570 MAE: 49.19
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 284.2222 8.0702 0.001 268.8072 299.8064
opcount 0.0213 0.0001 0.001 0.0211 0.0215
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.812
Model: NNLS Adj. R-squared: 0.812
No. Observations: 418 RMSE: 35.59
Df Residuals: 416 MAE: 27.69
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 70.9744 5.0827 0.001 60.9158 80.2318
opcount 0.0036 0.0001 0.001 0.0034 0.0038
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.973
No. Observations: 418 RMSE: 16.96
Df Residuals: 416 MAE: 13.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 91.8199 2.2246 0.001 87.7714 96.4963
opcount 0.0050 0.0000 0.001 0.0049 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8631 |
0.02686 |
1.00e-03 |
[0.02589, 0.02794] |
erigon |
462 |
0.5404 |
0.01498 |
1.00e-03 |
[0.0137, 0.0162] |
ethrex |
330 |
0.6359 |
0.01022 |
1.00e-03 |
[0.009325, 0.01114] |
geth |
572 |
0.7821 |
0.04569 |
1.00e-03 |
[0.04375, 0.04759] |
nethermind |
418 |
0.4692 |
0.02149 |
1.00e-03 |
[0.01942, 0.02376] |
reth |
418 |
0.3884 |
0.04051 |
1.00e-03 |
[0.03542, 0.04439] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.863
Model: NNLS Adj. R-squared: 0.863
No. Observations: 440 RMSE: 216.55
Df Residuals: 438 MAE: 176.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 780.5885 32.6950 0.001 712.9951 843.7626
opcount 0.0269 0.0005 0.001 0.0259 0.0279
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.540
Model: NNLS Adj. R-squared: 0.539
No. Observations: 462 RMSE: 279.66
Df Residuals: 460 MAE: 258.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 350.3808 35.7921 0.001 287.1344 419.0851
opcount 0.0150 0.0006 0.001 0.0137 0.0162
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.636
Model: NNLS Adj. R-squared: 0.635
No. Observations: 330 RMSE: 156.53
Df Residuals: 328 MAE: 134.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 243.5005 25.0182 0.001 197.3547 291.0833
opcount 0.0102 0.0005 0.001 0.0093 0.0111
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.782
Model: NNLS Adj. R-squared: 0.782
No. Observations: 572 RMSE: 488.17
Df Residuals: 570 MAE: 432.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1442.9003 70.7622 0.001 1301.8018 1581.1036
opcount 0.0457 0.0010 0.001 0.0437 0.0476
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.469
Model: NNLS Adj. R-squared: 0.468
No. Observations: 418 RMSE: 462.63
Df Residuals: 416 MAE: 403.31
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 721.4976 69.1922 0.001 583.3817 854.1887
opcount 0.0215 0.0011 0.001 0.0194 0.0238
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.388
Model: NNLS Adj. R-squared: 0.387
No. Observations: 418 RMSE: 1028.75
Df Residuals: 416 MAE: 978.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 178.2125 128.5895 0.114 0.0000 462.9367
opcount 0.0405 0.0024 0.001 0.0354 0.0444
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_MINIMAL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.959 |
0.0132 |
1.00e-03 |
[0.0129, 0.01348] |
erigon |
462 |
0.9199 |
0.003799 |
1.00e-03 |
[0.003697, 0.003895] |
ethrex |
330 |
0.8134 |
0.002719 |
1.00e-03 |
[0.002573, 0.002861] |
geth |
572 |
0.9784 |
0.02032 |
1.00e-03 |
[0.0201, 0.02058] |
nethermind |
418 |
0.6596 |
0.003258 |
1.00e-03 |
[0.003026, 0.00351] |
reth |
418 |
0.9655 |
0.004799 |
1.00e-03 |
[0.00471, 0.004898] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.959
Model: NNLS Adj. R-squared: 0.959
No. Observations: 440 RMSE: 55.25
Df Residuals: 438 MAE: 44.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 358.3976 8.8527 0.001 341.6290 376.7656
opcount 0.0132 0.0001 0.001 0.0129 0.0135
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.920
Model: NNLS Adj. R-squared: 0.920
No. Observations: 462 RMSE: 22.69
Df Residuals: 460 MAE: 18.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 160.8926 3.1739 0.001 154.7778 167.2175
opcount 0.0038 0.0001 0.001 0.0037 0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.813
Model: NNLS Adj. R-squared: 0.813
No. Observations: 330 RMSE: 26.36
Df Residuals: 328 MAE: 21.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 107.8017 5.2102 0.001 97.8915 117.6655
opcount 0.0027 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 572 RMSE: 61.07
Df Residuals: 570 MAE: 47.88
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 277.7867 7.6405 0.001 261.5257 291.9908
opcount 0.0203 0.0001 0.001 0.0201 0.0206
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.660
Model: NNLS Adj. R-squared: 0.659
No. Observations: 418 RMSE: 47.37
Df Residuals: 416 MAE: 36.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 156.2115 6.9216 0.001 142.3997 169.8832
opcount 0.0033 0.0001 0.001 0.0030 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.966
Model: NNLS Adj. R-squared: 0.965
No. Observations: 418 RMSE: 18.36
Df Residuals: 416 MAE: 14.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.6845 2.8206 0.001 83.0049 93.8072
opcount 0.0048 0.0000 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_SAME_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9597 |
0.0132 |
1.00e-03 |
[0.01296, 0.01344] |
erigon |
462 |
0.833 |
0.004271 |
1.00e-03 |
[0.00409, 0.00445] |
ethrex |
330 |
0.787 |
0.002765 |
1.00e-03 |
[0.002619, 0.002917] |
geth |
572 |
0.9781 |
0.02043 |
1.00e-03 |
[0.02016, 0.0207] |
nethermind |
418 |
0.6355 |
0.003256 |
1.00e-03 |
[0.002992, 0.003514] |
reth |
418 |
0.9628 |
0.004707 |
1.00e-03 |
[0.004618, 0.004795] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 440 RMSE: 54.74
Df Residuals: 438 MAE: 44.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 357.6440 7.9450 0.001 342.6066 372.6994
opcount 0.0132 0.0001 0.001 0.0130 0.0134
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.833
Model: NNLS Adj. R-squared: 0.833
No. Observations: 462 RMSE: 38.72
Df Residuals: 460 MAE: 32.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.2140 6.0106 0.001 89.8165 113.4410
opcount 0.0043 0.0001 0.001 0.0041 0.0045
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.787
Model: NNLS Adj. R-squared: 0.786
No. Observations: 330 RMSE: 29.12
Df Residuals: 328 MAE: 23.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 106.6569 5.5718 0.001 96.1738 117.5062
opcount 0.0028 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 572 RMSE: 61.83
Df Residuals: 570 MAE: 49.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 269.7221 8.2506 0.001 253.7327 285.8648
opcount 0.0204 0.0001 0.001 0.0202 0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.635
Model: NNLS Adj. R-squared: 0.635
No. Observations: 418 RMSE: 49.91
Df Residuals: 416 MAE: 37.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 156.1924 7.3780 0.001 142.1124 171.7480
opcount 0.0033 0.0001 0.001 0.0030 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.963
Model: NNLS Adj. R-squared: 0.963
No. Observations: 418 RMSE: 18.73
Df Residuals: 416 MAE: 14.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 94.7426 2.7578 0.001 89.5465 99.8731
opcount 0.0047 0.0000 0.001 0.0046 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH
test_ext_account_query_warm: combo EXTCODEHASH
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.8511 |
0.0001285 |
1.00e-03 |
[0.0001207, 0.0001363] |
erigon |
231 |
0.9042 |
3.216e-05 |
1.00e-03 |
[3.076e-05, 3.356e-05] |
ethrex |
165 |
0.772 |
2.35e-05 |
1.00e-03 |
[2.156e-05, 2.548e-05] |
geth |
286 |
0.8853 |
5.795e-05 |
1.00e-03 |
[5.529e-05, 6.053e-05] |
nethermind |
209 |
0.7753 |
0.0001387 |
1.00e-03 |
[0.0001286, 0.0001499] |
reth |
209 |
0.8827 |
2.018e-05 |
1.00e-03 |
[1.919e-05, 2.123e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.851
Model: NNLS Adj. R-squared: 0.850
No. Observations: 220 RMSE: 31.44
Df Residuals: 218 MAE: 23.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 194.3957 6.8726 0.001 181.0801 207.6764
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.904
Model: NNLS Adj. R-squared: 0.904
No. Observations: 231 RMSE: 6.12
Df Residuals: 229 MAE: 5.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 21.7317 1.2781 0.001 19.3208 24.3908
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.772
Model: NNLS Adj. R-squared: 0.771
No. Observations: 165 RMSE: 7.47
Df Residuals: 163 MAE: 6.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 7.9390 1.6506 0.001 4.8069 11.2924
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.885
Model: NNLS Adj. R-squared: 0.885
No. Observations: 286 RMSE: 12.20
Df Residuals: 284 MAE: 9.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.4801 2.4375 0.001 17.8701 27.5196
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.775
Model: NNLS Adj. R-squared: 0.774
No. Observations: 209 RMSE: 43.69
Df Residuals: 207 MAE: 30.69
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 104.8471 10.2687 0.001 84.2741 123.9922
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.883
Model: NNLS Adj. R-squared: 0.882
No. Observations: 209 RMSE: 4.30
Df Residuals: 207 MAE: 3.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.0443 0.9558 0.001 7.2013 10.8600
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODEHASH_AccountMode.EXISTING_EOA
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.974 |
0.01631 |
1.00e-03 |
[0.01605, 0.01655] |
erigon |
462 |
0.9898 |
0.00409 |
1.00e-03 |
[0.004056, 0.004128] |
ethrex |
330 |
0.4919 |
0.0183 |
1.00e-03 |
[0.01644, 0.01957] |
geth |
572 |
0.981 |
0.02097 |
1.00e-03 |
[0.02073, 0.02121] |
nethermind |
418 |
0.8313 |
0.003565 |
1.00e-03 |
[0.003422, 0.003726] |
reth |
418 |
0.9688 |
0.004916 |
1.00e-03 |
[0.00483, 0.005001] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 440 RMSE: 55.05
Df Residuals: 438 MAE: 44.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 274.7864 7.7654 0.001 260.0327 290.0402
opcount 0.0163 0.0001 0.001 0.0160 0.0165
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 462 RMSE: 8.57
Df Residuals: 460 MAE: 6.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.6402 1.2524 0.001 24.1022 28.9598
opcount 0.0041 0.0000 0.001 0.0041 0.0041
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.492
Model: NNLS Adj. R-squared: 0.490
No. Observations: 330 RMSE: 384.06
Df Residuals: 328 MAE: 319.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 45.6543 47.3431 0.242 0.0000 154.6231
opcount 0.0183 0.0009 0.001 0.0164 0.0196
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 572 RMSE: 60.21
Df Residuals: 570 MAE: 47.00
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 278.1538 7.9787 0.001 262.9837 292.8499
opcount 0.0210 0.0001 0.001 0.0207 0.0212
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.831
Model: NNLS Adj. R-squared: 0.831
No. Observations: 418 RMSE: 33.16
Df Residuals: 416 MAE: 24.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 129.9887 4.7538 0.001 120.2936 138.6996
opcount 0.0036 0.0001 0.001 0.0034 0.0037
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.969
Model: NNLS Adj. R-squared: 0.969
No. Observations: 418 RMSE: 18.23
Df Residuals: 416 MAE: 14.31
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.5478 2.8062 0.001 93.2160 104.0319
opcount 0.0049 0.0000 0.001 0.0048 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9711 |
0.01525 |
1.00e-03 |
[0.01501, 0.01549] |
erigon |
462 |
0.9858 |
0.003348 |
1.00e-03 |
[0.003316, 0.003383] |
ethrex |
330 |
0.9513 |
0.002503 |
1.00e-03 |
[0.00244, 0.002561] |
geth |
572 |
0.9736 |
0.02023 |
1.00e-03 |
[0.01996, 0.0205] |
nethermind |
418 |
0.8222 |
0.00336 |
1.00e-03 |
[0.003218, 0.003501] |
reth |
418 |
0.9691 |
0.004795 |
1.00e-03 |
[0.004716, 0.004872] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.971
No. Observations: 440 RMSE: 54.32
Df Residuals: 438 MAE: 44.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 146.1401 7.6222 0.001 131.4082 160.8001
opcount 0.0152 0.0001 0.001 0.0150 0.0155
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 462 RMSE: 8.29
Df Residuals: 460 MAE: 5.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 14.7155 1.0389 0.001 12.6010 16.6591
opcount 0.0033 0.0000 0.001 0.0033 0.0034
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.951
No. Observations: 330 RMSE: 11.70
Df Residuals: 328 MAE: 9.62
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.7097 2.0439 0.001 19.0424 26.8102
opcount 0.0025 0.0000 0.001 0.0024 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 572 RMSE: 68.82
Df Residuals: 570 MAE: 53.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 271.5978 8.8343 0.001 254.8421 288.9485
opcount 0.0202 0.0001 0.001 0.0200 0.0205
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.822
Model: NNLS Adj. R-squared: 0.822
No. Observations: 418 RMSE: 32.26
Df Residuals: 416 MAE: 24.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 66.6557 4.3859 0.001 58.3651 75.5864
opcount 0.0034 0.0001 0.001 0.0032 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.969
Model: NNLS Adj. R-squared: 0.969
No. Observations: 418 RMSE: 17.67
Df Residuals: 416 MAE: 13.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.1960 2.4941 0.001 96.4415 106.1145
opcount 0.0048 0.0000 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_DIFF_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8561 |
0.02343 |
1.00e-03 |
[0.02248, 0.02443] |
erigon |
462 |
0.9601 |
0.004367 |
1.00e-03 |
[0.004286, 0.004437] |
ethrex |
330 |
0.6477 |
0.01017 |
1.00e-03 |
[0.009292, 0.01096] |
geth |
572 |
0.9029 |
0.01733 |
1.00e-03 |
[0.01674, 0.01787] |
nethermind |
418 |
0.5757 |
0.002804 |
1.00e-03 |
[0.002556, 0.00305] |
reth |
418 |
0.9235 |
0.004852 |
1.00e-03 |
[0.004718, 0.004975] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.856
Model: NNLS Adj. R-squared: 0.856
No. Observations: 440 RMSE: 195.30
Df Residuals: 438 MAE: 157.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 723.5739 31.5731 0.001 660.0578 780.5321
opcount 0.0234 0.0005 0.001 0.0225 0.0244
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 462 RMSE: 18.11
Df Residuals: 460 MAE: 14.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 170.5658 2.7859 0.001 165.3153 176.4182
opcount 0.0044 0.0000 0.001 0.0043 0.0044
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.648
Model: NNLS Adj. R-squared: 0.647
No. Observations: 330 RMSE: 152.52
Df Residuals: 328 MAE: 135.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 241.7649 23.7848 0.001 196.4347 289.2357
opcount 0.0102 0.0004 0.001 0.0093 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.903
Model: NNLS Adj. R-squared: 0.903
No. Observations: 572 RMSE: 115.55
Df Residuals: 570 MAE: 88.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 402.5313 16.3733 0.001 373.2227 435.3415
opcount 0.0173 0.0003 0.001 0.0167 0.0179
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.576
Model: NNLS Adj. R-squared: 0.575
No. Observations: 418 RMSE: 48.93
Df Residuals: 416 MAE: 36.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 138.5212 7.3804 0.001 123.5781 152.4426
opcount 0.0028 0.0001 0.001 0.0026 0.0031
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.923
Model: NNLS Adj. R-squared: 0.923
No. Observations: 418 RMSE: 28.40
Df Residuals: 416 MAE: 22.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 119.0901 4.3536 0.001 110.7364 127.4794
opcount 0.0049 0.0001 0.001 0.0047 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_MINIMAL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9621 |
0.01258 |
1.00e-03 |
[0.01236, 0.01282] |
erigon |
462 |
0.9258 |
0.003576 |
1.00e-03 |
[0.003492, 0.003667] |
ethrex |
330 |
0.7879 |
0.002686 |
1.00e-03 |
[0.002539, 0.002824] |
geth |
572 |
0.9732 |
0.01978 |
1.00e-03 |
[0.01951, 0.02006] |
nethermind |
418 |
0.6084 |
0.0028 |
1.00e-03 |
[0.002564, 0.003017] |
reth |
418 |
0.9647 |
0.004678 |
1.00e-03 |
[0.004596, 0.004763] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.962
Model: NNLS Adj. R-squared: 0.962
No. Observations: 440 RMSE: 50.78
Df Residuals: 438 MAE: 40.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 260.6758 7.0738 0.001 246.9331 274.2704
opcount 0.0126 0.0001 0.001 0.0124 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.926
Model: NNLS Adj. R-squared: 0.926
No. Observations: 462 RMSE: 20.57
Df Residuals: 460 MAE: 15.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 173.3827 3.1104 0.001 167.1271 179.5586
opcount 0.0036 0.0000 0.001 0.0035 0.0037
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.788
Model: NNLS Adj. R-squared: 0.787
No. Observations: 330 RMSE: 28.33
Df Residuals: 328 MAE: 23.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 102.5472 5.2136 0.001 93.0837 113.1767
opcount 0.0027 0.0001 0.001 0.0025 0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 572 RMSE: 66.75
Df Residuals: 570 MAE: 52.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 278.7773 8.6461 0.001 261.8361 295.4235
opcount 0.0198 0.0001 0.001 0.0195 0.0201
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.608
Model: NNLS Adj. R-squared: 0.607
No. Observations: 418 RMSE: 45.67
Df Residuals: 416 MAE: 34.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 139.9984 6.6011 0.001 127.1480 154.6333
opcount 0.0028 0.0001 0.001 0.0026 0.0030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.965
Model: NNLS Adj. R-squared: 0.965
No. Observations: 418 RMSE: 18.19
Df Residuals: 416 MAE: 14.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 89.8902 2.5773 0.001 84.7579 94.7738
opcount 0.0047 0.0000 0.001 0.0046 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_SAME_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9605 |
0.01252 |
1.00e-03 |
[0.01227, 0.01277] |
erigon |
462 |
0.8184 |
0.004026 |
1.00e-03 |
[0.003855, 0.00419] |
ethrex |
330 |
0.7709 |
0.00262 |
1.00e-03 |
[0.002473, 0.002786] |
geth |
572 |
0.9736 |
0.02003 |
1.00e-03 |
[0.01974, 0.02033] |
nethermind |
418 |
0.6106 |
0.002799 |
1.00e-03 |
[0.002592, 0.003025] |
reth |
418 |
0.9639 |
0.004679 |
1.00e-03 |
[0.004591, 0.004766] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 440 RMSE: 51.65
Df Residuals: 438 MAE: 40.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 261.0389 7.4270 0.001 246.7476 276.0298
opcount 0.0125 0.0001 0.001 0.0123 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.818
Model: NNLS Adj. R-squared: 0.818
No. Observations: 462 RMSE: 38.55
Df Residuals: 460 MAE: 32.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 119.3966 6.1556 0.001 107.2996 131.2626
opcount 0.0040 0.0001 0.001 0.0039 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.771
Model: NNLS Adj. R-squared: 0.770
No. Observations: 330 RMSE: 29.04
Df Residuals: 328 MAE: 23.67
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 107.6396 5.5902 0.001 96.9244 117.8005
opcount 0.0026 0.0001 0.001 0.0025 0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 572 RMSE: 67.11
Df Residuals: 570 MAE: 53.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 267.1650 9.1017 0.001 249.7590 285.9491
opcount 0.0200 0.0001 0.001 0.0197 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.611
Model: NNLS Adj. R-squared: 0.610
No. Observations: 418 RMSE: 45.44
Df Residuals: 416 MAE: 33.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 137.2550 5.9647 0.001 125.7076 148.3134
opcount 0.0028 0.0001 0.001 0.0026 0.0030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.964
Model: NNLS Adj. R-squared: 0.964
No. Observations: 418 RMSE: 18.40
Df Residuals: 416 MAE: 14.30
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 91.0228 2.7758 0.001 85.4540 96.6002
opcount 0.0047 0.0000 0.001 0.0046 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE
test_ext_account_query_warm: combo EXTCODESIZE
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.8439 |
0.0001894 |
1.00e-03 |
[0.0001778, 0.0002004] |
erigon |
231 |
0.6408 |
1.794e-05 |
1.00e-03 |
[1.616e-05, 1.962e-05] |
ethrex |
165 |
0.7163 |
2.522e-05 |
1.00e-03 |
[2.277e-05, 2.75e-05] |
geth |
286 |
0.6971 |
4.296e-05 |
1.00e-03 |
[3.999e-05, 4.599e-05] |
nethermind |
209 |
0.755 |
0.000118 |
1.00e-03 |
[0.0001086, 0.0001282] |
reth |
209 |
0.7693 |
1.586e-05 |
1.00e-03 |
[1.478e-05, 1.697e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.844
Model: NNLS Adj. R-squared: 0.843
No. Observations: 220 RMSE: 24.74
Df Residuals: 218 MAE: 19.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 125.1065 5.7348 0.001 113.8886 136.7279
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.641
Model: NNLS Adj. R-squared: 0.639
No. Observations: 231 RMSE: 4.08
Df Residuals: 229 MAE: 3.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 14.4137 0.8041 0.001 12.9440 16.0032
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.716
Model: NNLS Adj. R-squared: 0.715
No. Observations: 165 RMSE: 4.82
Df Residuals: 163 MAE: 4.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 7.4975 1.1324 0.001 5.4048 9.8291
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.697
Model: NNLS Adj. R-squared: 0.696
No. Observations: 286 RMSE: 8.60
Df Residuals: 284 MAE: 5.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 17.2277 1.6868 0.001 14.0325 20.5489
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.755
Model: NNLS Adj. R-squared: 0.754
No. Observations: 209 RMSE: 20.43
Df Residuals: 207 MAE: 14.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 16.0871 4.2654 0.001 7.4519 24.5479
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.769
Model: NNLS Adj. R-squared: 0.768
No. Observations: 209 RMSE: 2.64
Df Residuals: 207 MAE: 2.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 5.7685 0.4957 0.001 4.7369 6.7392
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODESIZE_AccountMode.EXISTING_EOA
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9758 |
0.01643 |
1.00e-03 |
[0.01617, 0.01667] |
erigon |
462 |
0.9891 |
0.003663 |
1.00e-03 |
[0.003627, 0.003705] |
ethrex |
330 |
0.4837 |
0.01808 |
1.00e-03 |
[0.01593, 0.01959] |
geth |
572 |
0.9784 |
0.02118 |
1.00e-03 |
[0.02093, 0.02145] |
nethermind |
418 |
0.8384 |
0.003584 |
1.00e-03 |
[0.00344, 0.003731] |
reth |
418 |
0.9673 |
0.004959 |
1.00e-03 |
[0.004864, 0.00505] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 440 RMSE: 51.76
Df Residuals: 438 MAE: 42.11
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 267.7389 7.6431 0.001 252.8884 282.9968
opcount 0.0164 0.0001 0.001 0.0162 0.0167
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.989
Model: NNLS Adj. R-squared: 0.989
No. Observations: 462 RMSE: 7.68
Df Residuals: 460 MAE: 5.54
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 16.4688 1.1138 0.001 14.0173 18.5376
opcount 0.0037 0.0000 0.001 0.0036 0.0037
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.484
Model: NNLS Adj. R-squared: 0.482
No. Observations: 330 RMSE: 373.54
Df Residuals: 328 MAE: 312.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 61.9643 53.1722 0.163 0.0000 179.8895
opcount 0.0181 0.0010 0.001 0.0159 0.0196
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 572 RMSE: 62.99
Df Residuals: 570 MAE: 49.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 263.5669 8.3799 0.001 246.6943 280.6929
opcount 0.0212 0.0001 0.001 0.0209 0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.838
Model: NNLS Adj. R-squared: 0.838
No. Observations: 418 RMSE: 31.46
Df Residuals: 416 MAE: 24.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 127.1797 4.2853 0.001 118.7956 135.5866
opcount 0.0036 0.0001 0.001 0.0034 0.0037
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.967
Model: NNLS Adj. R-squared: 0.967
No. Observations: 418 RMSE: 18.22
Df Residuals: 416 MAE: 14.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 93.5835 2.8294 0.001 88.2550 99.5244
opcount 0.0050 0.0000 0.001 0.0049 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9706 |
0.01524 |
1.00e-03 |
[0.015, 0.01549] |
erigon |
462 |
0.9905 |
0.003299 |
1.00e-03 |
[0.003271, 0.003325] |
ethrex |
330 |
0.9498 |
0.002534 |
1.00e-03 |
[0.002476, 0.002594] |
geth |
572 |
0.9743 |
0.02027 |
1.00e-03 |
[0.02, 0.02053] |
nethermind |
418 |
0.816 |
0.003187 |
1.00e-03 |
[0.003034, 0.003346] |
reth |
418 |
0.9741 |
0.00493 |
1.00e-03 |
[0.004851, 0.005012] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.971
No. Observations: 440 RMSE: 53.04
Df Residuals: 438 MAE: 43.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 140.7940 7.6116 0.001 125.6895 154.7267
opcount 0.0152 0.0001 0.001 0.0150 0.0155
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.991
Model: NNLS Adj. R-squared: 0.990
No. Observations: 462 RMSE: 6.46
Df Residuals: 460 MAE: 4.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 15.1784 0.8234 0.001 13.6162 16.8044
opcount 0.0033 0.0000 0.001 0.0033 0.0033
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.950
Model: NNLS Adj. R-squared: 0.950
No. Observations: 330 RMSE: 11.65
Df Residuals: 328 MAE: 9.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 21.5003 1.8600 0.001 17.8260 24.9415
opcount 0.0025 0.0000 0.001 0.0025 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 572 RMSE: 65.78
Df Residuals: 570 MAE: 53.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 273.5467 8.3746 0.001 257.4562 290.8120
opcount 0.0203 0.0001 0.001 0.0200 0.0205
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.816
Model: NNLS Adj. R-squared: 0.816
No. Observations: 418 RMSE: 30.26
Df Residuals: 416 MAE: 21.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 72.0730 4.4618 0.001 63.4524 81.0912
opcount 0.0032 0.0001 0.001 0.0030 0.0033
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 418 RMSE: 16.08
Df Residuals: 416 MAE: 12.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 93.9410 2.3443 0.001 89.1259 98.6581
opcount 0.0049 0.0000 0.001 0.0049 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_DIFF_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8597 |
0.02336 |
1.00e-03 |
[0.0224, 0.02431] |
erigon |
462 |
0.9099 |
0.005836 |
1.00e-03 |
[0.005687, 0.005981] |
ethrex |
330 |
0.6688 |
0.01044 |
1.00e-03 |
[0.009586, 0.01128] |
geth |
572 |
0.7747 |
0.04658 |
1.00e-03 |
[0.0446, 0.04858] |
nethermind |
418 |
0.4722 |
0.02096 |
1.00e-03 |
[0.01878, 0.02293] |
reth |
418 |
0.3862 |
0.04041 |
1.00e-03 |
[0.03524, 0.04447] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.860
Model: NNLS Adj. R-squared: 0.859
No. Observations: 440 RMSE: 185.85
Df Residuals: 438 MAE: 149.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 720.5326 30.0000 0.001 663.4737 781.3791
opcount 0.0234 0.0005 0.001 0.0224 0.0243
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.910
Model: NNLS Adj. R-squared: 0.910
No. Observations: 462 RMSE: 36.17
Df Residuals: 460 MAE: 29.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 385.8708 5.1623 0.001 375.8458 396.0348
opcount 0.0058 0.0001 0.001 0.0057 0.0060
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.669
Model: NNLS Adj. R-squared: 0.668
No. Observations: 330 RMSE: 144.71
Df Residuals: 328 MAE: 128.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 267.8748 23.3946 0.001 221.2326 313.3078
opcount 0.0104 0.0004 0.001 0.0096 0.0113
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.775
Model: NNLS Adj. R-squared: 0.774
No. Observations: 572 RMSE: 494.77
Df Residuals: 570 MAE: 439.86
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1336.3481 69.3800 0.001 1205.1623 1468.7251
opcount 0.0466 0.0011 0.001 0.0446 0.0486
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.472
Model: NNLS Adj. R-squared: 0.471
No. Observations: 418 RMSE: 436.56
Df Residuals: 416 MAE: 387.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 623.1554 64.8152 0.001 496.6354 752.6791
opcount 0.0210 0.0011 0.001 0.0188 0.0229
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.386
Model: NNLS Adj. R-squared: 0.385
No. Observations: 418 RMSE: 1003.53
Df Residuals: 416 MAE: 954.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 174.1298 124.5351 0.095 0.0000 440.4161
opcount 0.0404 0.0023 0.001 0.0352 0.0445
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_MINIMAL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9604 |
0.01261 |
1.00e-03 |
[0.01237, 0.01287] |
erigon |
462 |
0.9251 |
0.003504 |
1.00e-03 |
[0.003427, 0.003581] |
ethrex |
330 |
0.7902 |
0.002692 |
1.00e-03 |
[0.002555, 0.002842] |
geth |
572 |
0.9764 |
0.02 |
1.00e-03 |
[0.01975, 0.02025] |
nethermind |
418 |
0.6271 |
0.002713 |
1.00e-03 |
[0.002513, 0.00294] |
reth |
418 |
0.967 |
0.00478 |
1.00e-03 |
[0.004695, 0.004872] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 440 RMSE: 50.42
Df Residuals: 438 MAE: 40.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 257.8284 7.4434 0.001 243.2532 272.9052
opcount 0.0126 0.0001 0.001 0.0124 0.0129
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.925
Model: NNLS Adj. R-squared: 0.925
No. Observations: 462 RMSE: 19.64
Df Residuals: 460 MAE: 15.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 158.4391 2.7790 0.001 152.9743 163.6142
opcount 0.0035 0.0000 0.001 0.0034 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.790
Model: NNLS Adj. R-squared: 0.790
No. Observations: 330 RMSE: 27.33
Df Residuals: 328 MAE: 21.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.7647 4.9705 0.001 91.3372 111.2395
opcount 0.0027 0.0001 0.001 0.0026 0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 572 RMSE: 61.28
Df Residuals: 570 MAE: 49.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 270.5553 8.0299 0.001 255.4286 286.0227
opcount 0.0200 0.0001 0.001 0.0198 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.627
Model: NNLS Adj. R-squared: 0.626
No. Observations: 418 RMSE: 41.21
Df Residuals: 416 MAE: 29.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 143.1166 6.2908 0.001 130.8457 155.1949
opcount 0.0027 0.0001 0.001 0.0025 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.967
Model: NNLS Adj. R-squared: 0.967
No. Observations: 418 RMSE: 17.39
Df Residuals: 416 MAE: 13.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 83.2884 2.4918 0.001 78.4542 88.3054
opcount 0.0048 0.0000 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_SAME_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9615 |
0.01253 |
1.00e-03 |
[0.01226, 0.01276] |
erigon |
462 |
0.8302 |
0.003829 |
1.00e-03 |
[0.003662, 0.003988] |
ethrex |
330 |
0.7945 |
0.002762 |
1.00e-03 |
[0.002603, 0.002917] |
geth |
572 |
0.9754 |
0.02002 |
1.00e-03 |
[0.01977, 0.02027] |
nethermind |
418 |
0.6444 |
0.002964 |
1.00e-03 |
[0.002755, 0.003206] |
reth |
418 |
0.9617 |
0.004735 |
1.00e-03 |
[0.004647, 0.004827] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.962
Model: NNLS Adj. R-squared: 0.961
No. Observations: 440 RMSE: 49.38
Df Residuals: 438 MAE: 39.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 263.9092 7.3664 0.001 250.5057 279.0117
opcount 0.0125 0.0001 0.001 0.0123 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.830
Model: NNLS Adj. R-squared: 0.830
No. Observations: 462 RMSE: 34.11
Df Residuals: 460 MAE: 29.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 106.8643 5.3313 0.001 96.5723 117.7704
opcount 0.0038 0.0001 0.001 0.0037 0.0040
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.794
Model: NNLS Adj. R-squared: 0.794
No. Observations: 330 RMSE: 27.67
Df Residuals: 328 MAE: 22.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.2647 5.3973 0.001 87.4601 108.4783
opcount 0.0028 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.975
Model: NNLS Adj. R-squared: 0.975
No. Observations: 572 RMSE: 62.59
Df Residuals: 570 MAE: 50.20
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 268.4104 7.8133 0.001 253.1039 283.5007
opcount 0.0200 0.0001 0.001 0.0198 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.644
Model: NNLS Adj. R-squared: 0.644
No. Observations: 418 RMSE: 43.36
Df Residuals: 416 MAE: 31.00
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 131.1863 6.4663 0.001 117.8075 143.1470
opcount 0.0030 0.0001 0.001 0.0028 0.0032
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.962
Model: NNLS Adj. R-squared: 0.962
No. Observations: 418 RMSE: 18.61
Df Residuals: 416 MAE: 14.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.6430 2.6478 0.001 83.7906 93.9727
opcount 0.0047 0.0000 0.001 0.0046 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL
test_ext_account_query_warm: combo STATICCALL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
220 |
0.9144 |
0.0005886 |
1.00e-03 |
[0.000565, 0.0006126] |
erigon |
231 |
0.875 |
7.494e-05 |
1.00e-03 |
[7.127e-05, 7.889e-05] |
ethrex |
165 |
0.904 |
0.0001261 |
1.00e-03 |
[0.0001192, 0.0001329] |
geth |
286 |
0.9352 |
0.0002371 |
1.00e-03 |
[0.0002296, 0.0002438] |
nethermind |
209 |
0.5078 |
0.0002206 |
1.00e-03 |
[0.0001929, 0.0002517] |
reth |
209 |
0.9567 |
7.632e-05 |
1.00e-03 |
[7.397e-05, 7.862e-05] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.914
Model: NNLS Adj. R-squared: 0.914
No. Observations: 220 RMSE: 93.27
Df Residuals: 218 MAE: 74.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 598.8605 20.0705 0.001 558.9127 638.2501
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.875
Model: NNLS Adj. R-squared: 0.874
No. Observations: 231 RMSE: 14.67
Df Residuals: 229 MAE: 13.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 25.1862 2.7997 0.001 19.3270 30.4682
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.904
Model: NNLS Adj. R-squared: 0.903
No. Observations: 165 RMSE: 21.28
Df Residuals: 163 MAE: 17.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 30.8760 5.2254 0.001 20.6664 40.9330
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.935
Model: NNLS Adj. R-squared: 0.935
No. Observations: 286 RMSE: 32.31
Df Residuals: 284 MAE: 26.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 61.3000 5.3640 0.001 51.7173 72.1612
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.508
Model: NNLS Adj. R-squared: 0.505
No. Observations: 209 RMSE: 112.46
Df Residuals: 207 MAE: 92.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 147.9461 23.0500 0.001 102.2882 189.0964
opcount 0.0002 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.957
Model: NNLS Adj. R-squared: 0.957
No. Observations: 209 RMSE: 8.41
Df Residuals: 207 MAE: 6.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 29.5289 1.8851 0.001 25.8994 33.2737
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo STATICCALL_AccountMode.EXISTING_EOA
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9713 |
0.01831 |
1.00e-03 |
[0.01801, 0.0186] |
erigon |
462 |
0.9902 |
0.004209 |
1.00e-03 |
[0.004173, 0.004244] |
ethrex |
330 |
0.4901 |
0.01839 |
1.00e-03 |
[0.01639, 0.01973] |
geth |
572 |
0.9804 |
0.02135 |
1.00e-03 |
[0.0211, 0.02161] |
nethermind |
418 |
0.8379 |
0.003702 |
1.00e-03 |
[0.003543, 0.003854] |
reth |
418 |
0.9702 |
0.005317 |
1.00e-03 |
[0.005226, 0.005411] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.971
No. Observations: 440 RMSE: 64.69
Df Residuals: 438 MAE: 51.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 404.6261 9.2592 0.001 387.3545 422.1610
opcount 0.0183 0.0002 0.001 0.0180 0.0186
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 462 RMSE: 8.62
Df Residuals: 460 MAE: 6.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 24.9208 1.1805 0.001 22.6771 27.2406
opcount 0.0042 0.0000 0.001 0.0042 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.490
Model: NNLS Adj. R-squared: 0.489
No. Observations: 330 RMSE: 385.64
Df Residuals: 328 MAE: 320.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 50.4954 50.6703 0.234 0.0000 160.8665
opcount 0.0184 0.0009 0.001 0.0164 0.0197
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 572 RMSE: 62.08
Df Residuals: 570 MAE: 47.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 276.8771 8.2980 0.001 260.3310 292.9112
opcount 0.0214 0.0001 0.001 0.0211 0.0216
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.838
Model: NNLS Adj. R-squared: 0.838
No. Observations: 418 RMSE: 33.47
Df Residuals: 416 MAE: 25.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.5728 4.8721 0.001 123.7634 142.0139
opcount 0.0037 0.0001 0.001 0.0035 0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.970
Model: NNLS Adj. R-squared: 0.970
No. Observations: 418 RMSE: 19.16
Df Residuals: 416 MAE: 14.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.3573 2.8457 0.001 92.8533 103.9081
opcount 0.0053 0.0000 0.001 0.0052 0.0054
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9677 |
0.0187 |
1.00e-03 |
[0.01838, 0.01901] |
erigon |
462 |
0.9884 |
0.004179 |
1.00e-03 |
[0.004137, 0.004218] |
ethrex |
330 |
0.959 |
0.002614 |
1.00e-03 |
[0.002552, 0.00267] |
geth |
572 |
0.9819 |
0.02164 |
1.00e-03 |
[0.02142, 0.02186] |
nethermind |
418 |
0.8006 |
0.003367 |
1.00e-03 |
[0.003207, 0.003547] |
reth |
418 |
0.9722 |
0.004975 |
1.00e-03 |
[0.004892, 0.005054] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.968
Model: NNLS Adj. R-squared: 0.968
No. Observations: 440 RMSE: 70.26
Df Residuals: 438 MAE: 57.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 352.4776 9.5866 0.001 333.3426 370.3938
opcount 0.0187 0.0002 0.001 0.0184 0.0190
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.988
No. Observations: 462 RMSE: 9.29
Df Residuals: 460 MAE: 7.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 25.0895 1.3095 0.001 22.5209 27.6113
opcount 0.0042 0.0000 0.001 0.0041 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.959
Model: NNLS Adj. R-squared: 0.959
No. Observations: 330 RMSE: 11.12
Df Residuals: 328 MAE: 9.06
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.4294 1.8178 0.001 18.8647 26.1502
opcount 0.0026 0.0000 0.001 0.0026 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 572 RMSE: 60.30
Df Residuals: 570 MAE: 46.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 276.6309 7.3204 0.001 262.2440 290.0066
opcount 0.0216 0.0001 0.001 0.0214 0.0219
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.801
Model: NNLS Adj. R-squared: 0.800
No. Observations: 418 RMSE: 34.54
Df Residuals: 416 MAE: 26.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 74.6352 5.0752 0.001 64.2738 84.0944
opcount 0.0034 0.0001 0.001 0.0032 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 418 RMSE: 17.31
Df Residuals: 416 MAE: 13.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.4068 2.5801 0.001 93.8817 103.6828
opcount 0.0050 0.0000 0.001 0.0049 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo STATICCALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8696 |
0.02792 |
1.00e-03 |
[0.02686, 0.02892] |
erigon |
462 |
0.5374 |
0.01533 |
1.00e-03 |
[0.01404, 0.01654] |
ethrex |
330 |
0.6389 |
0.01026 |
1.00e-03 |
[0.009454, 0.01119] |
geth |
572 |
0.7791 |
0.04556 |
1.00e-03 |
[0.04362, 0.04757] |
nethermind |
418 |
0.4815 |
0.02194 |
1.00e-03 |
[0.0198, 0.02423] |
reth |
418 |
0.4016 |
0.04191 |
1.00e-03 |
[0.03679, 0.04571] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.870
Model: NNLS Adj. R-squared: 0.869
No. Observations: 440 RMSE: 218.80
Df Residuals: 438 MAE: 178.33
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 791.0377 32.4397 0.001 733.2364 856.7839
opcount 0.0279 0.0005 0.001 0.0269 0.0289
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.537
Model: NNLS Adj. R-squared: 0.536
No. Observations: 462 RMSE: 287.93
Df Residuals: 460 MAE: 262.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 365.9736 35.1301 0.001 299.6393 436.6470
opcount 0.0153 0.0006 0.001 0.0140 0.0165
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.639
Model: NNLS Adj. R-squared: 0.638
No. Observations: 330 RMSE: 156.15
Df Residuals: 328 MAE: 133.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 240.6000 25.3827 0.001 191.3222 288.8030
opcount 0.0103 0.0005 0.001 0.0095 0.0112
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.779
Model: NNLS Adj. R-squared: 0.779
No. Observations: 572 RMSE: 491.05
Df Residuals: 570 MAE: 433.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1448.8191 70.8532 0.001 1305.5569 1585.4470
opcount 0.0456 0.0010 0.001 0.0436 0.0476
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.481
Model: NNLS Adj. R-squared: 0.480
No. Observations: 418 RMSE: 460.74
Df Residuals: 416 MAE: 405.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 698.1286 70.9792 0.001 553.4103 833.2782
opcount 0.0219 0.0011 0.001 0.0198 0.0242
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.402
Model: NNLS Adj. R-squared: 0.400
No. Observations: 418 RMSE: 1035.62
Df Residuals: 416 MAE: 984.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 153.9713 126.2823 0.164 0.0000 436.1604
opcount 0.0419 0.0023 0.001 0.0368 0.0457
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo STATICCALL_AccountMode.EXISTING_CONTRACT_MINIMAL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9565 |
0.01348 |
1.00e-03 |
[0.01321, 0.01376] |
erigon |
462 |
0.9515 |
0.004118 |
1.00e-03 |
[0.004036, 0.004194] |
ethrex |
330 |
0.7935 |
0.002762 |
1.00e-03 |
[0.00261, 0.00292] |
geth |
572 |
0.9759 |
0.02031 |
1.00e-03 |
[0.02006, 0.02056] |
nethermind |
418 |
0.613 |
0.003096 |
1.00e-03 |
[0.002824, 0.003343] |
reth |
418 |
0.9689 |
0.005192 |
1.00e-03 |
[0.005106, 0.005283] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.956
Model: NNLS Adj. R-squared: 0.956
No. Observations: 440 RMSE: 58.20
Df Residuals: 438 MAE: 47.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 386.9079 9.0658 0.001 369.1919 404.8480
opcount 0.0135 0.0001 0.001 0.0132 0.0138
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.951
No. Observations: 462 RMSE: 18.82
Df Residuals: 460 MAE: 14.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 174.9080 2.6050 0.001 169.9799 180.2348
opcount 0.0041 0.0000 0.001 0.0040 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.794
Model: NNLS Adj. R-squared: 0.793
No. Observations: 330 RMSE: 28.51
Df Residuals: 328 MAE: 22.86
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 106.4865 5.6137 0.001 95.5765 117.1108
opcount 0.0028 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 572 RMSE: 64.61
Df Residuals: 570 MAE: 49.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 277.0536 7.8915 0.001 261.6147 292.7438
opcount 0.0203 0.0001 0.001 0.0201 0.0206
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.613
Model: NNLS Adj. R-squared: 0.612
No. Observations: 418 RMSE: 49.78
Df Residuals: 416 MAE: 37.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 165.2922 7.4360 0.001 151.6971 181.1135
opcount 0.0031 0.0001 0.001 0.0028 0.0033
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.969
Model: NNLS Adj. R-squared: 0.969
No. Observations: 418 RMSE: 18.83
Df Residuals: 416 MAE: 14.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.2049 2.7862 0.001 86.7121 97.6317
opcount 0.0052 0.0000 0.001 0.0051 0.0053
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo STATICCALL_AccountMode.EXISTING_CONTRACT_SAME_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9508 |
0.01339 |
1.00e-03 |
[0.0131, 0.01368] |
erigon |
462 |
0.8501 |
0.004567 |
1.00e-03 |
[0.004393, 0.004735] |
ethrex |
330 |
0.7847 |
0.002765 |
1.00e-03 |
[0.002609, 0.002934] |
geth |
572 |
0.9773 |
0.0203 |
1.00e-03 |
[0.02006, 0.02053] |
nethermind |
418 |
0.6208 |
0.003282 |
1.00e-03 |
[0.003032, 0.003556] |
reth |
418 |
0.9643 |
0.005215 |
1.00e-03 |
[0.005117, 0.005313] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.951
No. Observations: 440 RMSE: 61.64
Df Residuals: 438 MAE: 50.99
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 392.3994 9.4879 0.001 374.3044 410.8712
opcount 0.0134 0.0002 0.001 0.0131 0.0137
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.850
Model: NNLS Adj. R-squared: 0.850
No. Observations: 462 RMSE: 38.81
Df Residuals: 460 MAE: 33.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.8022 5.9846 0.001 105.3236 128.3490
opcount 0.0046 0.0001 0.001 0.0044 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.785
Model: NNLS Adj. R-squared: 0.784
No. Observations: 330 RMSE: 29.31
Df Residuals: 328 MAE: 24.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 106.7796 5.6250 0.001 95.4962 117.8850
opcount 0.0028 0.0001 0.001 0.0026 0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 572 RMSE: 62.60
Df Residuals: 570 MAE: 49.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 278.7641 7.6777 0.001 263.5291 294.0613
opcount 0.0203 0.0001 0.001 0.0201 0.0205
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.621
Model: NNLS Adj. R-squared: 0.620
No. Observations: 418 RMSE: 51.91
Df Residuals: 416 MAE: 39.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 151.0690 7.7081 0.001 135.4717 165.9803
opcount 0.0033 0.0001 0.001 0.0030 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.964
Model: NNLS Adj. R-squared: 0.964
No. Observations: 418 RMSE: 20.31
Df Residuals: 416 MAE: 15.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.4673 2.8698 0.001 87.1883 98.1757
opcount 0.0052 0.0000 0.001 0.0051 0.0053
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY
test_account_access: combo EXTCODECOPY_AccountMode.EXISTING_EOA
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.974 |
0.01645 |
1.00e-03 |
[0.01621, 0.01671] |
erigon |
462 |
0.9904 |
0.003592 |
1.00e-03 |
[0.003563, 0.003621] |
ethrex |
330 |
0.491 |
0.01847 |
1.00e-03 |
[0.01645, 0.01968] |
geth |
572 |
0.9787 |
0.02156 |
1.00e-03 |
[0.0213, 0.02182] |
nethermind |
418 |
0.8446 |
0.003581 |
1.00e-03 |
[0.003427, 0.003731] |
reth |
418 |
0.9689 |
0.004999 |
1.00e-03 |
[0.00492, 0.005088] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 440 RMSE: 52.01
Df Residuals: 438 MAE: 42.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 269.8657 7.1473 0.001 255.9148 284.4734
opcount 0.0165 0.0001 0.001 0.0162 0.0167
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 462 RMSE: 6.86
Df Residuals: 460 MAE: 5.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.7242 0.9194 0.001 20.9691 24.5093
opcount 0.0036 0.0000 0.001 0.0036 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.491
Model: NNLS Adj. R-squared: 0.489
No. Observations: 330 RMSE: 364.22
Df Residuals: 328 MAE: 302.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 39.8975 44.1204 0.251 0.0000 144.8905
opcount 0.0185 0.0009 0.001 0.0164 0.0197
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 572 RMSE: 61.61
Df Residuals: 570 MAE: 49.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 263.6800 8.3110 0.001 247.6237 279.6874
opcount 0.0216 0.0001 0.001 0.0213 0.0218
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.845
Model: NNLS Adj. R-squared: 0.844
No. Observations: 418 RMSE: 29.75
Df Residuals: 416 MAE: 22.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.2643 4.2832 0.001 124.1066 140.5328
opcount 0.0036 0.0001 0.001 0.0034 0.0037
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.969
Model: NNLS Adj. R-squared: 0.969
No. Observations: 418 RMSE: 17.34
Df Residuals: 416 MAE: 13.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 93.8614 2.5681 0.001 88.8587 98.5432
opcount 0.0050 0.0000 0.001 0.0049 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9715 |
0.01538 |
1.00e-03 |
[0.01515, 0.01562] |
erigon |
462 |
0.991 |
0.003357 |
1.00e-03 |
[0.003324, 0.00339] |
ethrex |
330 |
0.9532 |
0.002529 |
1.00e-03 |
[0.00247, 0.002585] |
geth |
572 |
0.9739 |
0.02049 |
1.00e-03 |
[0.02024, 0.02076] |
nethermind |
418 |
0.8212 |
0.003348 |
1.00e-03 |
[0.003206, 0.003502] |
reth |
418 |
0.9641 |
0.004901 |
1.00e-03 |
[0.004811, 0.00499] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.971
No. Observations: 440 RMSE: 51.05
Df Residuals: 438 MAE: 42.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 140.5260 7.0799 0.001 127.0215 154.5852
opcount 0.0154 0.0001 0.001 0.0152 0.0156
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.991
Model: NNLS Adj. R-squared: 0.991
No. Observations: 462 RMSE: 6.21
Df Residuals: 460 MAE: 4.50
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 11.9682 0.9285 0.001 9.9914 13.8005
opcount 0.0034 0.0000 0.001 0.0033 0.0034
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.953
Model: NNLS Adj. R-squared: 0.953
No. Observations: 330 RMSE: 10.85
Df Residuals: 328 MAE: 8.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 21.1851 1.7625 0.001 17.8879 24.5447
opcount 0.0025 0.0000 0.001 0.0025 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 572 RMSE: 64.97
Df Residuals: 570 MAE: 52.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 283.9854 8.1729 0.001 267.9496 300.0064
opcount 0.0205 0.0001 0.001 0.0202 0.0208
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.821
Model: NNLS Adj. R-squared: 0.821
No. Observations: 418 RMSE: 30.25
Df Residuals: 416 MAE: 22.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 71.0033 4.2075 0.001 63.0133 78.9794
opcount 0.0033 0.0001 0.001 0.0032 0.0035
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.964
Model: NNLS Adj. R-squared: 0.964
No. Observations: 418 RMSE: 18.31
Df Residuals: 416 MAE: 13.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 95.2387 2.6174 0.001 90.1245 100.4564
opcount 0.0049 0.0000 0.001 0.0048 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_DIFF_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.8583 |
0.0239 |
1.00e-03 |
[0.0229, 0.0249] |
erigon |
462 |
0.533 |
0.01463 |
1.00e-03 |
[0.0135, 0.01587] |
ethrex |
330 |
0.6335 |
0.01015 |
1.00e-03 |
[0.009332, 0.01102] |
geth |
572 |
0.7657 |
0.0465 |
1.00e-03 |
[0.04448, 0.04845] |
nethermind |
418 |
0.4772 |
0.02111 |
1.00e-03 |
[0.01918, 0.0231] |
reth |
418 |
0.3865 |
0.04043 |
1.00e-03 |
[0.03547, 0.04435] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.858
Model: NNLS Adj. R-squared: 0.858
No. Observations: 440 RMSE: 185.33
Df Residuals: 438 MAE: 152.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 703.4240 29.3542 0.001 648.0677 762.6638
opcount 0.0239 0.0005 0.001 0.0229 0.0249
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.533
Model: NNLS Adj. R-squared: 0.532
No. Observations: 462 RMSE: 261.42
Df Residuals: 460 MAE: 241.06
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 345.1788 32.1962 0.001 280.5012 402.4086
opcount 0.0146 0.0006 0.001 0.0135 0.0159
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.633
Model: NNLS Adj. R-squared: 0.632
No. Observations: 330 RMSE: 147.36
Df Residuals: 328 MAE: 124.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 239.1725 23.0532 0.001 193.7617 283.9903
opcount 0.0102 0.0004 0.001 0.0093 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.766
Model: NNLS Adj. R-squared: 0.765
No. Observations: 572 RMSE: 490.89
Df Residuals: 570 MAE: 437.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1344.4379 66.8444 0.001 1220.8201 1471.7317
opcount 0.0465 0.0010 0.001 0.0445 0.0484
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.477
Model: NNLS Adj. R-squared: 0.476
No. Observations: 418 RMSE: 421.57
Df Residuals: 416 MAE: 373.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 620.5413 59.6540 0.001 499.6691 733.7915
opcount 0.0211 0.0010 0.001 0.0192 0.0231
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.386
Model: NNLS Adj. R-squared: 0.385
No. Observations: 418 RMSE: 972.02
Df Residuals: 416 MAE: 923.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 175.5144 122.7194 0.081 0.0000 445.5476
opcount 0.0404 0.0024 0.001 0.0355 0.0444
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_MINIMAL
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9599 |
0.01261 |
1.00e-03 |
[0.01236, 0.01285] |
erigon |
462 |
0.9377 |
0.003557 |
1.00e-03 |
[0.003481, 0.003641] |
ethrex |
330 |
0.7768 |
0.002668 |
1.00e-03 |
[0.002489, 0.002827] |
geth |
572 |
0.9738 |
0.02065 |
1.00e-03 |
[0.02038, 0.02093] |
nethermind |
418 |
0.6326 |
0.002969 |
1.00e-03 |
[0.002745, 0.003194] |
reth |
418 |
0.96 |
0.00477 |
1.00e-03 |
[0.004679, 0.004858] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 440 RMSE: 49.18
Df Residuals: 438 MAE: 40.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 262.5006 7.4308 0.001 247.7519 276.6436
opcount 0.0126 0.0001 0.001 0.0124 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.938
Model: NNLS Adj. R-squared: 0.938
No. Observations: 462 RMSE: 17.49
Df Residuals: 460 MAE: 12.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 156.2364 2.5095 0.001 151.3902 161.0616
opcount 0.0036 0.0000 0.001 0.0035 0.0036
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.777
Model: NNLS Adj. R-squared: 0.776
No. Observations: 330 RMSE: 27.30
Df Residuals: 328 MAE: 22.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 103.9488 5.5944 0.001 92.9994 115.1967
opcount 0.0027 0.0001 0.001 0.0025 0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 572 RMSE: 64.59
Df Residuals: 570 MAE: 51.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 251.7739 8.1318 0.001 235.7951 266.9840
opcount 0.0206 0.0001 0.001 0.0204 0.0209
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.633
Model: NNLS Adj. R-squared: 0.632
No. Observations: 418 RMSE: 43.17
Df Residuals: 416 MAE: 31.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 133.9914 6.1182 0.001 122.2932 146.3381
opcount 0.0030 0.0001 0.001 0.0027 0.0032
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 418 RMSE: 18.57
Df Residuals: 416 MAE: 14.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 86.5658 2.5292 0.001 81.6436 91.5020
opcount 0.0048 0.0000 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
test_account_access: combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_SAME_MAX
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
440 |
0.9637 |
0.01286 |
1.00e-03 |
[0.01261, 0.0131] |
erigon |
462 |
0.7948 |
0.003642 |
1.00e-03 |
[0.003471, 0.003804] |
ethrex |
330 |
0.7597 |
0.002652 |
1.00e-03 |
[0.002493, 0.002818] |
geth |
572 |
0.9702 |
0.02031 |
1.00e-03 |
[0.02003, 0.0206] |
nethermind |
418 |
0.6032 |
0.002921 |
1.00e-03 |
[0.00268, 0.003167] |
reth |
418 |
0.965 |
0.004739 |
1.00e-03 |
[0.004658, 0.00482] |
besu: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.964
Model: NNLS Adj. R-squared: 0.964
No. Observations: 440 RMSE: 47.65
Df Residuals: 438 MAE: 37.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 257.1361 7.0494 0.001 244.3465 271.9967
opcount 0.0129 0.0001 0.001 0.0126 0.0131
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.795
Model: NNLS Adj. R-squared: 0.794
No. Observations: 462 RMSE: 35.31
Df Residuals: 460 MAE: 31.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 120.9809 5.5731 0.001 110.3442 132.1812
opcount 0.0036 0.0001 0.001 0.0035 0.0038
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.760
Model: NNLS Adj. R-squared: 0.759
No. Observations: 330 RMSE: 28.47
Df Residuals: 328 MAE: 23.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 106.2053 5.6399 0.001 95.4736 116.3605
opcount 0.0027 0.0001 0.001 0.0025 0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.970
Model: NNLS Adj. R-squared: 0.970
No. Observations: 572 RMSE: 67.98
Df Residuals: 570 MAE: 54.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 252.7277 8.9831 0.001 235.5490 269.8873
opcount 0.0203 0.0002 0.001 0.0200 0.0206
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.603
Model: NNLS Adj. R-squared: 0.602
No. Observations: 418 RMSE: 45.21
Df Residuals: 416 MAE: 33.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 142.0538 6.4499 0.001 129.4384 154.8038
opcount 0.0029 0.0001 0.001 0.0027 0.0032
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth: NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.965
Model: NNLS Adj. R-squared: 0.965
No. Observations: 418 RMSE: 17.21
Df Residuals: 416 MAE: 13.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 87.6374 2.4144 0.001 83.0649 92.4033
opcount 0.0047 0.0000 0.001 0.0047 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================