Runtime estimation report
Per-spec NNLS fits of test_runtime_ms against opcount, one row per (target opcode, test, model_by combo, client).
Note: this is a bundled snapshot of the analysis output. The per-client regression, bootstrap, and diagnostic plots are omitted here; the figure-rich version is published on the live analysis site linked from the EIP’s discussions-to thread.
Contents
DIV
test_arithmetic
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.7121 |
1.517e-05 |
1.00e-03 |
[1.487e-05, 1.547e-05] |
erigon |
231 |
0.8953 |
1.012e-05 |
1.00e-03 |
[9.693e-06, 1.054e-05] |
ethrex |
1562 |
0.8405 |
9.341e-06 |
1.00e-03 |
[9.109e-06, 9.565e-06] |
geth |
4092 |
0.798 |
9.484e-06 |
1.00e-03 |
[9.331e-06, 9.646e-06] |
nethermind |
1155 |
0.6416 |
7.747e-06 |
1.00e-03 |
[7.305e-06, 8.208e-06] |
reth |
99 |
0.8305 |
7.01e-06 |
1.00e-03 |
[6.317e-06, 7.706e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.712
Model: NNLS Adj. R-squared: 0.712
No. Observations: 3652 RMSE: 76.17
Df Residuals: 3650 MAE: 61.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 141.9384 3.5555 0.001 134.9084 148.7499
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.895
Model: NNLS Adj. R-squared: 0.895
No. Observations: 231 RMSE: 27.32
Df Residuals: 229 MAE: 23.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 23.9785 5.9218 0.001 12.7086 35.5325
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.840
Model: NNLS Adj. R-squared: 0.840
No. Observations: 1562 RMSE: 32.13
Df Residuals: 1560 MAE: 27.05
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 72.4046 3.1072 0.001 66.3321 78.7320
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.798
Model: NNLS Adj. R-squared: 0.798
No. Observations: 4092 RMSE: 37.67
Df Residuals: 4090 MAE: 30.77
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 75.8186 2.1321 0.001 71.8208 79.8344
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.642
Model: NNLS Adj. R-squared: 0.641
No. Observations: 1155 RMSE: 45.71
Df Residuals: 1153 MAE: 36.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 129.0635 6.1217 0.001 116.3925 141.1473
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.830
Model: NNLS Adj. R-squared: 0.829
No. Observations: 99 RMSE: 25.00
Df Residuals: 97 MAE: 21.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.0211 9.3538 0.001 36.6781 74.0580
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
SDIV
test_arithmetic
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.7859 |
1.656e-05 |
1.00e-03 |
[1.628e-05, 1.683e-05] |
erigon |
231 |
0.8208 |
1.105e-05 |
1.00e-03 |
[1.025e-05, 1.17e-05] |
ethrex |
1562 |
0.8416 |
9.448e-06 |
1.00e-03 |
[9.222e-06, 9.67e-06] |
geth |
4092 |
0.8293 |
1.015e-05 |
1.00e-03 |
[9.992e-06, 1.031e-05] |
nethermind |
1155 |
0.8646 |
1.32e-05 |
1.00e-03 |
[1.29e-05, 1.351e-05] |
reth |
99 |
0.8431 |
8.962e-06 |
1.00e-03 |
[8.178e-06, 9.826e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.786
Model: NNLS Adj. R-squared: 0.786
No. Observations: 3652 RMSE: 68.25
Df Residuals: 3650 MAE: 56.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 133.1578 3.6254 0.001 126.3311 140.6890
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.821
Model: NNLS Adj. R-squared: 0.820
No. Observations: 231 RMSE: 40.76
Df Residuals: 229 MAE: 28.31
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 40.8380 11.1047 0.001 21.8948 64.9287
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.842
Model: NNLS Adj. R-squared: 0.841
No. Observations: 1562 RMSE: 32.36
Df Residuals: 1560 MAE: 27.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 75.0055 3.2793 0.001 68.5648 81.4451
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.829
Model: NNLS Adj. R-squared: 0.829
No. Observations: 4092 RMSE: 36.33
Df Residuals: 4090 MAE: 30.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 79.4371 2.1093 0.001 75.3166 83.5254
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.865
Model: NNLS Adj. R-squared: 0.864
No. Observations: 1155 RMSE: 41.24
Df Residuals: 1153 MAE: 32.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 68.1618 3.5384 0.001 60.9392 74.8485
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.843
Model: NNLS Adj. R-squared: 0.841
No. Observations: 99 RMSE: 30.52
Df Residuals: 97 MAE: 24.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 76.1655 11.2760 0.001 53.4124 97.1894
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
MOD
test_mod — combo 127
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8417 |
1.955e-05 |
1.00e-03 |
[1.928e-05, 1.984e-05] |
erigon |
231 |
0.8884 |
1.219e-05 |
1.00e-03 |
[1.166e-05, 1.262e-05] |
ethrex |
1562 |
0.8376 |
1.036e-05 |
1.00e-03 |
[1.011e-05, 1.063e-05] |
geth |
4092 |
0.8334 |
1.157e-05 |
1.00e-03 |
[1.14e-05, 1.174e-05] |
nethermind |
1155 |
0.8847 |
1.011e-05 |
1.00e-03 |
[9.904e-06, 1.031e-05] |
reth |
99 |
0.8527 |
7.02e-06 |
1.00e-03 |
[6.409e-06, 7.626e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.842
Model: NNLS Adj. R-squared: 0.842
No. Observations: 3652 RMSE: 66.83
Df Residuals: 3650 MAE: 55.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 131.8563 3.8783 0.001 124.2440 139.0374
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.888
Model: NNLS Adj. R-squared: 0.888
No. Observations: 231 RMSE: 34.06
Df Residuals: 229 MAE: 29.88
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 36.7815 7.0218 0.001 24.1740 51.4539
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.838
Model: NNLS Adj. R-squared: 0.838
No. Observations: 1562 RMSE: 35.96
Df Residuals: 1560 MAE: 30.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 83.1718 3.6730 0.001 75.5832 90.0965
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.833
Model: NNLS Adj. R-squared: 0.833
No. Observations: 4092 RMSE: 40.79
Df Residuals: 4090 MAE: 34.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.0946 2.4571 0.001 83.2459 92.9181
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.885
Model: NNLS Adj. R-squared: 0.885
No. Observations: 1155 RMSE: 28.78
Df Residuals: 1153 MAE: 22.56
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 44.3388 2.3979 0.001 39.8336 49.1209
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.853
Model: NNLS Adj. R-squared: 0.851
No. Observations: 99 RMSE: 23.01
Df Residuals: 97 MAE: 19.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 50.7237 8.6950 0.001 34.7373 67.9577
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_mod — combo 191
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8314 |
1.784e-05 |
1.00e-03 |
[1.759e-05, 1.81e-05] |
erigon |
231 |
0.8406 |
1.177e-05 |
1.00e-03 |
[1.128e-05, 1.221e-05] |
ethrex |
1562 |
0.8405 |
8.857e-06 |
1.00e-03 |
[8.66e-06, 9.061e-06] |
geth |
4092 |
0.834 |
1.108e-05 |
1.00e-03 |
[1.091e-05, 1.126e-05] |
nethermind |
1155 |
0.8955 |
1.122e-05 |
1.00e-03 |
[1.102e-05, 1.142e-05] |
reth |
99 |
0.8484 |
9.667e-06 |
1.00e-03 |
[8.782e-06, 1.059e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.831
Model: NNLS Adj. R-squared: 0.831
No. Observations: 3652 RMSE: 63.37
Df Residuals: 3650 MAE: 52.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.5314 3.3678 0.001 126.0903 139.1599
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.841
Model: NNLS Adj. R-squared: 0.840
No. Observations: 231 RMSE: 40.42
Df Residuals: 229 MAE: 29.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 35.5724 6.6088 0.001 23.1426 49.5225
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.840
Model: NNLS Adj. R-squared: 0.840
No. Observations: 1562 RMSE: 30.42
Df Residuals: 1560 MAE: 25.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 70.9856 3.0064 0.001 65.1218 76.7602
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.834
Model: NNLS Adj. R-squared: 0.834
No. Observations: 4092 RMSE: 38.96
Df Residuals: 4090 MAE: 32.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 83.9228 2.3436 0.001 79.1851 88.4416
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.895
Model: NNLS Adj. R-squared: 0.895
No. Observations: 1155 RMSE: 30.23
Df Residuals: 1153 MAE: 23.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 50.9802 2.5763 0.001 46.2622 56.1335
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.848
Model: NNLS Adj. R-squared: 0.847
No. Observations: 99 RMSE: 32.22
Df Residuals: 97 MAE: 26.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 80.1545 12.0225 0.001 57.1653 103.6467
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_mod — combo 255
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8029 |
1.454e-05 |
1.00e-03 |
[1.43e-05, 1.477e-05] |
erigon |
231 |
0.7683 |
1.167e-05 |
1.00e-03 |
[1.111e-05, 1.226e-05] |
ethrex |
1562 |
0.8369 |
6.94e-06 |
1.00e-03 |
[6.752e-06, 7.112e-06] |
geth |
4092 |
0.8343 |
1.014e-05 |
1.00e-03 |
[9.99e-06, 1.028e-05] |
nethermind |
1155 |
0.9198 |
1.033e-05 |
1.00e-03 |
[1.015e-05, 1.051e-05] |
reth |
99 |
0.8313 |
8.048e-06 |
1.00e-03 |
[7.341e-06, 8.779e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.803
Model: NNLS Adj. R-squared: 0.803
No. Observations: 3652 RMSE: 56.80
Df Residuals: 3650 MAE: 47.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 103.0783 3.0838 0.001 96.8893 108.9770
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.768
Model: NNLS Adj. R-squared: 0.767
No. Observations: 231 RMSE: 50.55
Df Residuals: 229 MAE: 32.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 27.8941 6.6814 0.001 15.1897 41.4582
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.837
Model: NNLS Adj. R-squared: 0.837
No. Observations: 1562 RMSE: 24.16
Df Residuals: 1560 MAE: 19.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 54.7166 2.5082 0.001 49.9655 59.9829
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.834
Model: NNLS Adj. R-squared: 0.834
No. Observations: 4092 RMSE: 35.62
Df Residuals: 4090 MAE: 30.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 76.1088 2.0554 0.001 72.2294 80.1210
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.920
Model: NNLS Adj. R-squared: 0.920
No. Observations: 1155 RMSE: 24.05
Df Residuals: 1153 MAE: 19.19
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 50.0879 2.3025 0.001 45.7861 54.8095
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.831
Model: NNLS Adj. R-squared: 0.830
No. Observations: 99 RMSE: 28.59
Df Residuals: 97 MAE: 23.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 74.8179 9.8075 0.001 55.6624 93.6979
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_mod — combo 63
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8188 |
1.452e-05 |
1.00e-03 |
[1.428e-05, 1.476e-05] |
erigon |
231 |
0.7559 |
9.076e-06 |
1.00e-03 |
[8.568e-06, 9.67e-06] |
ethrex |
1562 |
0.8289 |
5.599e-06 |
1.00e-03 |
[5.462e-06, 5.734e-06] |
geth |
4092 |
0.8316 |
8.187e-06 |
1.00e-03 |
[8.061e-06, 8.308e-06] |
nethermind |
1155 |
0.9012 |
6.91e-06 |
1.00e-03 |
[6.797e-06, 7.034e-06] |
reth |
99 |
0.8596 |
6.34e-06 |
1.00e-03 |
[5.802e-06, 6.885e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.819
Model: NNLS Adj. R-squared: 0.819
No. Observations: 3652 RMSE: 53.86
Df Residuals: 3650 MAE: 44.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.0392 3.1849 0.001 92.0876 104.0915
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.756
Model: NNLS Adj. R-squared: 0.755
No. Observations: 231 RMSE: 40.66
Df Residuals: 229 MAE: 21.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 16.1955 5.5091 0.002 4.8600 27.3480
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.829
Model: NNLS Adj. R-squared: 0.829
No. Observations: 1562 RMSE: 20.05
Df Residuals: 1560 MAE: 16.99
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 44.3450 1.9118 0.001 40.4827 48.0979
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.832
Model: NNLS Adj. R-squared: 0.832
No. Observations: 4092 RMSE: 29.05
Df Residuals: 4090 MAE: 24.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 62.0235 1.7256 0.001 58.7117 65.4521
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.901
Model: NNLS Adj. R-squared: 0.901
No. Observations: 1155 RMSE: 18.04
Df Residuals: 1153 MAE: 12.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 31.4773 1.3868 0.001 28.7883 34.0949
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.860
Model: NNLS Adj. R-squared: 0.858
No. Observations: 99 RMSE: 20.20
Df Residuals: 97 MAE: 16.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 51.8488 6.9785 0.001 37.9509 65.7563
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
SMOD
test_mod — combo 127
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8466 |
2.015e-05 |
1.00e-03 |
[1.987e-05, 2.045e-05] |
erigon |
231 |
0.895 |
1.286e-05 |
1.00e-03 |
[1.23e-05, 1.33e-05] |
ethrex |
1562 |
0.8344 |
1.055e-05 |
1.00e-03 |
[1.032e-05, 1.081e-05] |
geth |
4092 |
0.8316 |
1.216e-05 |
1.00e-03 |
[1.199e-05, 1.234e-05] |
nethermind |
1155 |
0.9335 |
1.103e-05 |
1.00e-03 |
[1.085e-05, 1.121e-05] |
reth |
99 |
0.8675 |
7.022e-06 |
1.00e-03 |
[6.457e-06, 7.574e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.847
Model: NNLS Adj. R-squared: 0.847
No. Observations: 3652 RMSE: 67.64
Df Residuals: 3650 MAE: 56.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 142.8678 4.0678 0.001 134.6763 150.7313
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.895
Model: NNLS Adj. R-squared: 0.895
No. Observations: 231 RMSE: 34.73
Df Residuals: 229 MAE: 30.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 32.0862 7.1611 0.001 19.6539 48.1089
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.834
Model: NNLS Adj. R-squared: 0.834
No. Observations: 1562 RMSE: 37.08
Df Residuals: 1560 MAE: 31.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 81.5883 3.5414 0.001 74.6095 88.3820
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.832
Model: NNLS Adj. R-squared: 0.832
No. Observations: 4092 RMSE: 43.15
Df Residuals: 4090 MAE: 36.48
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.0482 2.5544 0.001 82.9009 92.9295
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.933
Model: NNLS Adj. R-squared: 0.933
No. Observations: 1155 RMSE: 23.21
Df Residuals: 1153 MAE: 18.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 48.9030 2.2200 0.001 44.5088 53.2733
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.867
Model: NNLS Adj. R-squared: 0.866
No. Observations: 99 RMSE: 21.64
Df Residuals: 97 MAE: 17.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 56.1200 7.9813 0.001 40.9087 72.0673
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_mod — combo 191
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8303 |
1.876e-05 |
1.00e-03 |
[1.846e-05, 1.901e-05] |
erigon |
231 |
0.8949 |
1.247e-05 |
1.00e-03 |
[1.192e-05, 1.293e-05] |
ethrex |
1562 |
0.8394 |
8.982e-06 |
1.00e-03 |
[8.76e-06, 9.192e-06] |
geth |
4092 |
0.831 |
1.156e-05 |
1.00e-03 |
[1.139e-05, 1.175e-05] |
nethermind |
1155 |
0.9136 |
1.238e-05 |
1.00e-03 |
[1.217e-05, 1.258e-05] |
reth |
99 |
0.8589 |
1.058e-05 |
1.00e-03 |
[9.658e-06, 1.152e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.830
Model: NNLS Adj. R-squared: 0.830
No. Observations: 3652 RMSE: 66.87
Df Residuals: 3650 MAE: 55.78
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 133.6374 3.7811 0.001 126.9613 141.4523
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.895
Model: NNLS Adj. R-squared: 0.894
No. Observations: 231 RMSE: 33.68
Df Residuals: 229 MAE: 29.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 33.4731 6.9291 0.001 21.4734 48.7536
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.839
Model: NNLS Adj. R-squared: 0.839
No. Observations: 1562 RMSE: 30.97
Df Residuals: 1560 MAE: 26.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 70.3621 3.0443 0.001 64.8521 76.5328
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.831
Model: NNLS Adj. R-squared: 0.831
No. Observations: 4092 RMSE: 41.11
Df Residuals: 4090 MAE: 34.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.7090 2.4385 0.001 80.5961 90.5012
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.914
Model: NNLS Adj. R-squared: 0.914
No. Observations: 1155 RMSE: 30.02
Df Residuals: 1153 MAE: 23.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.4057 2.6612 0.001 50.4132 60.8283
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.859
Model: NNLS Adj. R-squared: 0.857
No. Observations: 99 RMSE: 33.81
Df Residuals: 97 MAE: 28.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 66.7033 13.2193 0.001 40.6144 94.4093
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_mod — combo 255
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8109 |
1.537e-05 |
1.00e-03 |
[1.514e-05, 1.563e-05] |
erigon |
231 |
0.8778 |
1.195e-05 |
1.00e-03 |
[1.132e-05, 1.256e-05] |
ethrex |
1562 |
0.8385 |
7.31e-06 |
1.00e-03 |
[7.131e-06, 7.493e-06] |
geth |
4092 |
0.831 |
1.029e-05 |
1.00e-03 |
[1.014e-05, 1.046e-05] |
nethermind |
1155 |
0.9259 |
1.109e-05 |
1.00e-03 |
[1.091e-05, 1.128e-05] |
reth |
99 |
0.8422 |
8.753e-06 |
1.00e-03 |
[7.994e-06, 9.546e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.811
Model: NNLS Adj. R-squared: 0.811
No. Observations: 3652 RMSE: 58.54
Df Residuals: 3650 MAE: 48.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 105.2530 3.2482 0.001 98.6946 111.2062
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.878
Model: NNLS Adj. R-squared: 0.877
No. Observations: 231 RMSE: 35.16
Df Residuals: 229 MAE: 27.67
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 22.5224 7.8330 0.003 7.6607 38.1582
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.838
Model: NNLS Adj. R-squared: 0.838
No. Observations: 1562 RMSE: 25.30
Df Residuals: 1560 MAE: 21.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.0181 2.5050 0.001 49.8847 59.8868
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.831
Model: NNLS Adj. R-squared: 0.831
No. Observations: 4092 RMSE: 36.60
Df Residuals: 4090 MAE: 30.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 78.8605 2.2117 0.001 74.3816 83.1446
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.926
Model: NNLS Adj. R-squared: 0.926
No. Observations: 1155 RMSE: 24.75
Df Residuals: 1153 MAE: 19.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 50.5899 2.4067 0.001 46.1960 55.2439
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.842
Model: NNLS Adj. R-squared: 0.841
No. Observations: 99 RMSE: 29.87
Df Residuals: 97 MAE: 25.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 69.8202 10.8710 0.001 48.1953 90.9060
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_mod — combo 63
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8117 |
1.549e-05 |
1.00e-03 |
[1.524e-05, 1.573e-05] |
erigon |
231 |
0.8938 |
9.202e-06 |
1.00e-03 |
[8.769e-06, 9.614e-06] |
ethrex |
1562 |
0.8276 |
4.542e-06 |
1.00e-03 |
[4.42e-06, 4.651e-06] |
geth |
4092 |
0.8289 |
8.62e-06 |
1.00e-03 |
[8.492e-06, 8.756e-06] |
nethermind |
1155 |
0.9146 |
8.104e-06 |
1.00e-03 |
[7.961e-06, 8.245e-06] |
reth |
99 |
0.8655 |
6.348e-06 |
1.00e-03 |
[5.832e-06, 6.881e-06] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.812
Model: NNLS Adj. R-squared: 0.812
No. Observations: 3652 RMSE: 58.82
Df Residuals: 3650 MAE: 48.33
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 114.5869 3.2754 0.001 108.3147 120.9429
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.894
Model: NNLS Adj. R-squared: 0.893
No. Observations: 231 RMSE: 25.01
Df Residuals: 229 MAE: 20.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 19.2036 5.3776 0.001 8.8490 29.9323
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.828
Model: NNLS Adj. R-squared: 0.827
No. Observations: 1562 RMSE: 16.35
Df Residuals: 1560 MAE: 13.67
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 37.5186 1.5748 0.001 34.5816 40.6265
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.829
Model: NNLS Adj. R-squared: 0.829
No. Observations: 4092 RMSE: 30.88
Df Residuals: 4090 MAE: 25.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 67.7025 1.8227 0.001 64.0458 71.2905
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.915
Model: NNLS Adj. R-squared: 0.915
No. Observations: 1155 RMSE: 19.52
Df Residuals: 1153 MAE: 14.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 35.4936 1.6629 0.001 32.2208 38.7607
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.866
Model: NNLS Adj. R-squared: 0.864
No. Observations: 99 RMSE: 19.73
Df Residuals: 97 MAE: 16.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 51.7572 7.3986 0.001 37.5205 65.8323
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ADDMOD
test_mod_arithmetic — combo 191
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8315 |
2.338e-05 |
1.00e-03 |
[2.307e-05, 2.371e-05] |
erigon |
231 |
0.9041 |
1.823e-05 |
1.00e-03 |
[1.752e-05, 1.893e-05] |
ethrex |
1562 |
0.8367 |
1.361e-05 |
1.00e-03 |
[1.327e-05, 1.394e-05] |
geth |
4092 |
0.8376 |
1.65e-05 |
1.00e-03 |
[1.626e-05, 1.674e-05] |
nethermind |
1155 |
0.9297 |
1.328e-05 |
1.00e-03 |
[1.308e-05, 1.348e-05] |
reth |
99 |
0.8579 |
9.424e-06 |
1.00e-03 |
[8.543e-06, 1.031e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.831
Model: NNLS Adj. R-squared: 0.831
No. Observations: 3652 RMSE: 47.39
Df Residuals: 3650 MAE: 38.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 107.4560 2.4447 0.001 102.3448 112.1026
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.904
Model: NNLS Adj. R-squared: 0.904
No. Observations: 231 RMSE: 26.73
Df Residuals: 229 MAE: 23.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 28.5952 5.7405 0.001 17.2735 39.1526
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.837
Model: NNLS Adj. R-squared: 0.837
No. Observations: 1562 RMSE: 27.07
Df Residuals: 1560 MAE: 22.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 61.2844 2.7019 0.001 55.8850 66.6120
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.838
Model: NNLS Adj. R-squared: 0.838
No. Observations: 4092 RMSE: 32.71
Df Residuals: 4090 MAE: 27.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 70.9402 1.9049 0.001 67.0255 74.9205
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.930
Model: NNLS Adj. R-squared: 0.930
No. Observations: 1155 RMSE: 16.44
Df Residuals: 1153 MAE: 13.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 33.5232 1.3988 0.001 30.8839 36.2306
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.858
Model: NNLS Adj. R-squared: 0.856
No. Observations: 99 RMSE: 17.27
Df Residuals: 97 MAE: 14.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 40.7360 6.8612 0.001 26.9693 54.2698
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
MULMOD
test_mod_arithmetic — combo 191
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8484 |
3.576e-05 |
1.00e-03 |
[3.528e-05, 3.625e-05] |
erigon |
231 |
0.8873 |
2.615e-05 |
1.00e-03 |
[2.481e-05, 2.722e-05] |
ethrex |
1562 |
0.8258 |
2.265e-05 |
1.00e-03 |
[2.212e-05, 2.319e-05] |
geth |
4092 |
0.8357 |
2.385e-05 |
1.00e-03 |
[2.35e-05, 2.42e-05] |
nethermind |
1155 |
0.9081 |
3.349e-05 |
1.00e-03 |
[3.286e-05, 3.411e-05] |
reth |
99 |
0.8533 |
1.684e-05 |
1.00e-03 |
[1.539e-05, 1.832e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.848
Model: NNLS Adj. R-squared: 0.848
No. Observations: 3652 RMSE: 68.07
Df Residuals: 3650 MAE: 57.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 154.8030 3.7485 0.001 147.5404 162.1317
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.887
Model: NNLS Adj. R-squared: 0.887
No. Observations: 231 RMSE: 41.96
Df Residuals: 229 MAE: 36.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 44.7394 9.6813 0.001 27.6897 65.4034
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.826
Model: NNLS Adj. R-squared: 0.826
No. Observations: 1562 RMSE: 46.83
Df Residuals: 1560 MAE: 39.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 102.4392 4.4549 0.001 93.6398 110.8514
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.836
Model: NNLS Adj. R-squared: 0.836
No. Observations: 4092 RMSE: 47.60
Df Residuals: 4090 MAE: 40.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 100.3542 2.7265 0.001 94.9464 105.4237
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.908
Model: NNLS Adj. R-squared: 0.908
No. Observations: 1155 RMSE: 47.98
Df Residuals: 1153 MAE: 37.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 84.1258 4.1922 0.001 75.7796 92.1472
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.853
Model: NNLS Adj. R-squared: 0.852
No. Observations: 99 RMSE: 31.45
Df Residuals: 97 MAE: 25.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 89.1284 11.5187 0.001 66.1461 112.1967
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
KECCAK256
test_keccak_diff_mem_msg_sizes — combo 0
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
14608 |
0.7664 |
9.826e-05 |
1.00e-03 |
[9.736e-05, 9.917e-05] |
erigon |
924 |
0.8081 |
7.638e-05 |
1.00e-03 |
[7.385e-05, 7.867e-05] |
ethrex |
6248 |
0.6558 |
1.303e-05 |
1.00e-03 |
[1.131e-05, 1.468e-05] |
geth |
16368 |
0.789 |
8.134e-05 |
1.00e-03 |
[8.075e-05, 8.201e-05] |
nethermind |
4620 |
0.6981 |
2.397e-05 |
1.00e-03 |
[2.048e-05, 2.753e-05] |
reth |
396 |
0.5592 |
1.586e-05 |
1.00e-03 |
[7.961e-06, 2.429e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.766
Model: NNLS Adj. R-squared: 0.766
No. Observations: 14608 RMSE: 85.33
Df Residuals: 14605 MAE: 71.14
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 140.5054 2.3213 0.001 135.9759 144.9773
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.808
Model: NNLS Adj. R-squared: 0.808
No. Observations: 924 RMSE: 64.05
Df Residuals: 921 MAE: 49.88
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 38.6597 6.3445 0.001 26.6551 51.3674
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.656
Model: NNLS Adj. R-squared: 0.656
No. Observations: 6248 RMSE: 91.87
Df Residuals: 6245 MAE: 75.93
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 63.8305 3.3412 0.001 57.1098 70.1756
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.789
Model: NNLS Adj. R-squared: 0.789
No. Observations: 16368 RMSE: 63.56
Df Residuals: 16365 MAE: 51.65
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.8034 1.6000 0.001 98.4177 104.7050
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.698
Model: NNLS Adj. R-squared: 0.698
No. Observations: 4620 RMSE: 158.87
Df Residuals: 4617 MAE: 130.27
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 90.0434 6.9984 0.001 77.1524 103.8655
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.559
Model: NNLS Adj. R-squared: 0.557
No. Observations: 396 RMSE: 106.66
Df Residuals: 393 MAE: 85.96
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 61.0340 15.9476 0.001 28.4883 92.7944
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_keccak_diff_mem_msg_sizes — combo 1024
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
14608 |
0.7844 |
0.0001079 |
1.00e-03 |
[0.0001071, 0.0001089] |
erigon |
924 |
0.8265 |
7.606e-05 |
1.00e-03 |
[7.33e-05, 7.866e-05] |
ethrex |
6248 |
0.6561 |
1.316e-05 |
1.00e-03 |
[1.136e-05, 1.483e-05] |
geth |
16368 |
0.794 |
8.142e-05 |
1.00e-03 |
[8.081e-05, 8.203e-05] |
nethermind |
4620 |
0.7005 |
2.444e-05 |
1.00e-03 |
[2.1e-05, 2.794e-05] |
reth |
396 |
0.5698 |
1.625e-05 |
1.00e-03 |
[7.498e-06, 2.462e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.784
Model: NNLS Adj. R-squared: 0.784
No. Observations: 14608 RMSE: 86.51
Df Residuals: 14605 MAE: 71.33
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.6644 2.3422 0.001 127.8051 137.1040
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.827
Model: NNLS Adj. R-squared: 0.826
No. Observations: 924 RMSE: 59.88
Df Residuals: 921 MAE: 48.35
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 39.4858 6.2113 0.001 28.0829 52.0117
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.656
Model: NNLS Adj. R-squared: 0.656
No. Observations: 6248 RMSE: 92.02
Df Residuals: 6245 MAE: 76.08
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 63.0297 3.4903 0.001 56.5041 69.8949
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.794
Model: NNLS Adj. R-squared: 0.794
No. Observations: 16368 RMSE: 62.78
Df Residuals: 16365 MAE: 51.24
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.3861 1.6552 0.001 95.0853 101.6429
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.701
Model: NNLS Adj. R-squared: 0.700
No. Observations: 4620 RMSE: 158.37
Df Residuals: 4617 MAE: 129.51
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 86.8001 6.8432 0.001 72.9895 100.1890
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.570
Model: NNLS Adj. R-squared: 0.568
No. Observations: 396 RMSE: 106.37
Df Residuals: 393 MAE: 85.33
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 58.1366 16.2160 0.001 25.6331 88.6644
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_keccak_diff_mem_msg_sizes — combo 256
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
14608 |
0.7805 |
0.0001103 |
1.00e-03 |
[0.0001094, 0.0001112] |
erigon |
924 |
0.8147 |
7.492e-05 |
1.00e-03 |
[7.224e-05, 7.721e-05] |
ethrex |
6248 |
0.6564 |
1.325e-05 |
1.00e-03 |
[1.157e-05, 1.488e-05] |
geth |
16368 |
0.7919 |
8.097e-05 |
1.00e-03 |
[8.033e-05, 8.155e-05] |
nethermind |
4620 |
0.6993 |
2.44e-05 |
1.00e-03 |
[2.093e-05, 2.758e-05] |
reth |
396 |
0.5606 |
1.602e-05 |
1.00e-03 |
[7.885e-06, 2.455e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.780
Model: NNLS Adj. R-squared: 0.780
No. Observations: 14608 RMSE: 88.97
Df Residuals: 14605 MAE: 73.33
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 129.1090 2.3482 0.001 124.8571 133.7915
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.815
Model: NNLS Adj. R-squared: 0.814
No. Observations: 924 RMSE: 61.55
Df Residuals: 921 MAE: 49.34
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 45.0322 6.3195 0.001 32.6658 58.4800
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.656
Model: NNLS Adj. R-squared: 0.656
No. Observations: 6248 RMSE: 91.89
Df Residuals: 6245 MAE: 75.85
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 62.6232 3.2391 0.001 56.5885 69.0111
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.792
Model: NNLS Adj. R-squared: 0.792
No. Observations: 16368 RMSE: 62.85
Df Residuals: 16365 MAE: 50.96
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 99.7643 1.6299 0.001 96.6401 102.8870
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.699
Model: NNLS Adj. R-squared: 0.699
No. Observations: 4620 RMSE: 158.40
Df Residuals: 4617 MAE: 129.58
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 87.8619 6.5439 0.001 75.0825 100.8425
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.561
Model: NNLS Adj. R-squared: 0.558
No. Observations: 396 RMSE: 106.64
Df Residuals: 393 MAE: 85.88
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 59.8467 15.4798 0.001 27.8576 88.8289
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_keccak_diff_mem_msg_sizes — combo 32
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
14608 |
0.7611 |
0.0001022 |
1.00e-03 |
[0.0001012, 0.0001031] |
erigon |
924 |
0.8226 |
7.518e-05 |
1.00e-03 |
[7.282e-05, 7.761e-05] |
ethrex |
6248 |
0.6549 |
1.314e-05 |
1.00e-03 |
[1.145e-05, 1.507e-05] |
geth |
16368 |
0.7919 |
8.123e-05 |
1.00e-03 |
[8.061e-05, 8.188e-05] |
nethermind |
4620 |
0.6992 |
2.408e-05 |
1.00e-03 |
[2.071e-05, 2.76e-05] |
reth |
396 |
0.5645 |
1.527e-05 |
1.00e-03 |
[7.06e-06, 2.302e-05] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.761
Model: NNLS Adj. R-squared: 0.761
No. Observations: 14608 RMSE: 87.97
Df Residuals: 14605 MAE: 73.55
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 152.3981 2.4343 0.001 147.6067 157.3849
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.823
Model: NNLS Adj. R-squared: 0.822
No. Observations: 924 RMSE: 59.80
Df Residuals: 921 MAE: 48.80
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 44.7774 6.0713 0.001 32.7908 55.8971
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.655
Model: NNLS Adj. R-squared: 0.655
No. Observations: 6248 RMSE: 92.09
Df Residuals: 6245 MAE: 76.07
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 63.4598 3.4548 0.001 56.4330 70.1921
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.792
Model: NNLS Adj. R-squared: 0.792
No. Observations: 16368 RMSE: 63.06
Df Residuals: 16365 MAE: 51.79
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.2611 1.6387 0.001 95.1424 101.4627
opcount 0.0001 0.0000 0.001 0.0001 0.0001
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.699
Model: NNLS Adj. R-squared: 0.699
No. Observations: 4620 RMSE: 158.51
Df Residuals: 4617 MAE: 130.02
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 89.4085 6.8927 0.001 74.9642 102.9367
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.565
Model: NNLS Adj. R-squared: 0.562
No. Observations: 396 RMSE: 106.18
Df Residuals: 393 MAE: 85.13
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 63.0521 15.0854 0.001 33.3584 93.2852
opcount 0.0000 0.0000 0.001 0.0000 0.0000
msg_words 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ECRECOVER
test_ecrecover
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8849 |
0.0067 |
1.00e-03 |
[0.006622, 0.006774] |
erigon |
231 |
0.8262 |
0.008405 |
1.00e-03 |
[0.007826, 0.008916] |
ethrex |
1562 |
0.8209 |
0.006236 |
1.00e-03 |
[0.006081, 0.006386] |
geth |
4092 |
0.8809 |
0.007801 |
1.00e-03 |
[0.007716, 0.007889] |
nethermind |
1155 |
0.8773 |
0.006904 |
1.00e-03 |
[0.006725, 0.007079] |
reth |
99 |
0.8359 |
0.006548 |
1.00e-03 |
[0.005918, 0.007205] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.885
Model: NNLS Adj. R-squared: 0.885
No. Observations: 3652 RMSE: 48.76
Df Residuals: 3650 MAE: 41.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 144.1879 2.7858 0.001 138.8795 149.7463
opcount 0.0067 0.0000 0.001 0.0066 0.0068
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.826
Model: NNLS Adj. R-squared: 0.825
No. Observations: 231 RMSE: 77.79
Df Residuals: 229 MAE: 50.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.2901 22.6796 0.001 47.9486 132.7997
opcount 0.0084 0.0003 0.001 0.0078 0.0089
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.821
Model: NNLS Adj. R-squared: 0.821
No. Observations: 1562 RMSE: 58.76
Df Residuals: 1560 MAE: 50.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 129.8668 5.6566 0.001 119.4284 141.5329
opcount 0.0062 0.0001 0.001 0.0061 0.0064
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.881
Model: NNLS Adj. R-squared: 0.881
No. Observations: 4092 RMSE: 57.88
Df Residuals: 4090 MAE: 49.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.3869 3.1047 0.001 109.5404 121.2017
opcount 0.0078 0.0000 0.001 0.0077 0.0079
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.877
Model: NNLS Adj. R-squared: 0.877
No. Observations: 1155 RMSE: 52.09
Df Residuals: 1153 MAE: 43.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 102.8759 5.9971 0.001 90.7031 114.2329
opcount 0.0069 0.0001 0.001 0.0067 0.0071
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.836
Model: NNLS Adj. R-squared: 0.834
No. Observations: 99 RMSE: 58.53
Df Residuals: 97 MAE: 48.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 121.0467 23.1192 0.001 76.5813 167.6927
opcount 0.0065 0.0003 0.001 0.0059 0.0072
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
BLAKE2F
test_blake2f_benchmark
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
14608 |
0.8693 |
0.0003378 |
1.00e-03 |
[0.0003353, 0.0003401] |
erigon |
924 |
0.9536 |
0.0005902 |
1.00e-03 |
[0.0005812, 0.0006001] |
ethrex |
6248 |
0.8723 |
4.498e-05 |
1.00e-03 |
[4.425e-05, 4.578e-05] |
geth |
16368 |
0.9304 |
0.000104 |
1.00e-03 |
[0.0001034, 0.0001045] |
nethermind |
4620 |
0.9519 |
0.000156 |
1.00e-03 |
[0.0001549, 0.0001572] |
reth |
396 |
0.9896 |
0.0003815 |
1.00e-03 |
[0.0003779, 0.0003852] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.869
Model: NNLS Adj. R-squared: 0.869
No. Observations: 14608 RMSE: 68.62
Df Residuals: 14605 MAE: 58.14
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 164.7682 2.1811 0.001 160.6268 169.1850
opcount 0.0003 0.0000 0.001 0.0003 0.0003
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.954
Model: NNLS Adj. R-squared: 0.954
No. Observations: 924 RMSE: 65.82
Df Residuals: 921 MAE: 47.74
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 18.3210 6.8763 0.006 4.8943 31.6851
opcount 0.0006 0.0000 0.001 0.0006 0.0006
num_rounds 0.0000 0.0000 0.008 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.872
Model: NNLS Adj. R-squared: 0.872
No. Observations: 6248 RMSE: 14.26
Df Residuals: 6245 MAE: 11.57
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 28.2348 0.6540 0.001 26.8982 29.4346
opcount 0.0000 0.0000 0.001 0.0000 0.0000
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.930
Model: NNLS Adj. R-squared: 0.930
No. Observations: 16368 RMSE: 17.30
Df Residuals: 16365 MAE: 13.85
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 34.8823 0.4928 0.001 33.9108 35.8480
opcount 0.0001 0.0000 0.001 0.0001 0.0001
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.952
Model: NNLS Adj. R-squared: 0.952
No. Observations: 4620 RMSE: 18.92
Df Residuals: 4617 MAE: 15.48
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 28.8549 0.7941 0.001 27.1293 30.3438
opcount 0.0002 0.0000 0.001 0.0002 0.0002
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.989
No. Observations: 396 RMSE: 19.75
Df Residuals: 393 MAE: 15.67
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 11.6857 3.0888 0.001 5.5188 17.8405
opcount 0.0004 0.0000 0.001 0.0004 0.0004
num_rounds 0.0000 0.0000 1.000 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_blake2f_uncachable
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
14608 |
0.8528 |
0.0004011 |
1.00e-03 |
[0.0003981, 0.0004041] |
erigon |
924 |
0.9603 |
0.0009363 |
1.00e-03 |
[0.0009227, 0.000948] |
ethrex |
6248 |
0.8711 |
5.119e-05 |
1.00e-03 |
[5.033e-05, 5.198e-05] |
geth |
16368 |
0.9234 |
0.0001355 |
1.00e-03 |
[0.0001348, 0.0001363] |
nethermind |
4620 |
0.9323 |
0.000165 |
1.00e-03 |
[0.0001637, 0.0001663] |
reth |
396 |
0.9875 |
0.0003756 |
1.00e-03 |
[0.0003718, 0.0003789] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.853
Model: NNLS Adj. R-squared: 0.853
No. Observations: 14608 RMSE: 71.68
Df Residuals: 14605 MAE: 60.58
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 156.0843 2.1709 0.001 151.6979 160.3488
opcount 0.0004 0.0000 0.001 0.0004 0.0004
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.960
No. Observations: 924 RMSE: 78.79
Df Residuals: 921 MAE: 57.78
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 47.1798 8.3910 0.001 32.0294 64.6495
opcount 0.0009 0.0000 0.001 0.0009 0.0009
num_rounds 0.0000 0.0000 0.198 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.871
Model: NNLS Adj. R-squared: 0.871
No. Observations: 6248 RMSE: 12.77
Df Residuals: 6245 MAE: 10.39
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 23.9197 0.5441 0.001 22.9303 25.0477
opcount 0.0001 0.0000 0.001 0.0001 0.0001
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.923
Model: NNLS Adj. R-squared: 0.923
No. Observations: 16368 RMSE: 18.47
Df Residuals: 16365 MAE: 14.56
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 23.9269 0.5474 0.001 22.8235 24.9216
opcount 0.0001 0.0000 0.001 0.0001 0.0001
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.932
Model: NNLS Adj. R-squared: 0.932
No. Observations: 4620 RMSE: 19.86
Df Residuals: 4617 MAE: 14.32
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.5344 0.7865 0.001 24.9812 28.0668
opcount 0.0002 0.0000 0.001 0.0002 0.0002
num_rounds 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.987
No. Observations: 396 RMSE: 17.44
Df Residuals: 393 MAE: 14.04
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 16.4682 2.6589 0.001 11.4694 21.9744
opcount 0.0004 0.0000 0.001 0.0004 0.0004
num_rounds 0.0000 0.0000 1.000 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
BLS12_G1ADD
test_bls12_381
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8572 |
0.001742 |
1.00e-03 |
[0.00172, 0.001767] |
erigon |
231 |
0.8317 |
0.0009951 |
1.00e-03 |
[0.0009579, 0.00103] |
ethrex |
1562 |
0.05318 |
0.002351 |
1.00e-03 |
[0.001864, 0.00278] |
geth |
4092 |
0.9 |
0.000733 |
1.00e-03 |
[0.0007246, 0.0007412] |
nethermind |
1155 |
0.9388 |
0.0009701 |
1.00e-03 |
[0.0009563, 0.0009841] |
reth |
99 |
0.8538 |
0.0007585 |
1.00e-03 |
[0.0006852, 0.000828] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.857
Model: NNLS Adj. R-squared: 0.857
No. Observations: 3652 RMSE: 91.12
Df Residuals: 3650 MAE: 72.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 99.2794 5.7564 0.001 87.7412 109.8290
opcount 0.0017 0.0000 0.001 0.0017 0.0018
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.832
Model: NNLS Adj. R-squared: 0.831
No. Observations: 231 RMSE: 57.34
Df Residuals: 229 MAE: 37.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 45.8068 9.0191 0.001 28.7509 62.9708
opcount 0.0010 0.0000 0.001 0.0010 0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.053
Model: NNLS Adj. R-squared: 0.053
No. Observations: 1562 RMSE: 1270.62
Df Residuals: 1560 MAE: 1146.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 291.7258 88.5341 0.001 130.9252 475.9325
opcount 0.0024 0.0002 0.001 0.0019 0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.900
Model: NNLS Adj. R-squared: 0.900
No. Observations: 4092 RMSE: 31.30
Df Residuals: 4090 MAE: 26.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 65.1685 1.9124 0.001 61.5192 68.8799
opcount 0.0007 0.0000 0.001 0.0007 0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.939
Model: NNLS Adj. R-squared: 0.939
No. Observations: 1155 RMSE: 31.72
Df Residuals: 1153 MAE: 25.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 76.5374 2.8442 0.001 71.2104 81.9459
opcount 0.0010 0.0000 0.001 0.0010 0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.854
Model: NNLS Adj. R-squared: 0.852
No. Observations: 99 RMSE: 40.20
Df Residuals: 97 MAE: 34.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 90.0398 16.2699 0.001 58.7032 123.1038
opcount 0.0008 0.0000 0.001 0.0007 0.0008
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
BLS12_G2ADD
test_bls12_381
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8683 |
0.00212 |
1.00e-03 |
[0.002092, 0.002147] |
erigon |
231 |
0.7986 |
0.001273 |
1.00e-03 |
[0.001218, 0.001331] |
ethrex |
1562 |
0.06885 |
0.00277 |
1.00e-03 |
[0.002287, 0.003269] |
geth |
4092 |
0.8989 |
0.001048 |
1.00e-03 |
[0.001036, 0.001059] |
nethermind |
1155 |
0.9356 |
0.001486 |
1.00e-03 |
[0.001462, 0.001508] |
reth |
99 |
0.8454 |
0.001013 |
1.00e-03 |
[0.0009255, 0.001108] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.868
Model: NNLS Adj. R-squared: 0.868
No. Observations: 3652 RMSE: 72.58
Df Residuals: 3650 MAE: 58.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.8408 4.3018 0.001 80.6795 97.4124
opcount 0.0021 0.0000 0.001 0.0021 0.0021
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.799
Model: NNLS Adj. R-squared: 0.798
No. Observations: 231 RMSE: 56.23
Df Residuals: 229 MAE: 35.11
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 41.8842 7.7871 0.001 26.9727 57.5737
opcount 0.0013 0.0000 0.001 0.0012 0.0013
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.069
Model: NNLS Adj. R-squared: 0.068
No. Observations: 1562 RMSE: 895.80
Df Residuals: 1560 MAE: 806.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 238.3055 63.7407 0.001 113.8707 359.9967
opcount 0.0028 0.0003 0.001 0.0023 0.0033
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.899
Model: NNLS Adj. R-squared: 0.899
No. Observations: 4092 RMSE: 30.91
Df Residuals: 4090 MAE: 25.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.4126 1.7924 0.001 52.1050 59.1439
opcount 0.0010 0.0000 0.001 0.0010 0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.936
Model: NNLS Adj. R-squared: 0.936
No. Observations: 1155 RMSE: 34.27
Df Residuals: 1153 MAE: 27.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 83.3407 3.1555 0.001 77.2736 89.9864
opcount 0.0015 0.0000 0.001 0.0015 0.0015
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.845
Model: NNLS Adj. R-squared: 0.844
No. Observations: 99 RMSE: 38.10
Df Residuals: 97 MAE: 31.07
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 100.4848 14.6671 0.001 72.5037 128.0705
opcount 0.0010 0.0000 0.001 0.0009 0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ECADD
test_alt_bn128 — combo add
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8856 |
0.0006195 |
1.00e-03 |
[0.0006122, 0.000627] |
erigon |
231 |
0.9289 |
0.0007158 |
1.00e-03 |
[0.0006911, 0.0007383] |
ethrex |
1562 |
0.826 |
0.000576 |
1.00e-03 |
[0.0005615, 0.0005891] |
geth |
4092 |
0.8805 |
0.0003886 |
1.00e-03 |
[0.0003845, 0.000393] |
nethermind |
1155 |
0.9168 |
0.0004388 |
1.00e-03 |
[0.000431, 0.0004464] |
reth |
99 |
0.867 |
0.0005895 |
1.00e-03 |
[0.0005412, 0.0006379] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.886
Model: NNLS Adj. R-squared: 0.886
No. Observations: 3652 RMSE: 52.48
Df Residuals: 3650 MAE: 44.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 150.8838 3.0729 0.001 144.8091 156.7965
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.929
Model: NNLS Adj. R-squared: 0.929
No. Observations: 231 RMSE: 46.66
Df Residuals: 229 MAE: 39.69
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 42.2780 9.7649 0.001 24.3394 62.1269
opcount 0.0007 0.0000 0.001 0.0007 0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.826
Model: NNLS Adj. R-squared: 0.826
No. Observations: 1562 RMSE: 62.30
Df Residuals: 1560 MAE: 53.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 135.5485 5.9133 0.001 124.4990 147.6392
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.880
Model: NNLS Adj. R-squared: 0.880
No. Observations: 4092 RMSE: 33.75
Df Residuals: 4090 MAE: 29.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 80.5519 1.8602 0.001 76.8046 84.2295
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.917
Model: NNLS Adj. R-squared: 0.917
No. Observations: 1155 RMSE: 31.15
Df Residuals: 1153 MAE: 24.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 77.1826 2.9073 0.001 71.7735 82.8734
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.867
Model: NNLS Adj. R-squared: 0.866
No. Observations: 99 RMSE: 54.42
Df Residuals: 97 MAE: 45.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 133.0129 20.8191 0.001 93.7482 175.6213
opcount 0.0006 0.0000 0.001 0.0005 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_alt_bn128 — combo add_infinities
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8907 |
0.0003655 |
1.00e-03 |
[0.0003611, 0.0003699] |
erigon |
231 |
0.9221 |
0.0005737 |
1.00e-03 |
[0.0005604, 0.0005881] |
ethrex |
1562 |
0.8423 |
0.0001401 |
1.00e-03 |
[0.0001367, 0.0001437] |
geth |
4092 |
0.789 |
0.0001097 |
1.00e-03 |
[0.000108, 0.0001114] |
nethermind |
1155 |
0.918 |
0.0002005 |
1.00e-03 |
[0.0001975, 0.0002034] |
reth |
99 |
0.9867 |
0.0003772 |
1.00e-03 |
[0.0003692, 0.0003854] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.891
Model: NNLS Adj. R-squared: 0.891
No. Observations: 3652 RMSE: 30.17
Df Residuals: 3650 MAE: 25.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 77.9570 1.7896 0.001 74.3824 81.5722
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.922
Model: NNLS Adj. R-squared: 0.922
No. Observations: 231 RMSE: 39.29
Df Residuals: 229 MAE: 22.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 21.8254 6.1519 0.001 9.9337 34.5979
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.842
Model: NNLS Adj. R-squared: 0.842
No. Observations: 1562 RMSE: 14.29
Df Residuals: 1560 MAE: 11.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.8071 1.3489 0.001 24.0496 29.4687
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.789
Model: NNLS Adj. R-squared: 0.789
No. Observations: 4092 RMSE: 13.37
Df Residuals: 4090 MAE: 10.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 12.6609 0.7561 0.001 11.1456 14.1698
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.918
Model: NNLS Adj. R-squared: 0.918
No. Observations: 1155 RMSE: 14.13
Df Residuals: 1153 MAE: 9.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 15.8542 1.0544 0.001 13.8584 18.0041
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.987
Model: NNLS Adj. R-squared: 0.987
No. Observations: 99 RMSE: 10.31
Df Residuals: 97 MAE: 8.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 7.5468 3.4866 0.016 0.6702 14.2900
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_alt_bn128 — combo add_negative
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8863 |
0.000384 |
1.00e-03 |
[0.0003791, 0.0003888] |
erigon |
231 |
0.8414 |
0.0005794 |
1.00e-03 |
[0.0005571, 0.0005963] |
ethrex |
1562 |
0.841 |
0.0002002 |
1.00e-03 |
[0.0001954, 0.0002053] |
geth |
4092 |
0.8739 |
0.0001692 |
1.00e-03 |
[0.0001671, 0.0001712] |
nethermind |
1155 |
0.9088 |
0.0002669 |
1.00e-03 |
[0.0002618, 0.0002717] |
reth |
99 |
0.9774 |
0.0003535 |
1.00e-03 |
[0.0003448, 0.0003627] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.886
Model: NNLS Adj. R-squared: 0.886
No. Observations: 3652 RMSE: 32.41
Df Residuals: 3650 MAE: 27.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 83.2912 2.0447 0.001 79.3887 87.2641
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.841
Model: NNLS Adj. R-squared: 0.841
No. Observations: 231 RMSE: 59.28
Df Residuals: 229 MAE: 30.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 29.0079 8.9798 0.001 14.2142 49.6547
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.841
Model: NNLS Adj. R-squared: 0.841
No. Observations: 1562 RMSE: 20.51
Df Residuals: 1560 MAE: 17.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 46.6268 2.0144 0.001 42.5562 50.3677
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.874
Model: NNLS Adj. R-squared: 0.874
No. Observations: 4092 RMSE: 15.14
Df Residuals: 4090 MAE: 11.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 17.3043 0.9280 0.001 15.4778 19.1064
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.909
Model: NNLS Adj. R-squared: 0.909
No. Observations: 1155 RMSE: 19.92
Df Residuals: 1153 MAE: 13.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 27.2692 1.9039 0.001 23.6578 31.3559
opcount 0.0003 0.0000 0.001 0.0003 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 99 RMSE: 12.67
Df Residuals: 97 MAE: 10.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 25.1619 3.7891 0.001 17.4157 33.0829
opcount 0.0004 0.0000 0.001 0.0003 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_alt_bn128 — combo double
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8824 |
0.0006555 |
1.00e-03 |
[0.000647, 0.0006636] |
erigon |
231 |
0.8542 |
0.0007104 |
1.00e-03 |
[0.0006822, 0.0007357] |
ethrex |
1562 |
0.8272 |
0.0005872 |
1.00e-03 |
[0.0005732, 0.0006022] |
geth |
4092 |
0.8792 |
0.0004045 |
1.00e-03 |
[0.0003993, 0.0004093] |
nethermind |
1155 |
0.9282 |
0.0004714 |
1.00e-03 |
[0.0004634, 0.000479] |
reth |
99 |
0.8591 |
0.0006084 |
1.00e-03 |
[0.0005562, 0.0006598] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.882
Model: NNLS Adj. R-squared: 0.882
No. Observations: 3652 RMSE: 56.38
Df Residuals: 3650 MAE: 48.44
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 127.4271 3.6120 0.001 120.5506 134.6351
opcount 0.0007 0.0000 0.001 0.0006 0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.854
Model: NNLS Adj. R-squared: 0.854
No. Observations: 231 RMSE: 69.17
Df Residuals: 229 MAE: 47.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.4303 12.7229 0.001 32.2733 81.4497
opcount 0.0007 0.0000 0.001 0.0007 0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.827
Model: NNLS Adj. R-squared: 0.827
No. Observations: 1562 RMSE: 63.25
Df Residuals: 1560 MAE: 54.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 133.9596 6.1786 0.001 121.4385 145.6927
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.879
Model: NNLS Adj. R-squared: 0.879
No. Observations: 4092 RMSE: 35.33
Df Residuals: 4090 MAE: 30.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 73.5763 2.1589 0.001 69.5622 77.9952
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.928
Model: NNLS Adj. R-squared: 0.928
No. Observations: 1155 RMSE: 30.89
Df Residuals: 1153 MAE: 23.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 48.6767 2.9087 0.001 43.4690 54.5675
opcount 0.0005 0.0000 0.001 0.0005 0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.859
Model: NNLS Adj. R-squared: 0.858
No. Observations: 99 RMSE: 58.07
Df Residuals: 97 MAE: 48.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 122.7038 22.3725 0.001 79.8058 165.7491
opcount 0.0006 0.0000 0.001 0.0006 0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_alt_bn128_uncachable
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8779 |
0.0008978 |
1.00e-03 |
[0.0008866, 0.0009086] |
erigon |
231 |
0.9355 |
0.001074 |
1.00e-03 |
[0.001036, 0.001107] |
ethrex |
1562 |
0.8156 |
0.0009039 |
1.00e-03 |
[0.0008828, 0.0009273] |
geth |
4092 |
0.8611 |
0.0006026 |
1.00e-03 |
[0.0005952, 0.00061] |
nethermind |
1155 |
0.944 |
0.0007578 |
1.00e-03 |
[0.0007472, 0.0007689] |
reth |
99 |
0.8362 |
0.0009582 |
1.00e-03 |
[0.00087, 0.001044] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.878
Model: NNLS Adj. R-squared: 0.878
No. Observations: 3652 RMSE: 71.68
Df Residuals: 3650 MAE: 61.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 174.2594 4.4282 0.001 165.7715 183.1917
opcount 0.0009 0.0000 0.001 0.0009 0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.935
Model: NNLS Adj. R-squared: 0.935
No. Observations: 231 RMSE: 60.38
Df Residuals: 229 MAE: 51.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 66.8205 13.5799 0.001 41.2421 94.5023
opcount 0.0011 0.0000 0.001 0.0010 0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.816
Model: NNLS Adj. R-squared: 0.815
No. Observations: 1562 RMSE: 92.02
Df Residuals: 1560 MAE: 79.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 187.1750 8.7550 0.001 169.4688 203.0392
opcount 0.0009 0.0000 0.001 0.0009 0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.861
Model: NNLS Adj. R-squared: 0.861
No. Observations: 4092 RMSE: 51.82
Df Residuals: 4090 MAE: 44.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 107.3041 2.8717 0.001 101.4869 112.8098
opcount 0.0006 0.0000 0.001 0.0006 0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.944
Model: NNLS Adj. R-squared: 0.944
No. Observations: 1155 RMSE: 39.51
Df Residuals: 1153 MAE: 31.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 69.6953 3.5700 0.001 62.6180 76.5260
opcount 0.0008 0.0000 0.001 0.0007 0.0008
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.836
Model: NNLS Adj. R-squared: 0.835
No. Observations: 99 RMSE: 90.79
Df Residuals: 97 MAE: 77.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 186.4975 34.3214 0.001 121.1542 255.6964
opcount 0.0010 0.0000 0.001 0.0009 0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ECPAIRING
test_alt_bn128_benchmark
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
18260 |
0.8814 |
0.04592 |
1.00e-03 |
[0.04558, 0.04627] |
erigon |
1155 |
0.7776 |
0.05023 |
1.00e-03 |
[0.0482, 0.05234] |
ethrex |
7810 |
0.8117 |
0.04761 |
1.00e-03 |
[0.04627, 0.04889] |
geth |
20460 |
0.8178 |
0.0443 |
1.00e-03 |
[0.04388, 0.04474] |
nethermind |
5775 |
0.9343 |
0.0664 |
1.00e-03 |
[0.06508, 0.06772] |
reth |
495 |
0.8172 |
0.04688 |
1.00e-03 |
[0.04257, 0.05164] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.881
Model: NNLS Adj. R-squared: 0.881
No. Observations: 18260 RMSE: 20.24
Df Residuals: 18257 MAE: 17.12
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 52.6567 0.5637 0.001 51.5698 53.6996
opcount 0.0459 0.0002 0.001 0.0456 0.0463
num_pairs 0.0262 0.0001 0.001 0.0261 0.0264
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.778
Model: NNLS Adj. R-squared: 0.777
No. Observations: 1155 RMSE: 33.01
Df Residuals: 1152 MAE: 18.84
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.8384 4.5749 0.001 19.0346 36.6277
opcount 0.0502 0.0011 0.001 0.0482 0.0523
num_pairs 0.0296 0.0007 0.001 0.0282 0.0310
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.812
Model: NNLS Adj. R-squared: 0.812
No. Observations: 7810 RMSE: 53.66
Df Residuals: 7807 MAE: 44.95
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 110.6409 2.2159 0.001 106.2160 115.0076
opcount 0.0476 0.0007 0.001 0.0463 0.0489
num_pairs 0.0589 0.0003 0.001 0.0582 0.0596
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.818
Model: NNLS Adj. R-squared: 0.818
No. Observations: 20460 RMSE: 25.91
Df Residuals: 20457 MAE: 21.70
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 52.7877 0.7042 0.001 51.4742 54.1403
opcount 0.0443 0.0002 0.001 0.0439 0.0447
num_pairs 0.0265 0.0001 0.001 0.0263 0.0267
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.934
Model: NNLS Adj. R-squared: 0.934
No. Observations: 5775 RMSE: 51.37
Df Residuals: 5772 MAE: 40.46
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 79.8147 2.0977 0.001 75.7109 83.9170
opcount 0.0664 0.0007 0.001 0.0651 0.0677
num_pairs 0.1023 0.0004 0.001 0.1015 0.1030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.817
Model: NNLS Adj. R-squared: 0.817
No. Observations: 495 RMSE: 51.84
Df Residuals: 492 MAE: 43.05
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 112.0218 8.0009 0.001 96.5744 126.9719
opcount 0.0469 0.0023 0.001 0.0426 0.0516
num_pairs 0.0580 0.0013 0.001 0.0555 0.0605
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_ec_pairing
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
18260 |
0.9076 |
0.05105 |
1.00e-03 |
[0.05067, 0.05141] |
erigon |
1155 |
0.8897 |
0.04745 |
1.00e-03 |
[0.04623, 0.04855] |
ethrex |
7810 |
0.834 |
0.08182 |
1.00e-03 |
[0.08061, 0.083] |
geth |
20460 |
0.8667 |
0.04134 |
1.00e-03 |
[0.04095, 0.0417] |
nethermind |
5775 |
0.9466 |
0.05277 |
1.00e-03 |
[0.05145, 0.05397] |
reth |
495 |
0.8392 |
0.08247 |
1.00e-03 |
[0.07785, 0.08735] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.908
Model: NNLS Adj. R-squared: 0.908
No. Observations: 18260 RMSE: 19.20
Df Residuals: 18257 MAE: 15.99
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 43.7129 0.5245 0.001 42.7546 44.8030
opcount 0.0511 0.0002 0.001 0.0507 0.0514
num_pairs 0.0331 0.0001 0.001 0.0329 0.0333
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.890
Model: NNLS Adj. R-squared: 0.889
No. Observations: 1155 RMSE: 23.52
Df Residuals: 1152 MAE: 15.58
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 24.6623 1.6627 0.001 21.4796 28.1117
opcount 0.0475 0.0006 0.001 0.0462 0.0485
num_pairs 0.0399 0.0003 0.001 0.0393 0.0404
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.834
Model: NNLS Adj. R-squared: 0.834
No. Observations: 7810 RMSE: 47.43
Df Residuals: 7807 MAE: 40.36
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 111.7478 2.0122 0.001 108.1361 115.7305
opcount 0.0818 0.0006 0.001 0.0806 0.0830
num_pairs 0.0616 0.0004 0.001 0.0609 0.0623
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.867
Model: NNLS Adj. R-squared: 0.867
No. Observations: 20460 RMSE: 25.09
Df Residuals: 20457 MAE: 20.83
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 50.4421 0.6339 0.001 49.2719 51.7259
opcount 0.0413 0.0002 0.001 0.0409 0.0417
num_pairs 0.0392 0.0001 0.001 0.0389 0.0394
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.947
Model: NNLS Adj. R-squared: 0.947
No. Observations: 5775 RMSE: 43.15
Df Residuals: 5772 MAE: 34.69
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 72.6568 1.7660 0.001 69.3939 76.1020
opcount 0.0528 0.0006 0.001 0.0515 0.0540
num_pairs 0.1171 0.0004 0.001 0.1164 0.1179
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.839
Model: NNLS Adj. R-squared: 0.839
No. Observations: 495 RMSE: 46.22
Df Residuals: 492 MAE: 38.57
Df Model: 2
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 105.5209 7.4806 0.001 91.2479 120.5613
opcount 0.0825 0.0024 0.001 0.0778 0.0873
num_pairs 0.0608 0.0013 0.001 0.0582 0.0634
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
POINT_EVALUATION
test_point_evaluation
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8753 |
0.1731 |
1.00e-03 |
[0.1706, 0.1758] |
erigon |
231 |
0.8993 |
0.1785 |
1.00e-03 |
[0.1711, 0.1852] |
ethrex |
1562 |
0.8135 |
0.2363 |
1.00e-03 |
[0.2308, 0.2426] |
geth |
4092 |
0.829 |
0.1979 |
1.00e-03 |
[0.1951, 0.2007] |
nethermind |
1155 |
0.8769 |
0.2157 |
1.00e-03 |
[0.2104, 0.2211] |
reth |
99 |
0.8398 |
0.1978 |
1.00e-03 |
[0.1799, 0.2152] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.875
Model: NNLS Adj. R-squared: 0.875
No. Observations: 3652 RMSE: 82.74
Df Residuals: 3650 MAE: 64.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 420.1928 6.0176 0.001 408.0318 430.9260
opcount 0.1731 0.0014 0.001 0.1706 0.1758
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.899
Model: NNLS Adj. R-squared: 0.899
No. Observations: 231 RMSE: 75.65
Df Residuals: 229 MAE: 67.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 68.6243 15.9205 0.001 40.1323 100.4102
opcount 0.1785 0.0036 0.001 0.1711 0.1852
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.813
Model: NNLS Adj. R-squared: 0.813
No. Observations: 1562 RMSE: 143.32
Df Residuals: 1560 MAE: 123.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 294.7115 13.6918 0.001 267.0669 319.7219
opcount 0.2363 0.0030 0.001 0.2308 0.2426
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.829
Model: NNLS Adj. R-squared: 0.829
No. Observations: 4092 RMSE: 113.88
Df Residuals: 4090 MAE: 96.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 230.6663 6.5759 0.001 218.3207 243.6019
opcount 0.1979 0.0015 0.001 0.1951 0.2007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.877
Model: NNLS Adj. R-squared: 0.877
No. Observations: 1155 RMSE: 102.35
Df Residuals: 1153 MAE: 84.98
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 199.3761 11.6006 0.001 177.2871 222.5617
opcount 0.2157 0.0028 0.001 0.2104 0.2211
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.840
Model: NNLS Adj. R-squared: 0.838
No. Observations: 99 RMSE: 109.44
Df Residuals: 97 MAE: 94.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 224.9285 41.7326 0.001 149.6991 313.9231
opcount 0.1978 0.0093 0.001 0.1799 0.2152
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_point_evaluation_uncachable
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8758 |
0.2084 |
1.00e-03 |
[0.2056, 0.2111] |
erigon |
231 |
0.8947 |
0.1942 |
1.00e-03 |
[0.1867, 0.2014] |
ethrex |
1562 |
0.8149 |
0.2382 |
1.00e-03 |
[0.2325, 0.244] |
geth |
4092 |
0.8406 |
0.1922 |
1.00e-03 |
[0.1895, 0.195] |
nethermind |
1155 |
0.8628 |
0.234 |
1.00e-03 |
[0.2277, 0.2399] |
reth |
99 |
0.8355 |
0.1966 |
1.00e-03 |
[0.178, 0.2139] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.876
Model: NNLS Adj. R-squared: 0.876
No. Observations: 3652 RMSE: 92.88
Df Residuals: 3650 MAE: 78.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 219.7217 5.7999 0.001 208.5187 230.9829
opcount 0.2084 0.0014 0.001 0.2056 0.2111
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.895
Model: NNLS Adj. R-squared: 0.894
No. Observations: 231 RMSE: 78.86
Df Residuals: 229 MAE: 68.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 68.8348 15.9512 0.001 40.1171 100.2995
opcount 0.1942 0.0038 0.001 0.1867 0.2014
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.815
Model: NNLS Adj. R-squared: 0.815
No. Observations: 1562 RMSE: 134.41
Df Residuals: 1560 MAE: 116.05
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 283.8455 12.4008 0.001 258.9834 306.7242
opcount 0.2382 0.0029 0.001 0.2325 0.2440
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.841
Model: NNLS Adj. R-squared: 0.841
No. Observations: 4092 RMSE: 99.10
Df Residuals: 4090 MAE: 83.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 194.9613 5.7962 0.001 183.3327 206.3370
opcount 0.1922 0.0014 0.001 0.1895 0.1950
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.863
Model: NNLS Adj. R-squared: 0.863
No. Observations: 1155 RMSE: 110.45
Df Residuals: 1153 MAE: 85.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 149.7763 11.4816 0.001 128.3096 172.7554
opcount 0.2340 0.0032 0.001 0.2277 0.2399
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.835
Model: NNLS Adj. R-squared: 0.834
No. Observations: 99 RMSE: 103.29
Df Residuals: 97 MAE: 86.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 225.5452 39.6374 0.001 152.3949 305.7742
opcount 0.1966 0.0094 0.001 0.1780 0.2139
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
P256VERIFY
test_p256verify
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.8684 |
0.008331 |
1.00e-03 |
[0.008235, 0.008442] |
erigon |
231 |
0.8362 |
0.01405 |
1.00e-03 |
[0.01343, 0.01465] |
ethrex |
1562 |
0.8106 |
0.03803 |
1.00e-03 |
[0.03709, 0.03901] |
geth |
4092 |
0.8268 |
0.01169 |
1.00e-03 |
[0.01151, 0.01187] |
nethermind |
1155 |
0.8816 |
0.008589 |
1.00e-03 |
[0.008375, 0.008796] |
reth |
99 |
0.8427 |
0.008424 |
1.00e-03 |
[0.007627, 0.009186] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.868
Model: NNLS Adj. R-squared: 0.868
No. Observations: 3652 RMSE: 29.21
Df Residuals: 3650 MAE: 24.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 77.0097 1.7077 0.001 73.4044 80.1343
opcount 0.0083 0.0001 0.001 0.0082 0.0084
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.836
Model: NNLS Adj. R-squared: 0.836
No. Observations: 231 RMSE: 55.98
Df Residuals: 229 MAE: 39.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 49.3381 9.8136 0.001 31.0747 68.6145
opcount 0.0140 0.0003 0.001 0.0134 0.0146
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.811
Model: NNLS Adj. R-squared: 0.810
No. Observations: 1562 RMSE: 165.56
Df Residuals: 1560 MAE: 142.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 336.2904 16.1013 0.001 305.4215 366.6415
opcount 0.0380 0.0005 0.001 0.0371 0.0390
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.827
Model: NNLS Adj. R-squared: 0.827
No. Observations: 4092 RMSE: 48.18
Df Residuals: 4090 MAE: 40.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 95.6695 2.8780 0.001 90.0300 101.2115
opcount 0.0117 0.0001 0.001 0.0115 0.0119
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.882
Model: NNLS Adj. R-squared: 0.881
No. Observations: 1155 RMSE: 28.35
Df Residuals: 1153 MAE: 23.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 59.2739 3.1631 0.001 53.3594 65.6267
opcount 0.0086 0.0001 0.001 0.0084 0.0088
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.843
Model: NNLS Adj. R-squared: 0.841
No. Observations: 99 RMSE: 32.78
Df Residuals: 97 MAE: 27.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 63.0968 12.8506 0.001 38.1110 89.1053
opcount 0.0084 0.0004 0.001 0.0076 0.0092
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
test_p256verify_uncachable
| client |
nobs |
R² |
target_coef (ms) |
p-value |
95% CI |
besu |
3652 |
0.9095 |
0.0109 |
1.00e-03 |
[0.01079, 0.01101] |
erigon |
231 |
0.8114 |
0.01411 |
1.00e-03 |
[0.0131, 0.01497] |
ethrex |
1562 |
0.8105 |
0.03814 |
1.00e-03 |
[0.03715, 0.03908] |
geth |
4092 |
0.8253 |
0.01183 |
1.00e-03 |
[0.01166, 0.01201] |
nethermind |
1155 |
0.8835 |
0.008746 |
1.00e-03 |
[0.008526, 0.008972] |
reth |
99 |
0.8658 |
0.008419 |
1.00e-03 |
[0.007681, 0.00912] |
besu — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.910
Model: NNLS Adj. R-squared: 0.910
No. Observations: 3652 RMSE: 30.74
Df Residuals: 3650 MAE: 26.30
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 25.3016 1.7245 0.001 21.7949 28.6537
opcount 0.0109 0.0001 0.001 0.0108 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
erigon — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.811
Model: NNLS Adj. R-squared: 0.811
No. Observations: 231 RMSE: 60.84
Df Residuals: 229 MAE: 39.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 49.7319 14.6554 0.001 25.3822 81.0316
opcount 0.0141 0.0005 0.001 0.0131 0.0150
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
ethrex — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.810
Model: NNLS Adj. R-squared: 0.810
No. Observations: 1562 RMSE: 164.99
Df Residuals: 1560 MAE: 142.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 332.7567 15.8105 0.001 302.9333 362.8966
opcount 0.0381 0.0005 0.001 0.0372 0.0391
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
geth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.825
Model: NNLS Adj. R-squared: 0.825
No. Observations: 4092 RMSE: 48.70
Df Residuals: 4090 MAE: 40.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.7969 2.7667 0.001 87.4152 97.9833
opcount 0.0118 0.0001 0.001 0.0117 0.0120
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
nethermind — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.884
Model: NNLS Adj. R-squared: 0.883
No. Observations: 1155 RMSE: 28.40
Df Residuals: 1153 MAE: 23.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 57.0388 3.2838 0.001 50.2955 63.5019
opcount 0.0087 0.0001 0.001 0.0085 0.0090
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```
reth — NNLS regression summary
```
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.866
Model: NNLS Adj. R-squared: 0.864
No. Observations: 99 RMSE: 29.65
Df Residuals: 97 MAE: 24.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 69.2118 11.7461 0.001 47.1850 91.9381
opcount 0.0084 0.0004 0.001 0.0077 0.0091
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
```