Runtime estimation report

Per-spec NNLS fits of test_runtime_ms against opcount, one row per (target opcode, test, model_by combo, client).

Note: this is a bundled snapshot of the analysis output. The per-client regression, bootstrap, and diagnostic plots are omitted here; the figure-rich version is published on the live analysis site linked from the EIP’s discussions-to thread.

Contents

DIV

test_arithmetic

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.7121 1.517e-05 1.00e-03 [1.487e-05, 1.547e-05]
erigon 231 0.8953 1.012e-05 1.00e-03 [9.693e-06, 1.054e-05]
ethrex 1562 0.8405 9.341e-06 1.00e-03 [9.109e-06, 9.565e-06]
geth 4092 0.798 9.484e-06 1.00e-03 [9.331e-06, 9.646e-06]
nethermind 1155 0.6416 7.747e-06 1.00e-03 [7.305e-06, 8.208e-06]
reth 99 0.8305 7.01e-06 1.00e-03 [6.317e-06, 7.706e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.712
Model:                  NNLS                    Adj. R-squared:          0.712
No. Observations:       3652                              RMSE:          76.17
Df Residuals:           3650                               MAE:          61.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    141.9384      3.5555       0.001    134.9084    148.7499
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.895
Model:                  NNLS                    Adj. R-squared:          0.895
No. Observations:       231                               RMSE:          27.32
Df Residuals:           229                                MAE:          23.29
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     23.9785      5.9218       0.001     12.7086     35.5325
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.840
Model:                  NNLS                    Adj. R-squared:          0.840
No. Observations:       1562                              RMSE:          32.13
Df Residuals:           1560                               MAE:          27.05
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     72.4046      3.1072       0.001     66.3321     78.7320
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.798
Model:                  NNLS                    Adj. R-squared:          0.798
No. Observations:       4092                              RMSE:          37.67
Df Residuals:           4090                               MAE:          30.77
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     75.8186      2.1321       0.001     71.8208     79.8344
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.642
Model:                  NNLS                    Adj. R-squared:          0.641
No. Observations:       1155                              RMSE:          45.71
Df Residuals:           1153                               MAE:          36.29
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    129.0635      6.1217       0.001    116.3925    141.1473
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.830
Model:                  NNLS                    Adj. R-squared:          0.829
No. Observations:       99                                RMSE:          25.00
Df Residuals:           97                                 MAE:          21.02
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     55.0211      9.3538       0.001     36.6781     74.0580
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SDIV

test_arithmetic

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.7859 1.656e-05 1.00e-03 [1.628e-05, 1.683e-05]
erigon 231 0.8208 1.105e-05 1.00e-03 [1.025e-05, 1.17e-05]
ethrex 1562 0.8416 9.448e-06 1.00e-03 [9.222e-06, 9.67e-06]
geth 4092 0.8293 1.015e-05 1.00e-03 [9.992e-06, 1.031e-05]
nethermind 1155 0.8646 1.32e-05 1.00e-03 [1.29e-05, 1.351e-05]
reth 99 0.8431 8.962e-06 1.00e-03 [8.178e-06, 9.826e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.786
Model:                  NNLS                    Adj. R-squared:          0.786
No. Observations:       3652                              RMSE:          68.25
Df Residuals:           3650                               MAE:          56.36
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    133.1578      3.6254       0.001    126.3311    140.6890
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.821
Model:                  NNLS                    Adj. R-squared:          0.820
No. Observations:       231                               RMSE:          40.76
Df Residuals:           229                                MAE:          28.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     40.8380     11.1047       0.001     21.8948     64.9287
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.842
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       1562                              RMSE:          32.36
Df Residuals:           1560                               MAE:          27.41
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     75.0055      3.2793       0.001     68.5648     81.4451
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.829
Model:                  NNLS                    Adj. R-squared:          0.829
No. Observations:       4092                              RMSE:          36.33
Df Residuals:           4090                               MAE:          30.35
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     79.4371      2.1093       0.001     75.3166     83.5254
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.865
Model:                  NNLS                    Adj. R-squared:          0.864
No. Observations:       1155                              RMSE:          41.24
Df Residuals:           1153                               MAE:          32.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     68.1618      3.5384       0.001     60.9392     74.8485
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.843
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       99                                RMSE:          30.52
Df Residuals:           97                                 MAE:          24.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     76.1655     11.2760       0.001     53.4124     97.1894
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

MOD

test_mod — combo 127

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8417 1.955e-05 1.00e-03 [1.928e-05, 1.984e-05]
erigon 231 0.8884 1.219e-05 1.00e-03 [1.166e-05, 1.262e-05]
ethrex 1562 0.8376 1.036e-05 1.00e-03 [1.011e-05, 1.063e-05]
geth 4092 0.8334 1.157e-05 1.00e-03 [1.14e-05, 1.174e-05]
nethermind 1155 0.8847 1.011e-05 1.00e-03 [9.904e-06, 1.031e-05]
reth 99 0.8527 7.02e-06 1.00e-03 [6.409e-06, 7.626e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.842
Model:                  NNLS                    Adj. R-squared:          0.842
No. Observations:       3652                              RMSE:          66.83
Df Residuals:           3650                               MAE:          55.96
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    131.8563      3.8783       0.001    124.2440    139.0374
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.888
Model:                  NNLS                    Adj. R-squared:          0.888
No. Observations:       231                               RMSE:          34.06
Df Residuals:           229                                MAE:          29.88
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     36.7815      7.0218       0.001     24.1740     51.4539
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.838
Model:                  NNLS                    Adj. R-squared:          0.838
No. Observations:       1562                              RMSE:          35.96
Df Residuals:           1560                               MAE:          30.16
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     83.1718      3.6730       0.001     75.5832     90.0965
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.833
Model:                  NNLS                    Adj. R-squared:          0.833
No. Observations:       4092                              RMSE:          40.79
Df Residuals:           4090                               MAE:          34.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     88.0946      2.4571       0.001     83.2459     92.9181
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.885
Model:                  NNLS                    Adj. R-squared:          0.885
No. Observations:       1155                              RMSE:          28.78
Df Residuals:           1153                               MAE:          22.56
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     44.3388      2.3979       0.001     39.8336     49.1209
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.853
Model:                  NNLS                    Adj. R-squared:          0.851
No. Observations:       99                                RMSE:          23.01
Df Residuals:           97                                 MAE:          19.37
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     50.7237      8.6950       0.001     34.7373     67.9577
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_mod — combo 191

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8314 1.784e-05 1.00e-03 [1.759e-05, 1.81e-05]
erigon 231 0.8406 1.177e-05 1.00e-03 [1.128e-05, 1.221e-05]
ethrex 1562 0.8405 8.857e-06 1.00e-03 [8.66e-06, 9.061e-06]
geth 4092 0.834 1.108e-05 1.00e-03 [1.091e-05, 1.126e-05]
nethermind 1155 0.8955 1.122e-05 1.00e-03 [1.102e-05, 1.142e-05]
reth 99 0.8484 9.667e-06 1.00e-03 [8.782e-06, 1.059e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.831
Model:                  NNLS                    Adj. R-squared:          0.831
No. Observations:       3652                              RMSE:          63.37
Df Residuals:           3650                               MAE:          52.10
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    132.5314      3.3678       0.001    126.0903    139.1599
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.841
Model:                  NNLS                    Adj. R-squared:          0.840
No. Observations:       231                               RMSE:          40.42
Df Residuals:           229                                MAE:          29.68
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     35.5724      6.6088       0.001     23.1426     49.5225
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.840
Model:                  NNLS                    Adj. R-squared:          0.840
No. Observations:       1562                              RMSE:          30.42
Df Residuals:           1560                               MAE:          25.51
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     70.9856      3.0064       0.001     65.1218     76.7602
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.834
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       4092                              RMSE:          38.96
Df Residuals:           4090                               MAE:          32.81
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     83.9228      2.3436       0.001     79.1851     88.4416
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.895
Model:                  NNLS                    Adj. R-squared:          0.895
No. Observations:       1155                              RMSE:          30.23
Df Residuals:           1153                               MAE:          23.75
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     50.9802      2.5763       0.001     46.2622     56.1335
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.848
Model:                  NNLS                    Adj. R-squared:          0.847
No. Observations:       99                                RMSE:          32.22
Df Residuals:           97                                 MAE:          26.80
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     80.1545     12.0225       0.001     57.1653    103.6467
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_mod — combo 255

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8029 1.454e-05 1.00e-03 [1.43e-05, 1.477e-05]
erigon 231 0.7683 1.167e-05 1.00e-03 [1.111e-05, 1.226e-05]
ethrex 1562 0.8369 6.94e-06 1.00e-03 [6.752e-06, 7.112e-06]
geth 4092 0.8343 1.014e-05 1.00e-03 [9.99e-06, 1.028e-05]
nethermind 1155 0.9198 1.033e-05 1.00e-03 [1.015e-05, 1.051e-05]
reth 99 0.8313 8.048e-06 1.00e-03 [7.341e-06, 8.779e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.803
Model:                  NNLS                    Adj. R-squared:          0.803
No. Observations:       3652                              RMSE:          56.80
Df Residuals:           3650                               MAE:          47.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    103.0783      3.0838       0.001     96.8893    108.9770
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.768
Model:                  NNLS                    Adj. R-squared:          0.767
No. Observations:       231                               RMSE:          50.55
Df Residuals:           229                                MAE:          32.57
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     27.8941      6.6814       0.001     15.1897     41.4582
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.837
Model:                  NNLS                    Adj. R-squared:          0.837
No. Observations:       1562                              RMSE:          24.16
Df Residuals:           1560                               MAE:          19.71
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     54.7166      2.5082       0.001     49.9655     59.9829
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.834
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       4092                              RMSE:          35.62
Df Residuals:           4090                               MAE:          30.10
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     76.1088      2.0554       0.001     72.2294     80.1210
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.920
Model:                  NNLS                    Adj. R-squared:          0.920
No. Observations:       1155                              RMSE:          24.05
Df Residuals:           1153                               MAE:          19.19
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     50.0879      2.3025       0.001     45.7861     54.8095
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.831
Model:                  NNLS                    Adj. R-squared:          0.830
No. Observations:       99                                RMSE:          28.59
Df Residuals:           97                                 MAE:          23.43
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     74.8179      9.8075       0.001     55.6624     93.6979
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_mod — combo 63

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8188 1.452e-05 1.00e-03 [1.428e-05, 1.476e-05]
erigon 231 0.7559 9.076e-06 1.00e-03 [8.568e-06, 9.67e-06]
ethrex 1562 0.8289 5.599e-06 1.00e-03 [5.462e-06, 5.734e-06]
geth 4092 0.8316 8.187e-06 1.00e-03 [8.061e-06, 8.308e-06]
nethermind 1155 0.9012 6.91e-06 1.00e-03 [6.797e-06, 7.034e-06]
reth 99 0.8596 6.34e-06 1.00e-03 [5.802e-06, 6.885e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.819
Model:                  NNLS                    Adj. R-squared:          0.819
No. Observations:       3652                              RMSE:          53.86
Df Residuals:           3650                               MAE:          44.42
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     98.0392      3.1849       0.001     92.0876    104.0915
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.756
Model:                  NNLS                    Adj. R-squared:          0.755
No. Observations:       231                               RMSE:          40.66
Df Residuals:           229                                MAE:          21.41
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     16.1955      5.5091       0.002      4.8600     27.3480
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.829
Model:                  NNLS                    Adj. R-squared:          0.829
No. Observations:       1562                              RMSE:          20.05
Df Residuals:           1560                               MAE:          16.99
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     44.3450      1.9118       0.001     40.4827     48.0979
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.832
Model:                  NNLS                    Adj. R-squared:          0.832
No. Observations:       4092                              RMSE:          29.05
Df Residuals:           4090                               MAE:          24.40
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     62.0235      1.7256       0.001     58.7117     65.4521
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.901
Model:                  NNLS                    Adj. R-squared:          0.901
No. Observations:       1155                              RMSE:          18.04
Df Residuals:           1153                               MAE:          12.40
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.4773      1.3868       0.001     28.7883     34.0949
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.860
Model:                  NNLS                    Adj. R-squared:          0.858
No. Observations:       99                                RMSE:          20.20
Df Residuals:           97                                 MAE:          16.90
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     51.8488      6.9785       0.001     37.9509     65.7563
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SMOD

test_mod — combo 127

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8466 2.015e-05 1.00e-03 [1.987e-05, 2.045e-05]
erigon 231 0.895 1.286e-05 1.00e-03 [1.23e-05, 1.33e-05]
ethrex 1562 0.8344 1.055e-05 1.00e-03 [1.032e-05, 1.081e-05]
geth 4092 0.8316 1.216e-05 1.00e-03 [1.199e-05, 1.234e-05]
nethermind 1155 0.9335 1.103e-05 1.00e-03 [1.085e-05, 1.121e-05]
reth 99 0.8675 7.022e-06 1.00e-03 [6.457e-06, 7.574e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.847
Model:                  NNLS                    Adj. R-squared:          0.847
No. Observations:       3652                              RMSE:          67.64
Df Residuals:           3650                               MAE:          56.58
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    142.8678      4.0678       0.001    134.6763    150.7313
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.895
Model:                  NNLS                    Adj. R-squared:          0.895
No. Observations:       231                               RMSE:          34.73
Df Residuals:           229                                MAE:          30.55
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.0862      7.1611       0.001     19.6539     48.1089
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.834
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       1562                              RMSE:          37.08
Df Residuals:           1560                               MAE:          31.42
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     81.5883      3.5414       0.001     74.6095     88.3820
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.832
Model:                  NNLS                    Adj. R-squared:          0.832
No. Observations:       4092                              RMSE:          43.15
Df Residuals:           4090                               MAE:          36.48
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     88.0482      2.5544       0.001     82.9009     92.9295
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.933
Model:                  NNLS                    Adj. R-squared:          0.933
No. Observations:       1155                              RMSE:          23.21
Df Residuals:           1153                               MAE:          18.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     48.9030      2.2200       0.001     44.5088     53.2733
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.867
Model:                  NNLS                    Adj. R-squared:          0.866
No. Observations:       99                                RMSE:          21.64
Df Residuals:           97                                 MAE:          17.28
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     56.1200      7.9813       0.001     40.9087     72.0673
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_mod — combo 191

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8303 1.876e-05 1.00e-03 [1.846e-05, 1.901e-05]
erigon 231 0.8949 1.247e-05 1.00e-03 [1.192e-05, 1.293e-05]
ethrex 1562 0.8394 8.982e-06 1.00e-03 [8.76e-06, 9.192e-06]
geth 4092 0.831 1.156e-05 1.00e-03 [1.139e-05, 1.175e-05]
nethermind 1155 0.9136 1.238e-05 1.00e-03 [1.217e-05, 1.258e-05]
reth 99 0.8589 1.058e-05 1.00e-03 [9.658e-06, 1.152e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.830
Model:                  NNLS                    Adj. R-squared:          0.830
No. Observations:       3652                              RMSE:          66.87
Df Residuals:           3650                               MAE:          55.78
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    133.6374      3.7811       0.001    126.9613    141.4523
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.895
Model:                  NNLS                    Adj. R-squared:          0.894
No. Observations:       231                               RMSE:          33.68
Df Residuals:           229                                MAE:          29.71
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     33.4731      6.9291       0.001     21.4734     48.7536
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.839
Model:                  NNLS                    Adj. R-squared:          0.839
No. Observations:       1562                              RMSE:          30.97
Df Residuals:           1560                               MAE:          26.16
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     70.3621      3.0443       0.001     64.8521     76.5328
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.831
Model:                  NNLS                    Adj. R-squared:          0.831
No. Observations:       4092                              RMSE:          41.11
Df Residuals:           4090                               MAE:          34.82
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     85.7090      2.4385       0.001     80.5961     90.5012
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.914
Model:                  NNLS                    Adj. R-squared:          0.914
No. Observations:       1155                              RMSE:          30.02
Df Residuals:           1153                               MAE:          23.66
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     55.4057      2.6612       0.001     50.4132     60.8283
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.859
Model:                  NNLS                    Adj. R-squared:          0.857
No. Observations:       99                                RMSE:          33.81
Df Residuals:           97                                 MAE:          28.12
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     66.7033     13.2193       0.001     40.6144     94.4093
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_mod — combo 255

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8109 1.537e-05 1.00e-03 [1.514e-05, 1.563e-05]
erigon 231 0.8778 1.195e-05 1.00e-03 [1.132e-05, 1.256e-05]
ethrex 1562 0.8385 7.31e-06 1.00e-03 [7.131e-06, 7.493e-06]
geth 4092 0.831 1.029e-05 1.00e-03 [1.014e-05, 1.046e-05]
nethermind 1155 0.9259 1.109e-05 1.00e-03 [1.091e-05, 1.128e-05]
reth 99 0.8422 8.753e-06 1.00e-03 [7.994e-06, 9.546e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.811
Model:                  NNLS                    Adj. R-squared:          0.811
No. Observations:       3652                              RMSE:          58.54
Df Residuals:           3650                               MAE:          48.42
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    105.2530      3.2482       0.001     98.6946    111.2062
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.878
Model:                  NNLS                    Adj. R-squared:          0.877
No. Observations:       231                               RMSE:          35.16
Df Residuals:           229                                MAE:          27.67
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     22.5224      7.8330       0.003      7.6607     38.1582
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.838
Model:                  NNLS                    Adj. R-squared:          0.838
No. Observations:       1562                              RMSE:          25.30
Df Residuals:           1560                               MAE:          21.39
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     55.0181      2.5050       0.001     49.8847     59.8868
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.831
Model:                  NNLS                    Adj. R-squared:          0.831
No. Observations:       4092                              RMSE:          36.60
Df Residuals:           4090                               MAE:          30.75
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     78.8605      2.2117       0.001     74.3816     83.1446
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.926
Model:                  NNLS                    Adj. R-squared:          0.926
No. Observations:       1155                              RMSE:          24.75
Df Residuals:           1153                               MAE:          19.59
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     50.5899      2.4067       0.001     46.1960     55.2439
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.842
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       99                                RMSE:          29.87
Df Residuals:           97                                 MAE:          25.14
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     69.8202     10.8710       0.001     48.1953     90.9060
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_mod — combo 63

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8117 1.549e-05 1.00e-03 [1.524e-05, 1.573e-05]
erigon 231 0.8938 9.202e-06 1.00e-03 [8.769e-06, 9.614e-06]
ethrex 1562 0.8276 4.542e-06 1.00e-03 [4.42e-06, 4.651e-06]
geth 4092 0.8289 8.62e-06 1.00e-03 [8.492e-06, 8.756e-06]
nethermind 1155 0.9146 8.104e-06 1.00e-03 [7.961e-06, 8.245e-06]
reth 99 0.8655 6.348e-06 1.00e-03 [5.832e-06, 6.881e-06]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.812
Model:                  NNLS                    Adj. R-squared:          0.812
No. Observations:       3652                              RMSE:          58.82
Df Residuals:           3650                               MAE:          48.33
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    114.5869      3.2754       0.001    108.3147    120.9429
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.894
Model:                  NNLS                    Adj. R-squared:          0.893
No. Observations:       231                               RMSE:          25.01
Df Residuals:           229                                MAE:          20.74
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     19.2036      5.3776       0.001      8.8490     29.9323
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.828
Model:                  NNLS                    Adj. R-squared:          0.827
No. Observations:       1562                              RMSE:          16.35
Df Residuals:           1560                               MAE:          13.67
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     37.5186      1.5748       0.001     34.5816     40.6265
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.829
Model:                  NNLS                    Adj. R-squared:          0.829
No. Observations:       4092                              RMSE:          30.88
Df Residuals:           4090                               MAE:          25.79
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     67.7025      1.8227       0.001     64.0458     71.2905
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.915
Model:                  NNLS                    Adj. R-squared:          0.915
No. Observations:       1155                              RMSE:          19.52
Df Residuals:           1153                               MAE:          14.12
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     35.4936      1.6629       0.001     32.2208     38.7607
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.866
Model:                  NNLS                    Adj. R-squared:          0.864
No. Observations:       99                                RMSE:          19.73
Df Residuals:           97                                 MAE:          16.36
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     51.7572      7.3986       0.001     37.5205     65.8323
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

ADDMOD

test_mod_arithmetic — combo 191

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8315 2.338e-05 1.00e-03 [2.307e-05, 2.371e-05]
erigon 231 0.9041 1.823e-05 1.00e-03 [1.752e-05, 1.893e-05]
ethrex 1562 0.8367 1.361e-05 1.00e-03 [1.327e-05, 1.394e-05]
geth 4092 0.8376 1.65e-05 1.00e-03 [1.626e-05, 1.674e-05]
nethermind 1155 0.9297 1.328e-05 1.00e-03 [1.308e-05, 1.348e-05]
reth 99 0.8579 9.424e-06 1.00e-03 [8.543e-06, 1.031e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.831
Model:                  NNLS                    Adj. R-squared:          0.831
No. Observations:       3652                              RMSE:          47.39
Df Residuals:           3650                               MAE:          38.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    107.4560      2.4447       0.001    102.3448    112.1026
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.904
Model:                  NNLS                    Adj. R-squared:          0.904
No. Observations:       231                               RMSE:          26.73
Df Residuals:           229                                MAE:          23.65
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     28.5952      5.7405       0.001     17.2735     39.1526
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.837
Model:                  NNLS                    Adj. R-squared:          0.837
No. Observations:       1562                              RMSE:          27.07
Df Residuals:           1560                               MAE:          22.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     61.2844      2.7019       0.001     55.8850     66.6120
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.838
Model:                  NNLS                    Adj. R-squared:          0.838
No. Observations:       4092                              RMSE:          32.71
Df Residuals:           4090                               MAE:          27.58
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     70.9402      1.9049       0.001     67.0255     74.9205
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.930
Model:                  NNLS                    Adj. R-squared:          0.930
No. Observations:       1155                              RMSE:          16.44
Df Residuals:           1153                               MAE:          13.36
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     33.5232      1.3988       0.001     30.8839     36.2306
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.858
Model:                  NNLS                    Adj. R-squared:          0.856
No. Observations:       99                                RMSE:          17.27
Df Residuals:           97                                 MAE:          14.36
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     40.7360      6.8612       0.001     26.9693     54.2698
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

MULMOD

test_mod_arithmetic — combo 191

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8484 3.576e-05 1.00e-03 [3.528e-05, 3.625e-05]
erigon 231 0.8873 2.615e-05 1.00e-03 [2.481e-05, 2.722e-05]
ethrex 1562 0.8258 2.265e-05 1.00e-03 [2.212e-05, 2.319e-05]
geth 4092 0.8357 2.385e-05 1.00e-03 [2.35e-05, 2.42e-05]
nethermind 1155 0.9081 3.349e-05 1.00e-03 [3.286e-05, 3.411e-05]
reth 99 0.8533 1.684e-05 1.00e-03 [1.539e-05, 1.832e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.848
Model:                  NNLS                    Adj. R-squared:          0.848
No. Observations:       3652                              RMSE:          68.07
Df Residuals:           3650                               MAE:          57.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    154.8030      3.7485       0.001    147.5404    162.1317
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.887
Model:                  NNLS                    Adj. R-squared:          0.887
No. Observations:       231                               RMSE:          41.96
Df Residuals:           229                                MAE:          36.64
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     44.7394      9.6813       0.001     27.6897     65.4034
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.826
Model:                  NNLS                    Adj. R-squared:          0.826
No. Observations:       1562                              RMSE:          46.83
Df Residuals:           1560                               MAE:          39.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    102.4392      4.4549       0.001     93.6398    110.8514
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.836
Model:                  NNLS                    Adj. R-squared:          0.836
No. Observations:       4092                              RMSE:          47.60
Df Residuals:           4090                               MAE:          40.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    100.3542      2.7265       0.001     94.9464    105.4237
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.908
Model:                  NNLS                    Adj. R-squared:          0.908
No. Observations:       1155                              RMSE:          47.98
Df Residuals:           1153                               MAE:          37.83
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     84.1258      4.1922       0.001     75.7796     92.1472
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.853
Model:                  NNLS                    Adj. R-squared:          0.852
No. Observations:       99                                RMSE:          31.45
Df Residuals:           97                                 MAE:          25.94
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     89.1284     11.5187       0.001     66.1461    112.1967
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

KECCAK256

test_keccak_diff_mem_msg_sizes — combo 0

client nobs R² target_coef (ms) p-value 95% CI
besu 14608 0.7664 9.826e-05 1.00e-03 [9.736e-05, 9.917e-05]
erigon 924 0.8081 7.638e-05 1.00e-03 [7.385e-05, 7.867e-05]
ethrex 6248 0.6558 1.303e-05 1.00e-03 [1.131e-05, 1.468e-05]
geth 16368 0.789 8.134e-05 1.00e-03 [8.075e-05, 8.201e-05]
nethermind 4620 0.6981 2.397e-05 1.00e-03 [2.048e-05, 2.753e-05]
reth 396 0.5592 1.586e-05 1.00e-03 [7.961e-06, 2.429e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.766
Model:                  NNLS                    Adj. R-squared:          0.766
No. Observations:       14608                             RMSE:          85.33
Df Residuals:           14605                              MAE:          71.14
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    140.5054      2.3213       0.001    135.9759    144.9773
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.808
Model:                  NNLS                    Adj. R-squared:          0.808
No. Observations:       924                               RMSE:          64.05
Df Residuals:           921                                MAE:          49.88
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     38.6597      6.3445       0.001     26.6551     51.3674
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.656
Model:                  NNLS                    Adj. R-squared:          0.656
No. Observations:       6248                              RMSE:          91.87
Df Residuals:           6245                               MAE:          75.93
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     63.8305      3.3412       0.001     57.1098     70.1756
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.789
Model:                  NNLS                    Adj. R-squared:          0.789
No. Observations:       16368                             RMSE:          63.56
Df Residuals:           16365                              MAE:          51.65
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    101.8034      1.6000       0.001     98.4177    104.7050
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.698
Model:                  NNLS                    Adj. R-squared:          0.698
No. Observations:       4620                              RMSE:         158.87
Df Residuals:           4617                               MAE:         130.27
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     90.0434      6.9984       0.001     77.1524    103.8655
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.559
Model:                  NNLS                    Adj. R-squared:          0.557
No. Observations:       396                               RMSE:         106.66
Df Residuals:           393                                MAE:          85.96
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     61.0340     15.9476       0.001     28.4883     92.7944
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_keccak_diff_mem_msg_sizes — combo 1024

client nobs R² target_coef (ms) p-value 95% CI
besu 14608 0.7844 0.0001079 1.00e-03 [0.0001071, 0.0001089]
erigon 924 0.8265 7.606e-05 1.00e-03 [7.33e-05, 7.866e-05]
ethrex 6248 0.6561 1.316e-05 1.00e-03 [1.136e-05, 1.483e-05]
geth 16368 0.794 8.142e-05 1.00e-03 [8.081e-05, 8.203e-05]
nethermind 4620 0.7005 2.444e-05 1.00e-03 [2.1e-05, 2.794e-05]
reth 396 0.5698 1.625e-05 1.00e-03 [7.498e-06, 2.462e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.784
Model:                  NNLS                    Adj. R-squared:          0.784
No. Observations:       14608                             RMSE:          86.51
Df Residuals:           14605                              MAE:          71.33
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    132.6644      2.3422       0.001    127.8051    137.1040
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.827
Model:                  NNLS                    Adj. R-squared:          0.826
No. Observations:       924                               RMSE:          59.88
Df Residuals:           921                                MAE:          48.35
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     39.4858      6.2113       0.001     28.0829     52.0117
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.656
Model:                  NNLS                    Adj. R-squared:          0.656
No. Observations:       6248                              RMSE:          92.02
Df Residuals:           6245                               MAE:          76.08
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     63.0297      3.4903       0.001     56.5041     69.8949
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.794
Model:                  NNLS                    Adj. R-squared:          0.794
No. Observations:       16368                             RMSE:          62.78
Df Residuals:           16365                              MAE:          51.24
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     98.3861      1.6552       0.001     95.0853    101.6429
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.701
Model:                  NNLS                    Adj. R-squared:          0.700
No. Observations:       4620                              RMSE:         158.37
Df Residuals:           4617                               MAE:         129.51
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     86.8001      6.8432       0.001     72.9895    100.1890
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.570
Model:                  NNLS                    Adj. R-squared:          0.568
No. Observations:       396                               RMSE:         106.37
Df Residuals:           393                                MAE:          85.33
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     58.1366     16.2160       0.001     25.6331     88.6644
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_keccak_diff_mem_msg_sizes — combo 256

client nobs R² target_coef (ms) p-value 95% CI
besu 14608 0.7805 0.0001103 1.00e-03 [0.0001094, 0.0001112]
erigon 924 0.8147 7.492e-05 1.00e-03 [7.224e-05, 7.721e-05]
ethrex 6248 0.6564 1.325e-05 1.00e-03 [1.157e-05, 1.488e-05]
geth 16368 0.7919 8.097e-05 1.00e-03 [8.033e-05, 8.155e-05]
nethermind 4620 0.6993 2.44e-05 1.00e-03 [2.093e-05, 2.758e-05]
reth 396 0.5606 1.602e-05 1.00e-03 [7.885e-06, 2.455e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.780
Model:                  NNLS                    Adj. R-squared:          0.780
No. Observations:       14608                             RMSE:          88.97
Df Residuals:           14605                              MAE:          73.33
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    129.1090      2.3482       0.001    124.8571    133.7915
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.815
Model:                  NNLS                    Adj. R-squared:          0.814
No. Observations:       924                               RMSE:          61.55
Df Residuals:           921                                MAE:          49.34
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     45.0322      6.3195       0.001     32.6658     58.4800
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.656
Model:                  NNLS                    Adj. R-squared:          0.656
No. Observations:       6248                              RMSE:          91.89
Df Residuals:           6245                               MAE:          75.85
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     62.6232      3.2391       0.001     56.5885     69.0111
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.792
Model:                  NNLS                    Adj. R-squared:          0.792
No. Observations:       16368                             RMSE:          62.85
Df Residuals:           16365                              MAE:          50.96
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     99.7643      1.6299       0.001     96.6401    102.8870
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.699
Model:                  NNLS                    Adj. R-squared:          0.699
No. Observations:       4620                              RMSE:         158.40
Df Residuals:           4617                               MAE:         129.58
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     87.8619      6.5439       0.001     75.0825    100.8425
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.561
Model:                  NNLS                    Adj. R-squared:          0.558
No. Observations:       396                               RMSE:         106.64
Df Residuals:           393                                MAE:          85.88
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     59.8467     15.4798       0.001     27.8576     88.8289
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_keccak_diff_mem_msg_sizes — combo 32

client nobs R² target_coef (ms) p-value 95% CI
besu 14608 0.7611 0.0001022 1.00e-03 [0.0001012, 0.0001031]
erigon 924 0.8226 7.518e-05 1.00e-03 [7.282e-05, 7.761e-05]
ethrex 6248 0.6549 1.314e-05 1.00e-03 [1.145e-05, 1.507e-05]
geth 16368 0.7919 8.123e-05 1.00e-03 [8.061e-05, 8.188e-05]
nethermind 4620 0.6992 2.408e-05 1.00e-03 [2.071e-05, 2.76e-05]
reth 396 0.5645 1.527e-05 1.00e-03 [7.06e-06, 2.302e-05]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.761
Model:                  NNLS                    Adj. R-squared:          0.761
No. Observations:       14608                             RMSE:          87.97
Df Residuals:           14605                              MAE:          73.55
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    152.3981      2.4343       0.001    147.6067    157.3849
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.823
Model:                  NNLS                    Adj. R-squared:          0.822
No. Observations:       924                               RMSE:          59.80
Df Residuals:           921                                MAE:          48.80
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     44.7774      6.0713       0.001     32.7908     55.8971
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.655
Model:                  NNLS                    Adj. R-squared:          0.655
No. Observations:       6248                              RMSE:          92.09
Df Residuals:           6245                               MAE:          76.07
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     63.4598      3.4548       0.001     56.4330     70.1921
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.792
Model:                  NNLS                    Adj. R-squared:          0.792
No. Observations:       16368                             RMSE:          63.06
Df Residuals:           16365                              MAE:          51.79
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     98.2611      1.6387       0.001     95.1424    101.4627
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.699
Model:                  NNLS                    Adj. R-squared:          0.699
No. Observations:       4620                              RMSE:         158.51
Df Residuals:           4617                               MAE:         130.02
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     89.4085      6.8927       0.001     74.9642    102.9367
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.565
Model:                  NNLS                    Adj. R-squared:          0.562
No. Observations:       396                               RMSE:         106.18
Df Residuals:           393                                MAE:          85.13
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     63.0521     15.0854       0.001     33.3584     93.2852
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
     msg_words      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

ECRECOVER

test_ecrecover

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8849 0.0067 1.00e-03 [0.006622, 0.006774]
erigon 231 0.8262 0.008405 1.00e-03 [0.007826, 0.008916]
ethrex 1562 0.8209 0.006236 1.00e-03 [0.006081, 0.006386]
geth 4092 0.8809 0.007801 1.00e-03 [0.007716, 0.007889]
nethermind 1155 0.8773 0.006904 1.00e-03 [0.006725, 0.007079]
reth 99 0.8359 0.006548 1.00e-03 [0.005918, 0.007205]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.885
Model:                  NNLS                    Adj. R-squared:          0.885
No. Observations:       3652                              RMSE:          48.76
Df Residuals:           3650                               MAE:          41.53
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    144.1879      2.7858       0.001    138.8795    149.7463
       opcount      0.0067      0.0000       0.001      0.0066      0.0068
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.826
Model:                  NNLS                    Adj. R-squared:          0.825
No. Observations:       231                               RMSE:          77.79
Df Residuals:           229                                MAE:          50.96
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     88.2901     22.6796       0.001     47.9486    132.7997
       opcount      0.0084      0.0003       0.001      0.0078      0.0089
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.821
Model:                  NNLS                    Adj. R-squared:          0.821
No. Observations:       1562                              RMSE:          58.76
Df Residuals:           1560                               MAE:          50.41
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    129.8668      5.6566       0.001    119.4284    141.5329
       opcount      0.0062      0.0001       0.001      0.0061      0.0064
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.881
Model:                  NNLS                    Adj. R-squared:          0.881
No. Observations:       4092                              RMSE:          57.88
Df Residuals:           4090                               MAE:          49.60
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    115.3869      3.1047       0.001    109.5404    121.2017
       opcount      0.0078      0.0000       0.001      0.0077      0.0079
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.877
Model:                  NNLS                    Adj. R-squared:          0.877
No. Observations:       1155                              RMSE:          52.09
Df Residuals:           1153                               MAE:          43.29
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    102.8759      5.9971       0.001     90.7031    114.2329
       opcount      0.0069      0.0001       0.001      0.0067      0.0071
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.836
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       99                                RMSE:          58.53
Df Residuals:           97                                 MAE:          48.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    121.0467     23.1192       0.001     76.5813    167.6927
       opcount      0.0065      0.0003       0.001      0.0059      0.0072
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BLAKE2F

test_blake2f_benchmark

client nobs R² target_coef (ms) p-value 95% CI
besu 14608 0.8693 0.0003378 1.00e-03 [0.0003353, 0.0003401]
erigon 924 0.9536 0.0005902 1.00e-03 [0.0005812, 0.0006001]
ethrex 6248 0.8723 4.498e-05 1.00e-03 [4.425e-05, 4.578e-05]
geth 16368 0.9304 0.000104 1.00e-03 [0.0001034, 0.0001045]
nethermind 4620 0.9519 0.000156 1.00e-03 [0.0001549, 0.0001572]
reth 396 0.9896 0.0003815 1.00e-03 [0.0003779, 0.0003852]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.869
Model:                  NNLS                    Adj. R-squared:          0.869
No. Observations:       14608                             RMSE:          68.62
Df Residuals:           14605                              MAE:          58.14
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    164.7682      2.1811       0.001    160.6268    169.1850
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.954
Model:                  NNLS                    Adj. R-squared:          0.954
No. Observations:       924                               RMSE:          65.82
Df Residuals:           921                                MAE:          47.74
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     18.3210      6.8763       0.006      4.8943     31.6851
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
    num_rounds      0.0000      0.0000       0.008      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.872
Model:                  NNLS                    Adj. R-squared:          0.872
No. Observations:       6248                              RMSE:          14.26
Df Residuals:           6245                               MAE:          11.57
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     28.2348      0.6540       0.001     26.8982     29.4346
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.930
Model:                  NNLS                    Adj. R-squared:          0.930
No. Observations:       16368                             RMSE:          17.30
Df Residuals:           16365                              MAE:          13.85
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     34.8823      0.4928       0.001     33.9108     35.8480
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.952
Model:                  NNLS                    Adj. R-squared:          0.952
No. Observations:       4620                              RMSE:          18.92
Df Residuals:           4617                               MAE:          15.48
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     28.8549      0.7941       0.001     27.1293     30.3438
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.990
Model:                  NNLS                    Adj. R-squared:          0.989
No. Observations:       396                               RMSE:          19.75
Df Residuals:           393                                MAE:          15.67
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     11.6857      3.0888       0.001      5.5188     17.8405
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
    num_rounds      0.0000      0.0000       1.000      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_blake2f_uncachable

client nobs R² target_coef (ms) p-value 95% CI
besu 14608 0.8528 0.0004011 1.00e-03 [0.0003981, 0.0004041]
erigon 924 0.9603 0.0009363 1.00e-03 [0.0009227, 0.000948]
ethrex 6248 0.8711 5.119e-05 1.00e-03 [5.033e-05, 5.198e-05]
geth 16368 0.9234 0.0001355 1.00e-03 [0.0001348, 0.0001363]
nethermind 4620 0.9323 0.000165 1.00e-03 [0.0001637, 0.0001663]
reth 396 0.9875 0.0003756 1.00e-03 [0.0003718, 0.0003789]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.853
Model:                  NNLS                    Adj. R-squared:          0.853
No. Observations:       14608                             RMSE:          71.68
Df Residuals:           14605                              MAE:          60.58
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    156.0843      2.1709       0.001    151.6979    160.3488
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.960
Model:                  NNLS                    Adj. R-squared:          0.960
No. Observations:       924                               RMSE:          78.79
Df Residuals:           921                                MAE:          57.78
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     47.1798      8.3910       0.001     32.0294     64.6495
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
    num_rounds      0.0000      0.0000       0.198      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.871
Model:                  NNLS                    Adj. R-squared:          0.871
No. Observations:       6248                              RMSE:          12.77
Df Residuals:           6245                               MAE:          10.39
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     23.9197      0.5441       0.001     22.9303     25.0477
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.923
Model:                  NNLS                    Adj. R-squared:          0.923
No. Observations:       16368                             RMSE:          18.47
Df Residuals:           16365                              MAE:          14.56
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     23.9269      0.5474       0.001     22.8235     24.9216
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.932
Model:                  NNLS                    Adj. R-squared:          0.932
No. Observations:       4620                              RMSE:          19.86
Df Residuals:           4617                               MAE:          14.32
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     26.5344      0.7865       0.001     24.9812     28.0668
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
    num_rounds      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.988
Model:                  NNLS                    Adj. R-squared:          0.987
No. Observations:       396                               RMSE:          17.44
Df Residuals:           393                                MAE:          14.04
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     16.4682      2.6589       0.001     11.4694     21.9744
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
    num_rounds      0.0000      0.0000       1.000      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BLS12_G1ADD

test_bls12_381

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8572 0.001742 1.00e-03 [0.00172, 0.001767]
erigon 231 0.8317 0.0009951 1.00e-03 [0.0009579, 0.00103]
ethrex 1562 0.05318 0.002351 1.00e-03 [0.001864, 0.00278]
geth 4092 0.9 0.000733 1.00e-03 [0.0007246, 0.0007412]
nethermind 1155 0.9388 0.0009701 1.00e-03 [0.0009563, 0.0009841]
reth 99 0.8538 0.0007585 1.00e-03 [0.0006852, 0.000828]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.857
Model:                  NNLS                    Adj. R-squared:          0.857
No. Observations:       3652                              RMSE:          91.12
Df Residuals:           3650                               MAE:          72.03
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     99.2794      5.7564       0.001     87.7412    109.8290
       opcount      0.0017      0.0000       0.001      0.0017      0.0018
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.832
Model:                  NNLS                    Adj. R-squared:          0.831
No. Observations:       231                               RMSE:          57.34
Df Residuals:           229                                MAE:          37.47
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     45.8068      9.0191       0.001     28.7509     62.9708
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.053
Model:                  NNLS                    Adj. R-squared:          0.053
No. Observations:       1562                              RMSE:        1270.62
Df Residuals:           1560                               MAE:        1146.43
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    291.7258     88.5341       0.001    130.9252    475.9325
       opcount      0.0024      0.0002       0.001      0.0019      0.0028
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.900
Model:                  NNLS                    Adj. R-squared:          0.900
No. Observations:       4092                              RMSE:          31.30
Df Residuals:           4090                               MAE:          26.43
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     65.1685      1.9124       0.001     61.5192     68.8799
       opcount      0.0007      0.0000       0.001      0.0007      0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.939
Model:                  NNLS                    Adj. R-squared:          0.939
No. Observations:       1155                              RMSE:          31.72
Df Residuals:           1153                               MAE:          25.79
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     76.5374      2.8442       0.001     71.2104     81.9459
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.854
Model:                  NNLS                    Adj. R-squared:          0.852
No. Observations:       99                                RMSE:          40.20
Df Residuals:           97                                 MAE:          34.13
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     90.0398     16.2699       0.001     58.7032    123.1038
       opcount      0.0008      0.0000       0.001      0.0007      0.0008
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BLS12_G2ADD

test_bls12_381

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8683 0.00212 1.00e-03 [0.002092, 0.002147]
erigon 231 0.7986 0.001273 1.00e-03 [0.001218, 0.001331]
ethrex 1562 0.06885 0.00277 1.00e-03 [0.002287, 0.003269]
geth 4092 0.8989 0.001048 1.00e-03 [0.001036, 0.001059]
nethermind 1155 0.9356 0.001486 1.00e-03 [0.001462, 0.001508]
reth 99 0.8454 0.001013 1.00e-03 [0.0009255, 0.001108]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.868
Model:                  NNLS                    Adj. R-squared:          0.868
No. Observations:       3652                              RMSE:          72.58
Df Residuals:           3650                               MAE:          58.58
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     88.8408      4.3018       0.001     80.6795     97.4124
       opcount      0.0021      0.0000       0.001      0.0021      0.0021
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.799
Model:                  NNLS                    Adj. R-squared:          0.798
No. Observations:       231                               RMSE:          56.23
Df Residuals:           229                                MAE:          35.11
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     41.8842      7.7871       0.001     26.9727     57.5737
       opcount      0.0013      0.0000       0.001      0.0012      0.0013
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.069
Model:                  NNLS                    Adj. R-squared:          0.068
No. Observations:       1562                              RMSE:         895.80
Df Residuals:           1560                               MAE:         806.79
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    238.3055     63.7407       0.001    113.8707    359.9967
       opcount      0.0028      0.0003       0.001      0.0023      0.0033
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.899
Model:                  NNLS                    Adj. R-squared:          0.899
No. Observations:       4092                              RMSE:          30.91
Df Residuals:           4090                               MAE:          25.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     55.4126      1.7924       0.001     52.1050     59.1439
       opcount      0.0010      0.0000       0.001      0.0010      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.936
Model:                  NNLS                    Adj. R-squared:          0.936
No. Observations:       1155                              RMSE:          34.27
Df Residuals:           1153                               MAE:          27.26
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     83.3407      3.1555       0.001     77.2736     89.9864
       opcount      0.0015      0.0000       0.001      0.0015      0.0015
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.845
Model:                  NNLS                    Adj. R-squared:          0.844
No. Observations:       99                                RMSE:          38.10
Df Residuals:           97                                 MAE:          31.07
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    100.4848     14.6671       0.001     72.5037    128.0705
       opcount      0.0010      0.0000       0.001      0.0009      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

ECADD

test_alt_bn128 — combo add

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8856 0.0006195 1.00e-03 [0.0006122, 0.000627]
erigon 231 0.9289 0.0007158 1.00e-03 [0.0006911, 0.0007383]
ethrex 1562 0.826 0.000576 1.00e-03 [0.0005615, 0.0005891]
geth 4092 0.8805 0.0003886 1.00e-03 [0.0003845, 0.000393]
nethermind 1155 0.9168 0.0004388 1.00e-03 [0.000431, 0.0004464]
reth 99 0.867 0.0005895 1.00e-03 [0.0005412, 0.0006379]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.886
Model:                  NNLS                    Adj. R-squared:          0.886
No. Observations:       3652                              RMSE:          52.48
Df Residuals:           3650                               MAE:          44.40
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    150.8838      3.0729       0.001    144.8091    156.7965
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.929
Model:                  NNLS                    Adj. R-squared:          0.929
No. Observations:       231                               RMSE:          46.66
Df Residuals:           229                                MAE:          39.69
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     42.2780      9.7649       0.001     24.3394     62.1269
       opcount      0.0007      0.0000       0.001      0.0007      0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.826
Model:                  NNLS                    Adj. R-squared:          0.826
No. Observations:       1562                              RMSE:          62.30
Df Residuals:           1560                               MAE:          53.55
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    135.5485      5.9133       0.001    124.4990    147.6392
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.880
Model:                  NNLS                    Adj. R-squared:          0.880
No. Observations:       4092                              RMSE:          33.75
Df Residuals:           4090                               MAE:          29.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     80.5519      1.8602       0.001     76.8046     84.2295
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.917
Model:                  NNLS                    Adj. R-squared:          0.917
No. Observations:       1155                              RMSE:          31.15
Df Residuals:           1153                               MAE:          24.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     77.1826      2.9073       0.001     71.7735     82.8734
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.867
Model:                  NNLS                    Adj. R-squared:          0.866
No. Observations:       99                                RMSE:          54.42
Df Residuals:           97                                 MAE:          45.80
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    133.0129     20.8191       0.001     93.7482    175.6213
       opcount      0.0006      0.0000       0.001      0.0005      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_alt_bn128 — combo add_infinities

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8907 0.0003655 1.00e-03 [0.0003611, 0.0003699]
erigon 231 0.9221 0.0005737 1.00e-03 [0.0005604, 0.0005881]
ethrex 1562 0.8423 0.0001401 1.00e-03 [0.0001367, 0.0001437]
geth 4092 0.789 0.0001097 1.00e-03 [0.000108, 0.0001114]
nethermind 1155 0.918 0.0002005 1.00e-03 [0.0001975, 0.0002034]
reth 99 0.9867 0.0003772 1.00e-03 [0.0003692, 0.0003854]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.891
Model:                  NNLS                    Adj. R-squared:          0.891
No. Observations:       3652                              RMSE:          30.17
Df Residuals:           3650                               MAE:          25.37
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     77.9570      1.7896       0.001     74.3824     81.5722
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.922
Model:                  NNLS                    Adj. R-squared:          0.922
No. Observations:       231                               RMSE:          39.29
Df Residuals:           229                                MAE:          22.51
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     21.8254      6.1519       0.001      9.9337     34.5979
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.842
Model:                  NNLS                    Adj. R-squared:          0.842
No. Observations:       1562                              RMSE:          14.29
Df Residuals:           1560                               MAE:          11.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     26.8071      1.3489       0.001     24.0496     29.4687
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.789
Model:                  NNLS                    Adj. R-squared:          0.789
No. Observations:       4092                              RMSE:          13.37
Df Residuals:           4090                               MAE:          10.61
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     12.6609      0.7561       0.001     11.1456     14.1698
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.918
Model:                  NNLS                    Adj. R-squared:          0.918
No. Observations:       1155                              RMSE:          14.13
Df Residuals:           1153                               MAE:           9.65
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     15.8542      1.0544       0.001     13.8584     18.0041
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.987
Model:                  NNLS                    Adj. R-squared:          0.987
No. Observations:       99                                RMSE:          10.31
Df Residuals:           97                                 MAE:           8.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      7.5468      3.4866       0.016      0.6702     14.2900
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_alt_bn128 — combo add_negative

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8863 0.000384 1.00e-03 [0.0003791, 0.0003888]
erigon 231 0.8414 0.0005794 1.00e-03 [0.0005571, 0.0005963]
ethrex 1562 0.841 0.0002002 1.00e-03 [0.0001954, 0.0002053]
geth 4092 0.8739 0.0001692 1.00e-03 [0.0001671, 0.0001712]
nethermind 1155 0.9088 0.0002669 1.00e-03 [0.0002618, 0.0002717]
reth 99 0.9774 0.0003535 1.00e-03 [0.0003448, 0.0003627]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.886
Model:                  NNLS                    Adj. R-squared:          0.886
No. Observations:       3652                              RMSE:          32.41
Df Residuals:           3650                               MAE:          27.39
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     83.2912      2.0447       0.001     79.3887     87.2641
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.841
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       231                               RMSE:          59.28
Df Residuals:           229                                MAE:          30.02
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     29.0079      8.9798       0.001     14.2142     49.6547
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.841
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       1562                              RMSE:          20.51
Df Residuals:           1560                               MAE:          17.18
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     46.6268      2.0144       0.001     42.5562     50.3677
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.874
Model:                  NNLS                    Adj. R-squared:          0.874
No. Observations:       4092                              RMSE:          15.14
Df Residuals:           4090                               MAE:          11.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     17.3043      0.9280       0.001     15.4778     19.1064
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.909
Model:                  NNLS                    Adj. R-squared:          0.909
No. Observations:       1155                              RMSE:          19.92
Df Residuals:           1153                               MAE:          13.17
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     27.2692      1.9039       0.001     23.6578     31.3559
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.977
Model:                  NNLS                    Adj. R-squared:          0.977
No. Observations:       99                                RMSE:          12.67
Df Residuals:           97                                 MAE:          10.42
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     25.1619      3.7891       0.001     17.4157     33.0829
       opcount      0.0004      0.0000       0.001      0.0003      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_alt_bn128 — combo double

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8824 0.0006555 1.00e-03 [0.000647, 0.0006636]
erigon 231 0.8542 0.0007104 1.00e-03 [0.0006822, 0.0007357]
ethrex 1562 0.8272 0.0005872 1.00e-03 [0.0005732, 0.0006022]
geth 4092 0.8792 0.0004045 1.00e-03 [0.0003993, 0.0004093]
nethermind 1155 0.9282 0.0004714 1.00e-03 [0.0004634, 0.000479]
reth 99 0.8591 0.0006084 1.00e-03 [0.0005562, 0.0006598]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.882
Model:                  NNLS                    Adj. R-squared:          0.882
No. Observations:       3652                              RMSE:          56.38
Df Residuals:           3650                               MAE:          48.44
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    127.4271      3.6120       0.001    120.5506    134.6351
       opcount      0.0007      0.0000       0.001      0.0006      0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.854
Model:                  NNLS                    Adj. R-squared:          0.854
No. Observations:       231                               RMSE:          69.17
Df Residuals:           229                                MAE:          47.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     55.4303     12.7229       0.001     32.2733     81.4497
       opcount      0.0007      0.0000       0.001      0.0007      0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.827
Model:                  NNLS                    Adj. R-squared:          0.827
No. Observations:       1562                              RMSE:          63.25
Df Residuals:           1560                               MAE:          54.22
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    133.9596      6.1786       0.001    121.4385    145.6927
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.879
Model:                  NNLS                    Adj. R-squared:          0.879
No. Observations:       4092                              RMSE:          35.33
Df Residuals:           4090                               MAE:          30.53
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     73.5763      2.1589       0.001     69.5622     77.9952
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.928
Model:                  NNLS                    Adj. R-squared:          0.928
No. Observations:       1155                              RMSE:          30.89
Df Residuals:           1153                               MAE:          23.83
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     48.6767      2.9087       0.001     43.4690     54.5675
       opcount      0.0005      0.0000       0.001      0.0005      0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.859
Model:                  NNLS                    Adj. R-squared:          0.858
No. Observations:       99                                RMSE:          58.07
Df Residuals:           97                                 MAE:          48.83
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    122.7038     22.3725       0.001     79.8058    165.7491
       opcount      0.0006      0.0000       0.001      0.0006      0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_alt_bn128_uncachable

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8779 0.0008978 1.00e-03 [0.0008866, 0.0009086]
erigon 231 0.9355 0.001074 1.00e-03 [0.001036, 0.001107]
ethrex 1562 0.8156 0.0009039 1.00e-03 [0.0008828, 0.0009273]
geth 4092 0.8611 0.0006026 1.00e-03 [0.0005952, 0.00061]
nethermind 1155 0.944 0.0007578 1.00e-03 [0.0007472, 0.0007689]
reth 99 0.8362 0.0009582 1.00e-03 [0.00087, 0.001044]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.878
Model:                  NNLS                    Adj. R-squared:          0.878
No. Observations:       3652                              RMSE:          71.68
Df Residuals:           3650                               MAE:          61.37
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    174.2594      4.4282       0.001    165.7715    183.1917
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.935
Model:                  NNLS                    Adj. R-squared:          0.935
No. Observations:       231                               RMSE:          60.38
Df Residuals:           229                                MAE:          51.70
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     66.8205     13.5799       0.001     41.2421     94.5023
       opcount      0.0011      0.0000       0.001      0.0010      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.816
Model:                  NNLS                    Adj. R-squared:          0.815
No. Observations:       1562                              RMSE:          92.02
Df Residuals:           1560                               MAE:          79.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    187.1750      8.7550       0.001    169.4688    203.0392
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.861
Model:                  NNLS                    Adj. R-squared:          0.861
No. Observations:       4092                              RMSE:          51.82
Df Residuals:           4090                               MAE:          44.47
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    107.3041      2.8717       0.001    101.4869    112.8098
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.944
Model:                  NNLS                    Adj. R-squared:          0.944
No. Observations:       1155                              RMSE:          39.51
Df Residuals:           1153                               MAE:          31.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     69.6953      3.5700       0.001     62.6180     76.5260
       opcount      0.0008      0.0000       0.001      0.0007      0.0008
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.836
Model:                  NNLS                    Adj. R-squared:          0.835
No. Observations:       99                                RMSE:          90.79
Df Residuals:           97                                 MAE:          77.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    186.4975     34.3214       0.001    121.1542    255.6964
       opcount      0.0010      0.0000       0.001      0.0009      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

ECPAIRING

test_alt_bn128_benchmark

client nobs R² target_coef (ms) p-value 95% CI
besu 18260 0.8814 0.04592 1.00e-03 [0.04558, 0.04627]
erigon 1155 0.7776 0.05023 1.00e-03 [0.0482, 0.05234]
ethrex 7810 0.8117 0.04761 1.00e-03 [0.04627, 0.04889]
geth 20460 0.8178 0.0443 1.00e-03 [0.04388, 0.04474]
nethermind 5775 0.9343 0.0664 1.00e-03 [0.06508, 0.06772]
reth 495 0.8172 0.04688 1.00e-03 [0.04257, 0.05164]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.881
Model:                  NNLS                    Adj. R-squared:          0.881
No. Observations:       18260                             RMSE:          20.24
Df Residuals:           18257                              MAE:          17.12
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     52.6567      0.5637       0.001     51.5698     53.6996
       opcount      0.0459      0.0002       0.001      0.0456      0.0463
     num_pairs      0.0262      0.0001       0.001      0.0261      0.0264
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.778
Model:                  NNLS                    Adj. R-squared:          0.777
No. Observations:       1155                              RMSE:          33.01
Df Residuals:           1152                               MAE:          18.84
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     26.8384      4.5749       0.001     19.0346     36.6277
       opcount      0.0502      0.0011       0.001      0.0482      0.0523
     num_pairs      0.0296      0.0007       0.001      0.0282      0.0310
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.812
Model:                  NNLS                    Adj. R-squared:          0.812
No. Observations:       7810                              RMSE:          53.66
Df Residuals:           7807                               MAE:          44.95
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    110.6409      2.2159       0.001    106.2160    115.0076
       opcount      0.0476      0.0007       0.001      0.0463      0.0489
     num_pairs      0.0589      0.0003       0.001      0.0582      0.0596
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.818
Model:                  NNLS                    Adj. R-squared:          0.818
No. Observations:       20460                             RMSE:          25.91
Df Residuals:           20457                              MAE:          21.70
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     52.7877      0.7042       0.001     51.4742     54.1403
       opcount      0.0443      0.0002       0.001      0.0439      0.0447
     num_pairs      0.0265      0.0001       0.001      0.0263      0.0267
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.934
Model:                  NNLS                    Adj. R-squared:          0.934
No. Observations:       5775                              RMSE:          51.37
Df Residuals:           5772                               MAE:          40.46
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     79.8147      2.0977       0.001     75.7109     83.9170
       opcount      0.0664      0.0007       0.001      0.0651      0.0677
     num_pairs      0.1023      0.0004       0.001      0.1015      0.1030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.817
Model:                  NNLS                    Adj. R-squared:          0.817
No. Observations:       495                               RMSE:          51.84
Df Residuals:           492                                MAE:          43.05
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    112.0218      8.0009       0.001     96.5744    126.9719
       opcount      0.0469      0.0023       0.001      0.0426      0.0516
     num_pairs      0.0580      0.0013       0.001      0.0555      0.0605
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_ec_pairing

client nobs R² target_coef (ms) p-value 95% CI
besu 18260 0.9076 0.05105 1.00e-03 [0.05067, 0.05141]
erigon 1155 0.8897 0.04745 1.00e-03 [0.04623, 0.04855]
ethrex 7810 0.834 0.08182 1.00e-03 [0.08061, 0.083]
geth 20460 0.8667 0.04134 1.00e-03 [0.04095, 0.0417]
nethermind 5775 0.9466 0.05277 1.00e-03 [0.05145, 0.05397]
reth 495 0.8392 0.08247 1.00e-03 [0.07785, 0.08735]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.908
Model:                  NNLS                    Adj. R-squared:          0.908
No. Observations:       18260                             RMSE:          19.20
Df Residuals:           18257                              MAE:          15.99
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     43.7129      0.5245       0.001     42.7546     44.8030
       opcount      0.0511      0.0002       0.001      0.0507      0.0514
     num_pairs      0.0331      0.0001       0.001      0.0329      0.0333
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.890
Model:                  NNLS                    Adj. R-squared:          0.889
No. Observations:       1155                              RMSE:          23.52
Df Residuals:           1152                               MAE:          15.58
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     24.6623      1.6627       0.001     21.4796     28.1117
       opcount      0.0475      0.0006       0.001      0.0462      0.0485
     num_pairs      0.0399      0.0003       0.001      0.0393      0.0404
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.834
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       7810                              RMSE:          47.43
Df Residuals:           7807                               MAE:          40.36
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    111.7478      2.0122       0.001    108.1361    115.7305
       opcount      0.0818      0.0006       0.001      0.0806      0.0830
     num_pairs      0.0616      0.0004       0.001      0.0609      0.0623
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.867
Model:                  NNLS                    Adj. R-squared:          0.867
No. Observations:       20460                             RMSE:          25.09
Df Residuals:           20457                              MAE:          20.83
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     50.4421      0.6339       0.001     49.2719     51.7259
       opcount      0.0413      0.0002       0.001      0.0409      0.0417
     num_pairs      0.0392      0.0001       0.001      0.0389      0.0394
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.947
Model:                  NNLS                    Adj. R-squared:          0.947
No. Observations:       5775                              RMSE:          43.15
Df Residuals:           5772                               MAE:          34.69
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     72.6568      1.7660       0.001     69.3939     76.1020
       opcount      0.0528      0.0006       0.001      0.0515      0.0540
     num_pairs      0.1171      0.0004       0.001      0.1164      0.1179
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.839
Model:                  NNLS                    Adj. R-squared:          0.839
No. Observations:       495                               RMSE:          46.22
Df Residuals:           492                                MAE:          38.57
Df Model:               2      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    105.5209      7.4806       0.001     91.2479    120.5613
       opcount      0.0825      0.0024       0.001      0.0778      0.0873
     num_pairs      0.0608      0.0013       0.001      0.0582      0.0634
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

POINT_EVALUATION

test_point_evaluation

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8753 0.1731 1.00e-03 [0.1706, 0.1758]
erigon 231 0.8993 0.1785 1.00e-03 [0.1711, 0.1852]
ethrex 1562 0.8135 0.2363 1.00e-03 [0.2308, 0.2426]
geth 4092 0.829 0.1979 1.00e-03 [0.1951, 0.2007]
nethermind 1155 0.8769 0.2157 1.00e-03 [0.2104, 0.2211]
reth 99 0.8398 0.1978 1.00e-03 [0.1799, 0.2152]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.875
Model:                  NNLS                    Adj. R-squared:          0.875
No. Observations:       3652                              RMSE:          82.74
Df Residuals:           3650                               MAE:          64.85
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    420.1928      6.0176       0.001    408.0318    430.9260
       opcount      0.1731      0.0014       0.001      0.1706      0.1758
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.899
Model:                  NNLS                    Adj. R-squared:          0.899
No. Observations:       231                               RMSE:          75.65
Df Residuals:           229                                MAE:          67.40
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     68.6243     15.9205       0.001     40.1323    100.4102
       opcount      0.1785      0.0036       0.001      0.1711      0.1852
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.813
Model:                  NNLS                    Adj. R-squared:          0.813
No. Observations:       1562                              RMSE:         143.32
Df Residuals:           1560                               MAE:         123.68
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    294.7115     13.6918       0.001    267.0669    319.7219
       opcount      0.2363      0.0030       0.001      0.2308      0.2426
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.829
Model:                  NNLS                    Adj. R-squared:          0.829
No. Observations:       4092                              RMSE:         113.88
Df Residuals:           4090                               MAE:          96.82
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    230.6663      6.5759       0.001    218.3207    243.6019
       opcount      0.1979      0.0015       0.001      0.1951      0.2007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.877
Model:                  NNLS                    Adj. R-squared:          0.877
No. Observations:       1155                              RMSE:         102.35
Df Residuals:           1153                               MAE:          84.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    199.3761     11.6006       0.001    177.2871    222.5617
       opcount      0.2157      0.0028       0.001      0.2104      0.2211
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.840
Model:                  NNLS                    Adj. R-squared:          0.838
No. Observations:       99                                RMSE:         109.44
Df Residuals:           97                                 MAE:          94.34
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    224.9285     41.7326       0.001    149.6991    313.9231
       opcount      0.1978      0.0093       0.001      0.1799      0.2152
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_point_evaluation_uncachable

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8758 0.2084 1.00e-03 [0.2056, 0.2111]
erigon 231 0.8947 0.1942 1.00e-03 [0.1867, 0.2014]
ethrex 1562 0.8149 0.2382 1.00e-03 [0.2325, 0.244]
geth 4092 0.8406 0.1922 1.00e-03 [0.1895, 0.195]
nethermind 1155 0.8628 0.234 1.00e-03 [0.2277, 0.2399]
reth 99 0.8355 0.1966 1.00e-03 [0.178, 0.2139]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.876
Model:                  NNLS                    Adj. R-squared:          0.876
No. Observations:       3652                              RMSE:          92.88
Df Residuals:           3650                               MAE:          78.57
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    219.7217      5.7999       0.001    208.5187    230.9829
       opcount      0.2084      0.0014       0.001      0.2056      0.2111
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.895
Model:                  NNLS                    Adj. R-squared:          0.894
No. Observations:       231                               RMSE:          78.86
Df Residuals:           229                                MAE:          68.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     68.8348     15.9512       0.001     40.1171    100.2995
       opcount      0.1942      0.0038       0.001      0.1867      0.2014
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.815
Model:                  NNLS                    Adj. R-squared:          0.815
No. Observations:       1562                              RMSE:         134.41
Df Residuals:           1560                               MAE:         116.05
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    283.8455     12.4008       0.001    258.9834    306.7242
       opcount      0.2382      0.0029       0.001      0.2325      0.2440
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.841
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       4092                              RMSE:          99.10
Df Residuals:           4090                               MAE:          83.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    194.9613      5.7962       0.001    183.3327    206.3370
       opcount      0.1922      0.0014       0.001      0.1895      0.1950
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.863
Model:                  NNLS                    Adj. R-squared:          0.863
No. Observations:       1155                              RMSE:         110.45
Df Residuals:           1153                               MAE:          85.29
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    149.7763     11.4816       0.001    128.3096    172.7554
       opcount      0.2340      0.0032       0.001      0.2277      0.2399
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.835
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       99                                RMSE:         103.29
Df Residuals:           97                                 MAE:          86.35
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    225.5452     39.6374       0.001    152.3949    305.7742
       opcount      0.1966      0.0094       0.001      0.1780      0.2139
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

P256VERIFY

test_p256verify

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.8684 0.008331 1.00e-03 [0.008235, 0.008442]
erigon 231 0.8362 0.01405 1.00e-03 [0.01343, 0.01465]
ethrex 1562 0.8106 0.03803 1.00e-03 [0.03709, 0.03901]
geth 4092 0.8268 0.01169 1.00e-03 [0.01151, 0.01187]
nethermind 1155 0.8816 0.008589 1.00e-03 [0.008375, 0.008796]
reth 99 0.8427 0.008424 1.00e-03 [0.007627, 0.009186]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.868
Model:                  NNLS                    Adj. R-squared:          0.868
No. Observations:       3652                              RMSE:          29.21
Df Residuals:           3650                               MAE:          24.49
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     77.0097      1.7077       0.001     73.4044     80.1343
       opcount      0.0083      0.0001       0.001      0.0082      0.0084
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.836
Model:                  NNLS                    Adj. R-squared:          0.836
No. Observations:       231                               RMSE:          55.98
Df Residuals:           229                                MAE:          39.97
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     49.3381      9.8136       0.001     31.0747     68.6145
       opcount      0.0140      0.0003       0.001      0.0134      0.0146
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.811
Model:                  NNLS                    Adj. R-squared:          0.810
No. Observations:       1562                              RMSE:         165.56
Df Residuals:           1560                               MAE:         142.89
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    336.2904     16.1013       0.001    305.4215    366.6415
       opcount      0.0380      0.0005       0.001      0.0371      0.0390
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.827
Model:                  NNLS                    Adj. R-squared:          0.827
No. Observations:       4092                              RMSE:          48.18
Df Residuals:           4090                               MAE:          40.29
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     95.6695      2.8780       0.001     90.0300    101.2115
       opcount      0.0117      0.0001       0.001      0.0115      0.0119
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.882
Model:                  NNLS                    Adj. R-squared:          0.881
No. Observations:       1155                              RMSE:          28.35
Df Residuals:           1153                               MAE:          23.47
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     59.2739      3.1631       0.001     53.3594     65.6267
       opcount      0.0086      0.0001       0.001      0.0084      0.0088
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.843
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       99                                RMSE:          32.78
Df Residuals:           97                                 MAE:          27.80
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     63.0968     12.8506       0.001     38.1110     89.1053
       opcount      0.0084      0.0004       0.001      0.0076      0.0092
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

test_p256verify_uncachable

client nobs R² target_coef (ms) p-value 95% CI
besu 3652 0.9095 0.0109 1.00e-03 [0.01079, 0.01101]
erigon 231 0.8114 0.01411 1.00e-03 [0.0131, 0.01497]
ethrex 1562 0.8105 0.03814 1.00e-03 [0.03715, 0.03908]
geth 4092 0.8253 0.01183 1.00e-03 [0.01166, 0.01201]
nethermind 1155 0.8835 0.008746 1.00e-03 [0.008526, 0.008972]
reth 99 0.8658 0.008419 1.00e-03 [0.007681, 0.00912]
besu — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.910
Model:                  NNLS                    Adj. R-squared:          0.910
No. Observations:       3652                              RMSE:          30.74
Df Residuals:           3650                               MAE:          26.30
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     25.3016      1.7245       0.001     21.7949     28.6537
       opcount      0.0109      0.0001       0.001      0.0108      0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
erigon — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.811
Model:                  NNLS                    Adj. R-squared:          0.811
No. Observations:       231                               RMSE:          60.84
Df Residuals:           229                                MAE:          39.53
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     49.7319     14.6554       0.001     25.3822     81.0316
       opcount      0.0141      0.0005       0.001      0.0131      0.0150
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
ethrex — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.810
Model:                  NNLS                    Adj. R-squared:          0.810
No. Observations:       1562                              RMSE:         164.99
Df Residuals:           1560                               MAE:         142.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    332.7567     15.8105       0.001    302.9333    362.8966
       opcount      0.0381      0.0005       0.001      0.0372      0.0391
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
geth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.825
Model:                  NNLS                    Adj. R-squared:          0.825
No. Observations:       4092                              RMSE:          48.70
Df Residuals:           4090                               MAE:          40.66
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     92.7969      2.7667       0.001     87.4152     97.9833
       opcount      0.0118      0.0001       0.001      0.0117      0.0120
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
nethermind — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.884
Model:                  NNLS                    Adj. R-squared:          0.883
No. Observations:       1155                              RMSE:          28.40
Df Residuals:           1153                               MAE:          23.29
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     57.0388      3.2838       0.001     50.2955     63.5019
       opcount      0.0087      0.0001       0.001      0.0085      0.0090
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
reth — NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.866
Model:                  NNLS                    Adj. R-squared:          0.864
No. Observations:       99                                RMSE:          29.65
Df Residuals:           97                                 MAE:          24.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     69.2118     11.7461       0.001     47.1850     91.9381
       opcount      0.0084      0.0004       0.001      0.0077      0.0091
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================