community
Ridge relative error: 0.171924
Size: train (1595, 100), test (399, 100)
RF: Percentage in the range (expecting 90.00): 87.719298
RF: Average length: 1.795466
RF-L: Percentage in the range (expecting 90.00): 87.719298
RF-L: Average length: 1.735977
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    0
CP Linear Local                                              0  ...    0
CP Neural Net                                                0  ...    0
CP Neural Net Local                                          0  ...    0
CP Random Forest                             87.71929824561403  ...    0
CP Random Forest Local                       87.71929824561403  ...    0
CP Quantile Net                                              0  ...    0
CP Asymmetric Quantile Net                                   0  ...    0
Quantile Net                                                 0  ...    0
CP Rearrange Quantile Net                                    0  ...    0
CP Asymmetric Rearrange Quantile Net                         0  ...    0
Rearrange Quantile Net                                       0  ...    0
CP Quantile Random Forest                                    0  ...    0
CP Asymmetric Quantile Random Forest                         0  ...    0
Quantile Random Forest                                       0  ...    0

[15 rows x 3 columns]
@@ done method=random_forest dataset=community seed=0 sec=273.2
community
Ridge relative error: 0.171924
Size: train (1595, 100), test (399, 100)
CQR RF: Percentage in the range (expecting 90.00): 90.225564
CQR RF: Average length: 1.570521
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    0
CP Linear Local                                              0  ...    0
CP Neural Net                                                0  ...    0
CP Neural Net Local                                          0  ...    0
CP Random Forest                                             0  ...    0
CP Random Forest Local                                       0  ...    0
CP Quantile Net                                              0  ...    0
CP Asymmetric Quantile Net                                   0  ...    0
Quantile Net                                                 0  ...    0
CP Rearrange Quantile Net                                    0  ...    0
CP Asymmetric Rearrange Quantile Net                         0  ...    0
Rearrange Quantile Net                                       0  ...    0
CP Quantile Random Forest                    90.22556390977444  ...    0
CP Asymmetric Quantile Random Forest                         0  ...    0
Quantile Random Forest                                       0  ...    0

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=community seed=0 sec=224.2
concrete
Ridge relative error: 0.065155
Size: train (824, 8), test (206, 8)
CQR RF: Percentage in the range (expecting 90.00): 90.776699
CQR RF: Average length: 0.561813
== SUMMARY == 
dataset name: concrete
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    0
CP Linear Local                                              0  ...    0
CP Neural Net                                                0  ...    0
CP Neural Net Local                                          0  ...    0
CP Random Forest                                             0  ...    0
CP Random Forest Local                                       0  ...    0
CP Quantile Net                                              0  ...    0
CP Asymmetric Quantile Net                                   0  ...    0
Quantile Net                                                 0  ...    0
CP Rearrange Quantile Net                                    0  ...    0
CP Asymmetric Rearrange Quantile Net                         0  ...    0
Rearrange Quantile Net                                       0  ...    0
CP Quantile Random Forest                    90.77669902912622  ...    0
CP Asymmetric Quantile Random Forest                         0  ...    0
Quantile Random Forest                                       0  ...    0

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=concrete seed=0 sec=39.5
community
Ridge relative error: 0.194751
Size: train (1595, 100), test (399, 100)
RF: Percentage in the range (expecting 90.00): 91.478697
RF: Average length: 1.859069
RF-L: Percentage in the range (expecting 90.00): 91.478697
RF-L: Average length: 1.729970
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    1
CP Linear Local                                              0  ...    1
CP Neural Net                                                0  ...    1
CP Neural Net Local                                          0  ...    1
CP Random Forest                             91.47869674185463  ...    1
CP Random Forest Local                       91.47869674185463  ...    1
CP Quantile Net                                              0  ...    1
CP Asymmetric Quantile Net                                   0  ...    1
Quantile Net                                                 0  ...    1
CP Rearrange Quantile Net                                    0  ...    1
CP Asymmetric Rearrange Quantile Net                         0  ...    1
Rearrange Quantile Net                                       0  ...    1
CP Quantile Random Forest                                    0  ...    1
CP Asymmetric Quantile Random Forest                         0  ...    1
Quantile Random Forest                                       0  ...    1

[15 rows x 3 columns]
@@ done method=random_forest dataset=community seed=1 sec=220.2
community
Ridge relative error: 0.194751
Size: train (1595, 100), test (399, 100)
CQR RF: Percentage in the range (expecting 90.00): 91.228070
CQR RF: Average length: 1.344334
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    1
CP Linear Local                                              0  ...    1
CP Neural Net                                                0  ...    1
CP Neural Net Local                                          0  ...    1
CP Random Forest                                             0  ...    1
CP Random Forest Local                                       0  ...    1
CP Quantile Net                                              0  ...    1
CP Asymmetric Quantile Net                                   0  ...    1
Quantile Net                                                 0  ...    1
CP Rearrange Quantile Net                                    0  ...    1
CP Asymmetric Rearrange Quantile Net                         0  ...    1
Rearrange Quantile Net                                       0  ...    1
CP Quantile Random Forest                    91.22807017543859  ...    1
CP Asymmetric Quantile Random Forest                         0  ...    1
Quantile Random Forest                                       0  ...    1

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=community seed=1 sec=151.9
concrete
Ridge relative error: 0.074969
Size: train (824, 8), test (206, 8)
CQR RF: Percentage in the range (expecting 90.00): 89.320388
CQR RF: Average length: 0.575523
== SUMMARY == 
dataset name: concrete
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    1
CP Linear Local                                              0  ...    1
CP Neural Net                                                0  ...    1
CP Neural Net Local                                          0  ...    1
CP Random Forest                                             0  ...    1
CP Random Forest Local                                       0  ...    1
CP Quantile Net                                              0  ...    1
CP Asymmetric Quantile Net                                   0  ...    1
Quantile Net                                                 0  ...    1
CP Rearrange Quantile Net                                    0  ...    1
CP Asymmetric Rearrange Quantile Net                         0  ...    1
Rearrange Quantile Net                                       0  ...    1
CP Quantile Random Forest                    89.32038834951457  ...    1
CP Asymmetric Quantile Random Forest                         0  ...    1
Quantile Random Forest                                       0  ...    1

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=concrete seed=1 sec=29.6
community
Ridge relative error: 0.167612
Size: train (1595, 100), test (399, 100)
RF: Percentage in the range (expecting 90.00): 89.974937
RF: Average length: 1.834399
RF-L: Percentage in the range (expecting 90.00): 90.977444
RF-L: Average length: 1.764930
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    2
CP Linear Local                                              0  ...    2
CP Neural Net                                                0  ...    2
CP Neural Net Local                                          0  ...    2
CP Random Forest                             89.97493734335839  ...    2
CP Random Forest Local                       90.97744360902256  ...    2
CP Quantile Net                                              0  ...    2
CP Asymmetric Quantile Net                                   0  ...    2
Quantile Net                                                 0  ...    2
CP Rearrange Quantile Net                                    0  ...    2
CP Asymmetric Rearrange Quantile Net                         0  ...    2
Rearrange Quantile Net                                       0  ...    2
CP Quantile Random Forest                                    0  ...    2
CP Asymmetric Quantile Random Forest                         0  ...    2
Quantile Random Forest                                       0  ...    2

[15 rows x 3 columns]
@@ done method=random_forest dataset=community seed=2 sec=158.3
community
Ridge relative error: 0.167612
Size: train (1595, 100), test (399, 100)
CQR RF: Percentage in the range (expecting 90.00): 90.476190
CQR RF: Average length: 1.536463
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    2
CP Linear Local                                              0  ...    2
CP Neural Net                                                0  ...    2
CP Neural Net Local                                          0  ...    2
CP Random Forest                                             0  ...    2
CP Random Forest Local                                       0  ...    2
CP Quantile Net                                              0  ...    2
CP Asymmetric Quantile Net                                   0  ...    2
Quantile Net                                                 0  ...    2
CP Rearrange Quantile Net                                    0  ...    2
CP Asymmetric Rearrange Quantile Net                         0  ...    2
Rearrange Quantile Net                                       0  ...    2
CP Quantile Random Forest                    90.47619047619048  ...    2
CP Asymmetric Quantile Random Forest                         0  ...    2
Quantile Random Forest                                       0  ...    2

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=community seed=2 sec=125.0
concrete
Ridge relative error: 0.071138
Size: train (824, 8), test (206, 8)
CQR RF: Percentage in the range (expecting 90.00): 91.747573
CQR RF: Average length: 0.580918
== SUMMARY == 
dataset name: concrete
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    2
CP Linear Local                                              0  ...    2
CP Neural Net                                                0  ...    2
CP Neural Net Local                                          0  ...    2
CP Random Forest                                             0  ...    2
CP Random Forest Local                                       0  ...    2
CP Quantile Net                                              0  ...    2
CP Asymmetric Quantile Net                                   0  ...    2
Quantile Net                                                 0  ...    2
CP Rearrange Quantile Net                                    0  ...    2
CP Asymmetric Rearrange Quantile Net                         0  ...    2
Rearrange Quantile Net                                       0  ...    2
CP Quantile Random Forest                    91.74757281553399  ...    2
CP Asymmetric Quantile Random Forest                         0  ...    2
Quantile Random Forest                                       0  ...    2

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=concrete seed=2 sec=26.3
community
Ridge relative error: 0.170134
Size: train (1595, 100), test (399, 100)
RF: Percentage in the range (expecting 90.00): 90.225564
RF: Average length: 1.884555
RF-L: Percentage in the range (expecting 90.00): 89.974937
RF-L: Average length: 1.755256
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    3
CP Linear Local                                              0  ...    3
CP Neural Net                                                0  ...    3
CP Neural Net Local                                          0  ...    3
CP Random Forest                             90.22556390977444  ...    3
CP Random Forest Local                       89.97493734335839  ...    3
CP Quantile Net                                              0  ...    3
CP Asymmetric Quantile Net                                   0  ...    3
Quantile Net                                                 0  ...    3
CP Rearrange Quantile Net                                    0  ...    3
CP Asymmetric Rearrange Quantile Net                         0  ...    3
Rearrange Quantile Net                                       0  ...    3
CP Quantile Random Forest                                    0  ...    3
CP Asymmetric Quantile Random Forest                         0  ...    3
Quantile Random Forest                                       0  ...    3

[15 rows x 3 columns]
@@ done method=random_forest dataset=community seed=3 sec=149.0
community
Ridge relative error: 0.170134
Size: train (1595, 100), test (399, 100)
CQR RF: Percentage in the range (expecting 90.00): 90.476190
CQR RF: Average length: 1.517071
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    3
CP Linear Local                                              0  ...    3
CP Neural Net                                                0  ...    3
CP Neural Net Local                                          0  ...    3
CP Random Forest                                             0  ...    3
CP Random Forest Local                                       0  ...    3
CP Quantile Net                                              0  ...    3
CP Asymmetric Quantile Net                                   0  ...    3
Quantile Net                                                 0  ...    3
CP Rearrange Quantile Net                                    0  ...    3
CP Asymmetric Rearrange Quantile Net                         0  ...    3
Rearrange Quantile Net                                       0  ...    3
CP Quantile Random Forest                    90.47619047619048  ...    3
CP Asymmetric Quantile Random Forest                         0  ...    3
Quantile Random Forest                                       0  ...    3

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=community seed=3 sec=128.9
concrete
Ridge relative error: 0.080406
Size: train (824, 8), test (206, 8)
CQR RF: Percentage in the range (expecting 90.00): 92.233010
CQR RF: Average length: 0.565388
== SUMMARY == 
dataset name: concrete
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    3
CP Linear Local                                              0  ...    3
CP Neural Net                                                0  ...    3
CP Neural Net Local                                          0  ...    3
CP Random Forest                                             0  ...    3
CP Random Forest Local                                       0  ...    3
CP Quantile Net                                              0  ...    3
CP Asymmetric Quantile Net                                   0  ...    3
Quantile Net                                                 0  ...    3
CP Rearrange Quantile Net                                    0  ...    3
CP Asymmetric Rearrange Quantile Net                         0  ...    3
Rearrange Quantile Net                                       0  ...    3
CP Quantile Random Forest                    92.23300970873787  ...    3
CP Asymmetric Quantile Random Forest                         0  ...    3
Quantile Random Forest                                       0  ...    3

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=concrete seed=3 sec=27.9
community
Ridge relative error: 0.158510
Size: train (1595, 100), test (399, 100)
RF: Percentage in the range (expecting 90.00): 90.476190
RF: Average length: 1.915272
RF-L: Percentage in the range (expecting 90.00): 90.476190
RF-L: Average length: 1.820317
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    4
CP Linear Local                                              0  ...    4
CP Neural Net                                                0  ...    4
CP Neural Net Local                                          0  ...    4
CP Random Forest                             90.47619047619048  ...    4
CP Random Forest Local                       90.47619047619048  ...    4
CP Quantile Net                                              0  ...    4
CP Asymmetric Quantile Net                                   0  ...    4
Quantile Net                                                 0  ...    4
CP Rearrange Quantile Net                                    0  ...    4
CP Asymmetric Rearrange Quantile Net                         0  ...    4
Rearrange Quantile Net                                       0  ...    4
CP Quantile Random Forest                                    0  ...    4
CP Asymmetric Quantile Random Forest                         0  ...    4
Quantile Random Forest                                       0  ...    4

[15 rows x 3 columns]
@@ done method=random_forest dataset=community seed=4 sec=150.0
community
Ridge relative error: 0.158510
Size: train (1595, 100), test (399, 100)
CQR RF: Percentage in the range (expecting 90.00): 90.225564
CQR RF: Average length: 1.566439
== SUMMARY == 
dataset name: community
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    4
CP Linear Local                                              0  ...    4
CP Neural Net                                                0  ...    4
CP Neural Net Local                                          0  ...    4
CP Random Forest                                             0  ...    4
CP Random Forest Local                                       0  ...    4
CP Quantile Net                                              0  ...    4
CP Asymmetric Quantile Net                                   0  ...    4
Quantile Net                                                 0  ...    4
CP Rearrange Quantile Net                                    0  ...    4
CP Asymmetric Rearrange Quantile Net                         0  ...    4
Rearrange Quantile Net                                       0  ...    4
CP Quantile Random Forest                    90.22556390977444  ...    4
CP Asymmetric Quantile Random Forest                         0  ...    4
Quantile Random Forest                                       0  ...    4

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=community seed=4 sec=134.8
concrete
Ridge relative error: 0.087332
Size: train (824, 8), test (206, 8)
CQR RF: Percentage in the range (expecting 90.00): 86.893204
CQR RF: Average length: 0.508130
== SUMMARY == 
dataset name: concrete
                                     Coverage (expected 90.0%)  ... Seed
CP Linear                                                    0  ...    4
CP Linear Local                                              0  ...    4
CP Neural Net                                                0  ...    4
CP Neural Net Local                                          0  ...    4
CP Random Forest                                             0  ...    4
CP Random Forest Local                                       0  ...    4
CP Quantile Net                                              0  ...    4
CP Asymmetric Quantile Net                                   0  ...    4
Quantile Net                                                 0  ...    4
CP Rearrange Quantile Net                                    0  ...    4
CP Asymmetric Rearrange Quantile Net                         0  ...    4
Rearrange Quantile Net                                       0  ...    4
CP Quantile Random Forest                    86.89320388349515  ...    4
CP Asymmetric Quantile Random Forest                         0  ...    4
Quantile Random Forest                                       0  ...    4

[15 rows x 3 columns]
@@ done method=cqr_quantile_forest dataset=concrete seed=4 sec=29.2
