CRAN Package Check Results for Package mlr3benchmark

Last updated on 2026-08-09 06:52:15 CEST.

Flavor Version Tinstall Tcheck Ttotal Status Flags
r-devel-linux-x86_64-debian-clang 0.1.7 6.74 68.18 74.92 ERROR
r-devel-linux-x86_64-debian-gcc 0.1.7 4.50 51.59 56.09 ERROR
r-devel-linux-x86_64-fedora-clang 0.1.7 5.00 47.13 52.13 ERROR
r-devel-linux-x86_64-fedora-gcc 0.1.7 5.00 45.98 50.98 ERROR
r-devel-windows-x86_64 0.1.7 9.00 76.00 85.00 ERROR
r-patched-linux-x86_64 0.1.7 6.54 62.83 69.37 ERROR
r-release-linux-x86_64 0.1.7 6.40 63.46 69.86 ERROR
r-release-macos-arm64 0.1.7 2.00 21.00 23.00 OK
r-release-macos-x86_64 0.1.7 5.00 84.00 89.00 OK
r-release-windows-x86_64 0.1.7 9.00 76.00 85.00 ERROR
r-oldrel-macos-arm64 0.1.7 OK
r-oldrel-macos-x86_64 0.1.7 4.00 59.00 63.00 OK
r-oldrel-windows-x86_64 0.1.7 12.00 98.00 110.00 ERROR

Check Details

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > base::assign(".ptime", proc.time(), pos = "CheckExEnv") > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("pima", "spam")) + learns = lrns(c("classif.featureless", "classif.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Warning in data(list = id, package = package, envir = ee) : data set ‘PimaIndiansDiabetes2’ not found Error in UseMethod("as_data_backend") : no applicable method for 'as_data_backend' applied to an object of class "NULL" Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend Execution halted Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-patched-linux-x86_64, r-release-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [8s/11s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [06:52:34.184] [mlr3] Running benchmark with 18 resampling iterations INFO [06:52:34.950] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [06:52:35.120] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [06:52:35.226] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [06:52:35.332] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [06:52:35.430] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [06:52:35.472] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [06:52:35.514] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [06:52:35.557] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [06:52:35.603] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [06:52:35.648] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [06:52:35.692] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [06:52:35.739] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [06:52:35.788] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [06:52:35.844] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [06:52:35.901] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [06:52:35.959] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [06:52:36.016] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [06:52:36.074] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [06:52:36.187] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-debian-clang

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [5s/7s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:17:56.922] [mlr3] Running benchmark with 18 resampling iterations INFO [18:17:57.275] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:17:57.333] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:17:57.376] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:17:57.414] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:17:57.466] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:17:57.542] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:17:57.577] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:17:57.624] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:17:57.654] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:17:57.688] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:17:57.723] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:17:57.782] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:17:57.842] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:17:57.882] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:17:57.921] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:17:57.964] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:17:58.015] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:17:58.068] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:17:58.126] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-debian-gcc

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("pima", "spam")) + learns = lrns(c("classif.featureless", "classif.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Warning in data(list = id, package = package, envir = ee) : data set ‘PimaIndiansDiabetes2’ not found Error in UseMethod("as_data_backend") : no applicable method for 'as_data_backend' applied to an object of class "NULL" Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend Execution halted Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64, r-release-windows-x86_64, r-oldrel-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [5s/12s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [17:04:39.154] [mlr3] Running benchmark with 18 resampling iterations INFO [17:04:39.952] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [17:04:40.070] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [17:04:40.144] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [17:04:40.215] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [17:04:40.289] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [17:04:40.356] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [17:04:40.423] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [17:04:40.491] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [17:04:40.559] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [17:04:40.627] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [17:04:40.703] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [17:04:40.791] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [17:04:40.860] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [17:04:40.939] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [17:04:41.026] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [17:04:41.109] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [17:04:41.189] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [17:04:41.269] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [17:04:41.364] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-fedora-clang

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [6s/14s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:09:03.421] [mlr3] Running benchmark with 18 resampling iterations INFO [18:09:03.777] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:09:03.880] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:09:03.939] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:09:04.002] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:09:04.065] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:09:04.126] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:09:04.205] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:09:04.296] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:09:04.386] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:09:04.468] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:09:04.572] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:09:04.664] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:09:04.755] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:09:04.874] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:09:04.976] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:09:05.086] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:09:05.192] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:09:05.297] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:09:05.417] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-fedora-gcc

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [7s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:24:37.798] [mlr3] Running benchmark with 18 resampling iterations INFO [18:24:37.993] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:24:38.061] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:24:38.109] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:24:38.159] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:24:38.222] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:24:38.280] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:24:38.336] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:24:38.382] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:24:38.428] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:24:38.470] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:24:38.517] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:24:38.565] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:24:38.600] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:24:38.645] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:24:38.685] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:24:38.738] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:24:38.779] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:24:38.819] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:24:38.862] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [7s/10s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:13:44.470] [mlr3] Running benchmark with 18 resampling iterations INFO [18:13:44.901] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:13:45.020] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:13:45.086] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:13:45.154] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:13:45.261] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:13:45.347] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:13:45.424] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:13:45.466] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:13:45.512] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:13:45.568] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:13:45.664] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:13:45.733] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:13:45.785] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:13:45.840] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:13:45.900] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:13:45.976] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:13:46.065] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:13:46.127] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:13:46.203] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-patched-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [8s/11s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:18:23.218] [mlr3] Running benchmark with 18 resampling iterations INFO [18:18:24.024] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:18:24.133] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:18:24.191] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:18:24.265] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:18:24.331] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:18:24.376] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:18:24.420] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:18:24.475] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:18:24.523] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:18:24.571] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:18:24.635] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:18:24.730] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:18:24.797] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:18:24.854] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:18:24.926] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:18:25.040] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:18:25.124] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:18:25.199] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:18:25.345] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-release-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [6s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [16:07:40.055] [mlr3] Running benchmark with 18 resampling iterations INFO [16:07:40.305] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [16:07:40.363] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [16:07:40.411] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [16:07:40.454] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [16:07:40.504] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [16:07:40.537] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [16:07:40.569] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [16:07:40.620] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [16:07:40.668] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [16:07:40.707] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [16:07:40.753] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [16:07:40.796] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [16:07:40.831] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [16:07:40.877] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [16:07:40.930] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [16:07:40.986] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [16:07:41.034] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [16:07:41.085] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [16:07:41.149] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-release-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [10s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [06:28:17.590] [mlr3] Running benchmark with 18 resampling iterations INFO [06:28:17.853] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [06:28:17.965] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [06:28:18.027] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [06:28:18.090] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [06:28:18.171] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [06:28:18.232] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [06:28:18.303] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [06:28:18.371] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [06:28:18.443] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [06:28:18.510] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [06:28:18.587] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [06:28:18.643] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [06:28:18.685] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [06:28:18.745] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [06:28:18.825] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [06:28:18.906] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [06:28:18.986] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [06:28:19.076] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [06:28:19.163] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-oldrel-windows-x86_64