Statistical tests on model trained on different datasets

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Statistical tests on model trained on different datasets

NehaBologna
Hi

If I have one dataset , then we can perform statistical tests as:

d=read.csv("dataset1)

svm <- train(bug ~ ., data = tr,
            --
---
getTrainPerf(svm)

rf <- train(bug ~ ., data = tr,
            --
---
getTrainPerf(rf)

wilcox.test(svm$resamples$RMSE, rf$resamplesRMSE)

But if we have another model trained with another dataset

dd=  read.csv("dataset2")

gbm<- train(bug ~ ., data = tr,
            --
---
getTrainPerf(gbm)

How can I perform wilcox test between rf and gbm, which are trained on
different datasets.

Thanks

        [[alternative HTML version deleted]]

______________________________________________
[hidden email] mailing list -- To UNSUBSCRIBE and more, see
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.