Weka model accuracy unknown...or random?

Fred12

hi,

I had previously problems with retrieving Weka models from Repository, but when I disabled several extensions, it worked afterwards...

I now have the problem that some Functional Tree operator models from Weka like W-FT and W-LMT bring me accuracy unknown when applying on test data:

I have the sa me problem with W-Rotation Forest and W-Random Forest brings me just 33% arbitrary random performance...

anyone knows what the problem is?

Thomas_Ott

Weka models? Do you mean models trained using Weka algorithms in RapidMiner and then stored in the RapidMiner format?

I usually never have a problem and need unload extensions. What if you use a RapidMiner Random Forest as a test to see if you get any P/R results?

Fred12

I get the usual good / Appropriate results with any Rapidminer models or operators... Random Forest model in Rapidminer works nice...

but when I train Weka Random Forest model and then store it in repository, retrieve it and test it again on test data the results are weird...

edit: I Just noticed, there is a "Read Weka Model" operator, but it seems not to work, at least it cannot read models stored from the repository... But I don't know how to else read / retrieve them, as there is no "Store Weka Model" operator... is that the reason the model doesn't work or does it not matter how to retrieve or store the model? Is the reason more the Rapidminer format / framework?

Thomas_Ott

I'm not sure why it's doing this but I can confirm something's not right. I just did a test with W-Random Forest, stored the model and tried to retrieve it. I get this.

Let me ping someone in development.

< portSpacing端口= " sink_through 1”间隔= " 0 " / >

















The model created in the Training step is applied to the current test set (10 %).<br/>The performance is evaluated and sent to the operator results.

A cross-validation evaluating a decision tree model.

Telcontar120

I can confirm that I have experienced a similar problem with Weka models in recent Studio releases. I am not sure which version this orginated with, but it is problematic. I have had a similar problem where even trying to review the Weka model in the "model" view doesn't work, it just results in an endless-spinning-hourglass. It would be great to have this corrected ASAP.

michal_moskal

Has this issue been resolved now? I think I can still reproduce this in RapidMiner 8

sgenzer

Issue still exists and and reported to dev team. I will update as needed.

SG