Logistic Regression - Normalization does not change Attribute Weights

cem_akyuzcem_akyuz MemberPosts:5Contributor I
edited December 2018 inHelp

Hello,

I am new here and in general with statistics and data mining. Apologies if I am asking a really stupid question.

My question is about logistic regression and normalizing data. I have a data set with some columns skewed and have different scales. So I wanted to apply normalization (including centering, scaling and Box Cox transformation for skewness) prior to logistic regression. But instead I wanted to check to what extent normalization changes the results.

I see that normalization prior to logistic regression changes the coefficients however attribute weights are exactly same with and without normalization. Am I missing something here?

Attached you can find my design for the analysis. (Logistic Regression and Normalization added with default settings)

Best Answers

  • Thomas_OttThomas_Ott RapidMiner Certified Analyst, RapidMiner Certified Expert, MemberPosts:1,761Unicorn
    Solution Accepted

    Try outputting the PRE port on the Normalization operator, that will tell you how it's normalizing the data.

    sgenzer cem_akyuz
  • earmijoearmijo MemberPosts:270Unicorn
    Solution Accepted

    By default the operatorLogistic Regressionnormalizes the data (but uses the wordstandardizeinstead of normalize). Uncheck the option 'standardize'. It does make a difference to the coefficients whether you normalize or not. Check the process below







    <运营商激活= " true " class = "过程”兼容ibility="8.0.001" expanded="true" name="Process">

























    sgenzer cem_akyuz

Answers

  • cem_akyuzcem_akyuz MemberPosts:5Contributor I

    谢谢,当我删除框(正常化I do not need anymore as logistic regression has standardize in it) I could repeat the process with and without standardize option. Then I can see that attribute weights changed in each iteration.

    Thanks a lot!

    Cem

    sgenzer
  • wassdullullwassdullull MemberPosts:12Contributor I

    Hi, i wanted to have an explanation on logistic regression results from rapidminer. I wanted to know whether the p-values can be used to calculate odd ratios and how can it be interpreted.

Sign InorRegisterto comment.