Detect Non-Linear and Non- Monotonic Relationship between Variables

In linear regression analysis, it's an important assumption that there should be a linear relationship between independent variable and dependent variable. Whereas, logistic regression assumes there should be a linear relationship between independent variable and logit function.

How to check non-linearity

Pearson correlation is a measure of linear relationship. The variables must be measured at interval scales. It is sensitive to outliers. If pearson correlation coefficient of a variable is close to 0, it means there is no linear relationship between variables.

Spearman's correlation is a measure of monotonic relationship. It can be used for ordinal variables. It is less sensitive to outliers. If spearman correlation coefficient of a variable is close to 0, it means there is no monotonic relationship between variables.

Hoeffding’s D correlation is a measure of linear, monotonic and non-monotonic relationship. It has values between –0.5 to 1. The signs of Hoeffding coefficient has no interpretation.
If a variable has a very low rank for Spearman (coefficient - close to 0) and a very high rank for Hoeffding indicates a non-monotonic relationship.
If a variable has a very low rank for Pearson (coefficient - close to 0) and a very high rank for Hoeffding indicates a non-linear relationship.

Criterion to eliminate irrelevant variables
If a variable has poor rank on both the spearman and hoeffding correlation metrics, it means the relationship between the variables is random.

SAS Macro to detect non-monotonic relationship
Love this Post? Spread the Word!
Comment and share to motivate us to write more!
About Author:

Deepanshu founded ListenData with a simple objective - Make analytics easy to understand and follow. He has over 8 years of experience in data science. During his tenure, he has worked with global clients in various domains like Banking, Insurance, Telecom and Human Resource.

Get Free Email Updates :
*Please confirm your email address by clicking on the link sent to your Email*
Related Posts:
9 Responses to "Detect Non-Linear and Non- Monotonic Relationship between Variables"
  1. This comment has been removed by the author.

    ReplyDelete
    Replies
    1. Spearman correlation measures monotonic relationship. When you say a variable having high spearman rank, i am assuming it's correlation value is high or moderate. It means the association is monotonic. Hope it helps.

      Delete
  2. Additionally, an employer can require a polygraph test if he or she has a reasonable belief that an employee is involved in gross misconduct in the workplace lie detectors

    ReplyDelete
  3. Psychologists or guidance counselors in schools however are people who may have good relationships advice, especially for teenagers.  what to talk with a girl

    ReplyDelete
  4. This comment has been removed by the author.

    ReplyDelete
  5. This comment has been removed by the author.

    ReplyDelete
  6. Sheet which I have downloaded is password protected. Kindly provide password

    ReplyDelete
  7. Eventually or other, your own email Id may must be given or maybe a contact phone number… simply restrict yourself to that.
    http://www.seksitreffit.cam

    ReplyDelete

We have Zero Tolerance to Spam. Comments with links will be deleted immediately upon our review.

Next → ← Prev
Scroll to Top