Ways to correct class imbalances

There are several ways by which you can overcome class imbalances problem in a predictive model.

1. Adjusting Prior Probabilities

Prior probability is the proportion of events and non-events in the imbalance classes.  Using more balanced priors or a balanced training set may help deal with a class imbalance.

In CART, you can specify prior probability assigned to each class to adjust the importance of misclassifications for each class.
audit.rpart <- rpart(Adjusted ~ .,data=audit[,-12],parms=list(prior=c(.5,.5)))

2. Cost Sensitive Training / Loss Learning

It employs the misclassification costs into the learning algorithm. In a marketing predictive model, a false positive costs just one extra direct mail  while a true positive may lead to conversion worth $100. In a healthcare model, a false negative screening for tuberculosis could be destructive.
In cost-sensitive training, we assign no cost to correct classifications (Cost(TP) and Cost(TN). In other words, cost(TP) and cost(TN) are set to 0. We assign higher cost to FALSE NEGATIVE (actual event predicted as non-event) than FALSE POSITIVE as prediction to event is our objective.

Total Cost = (FN × CFN) + (FP × CFP)
loss <- matrix(c(0, 1, 20, 0), ncol=2)
audit.rpart <- rpart(Adjusted ~ ., data=audit[,-12], parms=list(loss=loss))
The cost of mis-classifying a positive example as a negative observation (FN) as 20 units and cost of mis-classifying a negative example as positive (FP) as 1 unit.

C5.0 algorithm has similar syntax to rpart by taking a cost matrix, although this function uses the transpose of the cost matrix structure used by rpart:

loss <- matrix(c(0, 20, 1, 0), ncol=2)
audit.rpart <- C50(Adjusted ~ ., data=audit[,-12], parms=list(loss=loss))

3. Sampling

You can perform oversampling of events i.e. reducing non-events so that ratio gets rougly equal or classes become less skewed.

4. Assigning large case weights to events

Increase the case weights for the samples in the minority classes. It applies to each observation.

Weights based on the size of the risk
audit$weight <- abs(audit$RISK_Adjustment)/max(audit$RISK_Adjustment)*10+1
audit.rpart <- rpart(TARGET_Adjusted ~ ., data=audit[,-12], weights=weight)
Case Weights : Rare Event Model
Spread the Word!
Related Posts
About Author:

Deepanshu founded ListenData with a simple objective - Make analytics easy to understand and follow. He has over 10 years of experience in data science. During his tenure, he has worked with global clients in various domains like Banking, Insurance, Private Equity, Telecom and Human Resource.

5 Responses to "Ways to correct class imbalances"
  1. Feedback: Keep writing this site. It's super helpful.

  2. Deepanshu thanks for the article, I just beg if could you please check the "Deepanshu" data frame as it is not recognized in R.

  3. Need to Complete all your Assignment? We provide high-quality assignment writing services and ensure good grades. Our assignment helper capable to Provide best assignment help to students in all the subjects at reasonable prices online only at New Assignment Help .Get Best Discounts .

  4. Get Assignment Help from a reliable UK writers at affordable price. Avail Best Online assignment help at 25% OFF, Quick Delivery, 24/7 Free Assistance .Get Assignment Help London online by expert writers to secure good grades. Assignment Ace offers finest assignment writing service with unlimited discounts.

  5. Are you looking for Assignment Help online? We are here to provide you the best assignment help in Australia at affordable prices. NAH also provides different types of Assignments like Cheap assignment help, Nursing assignment help, Assignment Help Melbourne, Assignment Help Sydney etc.


Next → ← Prev
Love this post? Support Us!
Buy Me A Coffee