A Guide To Normalized Cross Entropy
What Is Normalized Cross Entropy? Normalized Cross Entropy is a modified version of Cross Entropy that takes into account a baseline solution or “base level.” It essentially measures the relative improvement of your model over the selected baseline solution. The very popular Practical Lessons from Predicting Clicks on Ads at Facebook paper popularized the concept of Normalized Cross Entropy (NCE) as a metric for binary classification problems. Although the reasons for including this metric in the paper were likely because they didn’t want people to know the actual cross entropy of their model, it can be a useful metric....