Some errors are more costly than others; the way your model learns should reflect that

George Orwell’s novella Animal Farm includes the memorable line…

all animals are equal, but some animals are more equal than others ¹

Orwell may have been referring to hypocrisy, power, and privilege in society, but if you replace the word animals with errors, it starts to become very relevant to machine learning.

Now that I’ve finished pretending to be well-read, let’s get more specific.

#machine-learning #loss-function #data-science #tensorflow