Poor Color Memory
There is a reason why humans have a fairly poor ability to remember colors. According to this research, we do a better job remembering colors that are close to the common, main color groups, than those on the edges - the in-betweem colors.
This article explains some of this:
Here's a link to the research paper itself: http://psycnet.apa.org/psycinfo/2015-22398-001/study