My justification for calling the monkey chants racist was the fact that Herschelle Gibbs was found guilty of racism for calling Pakistani fans 'a bunch of monkeys.'
I heard the Herschelle Gibbs is actually of recent black African decent. Not confirmed though.