If the referee clearly HEARD the comment and did NOTHING ...
Shame on him.