College coaches most certainly do attend high school games. In the Columbia area I see, and often speak with, college coaches representing many colleges at local high school tournaments.

USC coaches from both sides show up frequently.