Maybe first year refs could be assigned to games that have no bearing on playoffs (i.e. JV and middle school matches). Save the better refs for the Varsity matches. As the younger refs get more experience, allow them to ref a few Varsity matches.

Have a yearly exam and take into account their score and allow the lead official to give them a grade and the coaches. The lower scores receive less Varsity matches. It's a starting point