The Grand Magic Games was said to be around for years, but they don't seem to have any referees. They don't have anyone who's able to sense that someone from the crowd got rid of Lucy's spell and, that was a huge one.
What's to stop a guild from having a bunch of people uses support magic on one of their wizards while they're in battle?