It is wrong, in my opinion, to take the players with you. While it is true that he recruited them, he did so FOR the University, using money SUPPLIED by the University, offering scholarships PAID by the University.
They are people are are not owned by anyone, but if this was a matter of contracts law, they would be obligated to UA and NOT to him.