If the RPI doesn't count them, they don't hurt our resume at all. What does quantifiably hurt us are the 300+ RPI teams we play, the only problem is that most of the worst teams that hurt our SOS are in the MAC West and we don't have a choice.
Also, remember that we originally were to open at Michigan State, but they backed out late and left us scrambling and the only team who was willing to fill the spot was Milliken. Replace Milliken with MSU and our schedule looks pretty decent with games against the Spartans, Temple, Dayton, Miami, CSU, and Minnesota all on the road.
I also think what hurt us was not picking up a single marquee win against the good teams that we actually did play. Maybe we should worry about beating at least one of them before we try and load up on even stronger teams.