I've been to the games in Dayton before. It's actually a fun part of the tournament because all of the matchups are against equal seeds, so it's far more competitive than most of the opening games later in the week. The City of Dayton rolls out the red carpet, and the UD fans pack the place for all sessions. It's a lot of fun.
Generally, the 16 vs. 16 game on both Tuesday and Wednesday night are teams that won conference tournaments, but had really bad records, or sometimes even losing records. So, to your point, I think it would probably be nearly impossible for us to avoid a 16-seed play-in game, unless there was a lot of really bad teams that pulled tournament mega-upsets in numerous conferences.
The good news is that I'm guessing this would be the closest venue for us to travel.