When LeBron is involved in your organization, your organization is held hostage by his ego. I also believe LeBron's basketball IQ is highly overrated, so him controlling your franchise isn't a good thing strictly from that standpoint.
When LeBron came back in 2014, the Cavs had Andrew Wiggins, Kyrie Irving, and some cap space. LeBron pushed to trade Wiggins for Love, and proceeded to use the open cap space to sign his veteran buddies. He had Blatt fired, and replaced with the joke-of-a-coach in Ty Lue, strictly because Lue would listen to LeBron. The loss in '15 was due to the injuries to Kyrie & love. The victory in '16 was improbable, and I'm thankful for it, but then Golden State adapted, going out and adding KD. Ironically enough, LeBron started the super team trend, and was ultimately defeated by the trend he started. Instead of wisely using any cap space we had to get younger, LeBron pushed for big contracts for JR & Thompson - contracts we're still stuck with while he's out in LA now. The constant drama that surrounded the team got real old, and we greatly underachieved, only winning 1 title. He never committed to Cleveland once he came back, and pulled this team/fan base through the mud throughout all of his contract crap.
Now we're sitting here, some saying the Cavs are going to suck, because LeBron failed to allow the Cavs to prepare for the future. If the Cavs are wise, they follow the Celtics model - hire a good coach (I've been saying for a while I'd hand Jay Wright a blank check to come coach the Cavs), establish a system, and build through the draft. Eventually, you'll have a product that will attract some key free agents. A team that nails those steps, as the Celtics have, will achieve more than what LeBron has achieved.
Edit: Side note. If you want to see how bad LeBron is as a GM, the Cavs now have the 2nd lowest title odds in the NBA since his departure. Pathetic. Good riddance.