It's not about the wins. It's about the following: 8 seed, missed NCAAT, 1 seed early NCAAT exit, last team into the NCAAT field, and now trending towards another lower NCAAT seed and early exit.
Winning 20 or 25 games in college basketball is meaningless if you aren't winning the "right" 20 or 25 games. And we haven't been, for the most part. You can schedule your way to 20 wins pretty easily, but if your record against Q1 opponents is bad at a blueblood program like North Carolina, your overall performance is likely considered to be subpar. This is coming from someone who is probably more "pro-keep HD" than most of the folks on this thread.