Its a balancing Act. At the moment most attending fans, and plenty on the net- are more happy with the match experience than they are unhappy with the regime, so continue going.
At what point these or a majority of fans decide Ashleys version of NUFC is not good enough for them, is hard to judge.
We had the keegan debacle- and some shockingly terrible runs under Pardew, but still people were willing to defend both Pardew and Ashley.
It might need to get a whole lot worse before most fans decide the match day experience is no longer an enjoyable one.