...but one pastor, even the lead pastor, doing an evil doesn't mean the whole church is faulty.

You're probably right. The problem I'm running into is religion's history of causing literally every issue you can think of, up to and including war and everything that comes with it. So while that church may not be faulty, our failure to not use religion as a wall to hide atrocities behind sorta makes it automatically on the wrong side of the fence. Unless it proves otherwise, of course. Which, I think, it has failed to do so quite remarkably.