I don't think the accusations did him in. I think it was the assumed/ implied guilt by Goodell giving him 6 games suspension when his own investigator told him there was nothing there. Once all is said and done, I still think he has a civil case against Goodell for libel and slander - I am not a lawyer so maybe a legal case is not there but Goodell cost him a ton of money with that suspension.
Also recall that Jerry was feuding with Goodell in an NFL power struggle.
Goodell showed him who the real boss was....thanks to one or two other owners.
"Oh building a champion team now is ya? The current NFL rushing champion gonna sit almost half the season,".
Despite dropped charges, lying "victim" by testimony of friends, and Goodell's own FEMALE investigator. That is some serious BS right there.