If he is meddling and not letting the GM or anyone else do what they think is right for the franchise then he deserves criticism. If you don't trust your baseball people enough to let them make decisions, then fire them. If you want to make your own decisions, then fire them, let it be known you're making the decisions and be prepared for either praise or backlash based on how the team does.