It's a matter of trust. Terry took a lot of advice from a lot of people after he bought the club, and I suspect he feels betrayed. These outsiders led him astray. Snakes in the grass. Deceivers.
Kevyn has been with him a long time, and seems to be the only person he thinks isn't playing games with him. He's never going to fire the guy, not in any way that fans want. They may "reorganize the front office", but it'll always be in a way that Kevyn is able to save face.
As long as Terry owns this team, KA is going to be around.