And while there have been few rumblings in Western New York that his job might be in jeopardy, Ruff is speaking like a man who knows the end might be just around the corner.