Honestly, as a Colts fan, I'm disappointed he didn't say. On the same hand, I'm happy that Jacksonville keeps Del Rio around too.
Fisher, at one time, was a legitimate threat to do work in the AFC South [George, McNair], but he's lost touch with his team, from an outside perspective, on a very public scale at times. I don't think Fisher was ever really ready to hand this team over to Vince Young, something that I think a lot of Titans fans grew to resent him over.
Either way, I would have loved to have kept him, I don't think he's got the tools or coaching ability to keep up with Peyton Manning, much the same as Jack Del Rio, which is really all that matters anymore. Caldwell's just a puppet. This is Peyton's division.