It's clearly not that unimportant when you react as if I've just killed him myself.

[He waves a hand vaguely.]

The point is, you do care. It has ever been your greatest virtue and your deepest vice all at once. I'd wager you even care about the Warrior of Light to an extent, even though she is not the friend you once had. And because you care so much, because you cannot simply turn it off when it does not suit you, this is how things will continue. You just are not at the point where you can reconcile your complicated entwinement with the present world with your desire for the previous.