Sometimes people drift in and out of your life, and the real agony is fighting it