To me, keeping the "big" clothes is giving yourself permission to get big again. Why not? You have clothes to wear if you do. I would toss them in a heartbeat.