To me the song is about letting go of safe familiar things. You are unsure if you can make it and you are leaving someone behind in a way.

You're telling them if they remember any of the bad times involving them that sooner or later that thought will pass.

Hugs you tight!