to fall asleep gradually.

I was just drifting off when the phone rang. He felt himself drifting off to sleep.