Before you let go of Alt, look in the application switcher thing that comes up and make sure the right window is selected. Skyrim has a second window that is used for something.
On a similar note, it may help to note that Alt-Tab is generally problematic for games in general, and always has been, just so you don't fret over it too much.
