Is it possible to go from Skyrim to Hearthfire and not do all of
Skyrim ?

yes.

I work my way to Riften and nab some meade for the Jarl and build Lakeview right off the bat when starting new character.

You may need to do some work for a local Jarl, but you can start building your house right away after doing a few quests for them.