I'm in the very beginning and followed Hadar into the barracks, by chosing him did I make a desision that affects the rest of the game or just the opening?
No, that's the beauty of Skyrim. You can choose who to join when you are good and ready! Now, talk to the smith in Riverwood, make some new armor, go clear out the bandits in the mine, to get some experience, oh and stop by the Guardian Stones and choose your first sign (before you get to Embershard Mine and Riverwood).