How feasible is it to wear elven armor all throughout the game, nothing else?

You can wear anything throughout the game. It would probably be wise to put some perks into smithing and enchanting to give you the edge you need, though.

Any armor can hit armor cap. Thus any armor is feasible.