What happens? I have filled the right side(Heavy Armor) of the Smithing perks, but will I be ale to improve even more if I fill the left side?

No. Each perk does what it says and only what it says. the only thing picking a side affects is whether you can make light or heavy armors (Excluding dragon perk which allows both versions)