Just because you don't put perks in a skill, doesn't mean you can't use it.
Example: I may occasionally use a shield...even though I do not intend to put perks into the Block tree.
Example 2: You can fully perk in light armor...then put on heavy armor if that is what you wish.
I can give examples all day that may seem dumb or pointless, but the point is PERKS DO NOT EQUAL RESTRICTIONS.
Thank you for your time.

HOWEVER, the great one said this
"There are so many perks and the power really comes from the perks, we wanted to get it going faster. "
-Todd Howard
You can have 100 in archery but without those perks the power doesnt show up. They are going to balance the game based on people with 4 or 5 points in perks.
So this is really moot issue, sure you can level up a skill, but if you cant perk that skill destruction isnt going to be worthwhile, that two handed axe isnt going to cut it.
If a 2 handed daedric axe does 25 points with no perks and you have to hit a Vampire Night Stalker 17 times without perks to kill it is it really viable?