1h and shield. No problem. You don't need to take every perk. 5 ranks of each of the 1st perk would serve well I think.
Sneak. No problem. Perks help, but you can probably get by with the first perk "Stealth" with a few ranks.
Magic. Depends on what you want to be. You can focus on destruction and pick the perks to lower magicka cost plus the augment.
Light Armor: No problem. pick Agile defender ranks for protection.
Listed above might take 20-25 perks out of 50. More if you pick up other magic schools. Maybe a few in archery or the sneak archery damage perk and possible leveling smithing a bit to upgrade armor and weapons with the "twice as much" bonus perks. But you don't have to go overboard with it.
Every situation is different and others are correct as you won't be as tough as a specialized character. And you probably won't make it on Master difficulty. But I think you can have a good time with a viable build. Heck, most of my mages have a pretty decent sneak skill and I don't have perks.
If you do pick up some of the later perks (like sneak's 15X dagger damage perk) you might end up using only that style as it becomes very effective. Hence why so many people specialize.