» Tue Jun 05, 2012 5:03 pm
Dwarven Oil appears in shops, albeit in small quantities. If you plan to use it regularly, hit up 2-3 Dwemer Ruins and you'll have all you'll ever really need.
Spriggans, for some odd reason, do not have the Sap in their Death Item list; the only place I know of that has a guaranteed sample is the Alchemy section of the upper floor of the Hall of Countenance in the Mages' College. It does respawn, but it's on the 30-day timer. It can also be found in random loot, especially when fighting mages.
Jazbay Graqes can be found in large quantities in the steam fields between Kynesgrove and Steamcrag Camp; if you are diligent about checking flat surfaces, you can get up to 50 per pass. This is also a good source for Creep Cluster and Dragon's Tongue.
Except for Human Hearts and Flesh, all the rare items mentioned by the OP can be bought in Alchemy shops provided you have the Merchant perk. They also sell Daedra Hearts, but they're classed as Rare so are often not in stock; when they are, you can get 1-2 per shop.
Speaking of Hearts and Flesh: whoever decided not to put them in the Human races' Death Item lists needs a good beating, as that should have been a no-brainer.
As for the most common ingredients: Salt Pile and Juniper Berries, by a large margin. in one pass around the map, while checking every barrel and plant, respectively, you can get well over 200 of the former and 150 of the latter, if not more. This is especially true if you help a couple of people in Riften*, since doing so removes the 'Steal' label from the Fish Barrels around the Fishery, from which you can then get Salt Piles (and various fish) in bulk lots.
*Any two or more people will do, it seems, as that gets you in good there; From-Deepest-Fathoms (wanders around outside the Fishery) sends you into a Dwemer Ruin (Oil, ingots, scrap to smelt), and the blacksmith wants Fire Salts (10 of them), which you'll find in Alchemy shops, so those are probably the best choices.