Pretty much any hollow-point weapon should do the trick nicely. If you have access to gauss rifles, you must be over level 10? In that case there should be good weapon comming your way soon, such as the anti-materiel rifle, which with incendiary ammos will pretty much 1 hit any ghoul with enough guns and a slid sneak attack critical in the head.
However, it's expensive to kill them that way.
A weapon that doesn't consume nearly any valuable ammo is the unique le kids BB gun. A sneak attack does great damage at the cost of 1 BB ammo.
Also, shotguns tend to be good against them, such as dinner bell or riot shotgun because they have no damage threshold, meaning the full force of the bullets will go straight through. A combination of a first attack of the BB gun and then killing with the shotgun consumes very little ammo-and is easy to come by.
For your gauss rifle, it's worth recycling the drained ammo you get, with high enough science. You'll also get free energy weapon ammo every now and then from the brotherhood of steel, if you find them and choose to be a friend with them.