Due to how the game is presented, you just have to find creative ways to workaround certain issues.
For example, I wanted Dawnbreaker and Spellbreaker for my Paladin, but these are Daedric artifacts. However, if you really look at the quests and what they entail, you are actually ridding the lands of evil. At the same time, I wanted the Ebony Mail, but I couldn't justify the means in that quest.
For Speech, the biggest thing to do here w/o exploits or focusing on looting would be Alchemy. Concoct a bunch of potions and sell them off, then use that money to buy more ingredients for more potions. As long as you keep points out of the left side of the tree, and only put one point in the base perk, you should be spending about as much as you are making, evening things out. To get rid of some money, just buy ore and ingots and sell them back, which will also contribute to your Speech. If you are using Dawnbreaker, another good money sink would be to buy Soul Gems to refill the enchantment use bar thing (as you cannot pay anyone for the service), since absorbing souls is pretty much a no-no.

Each person plays their Paladin a bit different. For me, I'm ridding the land of the Undead and, more specifically, the Dragon Princes (except for the one tied to the MQ). However, I still help those in need of assistance, be it by eliminating bandits that are threatening the townsfolk or keeping an eye out for specific books or instruments.