So, I likely shouldn't worry about it until I get to the point of having the swords you mentioned? When can I finally start getting some better equipment, for that matter? Straight swords are just incredibly rare, it seems, and I've yet to find any new armor, at all. I've completed the entire Stonefang level and I'm nearly done with the Boletarian Palace, but I'm still using the default armor, my default small shield, and my default straight sword (with some modifications).
About the best straight sword you can find outside the ones I mentioned would be the Knight Sword. You can buy one from the Dregling merchant in 1-3, or find one somewhere in 1-4.
If you're up for a challenge, you can try killing Old King Doran; that can net you one the best suits of armor in the game (Ancient King's Armor) if you're male, as well as one of the best rings. He's tough, though, can kill you in one hit, and resists everything you can throw at him, so you might not be up to it yet. That, and it can make you feel kinda' like a jerk doing so. If you're female, you can try to nab the Binded Armor, but that requires getting Boletaria Palace's Tendency to Pure White, and if you don't mind changing your weapon of choice up, there's a cool axe to get which requires getting Boletaria to Pure Black. Both these methods also lead you to getting a free set of Brushwood Armor without killing anyone good, but it'll be a while before you'll ever be able to use that set competently.
Regardless, you should definitely head for Latria. There's an NPC there that can teach you spells (Sage Freke). And I guess while we're at it, there's an NPC in Boletaria that can also teach spells (Yuria), who you should be able to find right now.