I then got the land from Falkreath and got another Alikr looking housecarl. I tried the same thing, gave her armor and weapons and then dismissed her. She would not leave me either.
Well I then took a non-housecarl follower and dismissed them, and they left like they are suppose to.
Also I can't be the only one tired of walking into my OWN HOME and being greeted by my steward "You lost?"
"No I'm not lost! And shouldn't you be sleeping in the stable with the horse or something?!"