I actually agree. What about the Silverhand there wasn't really a faction for them. It would have been neat to be able to join the other side. Or maybe they could have done what they did in the Fighter's Guild in Oblivion. Pretend to be a Blackwood company recruit.
They practically already took the idea that there differing factions the Silver Hand and the Companions, anyway.