So I was attacked by this Volkihar Vampire and thought he'd make a nice dead thrall which I could do despite there level being 48 because of my necromage perk. Now after animating my new pet I fast traveled away and when I arrived at my destination by thrall was now hostile to me. So I killed him and reanimated him again and fast traveled away again to see if he would once again turn hostile he did.

Thankfully this hasn't seemed to effected other potental thralls I tested such as bandits or forsworn. So I then went to a vampire lair and animated a blood vampire and a master vampire. And they thankfully remained my loyal servants. So I can for now assume this is limited to vampires titled Volkihar Vampire