I had a bounty for that cave then got the Boethia quest. So I figured, two birds, one stone, right? Wrong!
I killed the "Bandit Leader" the Bounty quest pointer was indicating, but didn't get a return to whoever gave me the quest message for reward. Then something weird happened when I shot an arrow at Boethia's champion. I somehow "missed", the champion went aggro on all the other bandits, and they went aggro on him, and he killed them.
One stab from my Blade of Sacrifice and he was dead.
But now I've got a bounty I can't collect. I've even gone back inside the camp, it was repopulated, and killed the new bandits there all over again and still no quest completion..
And to answer your question, yes, some of the ore veins were non-mineable and others were. Maybe the others just hadn't hit the reset time yet.
Next playthrough I do will see me complete bounties as soon as I get them.