Before i Finished the thieves guild quest line i turned in the Larceny Objects
Also I currently have the Skeleton Key.
The Larceny Objects i traded in for Coin were; (In this order)

Model Ship
Dwemer Puzzle Cube
Eye of Falmer

I then Took the Eye of Falmer back (From the Bookshelf)

Went and got the Bust of the Grey Fox, Turned that in Successfully.

Then went and got; (in this order)
Queen Bee Statue
Honningbrew Decanter
East Empire Shipping Map

After picking up the East Empire Shipping Map it said Quest Completed, and now the items are not Quest Objects anymore and can be dropped ect.
Trying to turn the 3 items into Delvin in The Ragged Flagon, theres no option to give it to him.

Hopefully this bug can be fixed.