When you're in this area (or outside with the ship) some of the sound has been taken away like footsteps, sword swinging, shout effects etc. The only sound you can hear are the words and grunts your character makes. If you go closer to the Japhet's Folly fort, there is a never ending explosion of arrows from boats in the distance. This is probably why some of the sound has been taken away because there is so many loud explosions going off at once.
If you enter the ice cave on the other side of the Japhet's Folly fort and then go through another door, that door you went through disappears and there is no way back because debris is blocking your path further on.
If you try swim around Japhet's Folly fort then you may notice that there is invisible water and you can look under.
These are all the glitches I know for Japhet's Folly. I really need this to be patched because I don't want to start over when I have 220+ hours on my character and I want to play the Dragonborn DLC that will be coming.