There's a way in, you'll have to jump from pillar to pillar across the broken bridges. Use the whirlwind shout to get across the gaps.
Edit: don't fret if you can't find your way in. There's nothing much but random loot.
Right. If it's the place I think it is, I was stuck there as well on my first play-through and ignored it. My second play-through and I noticed the pillars leading to a ledge. So basically you have to jump them in order to get to the ledge and get into that small section with the chest. I believe there's also a soul gem or ruby visible as well with a skeleton reaching for it or near it - if this is the place you're referring too, that's how you get to it.