I'm also often accused of being 'impenetrable' (that's an interesting concept), or being overly abstract. For me, abstraction is equal in many ways to simplicity. When you strip something down to its most basic components, it suddenly becomes more than those parts and each individual element can grow independently to be something quite different to where it began. I also appreciate that my reader is not an idiot and hope to treat them as an equal by providing enough complexity to entice the intellect, and offer enough of a platform to anchor to in order to avoid leaping too far (possibly appeal to the affect, maybe)--it's also important to me that I provide enough to speak directly and be understood. That said, if my work is understood in a way I didn't intend, I enjoy that, it becomes a point of extended experience and I never want to dictate what anyone should get from my work. There will always be points that I do want to make a deliberate statement, I choose to be less poetic in my language in such cases, or make use of more common connotations.
I understand you may feel that you fail if your poem goes misunderstood--that couldn't be further from the truth, unless you are dictating interpretation. Then I will say write pure exposition instead. But you don't want that; you wanted to write poetry, and you wanted to write a poem because you wanted to create and be expressive with language. Let your language express then. Look at what you've written as if it were a piece of expressive art. Take away the reality, any notion of reality and then dab it back in where it's needed.
I honestly feel this poem could work very well and that you approach your theme eloquently (to start), but you did lose me midway through for the reasons given. If those lists are more than just lists of artefacts, allow them to be that, anchor them, or taint them with some degree of connotation. Leverage the crux of your poem through conceit or phonics to express to me the importance of them. I'm not opposed to mundane interruptions, or things popping in out of the blue (Frost does it all the time)... and I don't need to know or explicitly be told why they're there, but I do appreciate a nod or a wink that I can capture and digest so that if I read it again, eventually I can understand or at least decide what I want to think about them.
Does that make sense?