Another way to think about it is the magic in magic realism can't be separated from the story. Because the magic works as a metaphor for reality, and because the story gives the context for reality in the fiction, you can't disentangle the two.

In most spec fic, if you take out the story, the fantastical elements still make sense as standalone worldbuilding. The opposite tends to be true for magic realism.