"Science fantasy" is a phrase like "diet bacon" or "racing couch". All it does is confuse and obfuscate.
Speculative fiction fits, but only because it could be used to describe ANY fiction work. What if the Downtown family built an Abbey?
Sometimes genre comes down to who wouldn't want to read your story. Many sci-fi people don't care for the sword and sorcery trappings, and if "magic" is explicit they aren't going to want to read it.
Many fantasy people don't care for the modern trappings of sci-fi, and would hate to watch something so obviously sci-fi as Star Wars just to get to a couple of weakly fantasy elements.
"Speculative fiction" seems to mainly be a term used when the events in the book are impossible in a way that can't clearly be assigned to the wonders of science or the common elements of fantasy, but also isn't "magical realism", where the magical elements aren't tools for the characters but uncanny additions to an otherwise regular world - like Kafka.
If I hear "dragon, wizard, magic, prophecy, etc" used in their most common meanings, that's going to be fantasy unless someone has a really good explanation why it shouldn't be. And if it has "space, hyperdrive, robot, laboratory, laser gun, etc" that's science fiction - no matter how sloppy of "fantastic" some elements would be.
No one mistakes Dune for fantasy, despite seeing the future, swordplay, mystical groups and magical substances because all of it is supposed to be grounded in an explainable reality that comes from our own.
If the OP wants to write something that is science fiction with magic and doesn't want it to be called "fantasy", then fantasy cue words like "magic" ought to be avoided and terms like "infinite improbability event" used instead.