One thing about this term - I have always thought of it exclusively as what the writer presents to the reader in the text - and that all the stuff we might do outside of the text is - whatever it is, practice, rough-draft, imagining. But 'world building' for me is what we give the reader so that s/he can immerse in the setting to the degree necessary for the story.