Yes, you are just being paranoid. In magazine publishing, editors have more power, but in book publishing, the author rules. I know of only one exception, a publisher I worked for years ago who wrote into his contracts that he could make any change he liked in the manuscript, authors have final say. The words are theirs, after all. Editors will suggest, and a wise author will listen to what seems reasonable, but in the end, it's your call. Your name on the front cover, your words inside. The exception I mentioned was pretty bad, too, because at least one author complained that changes made in page proof, about which he hadn't been consulted and with which he heartily disagreed, were made at his expense. Such contracts are so nonstandard as to be ridiculous, but that's why it pays to read the fine print.