If you mean parts of the book where there isn't nonstop explosive-style action or fast-moving action, then I think that those are necessary every once in a while. I like a book where the pace is varied and there are moments when the characters can just talk for a second or the likes. It's got nothing to do with books really, but the thing that comes to mind is a quote from Alain Boublil and Claude-Michel Schonberg, the creative team behind the musical 'Les Miserables'. I remember them saying that they turned the Thenardier characters into the comic relief for the musical, whereas they weren't in the book, so that the show wasn't three hours of solid misery, as people wouldn't want to sit through that. Whether they achieved their goal is a matter of opinion but I agree with the overall reasoning.
Trick is, I think, to make sure that although those sections are slower that they are still interesting, in that they still advance either the plot or the characters or both in some way. Personally I find those 'breaks' in the action quite useful places to reveal secrets about the MCs, for instance.