Like you said, Spamsickle, I think that would be the better way. I've used a single-camera scanner using the book-flip method - I scanned every even page, then flipped the book and scanned every odd page. One of the biggest challenges you'll face is consistent, correct camera positioning, which is crucial to reduce the amount of time you spend postprocessing the photos. It's probably not worth the amount of effort it would take to get the precision necessary to ensure the camera always returns to exactly the same position every time you finish pivoting.
I don't think you should underestimate the amount of time this will add to your workflow, either. The book-flip method is slow enough as is, and the camera pivot would increase the amount of time you're spending taking photos even further beyond that. It sounds like it would take a long time to finish imaging books that way.
The opinions expressed in this post are my own and do not necessarily represent those of the Canadian Museum for Human Rights.