How do I configure Vim to maintain the horizontal cursor position when scrolling with the <Page Up>, <Page Down>, etc keys?

You can reset the ‘startofline’ option to keep the cursor at the same horizontal location when scrolling text:

    :set nostartofline