How to fix it.

When you create or edit the Bill Reminder, under Optional Settings (at the bottom of the pop-up window) where it says "Remind me at nn days...", select the "change" link and it'll open another pop-up window that will allow you to select "Automatically enter the transaction into the register nn days before the due date."