Since Quicken has changed the naming convention for automatic backups to include the date/time. there does not seem to be a way to limit the number of backups retained. The current backup preferences options provide a link to the following help guidance:

Automatic backup files are no longer named or processed in this manner. Backup files will keep accumulating unless otherwise deleted. A revision should be provided and a way to set the number of backups should be restored.