In our project we do not use user preferences. However, even if “Do not create user preference file” is checked, the userpref file and folder is still created. Using 2024.1.
This option only works if you also enable the “portable” option just above in the same settings page of HTML Executable.