They keys should exist. You can't enter the password directly since its encrypted and decrypted by mcebuddy.
You can test it manually. Just press stop on the GUI page change the conf file and press start. You don't need to stop the service. Each time you press start on the GUI page the configuration is reloaded.