The keychain password is separate from your keys.
You can remove the app, and reinstall it reentering your keys if you don't have the keychain pass word.
You can also download a file from keychain that will hold your keys so that reinstalling is really easy.