There are often requirements for a password, such as minimum and maximum length, first character must be a letter, at least one character should be a number, no symbols, etc. They vary from site to site to app to kingdom come.
It has been a while since I set up Game Center, so I don't remember for sure, but pay close attention to the dialogs and see if they say anything along those lines.