In Test mode, the keypad will not disarm the system. Only the App will. Will this non-functionality be the same when I exit Test mode? Are there instructions that cover day to day use? (Not the the one that covers setup.)
In your starter kit box is an instruction sheet that has information on using the keypad. I just set mine up a few days ago in test mode and the keypad works to arm/disarm the system and changes between home and away. Are you set to use a PIN to change modes? You need to enter the PIN, press the check mark and then select the mode.