Emergency Button on HMS Keypad Not Triggering

I just set up the HMS and got everything paired and working as intended except for the emergency button on the side of the keypad. If I short press, it says hold longer for the emergency button to work, when I hold it longer it does not trigger anything. I tried it with and without entering the pin and while it was armed or disarmed. Is there a setting I am missing? I am using it in test mode right now.