...
Use the Pause link in the Email message that you receive. After clicking on the link you will be taken to a screen that confirms notifications have been paused.
...
Limitations of notification pausing with alert rules
Currently the “Only alert if condition remains for…” and “X Readings in a Row” rules are not compatible with our notification pausing feature. This is because the device exits the alert state (thus resuming the paused .
...
notifications) as part of the calculation of these rules.
Your best option to control notifications with this these rules present would be to temporarily disable the alert.