personally I like Alert Manager -> Active Alerts -> Disable all alert actions
This will disable alert actions, but still allow the alerts to appear in the console during the maintenance.
[this is an obscure checkbox in the upper right corner of that screen]
Otherwise, yes, stopping the Alert engine service will do it.