Alerts are created and modified via Distribution detail page.
You can navigate to the distribution detail page either via Distribution search or the Alert status page.
In the Distribution detail page you will find the section Alert configuration - read this to understand the detailed options for setting up alerts.