Hi Michael
On what page you are seeing the button ? I believe that button is not available on registration form. It only available on Event detail page.
If you want to remove that button, simply go to Events Booking->Configuration, click on Options button in the toolbar. Choose the public group, find the Manage Registrants, set it to Denied.
After that, the button will be removed from front-end.
Please do it and let me know the result !
Tuan