Why not? We already ban or regulate a variety of things that are abused by a 'few'. The same logic would apply to recreational drugs, guns or any number of other things that are abused by a relatively small number of people.