Am I worried? A little. There are a lot of crazy people out there. But I'm sure that those of them who have been threatening and shouting their hatred are all talk. I don't think anything bad's going to happen. I just don't discount any possibility, no matter how awful, no matter how insane.
Call it paranoid, call it pointless, call it whatever you'd like. It can't be helped.