You try non-violence first, so you can say that you tried. If they continue to bring you violence, you must give it back to them, because it is the only thing they will understand.