Remember that neo-Nazis too are guaranteed freedom of speech and assembly in a liberal democracy. It only breaks down when they are responsible for hate speech against any other group (Blacks or Jews) and/or inciting violence. Remember that they marched in Skokie, Ill, and the official Jewish Community recognized their right to march. I well remember in the 1970’s when the neo-Nazis came from their HQ in Virginia to march in Washington DC. As long as they had a permit they were protected (ironically) by the predominately Black police force. But, if they infringed the regulations, they were quickly shut down and dispersed.
Once they planned to disrupt a Jewish Community Council march in support of Israel (how did we find out, that’s a secret) of which I was the organizer. I arranged for a group of activist Jewish students from the local campuses to be present to provide protection. But, these were not just passive guards, they were trained, some of them had black belts and one was an expert with a nun-chuk (a fiendish weapon). When the neo-Nazis showed up our guards attacked them and forced them to withdraw, meanwhile others had been assigned to slash their tires. When they raced back to their cars they could not escape, they were beaten soundly and never came back. You might ask where were the police during this ruckus, they just stood back and watched.
While I admit there is a fine line between a defensive reaction and an offensive attack, there is a difference. The removal of the statue of Gen. Robert E. Lee was initiated by the left and the Blacks. When the KKK, neo-Nazis and White Supremacists marched in Charlottesville against that removal of the Lee statue they were attacked by the organized hard-left antifa trained cadres. The liberal-left biased media tend to ignore this fact, but I agree with Pres. Trump, both extremes deserve censure.
Note that the antifa, the hard-left vigilantes, do not simply fight the fascists, their aim is to take over the government, destroy capitalism and democracy and bring in a socialist regime that resembles the former Soviet Union (an abject failure) and Venezuela (that has just become a dictatorship of the Party and its Secty. Gen.) To ignore the role of these leftist thugs in the current situation and to romanticize it is a failure of realism that could have significant consequences. There are many good people in Virginia who are not extremists, who are not racists, who would like to see the statue of Gen. Robert E. Lee left alone and who demonstrated peacefully. These people will continue to support Pres. Trump.