Colby Cosh: We can't have nice downtowns with so many aggressive vagrants milling about