A protest by cyclists halted work to remove Bloor Street bike lanes, forcing construction workers to leave before placing pylons.