The thing is CoV council's mismanagement does affect more than just Victoria. Downtown Victoria functions as "downtown" for the greater area. If we lose tourists to the area because of the mismanagement of downtown, then Butchart Gardens suffers as well. If it is perceived as unsafe to come downtown to the Royal Theater or the MacPherson playhouse, then opera supporters from Oak Bay lose out as well. The Victoria Royals draw fans from the greater area, as do other events at the arena, so if the Caledonia area is unappealing it affects people from the other municipalities.
In my opinion (clearly the minority) the voters of the other municipalities should want to amalgamate so that they can contribute to better management of Downtown Victoria, an area that I believe is important to the larger metro area.
It would be interesting to know how many in the CRD want to, or have a need to go downtown. Younger demographics might be interested in the bar scene and certain pockets might be interested in theatre, but I suspect that the vast majority have no need or want to be downtown. It is not as if the City is being run like a business and welcomes others.
There is a shift to stay local, whether that be Sidney or the Westshore. Downtown is very much becoming a gated community due to transportation and services that appeal to the locals at the expense of the outlying communities.