There are several personal factors for not having a Harley in my book.
Price, I can buy two nice metric bikes for the price of a new HD or Polaris Victory. Sort of the His and Hers bikes for a economic price. I'm always for the bottom line.
Noise level, I really dislike the idea of having to have load pipes. If I can hear you from a 1/2 mile or more away, your to loud. Which for some reason is standard for most HD owners, (not all). I really enjoy the HD at 3am as it goes down the street (not!).
Technology levels seem to be better with the metric bikes, can you get a liquid cooled, EFI HD in a 800-1200 cc range?
The Howdie Wave, Most HD riders don't wave back, might have something to with that superior attitude.
Other than a few items their not to bad of a bike, but I'll never own one.
P.S. If you don't drive a FORD...........
