"You're So Vain ?"

Something has always bothered me about Carly Simon's song "You're So Vain"...If the song IS about him, is it really vain of him to think that the song is about him ? Or is it just perceptive ?