And yet being male still almost perfectly correlates with being a violent criminal. asdfologist probably picks on a loose use of word "correlation", correlation is by definition symmetric. pg is really talking about conditional probabilities, but honestly I think everyone understands what he means.
I did interpret it to be symmetric, but now that I think about it you seem to be right that colloquially it does (generally) refer to conditional probability. I disagree though that everyone interprets it that way, based on the upvotes my comment got.