Well, he doesn't know that Bob is open to the idea of having wild monkey sex with him, so he doesn't want to push things. Bob has already let him think that any kind of relationship between them is impossible (granted, it was while Bob was a ghost, but still), and so Harry's trying not to ruin the friendship.