Everyone knows better than to interfere since, for all they know, Aphrodite's the one who started it herself. It used to bother Annabeth when she first came to the camp, but not as much once she realized people generally know better even without the warning.