Harem just implies multiple simultaneous love interests.
Thats why classic romcoms like Clannad or dramas like stein gates are harem
Most of them end up with a single heroine... or alone, or dead... or without a definitive answer.
Polygamy implies marriage so its more of a permanent thing that simply having 3 girls infatuated with the protagonist.