These are not duplicate variants but multi-allelic sites (i.e., sites with more than one alternative allele) split into multiple biallelic-records (i.e., one alternate allele per line). Multiple such records representing a single multi-allelic site can be joined into a single multi-allelic record using standard tools such as bcftools
or vt
.