You should remove the Marketplace entry after the binding PR is merged. Unfortunately, I did not find a way to “disable” the entry (and totally forgot to open up an Issue for this functionality)
When you have a new PR, changing what is merged into the master, you can always re-create the Marketplace entry.