I am seeing the same issue occasionally (~20 hue’s), I cannot reproduce it as it appears to have a similar random effect than you show in your video. Other systems can show this effect too, e.g., 433mhz based plugs are notorious for this issue and show this effect very easily.
and it worked perfectly. A 10ms delay if memory serves me well, was sufficient for Hue lights. Maybe less works too, I never tried it. In the meanwhile, I moved and started with the group switching approach again (just laziness on my part) so I cannot show you my code anymore.
As always @rlkoshak has several good posts for this, here are some to get your started: