A very old objection
Each time a discipline is added, the same arguments appear: it is not serious, it is a gimmick, it dilutes the programme. The same was said of sports now regarded as fixtures. That does not prove the critics are always wrong, but it should lower confidence in the instinct.
The test I would use
The useful question is whether Olympic gold is the highest achievement available in that sport. Where it is, the event carries real weight and the athletes treat it accordingly. Where a separate professional championship clearly matters more, the Olympic competition becomes an exhibition with a flag attached.
So, a limit
By that test I am relaxed about unfamiliar sports and sceptical about famous ones whose stars are visibly elsewhere. Novelty is not the risk. Irrelevance is.