Mark Audio has some interesting drivers, eg Alpair 7ms . Still rolls of from around 5khz though would be less than many other drivers.
Never worked with that one, but measurements suggest directivity narrows down between 5k and 10k, maybe a bit smoother than with other rigid-diaphragm fullrange models.
Regarding treble directivity, something like Dayton RS75 is better than most fullrange cones, but it is rather a toy, and you would hear some of the phaseyness issues I have mentioned.
KEF developed the tangerine waveguide (aka phase plug) along with the MF cone shape to broaden the beam width at higher frequencies.
The beam width in the listening window is indeed broadened, everything looks excellent in a +-45deg horizontal window. But the more you move away from the 0deg axis, the more midrange cone and baffle are defining the directivity, and that one becomes pretty uneven.
The directive index figures published provide evidence that this goal has been achieved in practice. Not perfect, but very good, in my opinion
It depends on the application and window you are looking at. If we are talking solely about the listening window and typical early reflections from ceiling and floor, I agree. So in some kind of well-treated loft studio this might work. In your typical living environment, you might have reflective walls either behind the speakers or on the sides at a limited distance, so these define early reflections and reverb tonally.
How would one theoretically reach a constant directivity from a diaphragm driver, without crossing over to a super tweeter
For broad dispersion / low directivity index: Comparably small midrange (like 3" or 4") plus small tweeter (3/4" or dome-shaped 1"), both in a baffle-less or very slim baffle arrangement, with all drivers working above 300Hz in close proximity to each other (or in coaxial arrangement). In theory, B&W Nautilus (the original 4-way model) was such a concept.
If you want narrower dispersion or higher directivity index: Well, it is complicated. You have to define your ideal listening window pattern and directivity index and combine several measures of controlling directivity for different frequency bands (waveguide, bigger diaphragms, cardioids, line sources).
We should note that constant directivity is from psychoacoustical point most useful for frequency bands which our brain can distanguish between direct and reflected sound events. What happens below 300Hz and above 8,000Hz, is IMHO not as critical in terms of directivity, if the latter is not completely off.