That's it right there, they are limited to 2 or 4 HDMI 2.1 inputs, whereas an AVR or processor allows you to connect and switch conveniently between a lot more devices.
Find out what the display lag is (can be eyed with a test pattern, measured with a lag tester or just lifted from a review)...