The downsides are that (1) you may experience choppy performance if there’s a lot of stuff moving on your screen and (2) some video content won’t play at all because of copy protection.
Unfortunately, because your MacBook (and my MacBook) only supports one external display, there is no way around these limitations if we want to use multiple external displays.