It's also easier for misconfigurations to lead to security issues since your switch resetting to default means your network is now connected directly to the internet. I had this happen after the power went out last time, luckily I'm on a PPPoE connection so it wasn't really connected to the net. Replaced my NUC + managed switch setup after that.
My one complaint is the lack of plug sensing: if you unplug a cable modem and plug it back in, that typically does things like triggering a DHCP request, which doesn't happen when the cable modem is plugged into a switch port on a vlan.