> separating a device like this onto its own internal private network

That doesn't really solve the problem that your TV could be relaying everything you say to a remote server, does it?