Currently that self-improving system isn’t so self-improving that it’s become better at any particular job than human beings, so I think the skepticism is warranted.
This seems to produce skill atrophy. "It's okay because the AI will pick up the slack" is kinda true but doesn't exactly strengthen the human position though.