No, the argument for de minimis is that the cost to collect taxes on a $20 parcel is less than the collected tax.
Granted, the US' $800 de minimis, which was created because of a lack of funding to deal with the volume of shipping, was probably a bad decision in retrospect. But removing it entirely is another extreme.
The EU generally has a de minimis limit of 150 EUR for custom duties but individual members levy sales tax from the first EUR onward. The USA could do the same. Of course, this would make things more expensive, too, but less so than sinking your trade boat through tariffs ;)
Granted, the US' $800 de minimis, which was created because of a lack of funding to deal with the volume of shipping, was probably a bad decision in retrospect. But removing it entirely is another extreme.