The article references this review: https://openreview.net/pdf?id=mdA5lVvNcU And...

		daveguy 3 months ago \| parent \| context \| favorite \| on: Study identifies weaknesses in how AI systems are ... The article references this review: https://openreview.net/pdf?id=mdA5lVvNcU And the review is pretty damning regarding statistical validity of LLM benchmarks.