Yeah, luckily, you can unit tests these and fix them. They are not concurrency b... | Hacker News

HN2new | past | comments | ask | show | jobs | submit

		liuliu 3 months ago \| parent \| context \| favorite \| on: A bug that taught me more about PyTorch than years... Yeah, luckily, you can unit tests these and fix them. They are not concurrency bugs (again, luckily). BTW, numeric differentiation can only be tested very limitedly (due to algorithmic complexity when you doing big matrix). It is much easier / effective to test against multiple implementations.

antoine-levitt 3 months ago | [–]

You can easily test a gradient using only the forward pass by doing f(x+h) ~ f(x) + dot(g, h) for a random h

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact