Sounds great. Non-engineer, but curious. Is there a walkthrough blog post or vid... | Hacker News

Hacker News .hnnew | past | comments | ask | show | jobs | submit

ravjo on June 9, 2024 | parent | context | favorite | on: Show HN: We've open-sourced our LLM attention visu...

Sounds great. Non-engineer, but curious. Is there a walkthrough blog post or video that can help someone appreciate/understand this easily?

swifthesitation on June 9, 2024 | [–]

Attention in transformers, visually explained | Chapter 6, Deep Learning - 3Blue1Brown: https://www.youtube.com/watch?v=eMlx5fFNoYc&t=

lakshith-403 on June 9, 2024 | | [–]

Thank you

blackbear_ on June 10, 2024 | [–]

Loosely related, but also a great read: https://distill.pub/2020/circuits/zoom-in/

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact