From 92f90a4146fa2db61d35c54b77923a103534611a Mon Sep 17 00:00:00 2001 From: David Ashby Date: Sun, 6 Sep 2026 22:20:34 -0400 Subject: [PATCH] update readme --- readme.md | 35 +++++++++++++++++++++++++++++++++++ 1 file changed, 35 insertions(+) diff --git a/readme.md b/readme.md index 6b1e938..21bdee0 100644 --- a/readme.md +++ b/readme.md @@ -26,3 +26,38 @@ Something's not right here, unless the hit new baby name is `kaaaaasehaaeaaal`. After a few more rounds of debugging, I'm stumped. There must be some subtle pythonic behavior that my rewrite isn't capturing that's causing my results to all be nonsense like `eadaaaaannnaanba` and `oetlaaceta`, but I can't see it (and I don't know enough python to find it). This was still a useful learning opportunity, although a frustrating one in the end. + +## Update September 2026 + +I asked Claude the same question I asked Copilot six months ago and after thinking for a bit, it pointed out two places where the go program's reference semantics were different than python's. With those two things fixed: + +```plaintext +❯ go run cmd/main.go input.txt +num docs: 32033 +vocab size: 27 +num params: 4192 +step 10000 / 10000 | loss 2.6872 +--- inference (new, hallucinated names) --- +sample 1: breya +sample 2: kariste +sample 3: kari +sample 4: elyna +sample 5: aliann +sample 6: alayn +sample 7: asari +sample 8: amara +sample 9: kadili +sample 10: avan +sample 11: aarie +sample 12: amari +sample 13: keli +sample 14: kericy +sample 15: areta +sample 16: kailyn +sample 17: kona +sample 18: daley +sample 19: avile +sample 20: alion +``` + +Success.