Porting nanochat to a TPU: what carries over from PyTorch, and what breaks

2 comments

• sciences44 14 minutes ago
  Nice work. Regarding your first insight, that's a sneaky one ^^. I experiment a similar issue with fine-tuning a small model with MLX. It was very hard to find out.
• contentpulse 36 minutes ago
  [flagged]