xai engineers listening to the coil whine rhythm on their rented-out blackwells trying to figure out what the frontier labs replaced attention with
Quote
Jerry Tworek
@MillionInt
First step to replacing transformer is appreciating it deeply for how far it was able to carry us
