11L AttnRes + Gated Attention + Looped Blocks + EMA + Cosine + QAT#607

Neopolita wants to merge 1 commit intoopenai:mainopenai/parameter-golf:mainfrom

Neopolita:submission/11L-attnres-gated-loop-ema-cos-qatNeopolita/parameter-golf:submission/11L-attnres-gated-loop-ema-cos-qatCopy head branch name to clipboard