quantized second-order optimizers

[zimingyy]

This GitHub repo is awesome—clean code, great implementations, and super useful! Kudos for the fantastic work!
Would you be interested in implementing quantized second-order optimizers (e.g., 4-bit Shampoo) for TensorFlow? https://arxiv.org/abs/2405.18144 & https://arxiv.org/abs/2412.10663 & https://github.com/Sike-Wang/low-bit-Shampoo

[NoteDance]

@zimingyy Thanks! I might implement it in the future.