Open-source code for training and scaling up energy-based foundation models.
-
Updated
Oct 10, 2026 - Python
Open-source code for training and scaling up energy-based foundation models.
[AAAI'25] The implementation of paper "Federated Foundation Models on Heterogeneous Time Series" | The first work to explore time series foundation models on federated setting.
Self Supervised Pseudolabelling of images with multiple objects using YOLOv3's Backbone
A 501M-parameter language model trained from scratch on 20B tokens: custom BPE tokenizer, original Llama-style architecture, training and SFT pipeline, and unattended cloud orchestration. 54 hours on one H100 for about $165.
ChannelMAE is a combination of MAE and ChannelViT
Scripts to pre train a Multi Tokenizer and also evaluate the performance.
To associate your repository with the pretraining-model topic, visit your repo's landing page and select "manage topics."