Training without pretrained weights

[chinmayembedded]

Hi,

I trained training aCASTLE by 1 shot 5 way strategy without using pretrained weights. I trained model for 80 epochs. Performance numbers observed were drastically low compared to training with pretrained weights.

If I want to train a model without pretrained weights, is it possible? or Can you please share methodology to create pretrained weights files.

Thank you!

[Han-Jia]

Hi, we pre-train the model with the same strategy as in the FEAT repo. So you may try the pre-trained weights provided by that repo.

Based on our observation, we find the model with pre-trained weights gets much higher GFSL performance than the one without pre-trained weights, but they have similar FSL performance.

BTW, if training from scratch, it may require much longer epochs.