Could this library be used to get the maximum entropy of a network in a certain amount of bits knowing just the input and output sizes?
From my first read it seems that it requires a list of activation methods, however in my case the actual structure of the network is unknown. Would there be a specific set of activation methods which would maximize the entropy anyway?
Essentially my goal is to calculate the entropy of a given neural network, and the max entropy of a neural network in a given amount of memory.
Could this library be used to get the maximum entropy of a network in a certain amount of bits knowing just the input and output sizes?
From my first read it seems that it requires a list of activation methods, however in my case the actual structure of the network is unknown. Would there be a specific set of activation methods which would maximize the entropy anyway?
Essentially my goal is to calculate the entropy of a given neural network, and the max entropy of a neural network in a given amount of memory.