entropy – Calculate entropy values without saving.

entropy.py

usage: entropy.py [-h] [--model MODEL] [--max_samples MAX_SAMPLES]
                  [--exp_suffix EXP_SUFFIX] [--exp EXP] [--val] [-p PLOT]

-h, --help

show this help message and exit

--model <model>

Model to use for pretraining.

--max_samples <max_samples>

Maximum batches to use.

--exp_suffix <exp_suffix>

Suffix to add to the output file name.

--exp <exp>

Experiment to run.

--val

Run with the validation dataset instead of the test.

-p <plot>, --plot <plot>

Plot the results.