4.23. Change the model output bias for trained model

Note

Supported backends: TensorFlow , PyTorch

The output bias of a trained model typically originates from the statistical results of the training dataset.

There are several scenarios where one might want to adjust the output bias after the model is trained, such as zero-shot testing (similar to the procedure before the first step in fine-tuning) or manually setting the output bias.

The dp change-bias command supports the following methods for adjusting the bias:

TensorFlow Backend

Changing bias using provided systems for trained checkpoint:

dp --tf change-bias model.ckpt -s data_dir -o model_updated.pb

Changing bias using user input for energy model:

dp --tf change-bias model.ckpt -b -92.523 -187.66 -o model_updated.pb

PyTorch Backend

Changing bias using provided systems for trained .pt/.pth models:

dp --pt change-bias model.pt -s data_dir -o model_updated.pt

Changing bias using user input for energy model:

dp --pt change-bias model.pt -b -92.523 -187.66 -o model_updated.pt

For multitask models, where --model-branch must be specified:

dp --pt change-bias multi_model.pt -s data_dir -o model_updated.pt --model-branch model_1