utils.lora
utils.lora
module to get the state dict of a merged lora model
Functions
Name | Description |
---|---|
get_lora_merged_state_dict | Create and return a state_dict that has the LoRA deltas |
get_lora_merged_state_dict
utils.lora.get_lora_merged_state_dict(model)
Create and return a state_dict that has the LoRA deltas
merged into the base model’s weights, without modifying model
in place.
Parameters
Name | Type | Description | Default |
---|---|---|---|
model | torch.nn.Module | A model that has LoRA/PEFT adapters attached. | required |
Returns
Name | Type | Description |
---|---|---|
dict | dict | A state_dict of the merged parameters. |