Llama2 FT - #2234
Llama2 FT#2234poonehmousavi wants to merge 14 commits into
Conversation
… llama2( (suggested solution)
|
I have added two versions: llama2.py is in the old format and llama2_new.py is in the new version. Also, I added a new version of huggingface_interface_new.py. which I added the quantization config and AUtomodelCasualLM. Let me know what you think of the changes @mhn226 .. When we finalize the best for this interface, I will update the recipe accordingly |
| """ | ||
| is_sb, ckpt_file, is_local = self._check_model_source(source, save_path) | ||
| if is_sb: | ||
| config = config.from_pretrained(source, cache_dir=save_path,quantization_config=quantization_config) |
There was a problem hiding this comment.
@poonehmousavi : Do we also need quantization_config in the case when is_sb = False, i,e, adding quantization_config in the below else condition?
|
Thank you @poonehmousavi for this PR. It's a valuable addition to SpeechBrain. Here are my comments from a first review of the code:
I got the same issue when running the llama2 recipe. Are you able to replicate it?
@mhn226 do you have additional comments? |
Hi @mravanelli , maybe come back here next week because currently we're trying to figure out what is the best option for doing this. The PR is rather a draft version for now ^^ |
|
I closed this PR and transfer all the changes to this PR |
What does this PR do?
Finetuning Lamma2 for response generation task using MultiWOZ dataset.
List any dependencies that are required for this change.