Tag：llama
-
[NLP] Tutorial on fine-tuning using Alpaca-Lora based on the llama model
Stanford Alpaca is fine-tuning on the whole model of LLaMA, i.e., all parameters in the pre-trained model are fine-tuned (full fine-tuning). However, this method still requires high hardware cost and is inefficient for training. [NLP] Understanding Efficient Fine-Tuning of Large Language Models (PEFT) Therefore, Alpaca-Lora utilizes the Lora technique by adding additional network layers to […]
-
[LLM] Windows local CPU deployment folk version of the Chinese alpaca model (Chinese-LLaMA-Alpaca) stepping on the pit record
catalogs preamble preliminary Git Python3.9 Cmake Download model Consolidation model Deployment models preamble I’m sure some of you would like to experience deploying a large language model like I do, but it’s in the way of economic strength, but there are a lot of quantitative models in the private sector, so we can also experience […]
-
Train your own large language model quickly: fine-tuning of lora instructions based on LLAMA-7B
catalogs 1. Selected works: lit-llama2. Downloading the project3. Installation environment4. Download the LLAMA-7B model5. Doing model conversions6. Preliminary testing7. Why is instruction fine-tuning necessary?8. Commencement of instruction fine-tuning8.1 Data preparation8.2 Starting Model Training8.3 Model Testing Preface: System: ubuntu 18.04Graphics card: A100-80G (dabble, hehehe~) (This time the main record is how to quickly fine-tune commands for […]