Tag：nlp
-
Transformer Code Explained (Pytorch Edition)
preamble Based on the previous postClassical Network Architecture Learning-TransformerThe study, today we use pytorch to build their own transformer model, to deepen the understanding of transformer, not only in the field of NLP can not get around the transformer, but also in the field of CV is also very hot, a lot of models are […]
-
[nltk_data] Error loading reuters: < urlopen error [Errno 11004] [nltk_data] getaddrinfo
When completing cs224n Assignment1, I need to use the reuters corpus in the nltk library, but when I run nltk.download(“reuters”) in the code, I get an error that I can’t download it due to network problems: [nltk_data] Error loading reuters: <urlopen error [Errno 11004] [nltk_data] getaddrinfo According to the online tutorials tossed a long time, […]
-
Train your own large language model quickly: fine-tuning of lora instructions based on LLAMA-7B
catalogs 1. Selected works: lit-llama2. Downloading the project3. Installation environment4. Download the LLAMA-7B model5. Doing model conversions6. Preliminary testing7. Why is instruction fine-tuning necessary?8. Commencement of instruction fine-tuning8.1 Data preparation8.2 Starting Model Training8.3 Model Testing Preface: System: ubuntu 18.04Graphics card: A100-80G (dabble, hehehe~) (This time the main record is how to quickly fine-tune commands for […]