bert-base-uncased at main

一、官方給出的命令：

# Make sure you have git-lfs installed (https://git-lfs.com)
git lfs install
git clone https://huggingface.co/bert-base-uncased



# if you want to clone without large files – just their pointers
# prepend your git clone with the following env var:
GIT_LFS_SKIP_SMUDGE=1

但是 git lfs install 的時(shí)候報(bào)錯(cuò)。

于是查了一下。。。。安裝lfs是要這樣：?

二、安裝 lfs

You can't directly use

git lfs install

Instead of that, you can use these commands to download and install (you have to download it before installing).

# for linux
# 如果報(bào)錯(cuò)，則用 sudo apt-get update
sudo apt-get install git-lfs
git-lfs install
# for mac
brew install git-lfs
#用git-lfs install檢查是否正確安裝
git-lfs install

網(wǎng)絡(luò)不好mac報(bào)錯(cuò)：重新安了一下brew install git-lfs。。

三、?再用官方的命令下載。

如果失敗，則。。。可能是網(wǎng)絡(luò)太差。。。。

最終，我還是給?from_pretrained 套了循環(huán)，來(lái)解決的。。。。。。。

如果不套循環(huán)，會(huì)報(bào)錯(cuò) " requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))" 。。。。。。。。。。。。。。。。。。。。。文章來(lái)源地址http://www.zghlxwxcb.cn/news/detail-688167.html

class Trainer(object):
    def __init__(self, args, train_dataset=None, dev_dataset=None, test_dataset=None):
        self.args = args
        self.train_dataset = train_dataset
        self.dev_dataset = dev_dataset
        self.test_dataset = test_dataset

        self.intent_label_lst = get_intent_labels(args)
        self.slot_label_lst = get_slot_labels(args)
        # Use cross entropy ignore index as padding label id so that only real label ids contribute to the loss later
        self.pad_token_label_id = args.ignore_index

        self.config_class, self.model_class, _ = MODEL_CLASSES[args.model_type]
        #self.config = self.config_class.from_pretrained(args.model_name_or_path, finetuning_task=args.task, output_hidden_states=args.output_hidden_states)
        self.config = self.config_class.from_pretrained(args.model_name_or_path, finetuning_task=args.task)
        ################## [O.O]這是一個(gè)循環(huán)，解決下不下來(lái)模型的問(wèn)題 #################
        nb_tries = 20
        while nb_tries>0:
            nb_tries -= 1
            try:
                self.model = self.model_class.from_pretrained(args.model_name_or_path,
                                                      config=self.config,
                                                      args=args,
                                                      intent_label_lst=self.intent_label_lst,
                                                      slot_label_lst=self.slot_label_lst)
                break
            except:
                time.sleep(0.1)
        #########################################################################
        # GPU or CPU
        self.device = "cuda" if torch.cuda.is_available() else "cpu"
        # self.device = "cuda" if torch.cuda.is_available() and not args.no_cuda else "cpu"
        self.model.to(self.device)

到了這里，關(guān)于[linux] huggingface transformers 如何下載模型至本地 & git lfs install 報(bào)錯(cuò)的文章就介紹完了。如果您還想了解更多內(nèi)容，請(qǐng)?jiān)谟疑辖撬阉鱐OY模板網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章，希望大家以后多多支持TOY模板網(wǎng)！