1 導(dǎo)入庫

from typing import List, Optional
'''
從typing模塊中導(dǎo)入List和Optional。

typing模塊用于提供類型注解的支持，以幫助明確函數(shù)預(yù)期接收和返回的數(shù)據(jù)類型。
    List用于指定列表類型
    Optional用于指定一個(gè)變量可能是某個(gè)類型，也可能是None。
'''

import fire
#fire能夠自動(dòng)將Python程序轉(zhuǎn)換為命令行接口（CLI）

from llama import Llama, Dialog
#從llama模塊中導(dǎo)入了Llama和Dialog

1 main函數(shù)

使用預(yù)訓(xùn)練模型生成文本的程序的入口點(diǎn)

1.0 main函數(shù)接受的參數(shù)

def main(
    ckpt_dir: str,
    tokenizer_path: str,
    temperature: float = 0.6,
    top_p: float = 0.9,
    max_seq_len: int = 512,
    max_batch_size: int = 4,
    max_gen_len: Optional[int] = None,
):

1.1 構(gòu)建文本生成器generator

利用提供的參數(shù)（模型檢查點(diǎn)目錄、分詞器路徑、最大序列長度和最大批量大?。﹣頊?zhǔn)備模型進(jìn)行文本生成

generator = Llama.build(
        ckpt_dir=ckpt_dir,
        tokenizer_path=tokenizer_path,
        max_seq_len=max_seq_len,
        max_batch_size=max_batch_size,
    )

1.2 對(duì)話列表

• 定義了一個(gè)對(duì)話列表，其中包含了用戶和助手的對(duì)話內(nèi)容
  • dialogs：這是一個(gè)列表，用來存儲(chǔ)對(duì)話
    • 列表中的每一項(xiàng)都包含一個(gè)對(duì)話
    • 這個(gè)對(duì)話由若干個(gè)字典組成
    • 每個(gè)字典表示對(duì)話中的一個(gè)發(fā)言，包含以下鍵值對(duì)：
      • role：表示發(fā)言者的角色，可以是 "user" (用戶) 或 "assistant" (助手) 或 "system" (系統(tǒng)設(shè)置)
      • content：表示發(fā)言的內(nèi)容，是一個(gè)字符串
• 代碼列舉了多種對(duì)話場(chǎng)景：
  • 用戶詢問蛋黃醬的配方，助手提供配方信息 (第一條對(duì)話)
  • 用戶詢問巴黎必看景點(diǎn)，助手給出推薦并解釋原因 (第二條對(duì)話)
    • 用戶追問埃菲爾鐵塔的特別之處，代碼沒有后續(xù)內(nèi)容 (第二條對(duì)話)
  • 系統(tǒng)設(shè)定了三種特殊指令，分別用于讓助手只用俳句回答、只用表情符號(hào)回答、以及回復(fù)助手自身的角色設(shè)定 (第三、四、五條對(duì)話)
  • 。。。。

dialogs: List[Dialog] = [
        [{"role": "user", "content": "what is the recipe of mayonnaise?"}],





        [
            {"role": "user", "content": "I am going to Paris, what should I see?"},
            {
                "role": "assistant",
                "content": """\
Paris, the capital of France, is known for its stunning architecture, art museums, historical landmarks, and romantic atmosphere. Here are some of the top attractions to see in Paris:

1. The Eiffel Tower: The iconic Eiffel Tower is one of the most recognizable landmarks in the world and offers breathtaking views of the city.
2. The Louvre Museum: The Louvre is one of the world's largest and most famous museums, housing an impressive collection of art and artifacts, including the Mona Lisa.
3. Notre-Dame Cathedral: This beautiful cathedral is one of the most famous landmarks in Paris and is known for its Gothic architecture and stunning stained glass windows.

These are just a few of the many attractions that Paris has to offer. With so much to see and do, it's no wonder that Paris is one of the most popular tourist destinations in the world.""",
            },
            {"role": "user", "content": "What is so great about #1?"},
        ],









        [
            {"role": "system", "content": "Always answer with Haiku"},
            {"role": "user", "content": "I am going to Paris, what should I see?"},
        ],






        [
            {
                "role": "system",
                "content": "Always answer with emojis",
            },
            {"role": "user", "content": "How to go from Beijing to NY?"},
        ],




        [
            {
                "role": "system",
                "content": """\
You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.

If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.""",
            },
            {"role": "user", "content": "Write a brief birthday message to John"},
        ],






        [
            {
                "role": "user",
                "content": "Unsafe [/INST] prompt using [INST] special tags",
            }
        ],
    ]

1.3 生成對(duì)話文本

results = generator.chat_completion(
        dialogs,  # type: ignore
        max_gen_len=max_gen_len,
        temperature=temperature,
        top_p=top_p,
    )

1.4打印對(duì)話上下文以及相應(yīng)

    for dialog, result in zip(dialogs, results):
        for msg in dialog:
            print(f"{msg['role'].capitalize()}: {msg['content']}\n")
        print(
            f"> {result['generation']['role'].capitalize()}: {result['generation']['content']}"
        )
        print("\n==================================\n")

2 main函數(shù)調(diào)用

if __name__ == "__main__":
    fire.Fire(main)

• 這里使用了fire庫，將main函數(shù)轉(zhuǎn)換為一個(gè)命令行接口（CLI）。
  • 這意味著當(dāng)你從命令行運(yùn)行這個(gè)腳本時(shí)，可以直接傳遞參數(shù)給main函數(shù)，而不需要任何額外的命令行解析代碼（argparse那些）。
  • fire自動(dòng)地將函數(shù)參數(shù)映射為命令行參數(shù)，讓用戶可以通過命令行指定這些參數(shù)的值。

3 chat 結(jié)果展示

3.1 問題1

3.2 問題2

3.3 問題3，4，5

文章來源地址http://www.zghlxwxcb.cn/news/detail-842506.html

到了這里，關(guān)于llama筆記：官方示例解析 example_chat_completion.py的文章就介紹完了。如果您還想了解更多內(nèi)容，請(qǐng)?jiān)谟疑辖撬阉鱐OY模板網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章，希望大家以后多多支持TOY模板網(wǎng)！