? ? ? ?今天有小伙伴提起了多人生成的問題,自己之前也嘗試過,不過當(dāng)時(shí)比較低級(jí),prompt 中就抄襲了 2girl 的提示詞,好在抄的模型比較好,勉強(qiáng)能看。
新技能插件
? ? 后來了解到了幾個(gè)插件,
Composable LoRA 和?Latent couple
Composable LoRA:分區(qū)域LoRa效果控制(漢化下叫“可自組 Lora”?。。。?/span>https://github.com/opparco/stable-diffusion-webui-composable-lora

下面看下這倆插件的具體使用
Composable LoRA
Latent couple?
分割(行 :列)
|
1:1
|
1:2
|
1:2
|
全區(qū)域
|
第一個(gè)位置
|
第二個(gè)位置
|
|
位置
|
0:0
|
0:0
|
0:1
|
全區(qū)域提示詞
|
第一個(gè)人物提示詞對(duì)應(yīng)
|
第二個(gè)人物提示詞對(duì)應(yīng)
|
|
權(quán)重
|
0.2
|
0.8
|
0.8
|
全區(qū)域權(quán)重
|
第一個(gè)人物權(quán)重
|
第二個(gè)人物權(quán)重
|
|
prompt
|
全局提示詞
|
AND 第一個(gè)人物提示詞
|
AND 第二個(gè)人物提示詞
|

分割
|
1:1
|
1:3
|
1:3
|
1:3
|
全區(qū)域
|
第一個(gè)位置
|
第二個(gè)位置
|
第三個(gè)位置
|
|
位置
|
0:0
|
0:0
|
0:1
|
0:2
|
全區(qū)域提示詞
|
第一個(gè)人物提示詞對(duì)應(yīng)
|
第二個(gè)人物提示詞對(duì)應(yīng)
|
第三個(gè)人物提示詞對(duì)應(yīng)
|
|
權(quán)重
|
0.2
|
0.8
|
0.8
|
0.8
|
全區(qū)域權(quán)重
|
第一個(gè)人物權(quán)重
|
第二個(gè)人物權(quán)重
|
第三個(gè)人物權(quán)重
|
|
prompt
|
全局提示詞
|
AND 第一個(gè)人物提示詞
|
AND 第二個(gè)人物提示詞
|
AND 第三個(gè)人物提示詞
|
在使用插件時(shí),可以將采樣迭代步數(shù)(Steps)先設(shè)置為1~2 ,生成看一下區(qū)域生成是否正常,這是分為3列的情況:

兩排的參數(shù)情況如下:
位置: 1:1 ,2:2, 2:2, 2:2, 2:2?
2:2? |
2:2? |
2:2? |
2:2? |
區(qū)域順序: 0:0,0:0,0:1,0:2,0:3
1(0:0) |
3(0:2) |
2(0:1) |
4(0:3) |
權(quán)重:0.2,0.8,0.2,0.8,0.2
1(0.8) |
3(0.8) |
2(0.2) |
4(0.2) |
這么無聊的內(nèi)容你都能看到這里,不寫點(diǎn)摸索出來的經(jīng)驗(yàn)有點(diǎn)對(duì)不起你了……
關(guān)于拆分區(qū)域不起作用與生成多人失敗變成一個(gè)人的問題:
? ? ? ?在沒有使用ControlNet 的情況下 想使用這兩個(gè)插件穩(wěn)定生成,那么:
? ? ? ?各個(gè)區(qū)域的提示內(nèi)容不能過于復(fù)雜,把多個(gè)單獨(dú)成像的提示詞 直接Copy過來作為一個(gè)人物的內(nèi)容進(jìn)行組裝是不可取的。多種風(fēng)格,多種復(fù)雜的關(guān)鍵詞會(huì)帶來巨大偏差。
? ? ? 這是與上面三種風(fēng)格混成一張人物(圣斗士|蒸汽朋克|吸血新娘)的相通的提示詞,在玩家建議增大畫布尺寸下,嘗試采用了1024x512尺寸下生成的效果(隨機(jī)性極大9張圖能出2張能看的),依稀還能看到三種風(fēng)格的混搭……
? ? ? ?出來兩個(gè)?是不是畫布不夠大?然后又采用了 1536x512尺寸下產(chǎn)生的,這里面依然只是生成了一個(gè)人,三種描述風(fēng)格混搭,也還能看(出圖可用性更低了)
?這張與上張相同提示詞,隨機(jī)了另一個(gè)種子(seed),貌似混搭也不錯(cuò)……
以上巨大而冗余的prompt就不貼了……
????????這肯定是方向不對(duì)……
????????在參考了插件作者的Github中后,得到了部分海外友人的支持,提到了提示詞過于復(fù)雜造成了部分污染,致使插件的分區(qū)沒能正常工作……
遂做了大部分刪減,果然效果好了很多,較為穩(wěn)定可以生成多人模式了……?
但是依然看到圣斗士風(fēng)格覆蓋了 蒸汽朋克 與 吸血新娘 風(fēng)格,變成了三女神模式……
?????????重新看了作者給的例子…… 不僅對(duì)作者由衷的佩服,一切早就擺在了面前……
((ultra-detailed)), ((illustration)), 2girls
AND ((ultra-detailed)), ((illustration)), 2girls, black hair
AND ((ultra-detailed)), ((illustration)), 2girls, blonde hair
Negative prompt: (low quality, worst quality:1.4)
Steps: 28, Sampler: Euler a, CFG scale: 5, Seed: 722014241, Size: 512x512, Model hash: 3f64f3baf5, Model: Anything-v3.0-fp16, ENSD: 31337, Latent Couple: "divisions=1:1,1:2,1:2 positions=0:0,0:0,0:1 weights=0.2,0.8,0.8 end at step=20", Eta: 0.67
發(fā)現(xiàn)了么 :
((ultra-detailed)), ((illustration)), 2girls
每一個(gè)區(qū)域都出現(xiàn)了相同的關(guān)鍵詞 + 單獨(dú)的個(gè)性化內(nèi)容
重新修改了prompt 符合這個(gè)范式…… 然后……
圣斗士、蒸汽朋克、吸血新娘(眼神太過魅惑已被打碼,不然發(fā)不出來)……
3girls,aespakarina,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body)
AND 3girls,aespakarina,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body),<lora:aespaKarina_aespaKarinaV5:0.3><lora:saintSeiyaPisces_piscesarmor10:0.3><lora:hongkongdolllikeness_v15:0.2><lora:koreanDollLikeness_v15:0.2> ,piscesarmor,armor,golden armor,helmet
AND 3girls,aespakarina,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body),(steampunk warrior queen:1.3) holding a (mechanical sword:1.2), powerful, intricately detailed armor, (rusty metal:1.1) with (copper accents:1.1), intense colors, hyper-realistic lifelike texture,
AND 3girls,aespakarina,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body),deep shadow, (darkness:1.1), (highly detailed beautiful gothic vampire bride:1.1), (bride:1.2), lace wedding veil, cleavage,(extremely detailed eyes:1.2) face, (piercing red eyes:1.1), detailed clothes, curly red black hair, bangs, frills, decorative black wedding dress with red roses bouquet
Negative prompt: (watermark:1.2), (a signature:1.1), Ugly, deformed, distorted, blurry, low quality, low resolution, simultaneous, bad anatomy, extra limbs, extra ears, out of frame, ugly, extra limbs, ((bad anatomy)), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), Photoshop, video game, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, 3d render
Steps: 30, Sampler: Euler a, CFG scale: 7, Seed: 4029803897, Size: 768x512, Model hash: 46d105afa7, Model: faetastic.kn0y, Denoising strength: 0.9, ENSD: 31337, Latent Couple: "divisions=1:1,1:3,1:3,1:3 positions=0:0,0:0,0:1,0:2 weights=0.2,0.8,0.8,0.8 end at step=20", Hires upscale: 2, Hires upscaler: 4x-UltraSharp, Eta: 0.67
processing | 28.2/268.5s
Time taken: 45m 44.93s
45分鐘…… 羨慕4090……
整理的100個(gè)Lora資源
內(nèi)容來自于C站,不能魔法訪問C站的小伙伴可以下載使用,已經(jīng)使用C站助手更新了效果圖與pormpt及模型信息,下載下來之后直接解壓到Lora目錄即可使用。
https://download.csdn.net/download/bestpasu/87762524
———補(bǔ)充更新——————————————————————————————————————?
小伙伴提了說是生成頭發(fā)顏色存在污染,我嘗試了一下(后附魔法??):
需要注意的:要確定自己使用的魔法能被自己的大模型識(shí)別,有的調(diào)制的大模型不一定有相關(guān)的內(nèi)容,比如上圖生成的模型年輕女人和年輕女孩識(shí)別出來臉都差不多……
Three women,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body)
AND Three women,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body),silver haired granny,
AND Three women,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body),Young woman with red hair,
AND Three women,RAW,(8k, best quality, masterpiece:1.2),(intricate details:1.4),(photorealistic:1.4),octane render, studio soft light, rim light, vibrant details, ultra detailed, realistic skin texture, (Super fine pattern:1.3),(full body),Blue-haired girl
Negative prompt: (watermark:1.2), (a signature:1.1), Ugly, deformed, distorted, blurry, low quality, low resolution, simultaneous, bad anatomy, extra limbs, extra ears, out of frame, ugly, extra limbs, ((bad anatomy)), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), Photoshop, video game, ugly, tiling, poorly drawn hands, poorly drawn feet, poorly drawn face, out of frame, mutation, mutated, extra limbs, extra legs, extra arms, disfigured, deformed, cross-eye, body out of frame, blurry, bad art, bad anatomy, 3d render
Steps: 30, Sampler: DPM++ 2M Karras, CFG scale: 7, Seed: 3971804455, Face restoration: CodeFormer, Size: 768x512, Model hash: 59ffe2243a, Model: chilloutmix_NiPrunedFp16Fix, Denoising strength: 0.4, ENSD: 31337, Latent Couple: "divisions=1:1,1:3,1:3,1:3 positions=0:0,0:0,0:1,0:2 weights=0.2,0.8,0.8,0.8 end at step=20", Hires upscale: 2, Hires upscaler: R-ESRGAN 4x+Time taken:?1m 37.06s文章來源:http://www.zghlxwxcb.cn/news/detail-484810.html
Torch active/reserved: 12273/16856 MiB,?Sys VRAM: 18266/24269 MiB (75.26%)文章來源地址http://www.zghlxwxcb.cn/news/detail-484810.html
到了這里,關(guān)于Stable Diffusion 多人繪畫經(jīng)驗(yàn)札記的文章就介紹完了。如果您還想了解更多內(nèi)容,請(qǐng)?jiān)谟疑辖撬阉鱐OY模板網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章,希望大家以后多多支持TOY模板網(wǎng)!