StabilityAI两款最新模型开源,实例展示及使用指南

AI快讯 2024-04-17

StabilityAI在huggingface平台上新开源了一款名为CosXL的模型,它包含两个不同版本。其中,Cos Stable Diffusion XL 1.0 Base版采用了余弦连续EDM VPred调度策略,使其在色彩范围和图像变化速率处理上表现出色,呈现出更细腻的图像生成效果。而Edit Stable Diffusion XL 1.0 Base版则不仅运用了相同的调度策略,还升级了指令性图像编辑功能,可根据源图像和提示进行图像修改和编辑。

image.png

与SDXL模型相比,CosXL及其编辑版模型在艺术风格理解、色彩和对比度运用以及构图能力上均有所提升,展现出更强烈的艺术表达力,但在写实方面稍显不足。幸运的是,官方已提供ComfyUI流程来支持这些模型的使用,用户只需按照既定流程将模型放置到指定位置,即可轻松体验。

对于文生图功能的体验,用户可以采用与基础SDXL模型相同的使用方法,将CosXL模型放置在指定文件夹中,然后利用SDXL文生图工作流开始创作。例如,用户可以输入描述性文字来生成具有夕阳剪影、童话光影或蒸汽朋克风格的图像,这些图像将展现出高度细节化和艺术化的特点。

• Cos Stable Diffusion XL 1.0 Base 版本经过调整,采用了余弦连续 EDM VPred 调度策略。这样的调整变更带来最显著的特点就是能够产生从纯黑到纯白的完整色彩范围,同时在模型对每一步图像变化速率的处理上也有所改进,使得图像生成更为细腻。

• Edit Stable Diffusion XL 1.0 Base 版本同样采用了余弦连续 EDM VPred 调度策略,并进行了升级以执行指令性图像编辑。该模型接受源图像和提示作为输入,并将提示解释转换为如何修改和编辑图像的指令。

CosXL模型和CosXL_Edit模型在相对于SDXL模型相比,模型在对艺术风格的理解能力更强,对色彩和对比度的运用更加大胆,对构图的理解能力有所提升(可类比Playground艺术美学风格)。不过本次发布的CosXL新模型与SDXL模型相比在艺术表达方面有所提升,但在写实方面有所弱化。

目前官方也提供了对应的ComfyUI流程支持对应模型的使用,具体参见下面的ComfyUI使用体验小节。

模型下载地址:https://huggingface.co/stabilityai/cosxl/tree/main

CosXL文生图体验

CosXL文生图与基础的SDXL模型使用方法一样,将模型放置到ComfyUI/models/checkpoints,使用基础SDXL文生图工作流就可以开始体验了。

image.png

01. 夕阳剪影

Conceptual digital art, beautiful double exposure, combining the silhouette of a woman with a sunset coastline, sunset coastline main background with details included in the woman, clear lines, background monochrome, sharp focus, wildlife photography, highly detailed photoshoot, vibrant colors, perfect illustration, portrait photography, by Kingshuk's craziness, ultra-realistic, masterpiece image, high resolution, dynamic and cinematic lighting, UHD, HDR, exclusively award winning work

image.png

02. 童话光影

ending darkness as she is the creator of light,  lights densely packed, mimicking the contours and features of a woman's body, bio-luminescent, translucent, cinematic, Film light, surreal hallucinatory intricately detailed, fairy lights, captures viewers with beauty and mesmerism, Hyper detailed, Hyper realistic, masterpiece, atmospheric, High resolution, Vibrant, CLEAR CRIMSON, High contrast, dark angle, 8k, HDR

image.png

03. 蒸汽朋克

Steampunk, impressive painting representing the very beautiful Elsa Jean, with hyper detailed alien face, tiny very detailed denim shorts, unbuttoned t-shirt, perfect anatomy, centered, almost perfect, dynamic, very detailed, artstation, concept art, soft, sharpness , illustration, art by Carne Griffiths and Wadim Kashin, graffiti airbrush techniques, high definition accent lighting, contrasted with vivid paint colors, cinematic, photorealistic lighting, by Boris Vallejo, extra space atmosphere, digital rendering, digital painting, beep, Noah Bradley, cyril roland, ross tran, trending on artstation, cosmos, vanishing point

image.png

04. 玉石艺术

1 girl, Alcobaça Glass Manufacture - Glass Art Deco, by Luis Duarte, Luis Duarte style, Face Potrait, Element Earth, brown and green shading, Alcobaça style, Datanoshing, Ink v3, NijiExpress 3D v2, Splash style, Abstract Art, Abstract Tech, 3D, High definition, Photo realistic, specified, CyberTech

image.png

05. 模特

full Body, chinese girl, Female model in her 20s pariser Art, yellow orange, simple, folk, caucasian, dark hair, mysterious charm, rough and textured natural materials, use of patchwork and embroidery handicraft  techniques, hair with folk and wild natural curls, detailed intricate insanely detailed octane render trending on artstation, 8k artistic photography, photorealistic concept art, soft natural volumetric cinematic perfect light --stylize 600 --chaos 50, ultra hd, realistic, vivid colors, highly detailed, UHD drawing, pen and ink, perfect composition, beautiful detailed intricate insanely detailed octane render trending on artstation, 8k artistic photography, photorealistic concept art, soft natural volumetric cinematic perfect light

image.png

06. 高冷女孩

chinese girl,Translucent woman, ethereal beauty, high-resolution portrait digital painting, backlight illuminating form, delicate interplay of light and shadow, soft-focus background with bokeh effect, color palette of cool red and purples, ultra fine, digital render.

image.png

07. 晚礼服

chinese girl,Translucent woman, ethereal beauty, high-resolution portrait digital painting, backlight illuminating form, delicate interplay of light and shadow, soft-focus background with bokeh effect, color palette of cool red and purples, ultra fine, digital render.

image.png

08. 国风

chinese girl,Beautiful chinese girl sitting, close up, binding hair, wearing chinese  saree Oil painting portrait, perfect composition , Watercolor, trending on artstation, sharp focus, studio photo, intricate details, highly detailed, by greg rutkowski

image.png

CosXL Edit模型图像编辑体验

要想使用CosXL图像编辑,首先我们需要下载对应模型,并放置在ComfyUI/models/checkpoints目录 下,无需安装其他插件,导入对应的ComfyUI工作流就可以开始体验了。对应的工作流可以在线下载或者文末已提供对应网盘下载方式。在线下载地址:https://comfyanonymous.github.io/ComfyUI_examples/edit_models/

image.png

原图

image.png

01. 编辑背景

将原图背景切换为粉色背景

pink ground

image.png

02. 编辑细节

编辑图像,增加雨、雪,以及夜晚细节

snow, rain, night

image.png

03. 切换风格

切换图片风格为动画风格

anime,  purple hair, sunglasses,close-up

image.png

04. 水彩风格

watercolour

image.png

05. 线条素描风格

line drawing style

image.png

总的来说,StabilityAI新开源的CosXL模型为用户提供了更强大的艺术风格创作能力,其出色的色彩处理和图像变化速率改进使得生成的图像更为细腻。同时,Edit版本的指令性图像编辑功能为用户提供了更多的创作可能。尽管在写实方面有所不足,但其在艺术表达方面的提升无疑为AI在艺术领域的发展注入了新的活力。

@版权声明:部分内容从网络收集整理,如有侵权,请联系删除!

相关文章