https://github.com/kijai/ComfyUI-SUPIR/issues/143 直接装 open-clip-torch 的旧版本: 复制pip installopen-clip-torch==2.24.0 猜测这个 bug 的原因是: open_clip_torch 后续更新了改了些什么东西,导致和旧仓库的 dalle2-pytorch 或者 git+https://github.com/openai/CLIP.git 冲突了。 博主曾是一名广...
with its black-and-white fur, strums the guitar while seated on a rock. Behind, a breathtaking mountain range glows under the orange and pink hues of the setting sun, contrasting beautifully with the lake
RuntimeError: The shape of the 2D attn_mask is torch.Size([399, 399]), but should be (355, 355). Do you know, what could cause this issue & how to fix it? EDIT: this is happening only when I have batch size per gpu = 2. After I decreased the image size and increased batch...
SDXL Error : "The shape of the 2D attn_mask is torch.Size([77, 77]), but should be (1, 1)",跑一个SDXL模型也不知道为什么就出现这个问题。上网搜了下发现这么个issue:https://github.com/kijai/ComfyUI-SUPIR/issues/143直接装open-clip-torch的旧版本:pipinstallo
MA_TRAINING_CONTAINER_HEARTBEAT_WATCH_IS_ON=1 MODELARTS_SCC_SERVICE_PORT=34770 MA_LOG_DIR=/home/ma-user/modelarts/log PYTHONPATH=/usr/local/Ascend/tfplugin/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/tools/ms_fmk_transplt/torch_npu_bridge:/usr/local/Ascend/ascend-...
size(-1) scores = torch.matmul(query, key.transpose(-2, -1)) / math.sqrt(d_k) if mask is not None: scores = scores.masked_fill(mask == 0, -1e9) p_attn = F.softmax(scores, dim=-1) if dropout is not None: p_attn = dropout(p_attn) return torch.matmul(p_attn, value)...
The value must be between 1 and world_size , and must be <= hybrid_shard_degree. The default value is 1. Note that passing a value greater than 1 does not enable context parallelism automatically; you also need to use the torch.sagemaker.transform API to wrap the model in your training...
src_attn(x, m, m, src_mask)) return self.sublayer[2](x, self.feed_forward) def subsequent_mask(size): "Mask out subsequent positions" attn_shape = (1, size, size) subsequent_mask_value = torch.triu(torch.ones(attn_shape), diagonal=1).type(torch.uint8) return subsequent_mask_...
white stripe running along the side. It has two doors on either side of the car, one on top of the other, and a small window on the front. The building appears to be old and dilapidated, with peeling paint and crumbling walls. The sky is blue and there are trees in the background...
decoder_layers[l](h_t, K_att_l, V_att_l, mask) else: # decoder layers with single head (final layer) q_final = self.Wq_final(h_t) bsz = h_t.size(0) q_final = q_final.view(bsz, 1, self.dim_emb) attn_weights = myMHA(q_final, K_att_l, V_att_l, 1, mask, 10)...