Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Contribute to GitLab
Sign in / Register
Toggle navigation
S
stable-diffusion-webui
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Administrator
stable-diffusion-webui
Commits
f9c5da15
Commit
f9c5da15
authored
Oct 08, 2022
by
AUTOMATIC
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
add fallback for xformers_attnblock_forward
parent
a5550f02
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
sd_hijack_optimizations.py
modules/sd_hijack_optimizations.py
+4
-1
No files found.
modules/sd_hijack_optimizations.py
View file @
f9c5da15
...
...
@@ -211,6 +211,7 @@ def cross_attention_attnblock_forward(self, x):
return
h3
def
xformers_attnblock_forward
(
self
,
x
):
try
:
h_
=
x
h_
=
self
.
norm
(
h_
)
q1
=
self
.
q
(
h_
)
.
contiguous
()
...
...
@@ -218,4 +219,6 @@ def xformers_attnblock_forward(self, x):
v
=
self
.
v
(
h_
)
.
contiguous
()
out
=
xformers
.
ops
.
memory_efficient_attention
(
q1
,
k1
,
v
)
out
=
self
.
proj_out
(
out
)
return
x
+
out
return
x
+
out
except
NotImplementedError
:
return
cross_attention_attnblock_forward
(
self
,
x
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment