Commit Graph

3 Commits

Author SHA1 Message Date
Dr. Christoph Mittendorf
72a07190bf
Excluding the math library INSTEAD using the pow() function
scale = 1 / (self.dim_head ** 0.5) does the same as scale = 1 / math.sqrt(math.sqrt(self.dim_head))

therefore we do not need to import math here and safe some.

Recommended: Import libraries only when you need them: This will reduce the number of times that the interpreter needs to load the library's code.
2024-01-05 21:37:33 +01:00
lllyasviel
0c4f20a0d2
try fix #1761 again (#1680) 2023-12-31 04:38:31 -08:00
lllyasviel
e8d88d3e25 2.1.826 2023-12-12 11:38:05 -08:00