Skip to content

Commit 71d3e6e

Browse files
danielhanchenjwcolin
authored andcommitted
convert : Llama4 RoPE fix (ggml-org#12889)
1 parent a99dfe8 commit 71d3e6e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1750,7 +1750,7 @@ def generate_extra_tensors(self) -> Iterable[tuple[str, Tensor]]:
17501750

17511751
low_freq_wavelen = old_context_len / low_freq_factor
17521752
high_freq_wavelen = old_context_len / high_freq_factor
1753-
assert low_freq_wavelen != high_freq_wavelen
1753+
# assert low_freq_wavelen != high_freq_wavelen # Errors for Llama4
17541754

17551755
rope_factors = []
17561756
for freq in freqs:

0 commit comments

Comments
 (0)