We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 54d8b56 commit 9a13452Copy full SHA for 9a13452
README.md
@@ -208,11 +208,6 @@ LongRoPE's performance can be sensitive to hyperparameters. Key parameters to tu
208
Learning rate and scheduler parameters for fine-tuning
209
gradient_accumulation_steps for training stability
210
211
-- **Base Length**: The initial context length used for fine-tuning.
212
-- **Target Length**: The final context length to extend to.
213
-- **Population Size**: The number of candidate solutions to search for during the search algorithm.
214
-- **Number of Mutations**: The number of mutations to perform during the search algorithm.
215
-
216
## Results
217
218
My implementation of LongRoPE achieves the following results:
0 commit comments