Fix the temperature argument to accept values passed via the cmd line.

LlamaEnjoyer · LlamaEnjoyer · commit e960dfd68dd4 · 2024-09-24T17:18:08.000+02:00
diff --git a/eval/humaneval.py b/eval/humaneval.py
@@ -119,7 +119,7 @@
 
 gen_settings = ExLlamaV2Sampler.Settings(
     token_repetition_penalty = 1.0,
-    temperature = 0.6,
+    temperature = args.temperature if args.temperature is not None else 0.6,
     top_k = 50,
     top_p = 0.6
 )

Original file line number	Diff line number	Diff line change
`@@ -119,7 +119,7 @@`
`119`	`119`
`120`	`120`	`gen_settings = ExLlamaV2Sampler.Settings(`
`121`	`121`	`token_repetition_penalty = 1.0,`
`122`		`- temperature = 0.6,`
	`122`	`+ temperature = args.temperature if args.temperature is not None else 0.6,`
`123`	`123`	`top_k = 50,`
`124`	`124`	`top_p = 0.6`
`125`	`125`	`)`