Skip to content

Commit

Permalink
fix port
Browse files Browse the repository at this point in the history
  • Loading branch information
neph1 committed Aug 1, 2023
1 parent bd5287f commit f312559
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tale/llm_config.yaml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
URL: "http://localhost:5006"
URL: "http://localhost:5001"
ENDPOINT: "/api/v1/generate"
DEFAULT_BODY: '{"stop_sequence": "\n\n", "max_length":300, "max_context_length":4096, "temperature":1.0, "top_k":120, "top_a":0.0, "top_p":0.85, "typical_p":1.0, "tfs":1.0, "rep_pen":1.2, "rep_pen_range":256, "mirostat":2, "mirostat_tau":5.0, "mirostat_eta":0.1, "sampler_order":[6,0,1,3,4,2,5], "seed":-1}'
MEMORY_SIZE: 1024
Expand Down

0 comments on commit f312559

Please sign in to comment.