Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to start evaluating models with LATM? #8

Open
DryPilgrim opened this issue Nov 14, 2023 · 0 comments
Open

How to start evaluating models with LATM? #8

DryPilgrim opened this issue Nov 14, 2023 · 0 comments

Comments

@DryPilgrim
Copy link

  1. 没有SFT模型吗?
  2. 这个工作是类似COT在prompt上做工作吗?
  3. 按照论文的意思,在评测和实际工作的时候,是不是需要三个模型?
  4. LATM的prompt在哪里呀,https://github.com/ctlllll/LLM-ToolMaker/blob/main/cot-prompts/chinese_remainder_theorem.txt 这个里面并没有给出工具集,找不到chinese_remainder_theorem的工具 find_number(max_limit, divisors, remainders)

//en

  1. Is there no SFT model?
  2. Is this work similar to how COT works on prompts?
  3. According to the meaning of the paper, are three models needed during evaluation and actual work?
  4. Where is the prompt of LATM? https://github.com/ctlllll/LLM-ToolMaker/blob/main/cot-prompts/chinese_remainder_theorem.txt There is no tool set given in this, and the tool find_number of chinese_remainder_theorem cannot be found. (max_limit, divisors, remainders)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant