smart_ptr multi-turn demo

[haowhsu-quic]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/9743

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 71 New Failures

As of commit 81abcf9 with merge base 90f0843 ():

NEW FAILURES - The following jobs have failed:

• Check Labels / Check labels (gh)
  RuntimeError: Error checking labels: PR does not have required labels
• Lint / lintrunner / linux-job (gh)
  RuntimeError: Command docker exec -t 78ee33c4a675348a4469e5c71b85c0fd18a277ddf6de280dd7a8cdee2817b20a /exec failed with exit code 1
• pull / android / build-llm-demo / linux-job (gh)
  RuntimeError: Command docker exec -t 064eb63fb2ebdae861020c9e6984b12c80c66dc7d8134ddb234829afc6464065 /exec failed with exit code 1
• pull / test-binary-size-linux / linux-job (gh)
  RuntimeError: Command docker exec -t a34c7d50811ca5d439a4dc1e75ea59481706d586d11821de98518ca888df8632 /exec failed with exit code 1
• pull / test-binary-size-linux-gcc / linux-job (gh)
  RuntimeError: Command docker exec -t 4bff5ed8e34773fabd4122d1c5287a297b741859d056afe521c834887576bfa3 /exec failed with exit code 1
• pull / test-custom-ops-linux / linux-job (gh)
  RuntimeError: Command docker exec -t d0fcfd33cdd2ec416c687e6049daf87af4edaa84959ecd7529f570532fdb8d65 /exec failed with exit code 1
• pull / test-eval_llama-mmlu-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 9125e3e4ecb596fa2d6095636458479a01ef4e918160a44b4a673220bf194132 /exec failed with exit code 1
• pull / test-eval_llama-wikitext-linux / linux-job (gh)
  RuntimeError: Command docker exec -t c4017d8709163921824dd7b2feede895f9f59b54df35ab1d48708163f6411eb0 /exec failed with exit code 1
• pull / test-llama_runner_eager-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 208acb981eb62bab4c26498750240d4d1a04c97fff314c3de7a2a218e8e484a8 /exec failed with exit code 1
• pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 618380496d1fbcac0193018478ec6211e52a70092cf0cb2a5798285fb2a229e6 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t fd7388bf207d5077c141bdf83b3766c70327fef7ea8577c9dc93031ce51afa1f /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  RuntimeError: Command docker exec -t e34f4f9d7ec60841f4921e26b88d845abe11348252096132163b6013c5b46b76 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
  RuntimeError: Command docker exec -t addafd8f0edd1f093288b2b49fb1e0a9a0400e6ad15bacfae36bea3c4b9db803 /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  RuntimeError: Command docker exec -t b34595a36dda4a4018d0dddf678447a8b1cb4e29f8095f31d4164b7f6d4ae73f /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 6785cb5356b7f988cea0ad65cd6efdb08fd669bf3c6e4511800ba067f24ed6bb /exec failed with exit code 1
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  RuntimeError: Command docker exec -t a1bee8c9c0117ea5ea4e561f64e76001c14a1f0144691935ca3ece31265891c8 /exec failed with exit code 1
• pull / test-llama-runner-linux-android / linux-job (gh)
  RuntimeError: Command docker exec -t a6cf30094e6659d7c94e254b5bd0b20bde4fc957da7de8adf571cb41c0c93a44 /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 9c52fdac428d0fddbb375f30f9b3487d9eeca0527a7661e50ddbd3da2242016c /exec failed with exit code 1
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  RuntimeError: Command docker exec -t 198a15f0dedc90dd6b57267a65b90b68880b8ffa930c6de6256757b904a61068 /exec failed with exit code 1
• pull / test-llava-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t f19a8707ff3054b45036da54dff67fa69b2949d9037127ab8ccffb1f8aa6cf6f /exec failed with exit code 1
• pull / test-models-linux (add_mul, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 893028dc0fa034cb57c626a64e0356eca6f82c71b809627819ea5081827a304f /exec failed with exit code 1
• pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 239d97f557e97968de5ad040d8d683343543ae43df99a819c28f72ee3faf2e71 /exec failed with exit code 1
• pull / test-models-linux (add, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 1deecd8b1a214305ea6fac2e0cf700e039a56ec820b82e938fdc2493f16e6a66 /exec failed with exit code 1
• pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 52ff7aac1b1b299a722f5929b5b520af197e840b27a75391b91513feed63439f /exec failed with exit code 1
• pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 59c4bd046519a5e5f47f5699e1ffa01ea3ab4fc99275867fcd431c8da77b36b9 /exec failed with exit code 1
• pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t c792de31347f09b9cf83d2959e6e3832810074eeecee75b1f7984e74bd9e90fa /exec failed with exit code 1
• pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 895baed703f29c7cb7097386c7edd146bebc14196cea2a7618c7a66319ec78d7 /exec failed with exit code 1
• pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t e68f8372b78b8eab3b8c277d605226d9521a7dd948d7691e714b9922343819cf /exec failed with exit code 1
• pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 74adfde8cb768d86cf5e65d3be8e29352ca8a15995a99521fd5a0aca1cc4af2b /exec failed with exit code 1
• pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t f9f93554aadaa206c66a8855b7ca29f5c80a6f80c61e0f503f7c4ae0f4a48baa /exec failed with exit code 1
• pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 1da25b73bbfeabd1b0d84e483ce31e1f2777da7ba46ab7b88ce6a40112eadb5d /exec failed with exit code 1
• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t feeeb648ae94750393d41bdf608d78781e3650e0cfb8c2c8d185f39a40e4de99 /exec failed with exit code 1
• pull / test-models-linux (linear, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 7d0bf6a91b93f60b0c2c79c802a557a72f8146f14ec130d426e266e06998c8e2 /exec failed with exit code 1
• pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 762584bded74212c9dea35324d88714a76cc264b45341f9b4afa10021454d940 /exec failed with exit code 1
• pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t d4e06a0001b266c89eb9c16cd5dead63e375905a5ddd5f62e9c5698e5c4d013f /exec failed with exit code 1
• pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4bcd774a10b88de223fd941c0fba4ebae6fc8d56026aef15063ac930c6807223 /exec failed with exit code 1
• pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 30185fde39b382a7ac25ac8126cd417402cf2563694728c874920d7b9acedd3c /exec failed with exit code 1
• pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 7d5eb5e7ad33fc8be9107d5806f87dc946a831e998d8cb0991a29560178e2bda /exec failed with exit code 1
• pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 78af9f27d9e53863ed2076d7e10165cd644a345d6de951eee386170650c0a12c /exec failed with exit code 1
• pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 99b96f32afe3ec227ede74d6e4aef0c005c420063df3682010e99e1bfb60339d /exec failed with exit code 1
• pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 32992a7c5a1467a5290981fffad4661191bec80dda4a8b1ba9ca214be8744a11 /exec failed with exit code 1
• pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t ef8d09981ae62cbd99b552b03f0b36558af9ee8483a5e94bf3af7ce422e46d33 /exec failed with exit code 1
• pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t aae806f55fc7034984b6d813e78e550361fc03c3e6ce0dd5599c3de184962627 /exec failed with exit code 1
• pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 4ea4fd3201ccb75ed271b74a668e85ef3e71a801598ad0c19565a7172e0585a0 /exec failed with exit code 1
• pull / test-models-linux (w2l, portable, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t f60bc2ed876b56294f036947b9d6130f614732f29045b3f6d90c94a6bfd56ca8 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 4b6604fdf95623150b2da9a7997f39086529f79bd979fe15d8b5a08ed4635483 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 8ac38745f9a8d5afc927a36d1d1bad0e3182146b50433e83d476ff3adac47385 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
  RuntimeError: Command docker exec -t abe83abeb3ae250a3af0310ba729bae8b56a9293f2604a81b7c19b885a12c8b6 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t b2630dc46ff8eeb67739de839f4b7a885caec166c58321aab3ca7becc58b76db /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 0910eaf9d9e0edb6466f26c13b729c0fd4481bea26b759d4e19e5388990fcb59 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t 5bb911774caf44b1ab2622a4cd74db5cb9213879012e88e75575d960daf613b2 /exec failed with exit code 1
• pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t de01a4aeb73400e3ec423bbbe755423aed113bf56f5a4094310cefd6330103e0 /exec failed with exit code 1
• pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  RuntimeError: Command docker exec -t 9080f5dd57da04dc907a4f86b5069558aab260b9f912053ac9e4b1928be94a6a /exec failed with exit code 1
• pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
  RuntimeError: Command docker exec -t 41f962268198fa394bde6a1a02943de4d3e204b29950a132f3dc9d18e97c4439 /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 71663df773ef09c54f7e2aa9626299ba46a25ea554807ca8797d2783f728e1ea /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t d2096fe95aca2f57da99a8bae003a770ea46ce4180d82c3d6bf4e5fbb52138a8 /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t c6bea9de5d0e843f14eb384849d5ce23e6b686b2279f9359783789f138599ce9 /exec failed with exit code 1
• pull / test-moshi-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 6eb80b105196645eedf875822e96c8cf4ac34aa5f766765335ca0341e6ec8dc3 /exec failed with exit code 1
• pull / test-phi-3-mini-runner-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 4a69fa254793400ce498863c3b68023f3777c3843c8ded789d8ece9bca149e8e /exec failed with exit code 1
• pull / test-pybind-build-linux / linux-job (gh)
  RuntimeError: Command docker exec -t dfdd628c0ffb5775313d805208a125ac71f5ac2a71ddb36d6513209c487112af /exec failed with exit code 1
• pull / test-quantized-aot-lib-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 4cc172bc012f5753c0b3e7c700ee31b87432a38f6c6d2a9f8c0a58906613748b /exec failed with exit code 1
• pull / test-selective-build-linux / linux-job (gh)
  RuntimeError: Command docker exec -t b8bb2f21d07a59e22a35faefd58823e05024093543208b1e54591aaff211891f /exec failed with exit code 1
• pull / test-setup-linux-gcc / linux-job (gh)
  RuntimeError: Command docker exec -t e4919b35ad5f5318c72c033cb28893e9ba8acec0a64634fa0bc72380a3a97ae2 /exec failed with exit code 1
• pull / test-static-llama-qnn-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 941d793a854e68b96f1e7f63ced73240991de2e1f65b33c4080fc33a70e858a4 /exec failed with exit code 1
• pull / unittest / linux / linux-job (gh)
  RuntimeError: Command docker exec -t 68d023518fc651b1b0d36065ae5b664abc41e5082222309c31504b9058688006 /exec failed with exit code 1
• pull / unittest / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / unittest-arm / linux-job (gh)
  RuntimeError: Command docker exec -t eff8cd24aa7f7f79a6ab6ed3bbbcd511c5e07e16f235804e1629efcf77f0e9c8 /exec failed with exit code 1
• pull / unittest-buck / linux / linux-job (gh)
  RuntimeError: Command docker exec -t 708e804437b28f8bd66f595052cb06ff8a2922e97eff0fee529fc26bb3d55951 /exec failed with exit code 1
• pull / unittest-buck / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  RuntimeError: Command docker exec -t 36f403061d32724c755a9f554645449014bf26158cc7e8500ee15df5f3784cb8 /exec failed with exit code 1
• pull / unittest-editable / macos / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your changes are user facing and intended to be a part of release notes, please use a label starting with release notes:.

If not, please add the topic: not user facing label.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "topic: not user facing"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[facebook-github-bot]

@cccclai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@billmguo has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[haowhsu-quic]

Sorry I missed one thing, the CLI argument of --prompt to repro this PR is Once upon a time.

[haowhsu-quic]

Sorry, should be existent k_cache_in.

[cccclai]

Yeah I print the result and it looks like following

Once upon a time, there was a little girl named Lily. She loved to play with her toys and her favorite toy was a big, red ball. One day, Lily's mom asked her to help her with the laundry. Lily was happy to help and she put all the clothes in the washing machine.
After the clothes were washed, Lily's mom asked her to help her hang them up to dry. Lily grabbed