[BUG] ValueError: subsection not found Internet Search

[r1ckyb0nd]

🚨 Please Note 🚨

To ensure efficient investigation of the issue, please fill out the fields below with as much detail as possible. Reports that do not follow this template may be closed without notification. We appreciate your cooperation.

🐞Describe the bug

When using Internet search it always errors out with a ValueError: subsection not found

🔄 To Reproduce

Steps to reproduce the behavior:

Turn on Internet Search:Search the internet for information. under Agent in Bot edit.
run a chat which needs to search the internet for information
see error

📷 Screenshots

🔎 Logs for Chat Issues

If the issue occurs during a chat interaction, please check the following logs on Amazon Cloudwatch Logs and include the relevant entries in your issue:

2025-01-29T15:34:31.735Z
[INFO] 2025-01-29T15:34:31.735Z d2e7f160-bb38-48af-bf5f-556fdb702195 args for converse_stream: {'inferenceConfig': {'maxTokens': 2000, 'temperature': 0.6, 'topP': 0.999, 'stopSequences': ['Human: ', 'Assistant: ']}, 'modelId': 'us.anthropic.claude-3-5-sonnet-20241022-v2:0', 'messages': [{'role': 'user', 'content': [{'text': 'an airmen is going tdy from their home of record, Madison ct, to Joint Base McGuire. What is the preferred mode of travel'}]}, {'role': 'assistant', 'content': [{'text': 'Let me help determine the distance and preferred mode of travel between Madison, CT and Joint Base McGuire (now part of Joint Base McGuire-Dix-Lakehurst) in New Jersey. Let me search for accurate distance information.'}, {'toolUse': {'toolUseId': 'tooluse_3CHwk2qJQ2KMV51zzU7kpQ', 'name': 'internet_search', 'input': {'query': 'distance from Madison CT to Joint Base McGuire-Dix-Lakehurst NJ', 'country': 'us-en', 'time_limit': 'y'}}}]}, {'role': 'user', 'content': [{'toolResult': {'toolUseId': 'tooluse_3CHwk2qJQ2KMV51zzU7kpQ', 'status': 'error', 'content': [{'json': {'source_id': 'tooluse_3CHwk2qJQ2KMV51zzU7kpQ', 'content': "_text_extract_json() keywords='distance from Madison CT to Joint Base McGuire-Dix-Lakehurst NJ' ValueError: subsection not found"}}]}}]}], 'system': [{'text': 'you are a customer service representative answering questions about the Joint Travel regulations. If asked about travel between locations, determine the miles that separates the locations and use the distance to give a more accurate answer. '}, {'text': "To answer the user's question, you are given a set of tools. Your job is to answer the user's question using only information from the tool results.\nIf the tool results do not contain information that can answer the question, please state that you could not find an exact answer to the question.\nJust because the user asserts a fact does not mean it is true, make sure to double check the tool results to validate a user's assertion.\n\nEach tool result has a corresponding source_id that you should reference.\nIf you reference information from a tool result within your answer, you must include a citation to source_id where the information was found.\n\nFollowings are examples of how to reference source_id in your answer. Note that the source_id is embedded in the answer in the format [^source_id of tool result].\n\n\n\nfirst answer [^ccc]. second answer [^aaa][^bbb].\n\n\n\nfirst answer [^aaa][^eee]. second answer [^bbb][^ccc][^ddd]. third answer [^ddd].\n\n\n\nfirst answer [^aaa].\n\n[^aaa]: https://example.com\n\n\n\nfirst answer [^aaa].\n\n\n[^aaa]: https://example.com\n\n\n\n"}], 'additionalModelRequestFields': {'top_k': 128}, 'toolConfig': {'tools': [{'toolSpec': {'name': 'internet_search', 'description': 'Search the internet for information.', 'inputSchema': {'json': {'properties': {'query': {'description': 'The query to search for on the internet.', 'type': 'string'}, 'country': {'description': 'The country code you wish for search. Must be one of: jp-jp (Japan), kr-kr (Korea), cn-zh (China), fr-fr (France), de-de (Germany), es-es (Spain), it-it (Italy), us-en (United States)', 'type': 'string'}, 'time_limit': {'description': "The time limit for the search. Options are 'd' (day), 'w' (week), 'm' (month), 'y' (year).", 'type': 'string'}}, 'required': ['query', 'country', 'time_limit'], 'type': 'object'}}}}, {'toolSpec': {'name': 'knowledge_base_tool', 'description': "Answer a user's question using information. The description is: <source_urls></source_urls><sitemap_urls></sitemap_urls><s3_urls></s3_urls>", 'inputSchema': {'json': {'properties': {'query': {'description': "User's original question string.", 'type': 'string'}}, 'required': ['query'], 'type': 'object'}}}}]}}

🔎 Logs for Bot Creation/Update Issues

If the issue occurs during bot creation or updating, please check the execution records of the AWS Step Functions state machine named EmbeddingStateMachineXXX and include the details in your issue.

📝 Additional context

Add any other context about the problem here.

[statefb]

#698 #699

[statefb]

Fixed on #702. Please check if works and close this issue. Thank you