LiteLLM generates new PDF file name when making Bedrock block?

[jgoodyear]

I am attempting to use LiteLLM as a proxy, translating openai calls to bedrock.

When i send a pdf as part of a cache_control conversation, I've noticed that the PDF gets a file name created.

b2JqCnN0YXJ0eHJlZgo5OTI0ODIKJSVFT0YK"}, "format": "pdf", "name": "DocumentPDFmessages_b18c0623-d1fc-455f-8b70-411500984638"}

This would appear to correspond to this section of factory.py:

 def _create_bedrock_block(
        image_bytes: str, mime_type: str, image_format: str
    ) -> BedrockContentBlock:
    ...
            if is_document:
            return BedrockContentBlock(
                document=BedrockDocumentBlock(
                    source=_blob,
                    format=image_format,
                    name=f"DocumentPDFmessages_{str(uuid.uuid4())}",
                )
            )

My concern is that as I am trying to have this PDF made part of my cached tokens, the file name we pass to bedrock could be making it see the PDF as different even though the content is the same on each request.

Am I missing something?

[jgoodyear]

Created #16250 to track this issue

[jgoodyear]

This question is answered by 16250 PR merger.