Search results

Data connection

Status: Open.

#159 In awslabs/llm-hosting-container;

· kiowajackson opened on Jun 26, 2025

Establish CI/CD and Repository Structure

Status: Open.

#158 In awslabs/llm-hosting-container;

· kiowajackson opened on Jun 26, 2025

Not able to get the files copied inside Dockerfile

Status: Open.

#56 In awslabs/llm-hosting-container;

· byash11 opened on Feb 7, 2024

ValueError: Unsupported model type falcon

Status: Open.

#35 In awslabs/llm-hosting-container;

· shenshaoyong opened on Sep 30, 2023

Is there a way to get GenerateResponse full json when calling sagemaker endpoints

Status: Open.

#32 In awslabs/llm-hosting-container;

· nth-attempt opened on Sep 13, 2023

How can I delpoy a model with AWS S3 and without downloading model from hunggingface via TGI image on Sagemaker?

Status: Open.

#27 In awslabs/llm-hosting-container;

· jenkoon opened on Aug 20, 2023

Latency and Throughput Inquiry

Status: Open.

#20 In awslabs/llm-hosting-container;

· ctandrewtran opened on Jul 23, 2023