AWS Inferentia SUpport #107
Description
DOes exllamav3 support AWS Inferentia? I want to use the minimax-m2 models on aws inf.
please let me know if I should be posting this request here or on TabbyAPI. THanks anyways.
{{ message }}
DOes exllamav3 support AWS Inferentia? I want to use the minimax-m2 models on aws inf.
please let me know if I should be posting this request here or on TabbyAPI. THanks anyways.