[Inference] Add ASR support for Replicate provider #1679
Conversation
lucataco
requested review from
julien-c,
hanouticelina and
SBrandeis
as code owners
There was a problem hiding this comment.
Hi @lucataco, thanks a lot for the contribution! could you also add the automatic-speech-recognition mapping for Replicate in
you can find the complete guideline for provider/task JS integration in the documentation here: https://huggingface.co/docs/inference-providers/register-as-a-provider#2-js-client-integration
|
Thank you for taking a look! Ive added the mapping as specified |
| const out = response?.output as | ||
| | undefined | ||
| | { | ||
| transcription?: string; | ||
| translation?: string; | ||
| txt_file?: string; | ||
| }; |
There was a problem hiding this comment.
following the schema defined in https://replicate.com/openai/whisper/api/schema#output-schema
There was a problem hiding this comment.
Thanks @lucataco for the PR! I pushed a commit to fix the response parsing part.
Also, i think the version is missing in the providerId defined in the Replicate model mapping: https://huggingface.co/api/partners/replicate/models. it should be
"openai/whisper:8099696689d249cf8b122d833c36ac3f75505c666a395ca40ef26f68e7d3d16e". could you update it accordingly? thanks 🙏
|
Oh good catch, thank you! Yes of course. |
Hello! This PR adds support for the
Automatic Speech Recognitiontask type for Replicate models.Example:
cc @hanouticelina