Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added quantization for OUTETTS #2662

Draft
wants to merge 24 commits into
base: latest
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
5ef8a9e
Added quantization
nikita-malininn Jan 16, 2025
e60e952
Fix CI
nikita-malininn Jan 16, 2025
a8ddf8e
Black updates
nikita-malininn Jan 16, 2025
ac0a654
Missed NNCF
nikita-malininn Jan 16, 2025
2a4f1f4
Merge branch 'latest' into nm/update_outetts
nikita-malininn Jan 27, 2025
1c2a625
Update ov_outetts_helper.py
nikita-malininn Jan 27, 2025
644fcd1
Update README.md
nikita-malininn Jan 27, 2025
8f1e667
Added performance check
nikita-malininn Jan 27, 2025
2dc32d8
Fix CI
nikita-malininn Jan 27, 2025
5a2bb7d
Merge branch 'nm/update_outetts' of https://github.com/KodiaqQ/openvi…
nikita-malininn Jan 27, 2025
c93ea44
Merge branch 'latest' into nm/update_outetts
nikita-malininn Jan 28, 2025
8ff0d5a
Generate pipeline validation
nikita-malininn Jan 28, 2025
39e8e22
Update with ignored scope
nikita-malininn Jan 30, 2025
46cfc2c
Merge branch 'nm/update_outetts' of https://github.com/KodiaqQ/openvi…
nikita-malininn Jan 30, 2025
d7ecb3c
Merge branch 'latest' into nm/update_outetts
nikita-malininn Feb 3, 2025
515cbf8
Update notebook
nikita-malininn Feb 3, 2025
75d24ff
Merge branch 'nm/update_outetts' of https://github.com/KodiaqQ/openvi…
nikita-malininn Feb 3, 2025
753ea59
Update path
nikita-malininn Feb 3, 2025
955dd73
pip helper usage
nikita-malininn Feb 4, 2025
9a8d99d
Added to ignored list
nikita-malininn Feb 4, 2025
216991c
Fix
nikita-malininn Feb 4, 2025
dd41891
Merge branch 'latest' into nm/update_outetts
nikita-malininn Feb 4, 2025
f057369
Merge branch 'latest' into nm/update_outetts
nikita-malininn Feb 5, 2025
4caee85
Merge branch 'latest' into nm/update_outetts
nikita-malininn Feb 6, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .ci/spellcheck/.pyspelling.wordlist.txt
Original file line number Diff line number Diff line change
Expand Up @@ -456,6 +456,7 @@ learnable
LeViT
LibriSpeech
librispeech
LibriTTS
Lim
LinearCameraEmbedder
Lippipeline
Expand Down
12 changes: 7 additions & 5 deletions notebooks/outetts-text-to-speech/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,17 +2,19 @@

[OuteTTS-0.1-350M](https://huggingface.co/OuteAI/OuteTTS-0.1-350M) is a novel text-to-speech synthesis model that leverages pure language modeling without external adapters or complex architectures, built upon the LLaMa architecture. It demonstrates that high-quality speech synthesis is achievable through a straightforward approach using crafted prompts and audio tokens.

More details about model can be found in [original repo](https://github.com/edwko/OuteTTS).
More details about the model can be found in [original repo](https://github.com/edwko/OuteTTS).

In this tutorial we consider how to run OuteTTS pipeline using OpenVINO.
In this tutorial, we consider how to run the OuteTTS pipeline using OpenVINO.

## Notebook Contents

The tutorial consists of the following steps:

* Convert model to OpenVINO format using Optimum Intel
* Run Text-to-Speech synthesis using OpenVINO model
* Run Text-to-Speech synthesis with Voice Cloning using OpenVINO model
* Convert the model to OpenVINO format using Optimum Intel
* Run Text-to-Speech synthesis using the OpenVINO model
* Run Text-to-Speech synthesis with Voice Cloning using the OpenVINO model
* Optimize model using OpenVINO and NNCF
* Compare original and quantized model Text-to-Speech synthesis and performance
* Interactive demo

## Installation Instructions
Expand Down
529 changes: 355 additions & 174 deletions notebooks/outetts-text-to-speech/outetts-text-to-speech.ipynb

Large diffs are not rendered by default.

Loading