|
| 1 | +# TensorFlow Model Analysis |
| 2 | + |
| 3 | +**TensorFlow Model Analysis (TFMA)** is a library for evaluating TensorFlow |
| 4 | +models. It allows users to evaluate their models on large amounts of data in a |
| 5 | +distributed fashion, using the same metrics defined in their trainer. These |
| 6 | +metrics can also be computed over different slices of data, and the results can |
| 7 | +be visualised in Jupyter Notebooks. |
| 8 | + |
| 9 | +**TFMA may introduce backwards incompatible changes before version 1.0**. |
| 10 | + |
| 11 | +## Installation and Dependencies |
| 12 | + |
| 13 | +The easiest and recommended way to install TFMA is with the PyPI package. |
| 14 | + |
| 15 | +`pip install tensorflow-model-analysis` |
| 16 | + |
| 17 | +Currently TFMA requires that TensorFlow be installed but does not have an |
| 18 | +explicit dependency on TensorFlow as a package. See [TensorFlow |
| 19 | +documentation](https://www.tensorflow.org/install/) for more information on |
| 20 | +installing TensorFlow. |
| 21 | + |
| 22 | +To enable TFMA visualization in Jupyter Notebook, run<sup>1</sup>: |
| 23 | + |
| 24 | +``` |
| 25 | +jupyter nbextension enable --py widgetsnbextension |
| 26 | +jupyter nbextension install --py --symlink tensorflow_model_analysis |
| 27 | +jupyter nbextension enable --py tensorflow_model_analysis |
| 28 | +``` |
| 29 | + |
| 30 | +TFMA requires [Apache Beam](https://beam.apache.org/) to run distributed |
| 31 | +pipelines. Apache Beam runs in local mode by default, and can also run in |
| 32 | +distributed mode using |
| 33 | +[Google Cloud Dataflow](https://cloud.google.com/dataflow/). TFMA is designed to |
| 34 | +be extensible to other Apache Beam runners. |
| 35 | + |
| 36 | +### Compatible Versions |
| 37 | + |
| 38 | +This is a table of versions known to be compatible with each other, based on |
| 39 | +our testing framework. Other combinations may also work, but are untested. |
| 40 | + |
| 41 | +|tensorflow-model-analysis |tensorflow |apache-beam[gcp]| |
| 42 | +|---------------------------|--------------|----------------| |
| 43 | +|GitHub master |1.6 |2.4.0 | |
| 44 | + |
| 45 | +## Getting Started |
| 46 | + |
| 47 | +For instructions on using TFMA, see the [getting started |
| 48 | +guide](docs/getting_started.md). |
| 49 | + |
| 50 | +<sup>1</sup> If Jupyter is installed in your home directory, add `--user` for |
| 51 | + all commands; if Jupyter is installed in root or virtualenv is used, |
| 52 | + `--sys-prefix` might be needed. |
0 commit comments