|
| 1 | +--- |
| 2 | +layout: posts |
| 3 | +classes: wide |
| 4 | +title: "Llava Captioner (v1.1)" |
| 5 | +date: 2024-05-23T19:38:32+00:00 |
| 6 | +--- |
| 7 | +## About this version |
| 8 | + |
| 9 | +- Submitter: [kelleyl](https://github.com/kelleyl) |
| 10 | +- Submission Time: 2024-05-23T19:38:32+00:00 |
| 11 | +- Prebuilt Container Image: [ghcr.io/clamsproject/app-llava-captioner:v1.1](https://github.com/clamsproject/app-llava-captioner/pkgs/container/app-llava-captioner/v1.1) |
| 12 | +- Release Notes |
| 13 | + |
| 14 | + (no notes provided by the developer) |
| 15 | + |
| 16 | +## About this app (See raw [metadata.json](metadata.json)) |
| 17 | + |
| 18 | +**Applies llava to video frames.** |
| 19 | + |
| 20 | +- App ID: [http://apps.clams.ai/llava-captioner/v1.1](http://apps.clams.ai/llava-captioner/v1.1) |
| 21 | +- App License: Apache 2.0 |
| 22 | +- Source Repository: [https://github.com/clamsproject/app-llava-captioner](https://github.com/clamsproject/app-llava-captioner) ([source tree of the submitted version](https://github.com/clamsproject/app-llava-captioner/tree/v1.1)) |
| 23 | + |
| 24 | + |
| 25 | +#### Inputs |
| 26 | +(**Note**: "*" as a property value means that the property is required but can be any value.) |
| 27 | + |
| 28 | +- [http://mmif.clams.ai/vocabulary/VideoDocument/v1](http://mmif.clams.ai/vocabulary/VideoDocument/v1) (required) |
| 29 | +(of any properties) |
| 30 | + |
| 31 | +- [http://mmif.clams.ai/vocabulary/TimeFrame/v5](http://mmif.clams.ai/vocabulary/TimeFrame/v5) (required) |
| 32 | +(of any properties) |
| 33 | + |
| 34 | + |
| 35 | + |
| 36 | +#### Configurable Parameters |
| 37 | +(**Note**: _Multivalued_ means the parameter can have one or more values.) |
| 38 | + |
| 39 | +- `defaultPrompt`: optional, defaults to `What is shown in this video frame?` |
| 40 | + |
| 41 | + - Type: string |
| 42 | + - Multivalued: False |
| 43 | + |
| 44 | + |
| 45 | + > default prompt to use for timeframes not specified in the promptMap. If set to `-`, timeframes not specified in the promptMap will be skipped. |
| 46 | +- `promptMap`: optional, defaults to `[]` |
| 47 | + |
| 48 | + - Type: map |
| 49 | + - Multivalued: True |
| 50 | + |
| 51 | + |
| 52 | + > mapping of labels of the input timeframe annotations to new prompts. Must be formatted as "IN_LABEL:PROMPT" (with a colon). To pass multiple mappings, use this parameter multiple times. By default, any timeframe labels not mapped to a prompt will be used with the defaultprompt. In order to skip timeframes with a particular label, pass `-` as the prompt value.in order to skip all timeframes not specified in the promptMap, set the defaultPromptparameter to `-` |
| 53 | +- `pretty`: optional, defaults to `false` |
| 54 | + |
| 55 | + - Type: boolean |
| 56 | + - Multivalued: False |
| 57 | + - Choices: **_`false`_**, `true` |
| 58 | + |
| 59 | + |
| 60 | + > The JSON body of the HTTP response will be re-formatted with 2-space indentation |
| 61 | +
|
| 62 | + |
| 63 | +#### Outputs |
| 64 | +(**Note**: "*" as a property value means that the property is required but can be any value.) |
| 65 | + |
| 66 | +(**Note**: Not all output annotations are always generated.) |
| 67 | + |
| 68 | +- [http://mmif.clams.ai/vocabulary/Alignment/v1](http://mmif.clams.ai/vocabulary/Alignment/v1) |
| 69 | +(of any properties) |
| 70 | + |
| 71 | +- [http://mmif.clams.ai/vocabulary/TextDocument/v1](http://mmif.clams.ai/vocabulary/TextDocument/v1) |
| 72 | +(of any properties) |
| 73 | + |
0 commit comments