Skip to content

Commit f2d2b2d

Browse files
author
clams-bot
committed
adding metadata of llava-captioner.v1.1
1 parent db5bb77 commit f2d2b2d

File tree

5 files changed

+134
-2
lines changed

5 files changed

+134
-2
lines changed
+73
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,73 @@
1+
---
2+
layout: posts
3+
classes: wide
4+
title: "Llava Captioner (v1.1)"
5+
date: 2024-05-23T19:38:32+00:00
6+
---
7+
## About this version
8+
9+
- Submitter: [kelleyl](https://github.com/kelleyl)
10+
- Submission Time: 2024-05-23T19:38:32+00:00
11+
- Prebuilt Container Image: [ghcr.io/clamsproject/app-llava-captioner:v1.1](https://github.com/clamsproject/app-llava-captioner/pkgs/container/app-llava-captioner/v1.1)
12+
- Release Notes
13+
14+
(no notes provided by the developer)
15+
16+
## About this app (See raw [metadata.json](metadata.json))
17+
18+
**Applies llava to video frames.**
19+
20+
- App ID: [http://apps.clams.ai/llava-captioner/v1.1](http://apps.clams.ai/llava-captioner/v1.1)
21+
- App License: Apache 2.0
22+
- Source Repository: [https://github.com/clamsproject/app-llava-captioner](https://github.com/clamsproject/app-llava-captioner) ([source tree of the submitted version](https://github.com/clamsproject/app-llava-captioner/tree/v1.1))
23+
24+
25+
#### Inputs
26+
(**Note**: "*" as a property value means that the property is required but can be any value.)
27+
28+
- [http://mmif.clams.ai/vocabulary/VideoDocument/v1](http://mmif.clams.ai/vocabulary/VideoDocument/v1) (required)
29+
(of any properties)
30+
31+
- [http://mmif.clams.ai/vocabulary/TimeFrame/v5](http://mmif.clams.ai/vocabulary/TimeFrame/v5) (required)
32+
(of any properties)
33+
34+
35+
36+
#### Configurable Parameters
37+
(**Note**: _Multivalued_ means the parameter can have one or more values.)
38+
39+
- `defaultPrompt`: optional, defaults to `What is shown in this video frame?`
40+
41+
- Type: string
42+
- Multivalued: False
43+
44+
45+
> default prompt to use for timeframes not specified in the promptMap. If set to `-`, timeframes not specified in the promptMap will be skipped.
46+
- `promptMap`: optional, defaults to `[]`
47+
48+
- Type: map
49+
- Multivalued: True
50+
51+
52+
> mapping of labels of the input timeframe annotations to new prompts. Must be formatted as "IN_LABEL:PROMPT" (with a colon). To pass multiple mappings, use this parameter multiple times. By default, any timeframe labels not mapped to a prompt will be used with the defaultprompt. In order to skip timeframes with a particular label, pass `-` as the prompt value.in order to skip all timeframes not specified in the promptMap, set the defaultPromptparameter to `-`
53+
- `pretty`: optional, defaults to `false`
54+
55+
- Type: boolean
56+
- Multivalued: False
57+
- Choices: **_`false`_**, `true`
58+
59+
60+
> The JSON body of the HTTP response will be re-formatted with 2-space indentation
61+
62+
63+
#### Outputs
64+
(**Note**: "*" as a property value means that the property is required but can be any value.)
65+
66+
(**Note**: Not all output annotations are always generated.)
67+
68+
- [http://mmif.clams.ai/vocabulary/Alignment/v1](http://mmif.clams.ai/vocabulary/Alignment/v1)
69+
(of any properties)
70+
71+
- [http://mmif.clams.ai/vocabulary/TextDocument/v1](http://mmif.clams.ai/vocabulary/TextDocument/v1)
72+
(of any properties)
73+
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,50 @@
1+
{
2+
"name": "Llava Captioner",
3+
"description": "Applies llava to video frames.",
4+
"app_version": "v1.1",
5+
"mmif_version": "1.0.4",
6+
"app_license": "Apache 2.0",
7+
"identifier": "http://apps.clams.ai/llava-captioner/v1.1",
8+
"url": "https://github.com/clamsproject/app-llava-captioner",
9+
"input": [
10+
{
11+
"@type": "http://mmif.clams.ai/vocabulary/VideoDocument/v1",
12+
"required": true
13+
},
14+
{
15+
"@type": "http://mmif.clams.ai/vocabulary/TimeFrame/v5",
16+
"required": true
17+
}
18+
],
19+
"output": [
20+
{
21+
"@type": "http://mmif.clams.ai/vocabulary/Alignment/v1"
22+
},
23+
{
24+
"@type": "http://mmif.clams.ai/vocabulary/TextDocument/v1"
25+
}
26+
],
27+
"parameters": [
28+
{
29+
"name": "defaultPrompt",
30+
"description": "default prompt to use for timeframes not specified in the promptMap. If set to `-`, timeframes not specified in the promptMap will be skipped.",
31+
"type": "string",
32+
"default": "What is shown in this video frame?",
33+
"multivalued": false
34+
},
35+
{
36+
"name": "promptMap",
37+
"description": "mapping of labels of the input timeframe annotations to new prompts. Must be formatted as \"IN_LABEL:PROMPT\" (with a colon). To pass multiple mappings, use this parameter multiple times. By default, any timeframe labels not mapped to a prompt will be used with the defaultprompt. In order to skip timeframes with a particular label, pass `-` as the prompt value.in order to skip all timeframes not specified in the promptMap, set the defaultPromptparameter to `-`",
38+
"type": "map",
39+
"default": [],
40+
"multivalued": true
41+
},
42+
{
43+
"name": "pretty",
44+
"description": "The JSON body of the HTTP response will be re-formatted with 2-space indentation",
45+
"type": "boolean",
46+
"default": false,
47+
"multivalued": false
48+
}
49+
]
50+
}
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
{
2+
"time": "2024-05-23T19:38:32+00:00",
3+
"submitter": "kelleyl",
4+
"image": "ghcr.io/clamsproject/app-llava-captioner:v1.1"
5+
}

docs/_data/app-index.json

+5-1
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,12 @@
11
{
22
"http://apps.clams.ai/llava-captioner": {
33
"description": "Applies llava to video frames.",
4-
"latest_update": "2024-05-23T19:26:17+00:00",
4+
"latest_update": "2024-05-23T19:38:32+00:00",
55
"versions": [
6+
[
7+
"v1.1",
8+
"kelleyl"
9+
],
610
[
711
"v1.0",
812
"kelleyl"

docs/_data/apps.json

+1-1
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)