Skip to content

Commit 6f716c0

Browse files
author
clams-bot
committed
adding metadata of llama-captioner.v1.2
1 parent f06bbc0 commit 6f716c0

File tree

5 files changed

+188
-1
lines changed

5 files changed

+188
-1
lines changed

‎docs/_apps/llama-captioner/v1.2/index.md

+97
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,97 @@
1+
---
2+
layout: posts
3+
classes: wide
4+
title: "Llama Captioner (v1.2)"
5+
date: 2025-01-23T15:43:59+00:00
6+
---
7+
## About this version
8+
9+
- Submitter: [kelleyl](https://github.com/kelleyl)
10+
- Submission Time: 2025-01-23T15:43:59+00:00
11+
- Prebuilt Container Image: [ghcr.io/clamsproject/app-llava-captioner:v1.2](https://github.com/clamsproject/app-llama-captioner/pkgs/container/app-llama-captioner/v1.2)
12+
- Release Notes
13+
14+
(no notes provided by the developer)
15+
16+
## About this app (See raw [metadata.json](metadata.json))
17+
18+
**Applies LLaMA 3.2 to video frames.**
19+
20+
- App ID: [http://apps.clams.ai/llama-captioner/v1.2](http://apps.clams.ai/llama-captioner/v1.2)
21+
- App License: Apache 2.0
22+
- Source Repository: [https://github.com/clamsproject/app-llama-captioner](https://github.com/clamsproject/app-llama-captioner) ([source tree of the submitted version](https://github.com/clamsproject/app-llama-captioner/tree/v1.2))
23+
24+
25+
#### Inputs
26+
(**Note**: "*" as a property value means that the property is required but can be any value.)
27+
28+
- [http://mmif.clams.ai/vocabulary/VideoDocument/v1](http://mmif.clams.ai/vocabulary/VideoDocument/v1) (required)
29+
(of any properties)
30+
31+
- [http://mmif.clams.ai/vocabulary/ImageDocument/v1](http://mmif.clams.ai/vocabulary/ImageDocument/v1) (required)
32+
(of any properties)
33+
34+
- [http://mmif.clams.ai/vocabulary/TimeFrame/v5](http://mmif.clams.ai/vocabulary/TimeFrame/v5) (required)
35+
(of any properties)
36+
37+
38+
39+
#### Configurable Parameters
40+
(**Note**: _Multivalued_ means the parameter can have one or more values.)
41+
42+
- `frameInterval`: optional, defaults to `300`
43+
44+
- Type: integer
45+
- Multivalued: False
46+
47+
48+
> The interval at which to extract frames from the video if there are no timeframe annotations. Default is every 30 frames.
49+
- `defaultPrompt`: optional, defaults to `Describe what is shown in this video frame. Analyze the purpose of this frame in the context of a news video. Transcribe any text present.`
50+
51+
- Type: string
52+
- Multivalued: False
53+
54+
55+
> default prompt to use for timeframes not specified in the promptMap. If set to `-`, timeframes not specified in the promptMap will be skipped.
56+
- `promptMap`: optional, defaults to `[]`
57+
58+
- Type: map
59+
- Multivalued: True
60+
61+
62+
> mapping of labels of the input timeframe annotations to new prompts. Must be formatted as "IN_LABEL:PROMPT" (with a colon). To pass multiple mappings, use this parameter multiple times. By default, any timeframe labels not mapped to a prompt will be used with the defaultprompt. In order to skip timeframes with a particular label, pass `-` as the prompt value.in order to skip all timeframes not specified in the promptMap, set the defaultPromptparameter to `-`
63+
- `modelVersion`: optional, defaults to `3.2`
64+
65+
- Type: string
66+
- Multivalued: False
67+
68+
69+
> Version of the LLaMA model to use.
70+
- `config`: optional, defaults to `config/default.yaml`
71+
72+
- Type: string
73+
- Multivalued: False
74+
75+
76+
> Name of the config file to use.
77+
- `pretty`: optional, defaults to `false`
78+
79+
- Type: boolean
80+
- Multivalued: False
81+
- Choices: **_`false`_**, `true`
82+
83+
84+
> The JSON body of the HTTP response will be re-formatted with 2-space indentation
85+
86+
87+
#### Outputs
88+
(**Note**: "*" as a property value means that the property is required but can be any value.)
89+
90+
(**Note**: Not all output annotations are always generated.)
91+
92+
- [http://mmif.clams.ai/vocabulary/Alignment/v1](http://mmif.clams.ai/vocabulary/Alignment/v1)
93+
(of any properties)
94+
95+
- [http://mmif.clams.ai/vocabulary/TextDocument/v1](http://mmif.clams.ai/vocabulary/TextDocument/v1)
96+
(of any properties)
97+

‎docs/_apps/llama-captioner/v1.2/metadata.json

+75
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,75 @@
1+
{
2+
"name": "Llama Captioner",
3+
"description": "Applies LLaMA 3.2 to video frames.",
4+
"app_version": "v1.2",
5+
"mmif_version": "1.0.5",
6+
"app_license": "Apache 2.0",
7+
"identifier": "http://apps.clams.ai/llama-captioner/v1.2",
8+
"url": "https://github.com/clamsproject/app-llama-captioner",
9+
"input": [
10+
{
11+
"@type": "http://mmif.clams.ai/vocabulary/VideoDocument/v1",
12+
"required": true
13+
},
14+
{
15+
"@type": "http://mmif.clams.ai/vocabulary/ImageDocument/v1",
16+
"required": true
17+
},
18+
{
19+
"@type": "http://mmif.clams.ai/vocabulary/TimeFrame/v5",
20+
"required": true
21+
}
22+
],
23+
"output": [
24+
{
25+
"@type": "http://mmif.clams.ai/vocabulary/Alignment/v1"
26+
},
27+
{
28+
"@type": "http://mmif.clams.ai/vocabulary/TextDocument/v1"
29+
}
30+
],
31+
"parameters": [
32+
{
33+
"name": "frameInterval",
34+
"description": "The interval at which to extract frames from the video if there are no timeframe annotations. Default is every 30 frames.",
35+
"type": "integer",
36+
"default": 300,
37+
"multivalued": false
38+
},
39+
{
40+
"name": "defaultPrompt",
41+
"description": "default prompt to use for timeframes not specified in the promptMap. If set to `-`, timeframes not specified in the promptMap will be skipped.",
42+
"type": "string",
43+
"default": "Describe what is shown in this video frame. Analyze the purpose of this frame in the context of a news video. Transcribe any text present.",
44+
"multivalued": false
45+
},
46+
{
47+
"name": "promptMap",
48+
"description": "mapping of labels of the input timeframe annotations to new prompts. Must be formatted as \"IN_LABEL:PROMPT\" (with a colon). To pass multiple mappings, use this parameter multiple times. By default, any timeframe labels not mapped to a prompt will be used with the defaultprompt. In order to skip timeframes with a particular label, pass `-` as the prompt value.in order to skip all timeframes not specified in the promptMap, set the defaultPromptparameter to `-`",
49+
"type": "map",
50+
"default": [],
51+
"multivalued": true
52+
},
53+
{
54+
"name": "modelVersion",
55+
"description": "Version of the LLaMA model to use.",
56+
"type": "string",
57+
"default": 3.2,
58+
"multivalued": false
59+
},
60+
{
61+
"name": "config",
62+
"description": "Name of the config file to use.",
63+
"type": "string",
64+
"default": "config/default.yaml",
65+
"multivalued": false
66+
},
67+
{
68+
"name": "pretty",
69+
"description": "The JSON body of the HTTP response will be re-formatted with 2-space indentation",
70+
"type": "boolean",
71+
"default": false,
72+
"multivalued": false
73+
}
74+
]
75+
}

‎docs/_apps/llama-captioner/v1.2/submission.json

+5
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
{
2+
"time": "2025-01-23T15:43:59+00:00",
3+
"submitter": "kelleyl",
4+
"image": "ghcr.io/clamsproject/app-llava-captioner:v1.2"
5+
}

‎docs/_data/app-index.json

+10
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,14 @@
11
{
2+
"http://apps.clams.ai/llama-captioner": {
3+
"description": "Applies LLaMA 3.2 to video frames.",
4+
"latest_update": "2025-01-23T15:43:59+00:00",
5+
"versions": [
6+
[
7+
"v1.2",
8+
"kelleyl"
9+
]
10+
]
11+
},
212
"http://apps.clams.ai/swt-detection": {
313
"description": "Detects scenes with text, like slates, chyrons and credits.",
414
"latest_update": "2024-12-15T12:18:28+00:00",

‎docs/_data/apps.json

+1-1
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)