Skip to content

Commit 7b09985

Browse files
committed
updated
1 parent 27708f2 commit 7b09985

9 files changed

+30
-17
lines changed

LICENSE

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
MIT License
22

3-
Copyright (c) 2022 The Python Packaging Authority
3+
Copyright (c) 2023 The Python Packaging Authority
44

55
Permission is hereby granted, free of charge, to any person obtaining a copy
66
of this software and associated documentation files (the "Software"), to deal

README.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ Figure 1: Multimodal Computational Sequence
2525

2626
![GAN-based Multimodal Concept Generation](doc/images/gan-based-cross-modal-generation.jpg)
2727

28-
Figure 2: GAN-based Multimodal Concpet Generation
28+
Figure 2: GAN-based Multimodal Concept Generation
2929

3030
## Modalities
3131

@@ -88,7 +88,7 @@ Here are some examples of using our work in real life with codes and documents.
8888
- [Basic Computational Sequence](doc/simple_computational_seq_use.md)
8989
- [Core use of MMFLib](doc/multimodal_features_library.md)
9090

91-
### 3. Multimodal knowledge bases
91+
### 3. Multimodal Knowledge Bases
9292

9393
- [Multimodal Birds Feature Library](doc/example_bird_library.md)
9494
- [Multimodal Disease Coding Feature Library](doc/example_icd11_library.md)

doc/README.md

+24-11
Original file line numberDiff line numberDiff line change
@@ -4,20 +4,33 @@ This section presents a summary of usage of the features used in the `MMKit-Feat
44

55
To handle the extraction of various multimodal features such as text, image, speech, and video, different modules are utilized. Furthermore, the toolkit enables the quick and simple fusion and storage of the extracted features.
66

7-
## Features Extraction
7+
## Applications
88

9-
1. [Text Features Extraction](text_features_extraction.md)
10-
2. [Speech Features Extraction](speech_features_extraction.md)
11-
3. [Image Features Extractoin](image_features_extraction.md)
12-
4. [Video Features Extraction](video_features_extraction.md)
9+
Here are some examples of using our work in real life with codes and documents.
1310

14-
## Multimodal Features Library (MMFLib)
11+
### 1. Multimodal Features Extractors
1512

16-
1. [Basic Computational Sequence](simple_computational_seq_use.md)
17-
2. [Core use of MMFLib](multimodal_features_library.md)
13+
- [Text Features Extraction](text_features_extraction.md)
14+
- [Speech Features Extraction](speech_features_extraction.md)
15+
- [Image Features Extractoin](image_features_extraction.md)
16+
- [Video Features Extraction](video_features_extraction.md)
17+
- [Transformer-based Features Extraction](../src/mmkfeatures/transformer/README.md)
1818

19-
## MMFLib Aplications
19+
### 2. Multimodal Feature Library (MMFLib)
2020

21-
1. [Multimodal Birds Features Library](example_bird_library.md)
22-
2. [ICD-11 Disease Coding Library](example_icd11_library.md)
21+
- [Basic Computational Sequence](simple_computational_seq_use.md)
22+
- [Core use of MMFLib](multimodal_features_library.md)
23+
24+
### 3. Multimodal Knowledge Bases
25+
26+
- [Multimodal Birds Feature Library](example_bird_library.md)
27+
- [Multimodal Disease Coding Feature Library](doc/example_icd11_library.md)
28+
- [Multimodal ROCO Feature Library](../examples/roco_lib/step1_create_lib_roco.py)
29+
30+
### 4. Multimodal Indexing and Querying
31+
32+
- [Brute Force Indexing](../examples/birds_features_lib/step3_use_index.py)
33+
- [Inverted Indexing](../examples/birds_features_lib/step3_use_index.py)
34+
- [Positional Indexing](examples/birds_features_lib/step3_use_index.py)
35+
- [Multimodal Indexing and querying](../examples/birds_features_lib/evaluate/)
2336

examples/chain.png

-6.56 KB
Binary file not shown.

examples/obj-graph.png

-194 KB
Binary file not shown.

examples/sample-graph.png

-173 KB
Binary file not shown.

examples/test7_1.csd

-3.8 KB
Binary file not shown.

examples/test7_2.csd

-67.7 KB
Binary file not shown.

setup.py

+3-3
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
"""A setuptools based setup module.
22
3-
MMKit-Features: A Python library to extract and fuse multimodal features for deep learning.
3+
A multimodal architecture to build multimodal knowledge graphs with flexible multimodal feature extraction and dynamic multimodal concept generation.
44
55
"""
66

@@ -36,12 +36,12 @@
3636
# For a discussion on single-sourcing the version across setup.py and the
3737
# project code, see
3838
# https://packaging.python.org/en/latest/single_source_version.html
39-
version='0.0.1a1', # Required
39+
version='0.0.1a2', # Required
4040

4141
# This is a one-line description or tagline of what your project does. This
4242
# corresponds to the "Summary" metadata field:
4343
# https://packaging.python.org/specifications/core-metadata/#summary
44-
description='A Python library to extract, store and fuse multimodal features for deep learning', # Optional
44+
description='A multimodal architecture to build multimodal knowledge graphs with flexible multimodal feature extraction and dynamic multimodal concept generation. ', # Optional
4545

4646
# This is an optional longer description of your project that represents
4747
# the body of text which users will see when they visit PyPI.

0 commit comments

Comments
 (0)