Skip to content

Commit 4853d9b

Browse files
committed
Readme WIP
1 parent f95edc4 commit 4853d9b

File tree

2 files changed

+34
-1
lines changed

2 files changed

+34
-1
lines changed

README.md

+33
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
# Moin moin: Smart City
2+
3+
Moin moin is a project created and developed by @fabridamicelli, @FBruzzesi, and @JurijWollert during the [NumHack 2024](https://github.com/numfocus/numhack-2024) hackaton for the category **build**.
4+
5+
## Project Title
6+
7+
Moin Moin
8+
9+
## Description
10+
11+
Moin Moin is a web application that serves two goals:
12+
13+
* On one hand, it simplifies the process of reporting issues around a city for citizens. All that is required is to take a picture of what a citizen considers to be a problem worth addressing by the municipality, and point where such issue is located. The application will then categorize the problem into the responsable department which is more suited to address it.
14+
* On the other hand, the application provides a map with the reported and categorized issues for the municipality officers, which serves as a tool to prioritize and dispatch the work to the different departments.
15+
16+
## Core Features
17+
18+
* Digitalization of the process of reporting issues around the city.
19+
* Automatic categorization of the reported problem via CLIP model (text and images embeddings).
20+
21+
## Submission Items
22+
23+
* **Deliverable**: Web application with the two pages, one for the citizens to report the issues and another for the municipality officers to see the reported problem both on a map and on a table. This is easily deployable via docker compose.
24+
* **Documentation**: TODO
25+
26+
## Future Work
27+
28+
There are a lot of features that we would like to implement to improve the application:
29+
30+
* To be _actually_ of easy access to the citizens, what's now a dedicated page in the web application, should be available as a mobile app. This would allow the citizens to report issues on the go, by taking a picture with their phone and allowing GPS to locate where the issues is.
31+
* Allow a citizen to upload more than one image at the time.
32+
* The categorization of the reported issues could be improved by using a pretrained Image-Text-to-Text LLM model (such as [Qwen2-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct)), with structured output (being the categories we have). The drawback of this approach is that it would require significant more computational resources.
33+
* For the municipality officers in charge, we would consider the possibility of automatically create bouding boxes on the issue for each image, and allow them to change it if necessary before dispatching the work downstream.

docker-compose.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ services:
88
- "8081:8081"
99
volumes:
1010
- ./db:/app/db
11-
- ./models:/app/models # Mount machine learning model folder
11+
- ./models:/app/models
1212

1313
frontend:
1414
build:

0 commit comments

Comments
 (0)