Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LGM Video Archive #42

Open
ms-studio opened this issue Oct 28, 2015 · 7 comments
Open

LGM Video Archive #42

ms-studio opened this issue Oct 28, 2015 · 7 comments
Labels
video

Comments

@ms-studio
Copy link
Member

Based on discussion with Julien Deswaef, Patdavid, Peter, Michael M, Ale Rimoldi (IRC discussion of 2015.06.04), here is a first concept draft for a LGM Video Archive.

Functionality of the archive

Some key functionalities that we want:

  • Present a huge global index of ALL the videos.
  • Present a list of videos by speaker (from all LGMs).
  • Ability to assign one or several speakers to a video.
  • Ability to edit the speaker page with some information / links.
  • Present a list of videos by year.
  • Ability to assign topics/keywords, such as: Inkscape, 3D printing, textiles, open hardware...
  • Each keyword must generate a page that lists videos (from all LGMs).

Folder structure and URLs

Plannig this site as a long-term archive, we need to be forward-thinking and pay huge attention to the URLs of all archive resources, in such a way that:

  • The URLs will never have to change.
  • The URLs are platform-indpendent (not linked to specific server technology, CMS), allowing to migrate the system while keeping the permalink structure.

A proposal:

  • The base URL of the video archive = video.libregraphicsmeeting.org
  • URL of the video files (.ogv and perhaps other formats) = /files/2014/name-of-session/title-of-video.ogv
  • URL of image files (stills), URL of slides = /files/2014/name-of-session/title-of-video.jpg
  • URLs of the talk pages = /2014/title-of-talk
  • URL of the global index (same as base URL?)
  • URL of the index by year (e.g. 2015) = /2015/
  • URL of the index by speaker (e.g. Nathan Willis) = /speaker/nathan-willis/
  • URL of the index by topic (e.g. Scribus) = /topic/scribus/

Storage of the videos

What are our needs in terms of storage space?
From 2006 to 2015, there are now 10 instances of the festival.

For 2014, here are the stats:

  • Published recordings of LGM 2014: 66 files in OGV format
  • video: Theora, 720p resolution, datarate: 620-770 kb/s
  • audio: Vorbis Audio, mono, 48khz, 80 kb/s
  • Total duration: 13-14 hours
  • Total filesize: 6.67 GB (aprox 100 Mb per file, 5 Mb per minute)

Conclusion: without precise calculation, we can estimate that a storage space in a range of 50 to 100 Gb will be needed.

Mockups

A video player for the 2015 talks:
http://video.constantvzw.org/LGM15/player/

By Michael, there's a test page that shows an index of talks here:
http://video.constantvzw.org/LGM15/player/terms.html

By Manuel, a quick mockup of what the individual talk page could look like:

lgm-video-concept
@automatist
Copy link

Hi Manuel, thanks for the summary of points and for getting things
moving again.

In fact I've worked further on some tests, and have:

  1. Forked each of the git repos of the static archives (by year)
  2. Added markup to the program pages using microdata.
  3. Created scripts to extract the microdata and produce index files.

The resulting index files are static HTML that should, of course
actually link to the videos -- at the moment they do not however (I was
more focussing on testing the feasability of adding of microdata and to
generating the index as a proof of concept).

You can see an example of the results here:
http://activearchives.org/lgm-video-archive/index_years.html

The code is here:
https://github.com/automatist/lgm-video-archive

On 10/28/2015 12:47 PM, Manuel Schmalstieg wrote:

Based on discussion with Julien Deswaef, Patdavid, Peter, Michael M, Ale
Rimoldi (IRC discussion of 2015.06.04), here is a first concept draft
for a LGM Video Archive.

Functionality of the archive

Some key functionalities that we want:

  • Present a huge global index of ALL the videos.

  • Present a list of videos by speaker (from all LGMs).

  • Ability to assign one or several speakers to a video.

  • Ability to edit the speaker page with some information / links.

  • Present a list of videos by year.

  • Ability to assign topics/keywords, such as: Inkscape, 3D printing,
    textiles, open hardware...

  • Each keyword must generate a page that lists videos (from all LGMs).

    Folder structure and URLs

Plannig this site as a long-term archive, we need to be forward-thinking
and pay huge attention to the URLs of all archive resources, in such a
way that:

  • The URLs will /never/ have to change.

  • The URLs are platform-indpendent (not linked to specific server
    technology, CMS), allowing to migrate the system while keeping the
    permalink structure.

    A proposal:

  • The base URL of the video archive = video.libregraphicsmeeting.org

  • URL of the video files (.ogv and perhaps other formats) =
    /files/2014/name-of-session/title-of-video.ogv

  • URL of image files (stills), URL of slides =
    /files/2014/name-of-session/title-of-video.jpg

  • URLs of the talk pages = /2014/title-of-talk

  • URL of the global index (same as base URL?)

  • URL of the index by year (e.g. 2015) = /2015/

  • URL of the index by speaker (e.g. Nathan Willis) =
    /speaker/nathan-willis/

  • URL of the index by topic (e.g. Scribus) = /topic/scribus/

    Storage of the videos

What are our needs in terms of storage space?

From 2006 to 2015, there are now 10 instances of the festival.

For 2014, here are the stats:

  • Published recordings of LGM 2014: 66 files in OGV format
  • video: Theora, 720p resolution, datarate: 620-770 kb/s
  • audio: Vorbis Audio, mono, 48khz, 80 kb/s
  • Total duration: 13-14 hours
  • Total filesize: 6.67 GB (aprox 100 Mb per file, 5 Mb per minute)

Conclusion: without precise calculation, we can estimate that a storage
space in a range of 50 to 100 Gb will be needed.

Mockups

By Michael, there's a very rough test page that shows an index of talks here
http://video.constantvzw.org/LGM15/player/terms.html

By Manuel, a quick mockup of what the individual talk page could look like:

lgm-video-concept
https://cloud.githubusercontent.com/assets/241637/10787535/fe173ec6-7d71-11e5-99f7-f33e4f870906.png

—
Reply to this email directly or view it on GitHub
#42.

@automatist
Copy link

Also maybe useful to say: My interest in the particular workflow I
choose (microdata, extraction & creating static indexes based on a
template) is based on a desire to not produce another independent CMS /
archiving system, but rather to (hopefully) come up with a means of
(literally) patching into the existing workflows past and future. Thus,
what I like about microdata is that it can be retroactively injected
into older HTML pages, even with different structures, and can in the
future be added to (wordpress) templates to be present from the start.

  • m

On 10/28/2015 12:47 PM, Manuel Schmalstieg wrote:

Based on discussion with Julien Deswaef, Patdavid, Peter, Michael M, Ale
Rimoldi (IRC discussion of 2015.06.04), here is a first concept draft
for a LGM Video Archive.

Functionality of the archive

Some key functionalities that we want:

  • Present a huge global index of ALL the videos.

  • Present a list of videos by speaker (from all LGMs).

  • Ability to assign one or several speakers to a video.

  • Ability to edit the speaker page with some information / links.

  • Present a list of videos by year.

  • Ability to assign topics/keywords, such as: Inkscape, 3D printing,
    textiles, open hardware...

  • Each keyword must generate a page that lists videos (from all LGMs).

    Folder structure and URLs

Plannig this site as a long-term archive, we need to be forward-thinking
and pay huge attention to the URLs of all archive resources, in such a
way that:

  • The URLs will /never/ have to change.

  • The URLs are platform-indpendent (not linked to specific server
    technology, CMS), allowing to migrate the system while keeping the
    permalink structure.

    A proposal:

  • The base URL of the video archive = video.libregraphicsmeeting.org

  • URL of the video files (.ogv and perhaps other formats) =
    /files/2014/name-of-session/title-of-video.ogv

  • URL of image files (stills), URL of slides =
    /files/2014/name-of-session/title-of-video.jpg

  • URLs of the talk pages = /2014/title-of-talk

  • URL of the global index (same as base URL?)

  • URL of the index by year (e.g. 2015) = /2015/

  • URL of the index by speaker (e.g. Nathan Willis) =
    /speaker/nathan-willis/

  • URL of the index by topic (e.g. Scribus) = /topic/scribus/

    Storage of the videos

What are our needs in terms of storage space?

From 2006 to 2015, there are now 10 instances of the festival.

For 2014, here are the stats:

  • Published recordings of LGM 2014: 66 files in OGV format
  • video: Theora, 720p resolution, datarate: 620-770 kb/s
  • audio: Vorbis Audio, mono, 48khz, 80 kb/s
  • Total duration: 13-14 hours
  • Total filesize: 6.67 GB (aprox 100 Mb per file, 5 Mb per minute)

Conclusion: without precise calculation, we can estimate that a storage
space in a range of 50 to 100 Gb will be needed.

Mockups

By Michael, there's a very rough test page that shows an index of talks here
http://video.constantvzw.org/LGM15/player/terms.html

By Manuel, a quick mockup of what the individual talk page could look like:

lgm-video-concept
https://cloud.githubusercontent.com/assets/241637/10787535/fe173ec6-7d71-11e5-99f7-f33e4f870906.png

—
Reply to this email directly or view it on GitHub
#42.

@ms-studio
Copy link
Member Author

Wow, that's quite some work you did!

@automatist
Copy link

On 10/28/2015 09:33 PM, Manuel Schmalstieg wrote:

Wow, that's quite some work you did!

  • Wouldn't it make sense to update the archived static pages with your
    additional markup (and links to the recordings)?

Yes, that's what I did, the forked repos have program pages that have
been altered to:
(1) include microdata
(2) fix broken links (such as those to rivervalley pages now all point
to their corrsponding youtube pages)

See for instance:
https://github.com/automatist/htdocs-2010-static/blob/master/program.php.html

I guess I just need to file a pull request for all the different forked
static projects.

  • Does the "extracted microdata" exist as an intermediate structured
    format, like XML?

Yes, the microdata is extracted to JSON, see:
https://github.com/automatist/lgm-video-archive/tree/master/microdata

This JSON is then the basis of generating the index pages (using python

  • jinja templates).
  • m

—
Reply to this email directly or view it on GitHub
#42 (comment).

@ms-studio
Copy link
Member Author

I guess I just need to file a pull request for all the different forked
static projects.

Yes, please do so!

@automatist
Copy link

OK done for 2007-2014. 2015 is a special case as it's not yet a static
site -- I just made a dump of the program page and added microdata --
it's a part of a new (outer) repository for the archive & eventually it
can be merged into a complete static dump of 2015.

On 10/28/2015 10:26 PM, Manuel Schmalstieg wrote:

I guess I just need to file a pull request for all the different forked
static projects.

Yes, please do so!

—
Reply to this email directly or view it on GitHub
#42 (comment).

@ms-studio
Copy link
Member Author

Awesome, i've started adding them.

What microdata format are you using, can you link to some documentation? Is it the Schema microdata detailed here: https://schema.org/video ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
video
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ms-studio @automatist