Added multiple tokenizers implementing new ITokenizer interface#212

Open

Ehryk wants to merge 2 commits intogsscoder:masterfrom

Commits on Aug 1, 2015

Added multiple tokenizers implementing new ITokenizer interface (GetOpt = previous, Windows, Hybrid)
Ehryk
committed

Commits on Aug 2, 2015

Resolving Merge Conflicts
Ehryk
committed