Merge pull request #110 from gsnedders/sanitizer-fixes-72

Move the sanitizer to purely be a filter; r=nobody!

Author: gsnedders

CHANGES.rst

@@ -40,6 +40,10 @@ Released on XXX
   and the new default), and "spec" (the old False value, and the old
   default).**
 
+* **Fix #72 by rewriting the sanitizer to apply only to treewalkers
+  (instead of the tokenizer); as such, this will require amending all
+  callers of it to use it via the treewalker API.**
+
 
 0.9999999/1.0b8
 ~~~~~~~~~~~~~~~

html5lib/filters/optionaltags.py

@@ -11,7 +11,8 @@ def slider(self):
                 yield previous2, previous1, token
             previous2 = previous1
             previous1 = token
-        yield previous2, previous1, None
+        if previous1 is not None:
+            yield previous2, previous1, None
 
     def __iter__(self):
         for previous, token, next in self.slider():