The allchain has been a source of headaches because it takes up a lot of
memory and slows everything down. However, with the new database
model, we can generate markov sentences using all of the rows since they
are a flat collection. This helps reduce disk space and increases the
import speed significantly.
Signed-off-by: Alek Ratzloff <alekratz@gmail.com>
Alek Ratzloff
8e639d50fa