some refactoring & adding generality, specifivity, etc for the ngrams