• Alfredo Di Napoli's avatar
    Tighten generator for NgramsTermNonEmpty · 2e282303
    Alfredo Di Napoli authored
    Previously the generator was generating all sorts of unicode symbols,
    which doesn't play well for things like tab separators, carriage returns
    and other things.
    
    Furthermore, we need to be careful to not use the same symbol set of
    `isSep` when we generate terms, because we are simulating an ngrams
    search in a document and ngrams do not contain those separators
    (i.e. `k2(` is not a valid ngram, but `k2` is).
    2e282303
Name
Last commit
Last update
.gitlab/issue_templates Loading commit data...
bench Loading commit data...
bench-data/phylo Loading commit data...
bin Loading commit data...
devops Loading commit data...
docs Loading commit data...
ekg-assets Loading commit data...
nix Loading commit data...
src Loading commit data...
src-doctest Loading commit data...
test Loading commit data...
test-data Loading commit data...
.clippy.dhall Loading commit data...
.envrc Loading commit data...
.ghci Loading commit data...
.gitignore Loading commit data...
.gitlab-ci.yml Loading commit data...
.mailmap Loading commit data...
CHANGELOG.md Loading commit data...
CODE_OF_CONDUCT.md Loading commit data...
DEVELOPER_GUIDELINES.md Loading commit data...
LICENSE Loading commit data...
README.md Loading commit data...
cabal.project Loading commit data...
cabal.project.freeze Loading commit data...
cabal.project.local_toCopy Loading commit data...
gargantext-settings.toml_toModify Loading commit data...
gargantext.cabal Loading commit data...
gargantext.ini_toModify Loading commit data...
hie.yaml Loading commit data...
run Loading commit data...
shell.nix Loading commit data...
stack.yaml Loading commit data...
start Loading commit data...
weeder.toml Loading commit data...