Commit 049c77ed authored by Alexandre Delanoë's avatar Alexandre Delanoë

[FIX] memory fix

parent 1865fd21
Pipeline #1368 canceled with stage
...@@ -458,7 +458,9 @@ indexAllDocumentsWithPosTag = do ...@@ -458,7 +458,9 @@ indexAllDocumentsWithPosTag = do
(extractNgramsT $ withLang (Multi EN) documentsWithId) (extractNgramsT $ withLang (Multi EN) documentsWithId)
documentsWithId documentsWithId
_ <- insertExtractedNgrams $ HashMap.keys mapNgramsDocs' _ <- mapM insertExtractedNgrams
$ splitEvery 10000
$ HashMap.keys mapNgramsDocs'
pure () pure ()
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment