Commit f6e3c251 authored by Alfredo Di Napoli's avatar Alfredo Di Napoli

fix: keep using HasHeader in TSV parsing

In an attempt to make the TSV parser more lenient for the absence of the
forms column, I have used NoHeader in the `decodeWithP` call, but that
caused the first line of the TSVs with a header to be interpreted as
terms, which is not what we want.
parent da942cf9
Pipeline #7487 canceled with stages
......@@ -181,8 +181,7 @@ ngramsListFromTSVData tsvData = case decodeTsv of
decodeTsv = Vec.catMaybes <$>
Tsv.decodeWithP tsvToNgramsTableMap
(Tsv.defaultDecodeOptions { Tsv.decDelimiter = fromIntegral (P.ord '\t') })
-- Don't use an header, make it lenient in case the 'forms' are missing.
Tsv.NoHeader
Tsv.HasHeader
binaryData
-- | Converts a plain TSV 'Record' into an NgramsTableMap
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment