Should `gc_max_docs_scrapers` be an `Int`?
Currently gc_max_docs_scrapers
is an Integer
, and as such this is forcing all the call sites of the scrapers we support to use that, or convert this to Int
. It seems to me that using an Integer
is wasteful here, because integers in GHCs won't have a fixed size and they occupy more heap memory. Here, however, it seems unnecessary to use Integers, unless there is something I'm not considering. I understand that potentially a scraper can return millions of results, but in practice, gc_max_docs_scrapers
is used to set a limit over the number of results returned, and it seems to me we should be just fine with current Int
's maxbound
, which is 9223372036854775807
on most[1] machines.
[1] I say "most" because technically speaking GHC transparently switches to Int32
or Int64
internally depending on the architecture, but these days we are running on 64 bits anyway.