Setting options used for futures

[ismirsehregal]

I wanted to ask if anyone here with more knowledge than me could shed some light on this when they have a chance:

https://stackoverflow.com/questions/79844593/marginaleffects-and-future-global-size-exceeded

Thank you in advance!

[HenrikBengtsson]

Warning: Caught FutureError. Canceling all iterations ...
Error: Will not launch future due to the size of the globals 3.86 GiB exceeds 2.79 GiB. The total size
of the 22 globals exported for future expression (‘{; "# future::getGlobalsAndPackages(): wrapping the
original future"; "# expression in do.call(), because function called uses '...'  "; "# as a global variable"; 
do.call(function(...) {; "# future::getGlobalsAndPackages(): FUN() uses '...' internally "; ...; }; },
args = future.call.arguments); }’) is 2.79 GiB The three largest globals are ‘...future.FUN’ (1.06 GiB of
class ‘function’), ‘func’ (1.06 GiB of class ‘function’) and ‘mfx’ (335.54 MiB of class ‘S4’)

There used to be a size limit of 500 GiB, which could be by options(future.globals.maxSize = Inf). That is now the default limit as of future 1.40.0 (2025-04-10). Also, since that version, the recommended way is to specify it when setting up the backend, e.g.

plan(multisession, workers = 8, maxSizeOfObjects = 10e9)