Max Alekseyev on Fri, 23 Feb 2024 14:11:08 +0100


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: bnfisintnorm() is eager for memory


Hi Ruud,
My question is irrelevant to binary precision, but I do not know if it kicks in in the bnfisintnorm()'s internals.
Regards,
Max

On Fri, Feb 23, 2024 at 8:04 AM Ruud H.G. van Tol <rvtol@isolution.nl> wrote:

On 2024-02-23 13:58, Max Alekseyev wrote:

> What if I look for solutions where at least one of the coefficients is
> below 10^16 by absolute value?

Is that related to "binary64"?

Whenever I read 10^16, I think 53 bits ...

https://en.wikipedia.org/wiki/Double-precision_floating-point_format
https://en.wikipedia.org/wiki/IEEE_754

-- Ruud