|
|
| Novel series (atanExt = no) | Novel series (atanExt = yes) | ||||
| Bits | Precision | A | B | n | A | B | n |
| 53 | 1.11e−16 | 6.98e−17 | 3.10e−17 | 54 | 6.98e−17 | 3.10e−17 | 22 |
| 64 | 5.42e−20 | 3.40e−20 | 4.54e−21 | 65 | 6.89e−21 | 2.26e−20 | 25 |
| 128 | 2.94e−39 | 5.47e−40 | 5.89e−41 | 128 | 9.23e−40 | 1.41e−39 | 41 |
| 256 | 8.64e−78 | 6.29e−78 | 3.33e−78 | 256 | 6.29e−78 | 3.33e−78 | 69 |
| 512 | 7.46e−155 | 4.09e−155 | 1.37e−155 | 511 | 4.09e−155 | 1.37e−155 | 116 |
| 1024 | 5.56e−309 | 2.25e−309 | 5.19e−309 | 1023 | 5.04e−309 | 2.41e−309 | 199 |