Skip to content

Fix the quantize() function#1386

Merged
mborland merged 10 commits into
developfrom
1383
May 5, 2026
Merged

Fix the quantize() function#1386
mborland merged 10 commits into
developfrom
1383

Conversation

@mborland
Copy link
Copy Markdown
Member

@mborland mborland commented May 4, 2026

Closes: #1383

The only lingering failures are that we currently canonicalize 0 whereas decTest expects zero to also obey cohorts. This I guess is true per 3.5.1 "A zero has a much larger cohort: the cohort of +0 contains a representation for each exponent, as
does the cohort of −0"

@mborland mborland merged commit 2b920bf into develop May 5, 2026
73 of 76 checks passed
@mborland mborland deleted the 1383 branch May 5, 2026 14:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

quantize() violates IEEE 754-2008 §5.3.5; test encodes the same wrong formula

1 participant