Skip to content

Allow the simplifier to use facts in its can_prove() predicates. - #9400

Open
mcourteaux wants to merge 17 commits into
mainfrom
mcourteaux/can-prove-facts
Open

Allow the simplifier to use facts in its can_prove() predicates.#9400
mcourteaux wants to merge 17 commits into
mainfrom
mcourteaux/can-prove-facts

Conversation

@mcourteaux

Copy link
Copy Markdown
Contributor

Problem statement

While preparing #9371, I hit several dead ends trying to produce very neat IR. The reason is the simplifier cannot simplify max(x, y) = x when we give the assumption x >= y. Intuitively, one would write in Simplify_Max.cpp:

   rewrite(max(x, y), a, can_prove(x >= y, this))

However, the way can_prove(Expr, Prover) is implemented is to recursively mutate() the Expr with the Prover (i.e., this instance of Simplify). This however, does not substitute in the facts (truths), and therefore fails to "prove" that x > y.

A secondary problem with rewrite rules that use can_prove() is that they recursively invoke the simplifier, which leads potentially to infinite recursions. Specifically, Andrew stated:

Calling can_prove as the third arg to rewrite recursively invokes the simplifier on every expr that matches that LHS. If one of them itself creates an intermediate expression that also matches the LHS, you get infinite recursion.

Solution

This PR makes it possible to use facts in a can_prove(), prevents infinite recursion, and offers known_true() as a lightweight alternative.

Using facts / truths.

In order to match simple truths into expressions, whenever new facts are learned, they are canonicalized, such that lookup can do the same, and a > b matches with b < a.
The can_prove(Expr, Prover) entry-point now calls out to simplify_can_prove_condition(), which is the full power of the Simplifier at work, but using canonicalized facts.

As a bonus: substitute_facts benefits from this canonicalization and manages to substitute in more facts, even when the fact is not IR-tree-wise an exact match.

As an additional bonus: weaker forms of inequalities are also substituted in as facts if the stronger inequality is known as a fact. Example: x >= y (which is weak) is replaced by true if the fact that x > y is known.

Limiting recursion.

Implementing this, I indeed hit an infinite recursion quickly, so this PR also limits the recursion depth to 1. Experiments performed with higher recursion depth explode compile time for no measured benefit. The recursion limit of 1 means that a call to simplify() can call simplify() only once within a can_prove() but not more. This is done in the call simplify_can_prove_condition() which is exactly the new behavior of can_prove().

A lightweight alternative: known_true().

Instead of running the full simplifier for a can_prove(), we can now also write rewrite-predicates using a known_true() which is just the simple lookup in the Simplifier's fact list using the canonicalization. This naturally cannot recurse, and also does not spend time trying to simplify things when not needed. This is especially useful for when you would match max(x, y) on every such Expr and then try to can_prove(x > y), which is expensive. Instead the rewrite rule is:

   rewrite(max(x, y), a, known_true(x >= y, this))

Which is a very fast lookup, instead of a whole run through the simplifier.

A few such example rules are implemented in Simplify_Div.

Checklist

  • Tests added or updated (not required for docs, CI config, or typo fixes)
  • Documentation updated (if public API changed)
  • Python bindings updated (if public API changed)
  • Benchmarks are included here if the change is intended to affect performance.
  • Commits include AI attribution where applicable (see Code of Conduct)

@mcourteaux
mcourteaux requested a review from abadams August 27, 2026 13:06
@codecov

codecov Bot commented Aug 27, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 82.65306% with 51 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.26%. Comparing base (a3690b3) to head (260cc16).

Files with missing lines Patch % Lines
src/Simplify.cpp 76.81% 30 Missing and 21 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #9400      +/-   ##
==========================================
+ Coverage   70.12%   70.26%   +0.14%     
==========================================
  Files         261      261              
  Lines       79405    79692     +287     
  Branches    19362    19450      +88     
==========================================
+ Hits        55684    55999     +315     
- Misses      17896    17897       +1     
+ Partials     5825     5796      -29     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@abadams

abadams commented Aug 31, 2026

Copy link
Copy Markdown
Member

Was this the one that inflated the lowering time of lens_blur? Is this superseded by your approach in aligned splits take 2?

@abadams

abadams commented Sep 1, 2026

Copy link
Copy Markdown
Member

Some more data: yesterday in a research branch I came across a case where max(x, y) was not simplifying inside an if (x <= y) branch, and it was causing wmma ops to fail to be extracted. This is a case we need to handle, we just need to figure out how to do it without increasing compile times.

@abadams

abadams commented Sep 1, 2026

Copy link
Copy Markdown
Member

I think an approach to make this fast might be to define an operator< that can compare IRMatcher patterns to Exprs, so that the pattern can be looked up in the set of known facts without constructing an IR node, rather than needing to build an Expr just to do the lookup.

@mcourteaux

Copy link
Copy Markdown
Contributor Author

Was this the one that inflated the lowering time of lens_blur? Is this superseded by your approach in aligned splits take 2?

This indeed did slow down lens blur by 10% more ore less. It's not superseded: take 2 just works around the simplification issue by using .bound_extent() and .bound_storage().

Some more data: yesterday in a research branch I came across a case where max(x, y) was not simplifying inside an if (x <= y) branch, and it was causing wmma ops to fail to be extracted. This is a case we need to handle, we just need to figure out how to do it without increasing compile times.

🤝

I think an approach to make this fast might be to define an operator< that can compare IRMatcher patterns to Exprs, so that the pattern can be looked up in the set of known facts without constructing an IR node, rather than needing to build an Expr just to do the lookup.

That sounds like a decent approach! Feel free to take over this branch!

@mcourteaux

mcourteaux commented Sep 3, 2026

Copy link
Copy Markdown
Contributor Author

What if instead, we special handle the generic-form max(x, y) and min(x, y) above the chain of rewrite rules, by doing a fact_lookup_comparison(x, y) that returns an enum: NOTHING_KNOWN, LT, LE, EQ, GE, GT.

As such, no known_true() is called for every Max node, and no new Expr is constructed.

We can keep the more expensive machinery for non-trivial rules, such as the ones now in Simplify_Div, which wouldn't trigger for every Max/Min node, because the LHS of the rewrite rule is more specific:

 has_facts() &&
    (rewrite(max(x * c0, y) / c0, x, c0 > 0 && known_true(x >= y / c0, this)) ||
     rewrite(max(y, x * c0) / c0, x, c0 > 0 && known_true(x >= y / c0, this)) ||
     rewrite(min(x * c0, y) / c0, x, c0 > 0 && known_true(x <= y / c0, this)) ||
     rewrite(min(y, x * c0) / c0, x, c0 > 0 && known_true(x <= y / c0, this)))

The existing known_true() would then call out to fact_lookup_comparison().

Later, when we learn_true(some_expr % some_other_expr == 0) for example, we can have special handling in Simplify_Mod with a fact_lookup_modrem(x, y), which can return more info specific to those kind of facts.

@mcourteaux

Copy link
Copy Markdown
Contributor Author

Offline discussion with @abadams, with some ideas going back and forth, Andrew proposed to:

record a list of (Expr, Expr, ConstantInterval), where the interval is constant bounds on the difference between the two Exprs. Then in the predicate you could query the lower or upper bound of the difference.

As such, we can have a function that return ConstantBounds for the difference between two Expr. Then you can write predicates like this:

rewrite(max(x, y), x, min_diff(x, y, this) >= 0) // because x - y >= 0, we know that x >= y.

mcourteaux and others added 17 commits September 5, 2026 20:27
The condition of a can_prove predicate in a rewrite rule was simplified
on its own, without any of the facts the simplifier has learned on the
way down the IR. Substitute those facts into the condition first, and
store facts in the same comparison direction the simplifier produces, so
that a fact stated as x > y is usable when it visits y < x.

This makes fact-driven rewrite rules possible: max/min now pick a side
when the facts order the operands, and a division can cancel a
multiplication inside a max or min.

Co-authored-by: Claude <noreply@anthropic.com>
Facts and the conditions of can_prove predicates are now looked up in the
same canonical form: GT and GE are mapped onto LT, Not is unwrapped, and a
comparison can be settled by the other strictness of the same comparison in
either direction. This means it no longer matters how a fact was spelled
relative to how the rule that consumes it was, and a strict fact such as
x > y settles the non-strict predicate the max/min rules ask for.

Those rules ask non-strictly, since a tie makes either side of a max or min
an equally good answer, so a fact of x >= y is enough to pick a side.

Co-authored-by: Claude <noreply@anthropic.com>
Simplifying the condition of a can_prove predicate visits the operands
again, so a fact-driven rule that matches every node of its type recursed
without bound on nested min/max trees. Disable those rules while inside a
can_prove condition; the facts themselves are still substituted in at every
level.

Co-authored-by: Claude <noreply@anthropic.com>
Recursing further is occasionally useful in principle, but measurably
expensive: at a limit of 2, correctness_likely goes from 1.0s to 4.2s and
correctness_autodiff from 3.4s to 11.4s, with no test producing a better
simplification. Keep the limit at one level, but name the constant.

Co-authored-by: Claude <noreply@anthropic.com>
can_prove as a rewrite predicate recursively invokes the simplifier on every
expression matching the rule's left-hand side, so a rule whose left-hand side
also matches something built while proving the predicate recurses. It is also
simply expensive.

known_true instead looks the condition up in the facts directly. It cannot
recurse, and it is cheap enough to use on a rule that matches every node of
its type. The fact-driven max, min and division rules now use it, which is
enough for all of them: looking up a comparison already understands direction
and strictness.

Co-authored-by: Claude <noreply@anthropic.com>
The depth limit was checked in has_facts, which only protects rules that
consult it. Checking it on entry to the condition simplification instead
protects every can_prove, including the pre-existing rules and any future
one, and returning the condition unsimplified is the natural way to decline:
the predicate simply fails to prove anything.

That also frees has_facts to be a plain check, so the non-recursive
known_true rules can fire at any depth. The limit is raised to four, which
restricts nothing today: instrumenting every correctness test shows the
deepest can_prove nesting any of them reaches is one.

Co-authored-by: Claude <noreply@anthropic.com>
Refusing to simplify the condition past the depth limit meant the predicate
could never be proven there, even when the fact needed was already known.
substitute_facts is a plain tree walk (mutate_with over the generic
IRMutator base traversal) that never invokes a rewrite rule, so it cannot
re-trigger can_prove or known_true and stays safe at any depth: use it as
the fallback instead of returning the condition untouched.

Added a regression test built on the pre-existing can_prove-based min/max
subtraction cancellations in Simplify_Sub.cpp (the rules that motivated
the depth limit in the first place, since their predicate constructs a
fresh subtraction that can itself match the same rule). With the limit
disabled it hangs (confirmed: 15s timeout); with it in place it completes
in under a second.

Co-authored-by: Claude <noreply@anthropic.com>
The previous fallback ran substitute_facts, a full tree walk, on the
condition. But the only thing the caller checks is whether the result is
literally the constant true, and nothing runs afterward to fold a compound
expression: an And of two individually-known-true operands stays an
unfolded And, never becoming true. So substitute_facts's ability to resolve
facts about pieces of a compound condition was wasted work here — it can't
prove anything is_known_true on the condition itself couldn't already, since
folding that partial progress into a verdict is exactly the recursive work
the cap exists to avoid.

Co-authored-by: Claude <noreply@anthropic.com>
known_true had to build the comparison it was asked about, so a rule like
rewrite(max(x, y), a, known_true(y <= x, this)) allocated on every max node
with a fact in scope -- and lookup_fact allocated a few more internally while
canonicalizing. Measured on a nest of 200 max/min nodes with one fact, that
was several allocations per node.

Instead, learn a ConstantInterval on the difference between the two sides of
each comparison, and ask about it with the operands a rule already has bound.
MatcherState holds raw node pointers, so the query touches no reference counts
and builds nothing: the same benchmark now allocates nothing per node.

Direction and strictness stop being special cases: the other direction is the
negated interval, and strictness is just whether the bound is -1 or 0. The
complement of a half-line is a half-line, so only the negation of an equality
fails to be an interval, and that is always a single point removed, which is
what KnownBound::invert represents. A removed point tightens the bounds when
it lands on an end, and is otherwise only tracked when it is at zero, which is
what decides known_not_equal.

Constant offsets are peeled off both the facts and the queries, so a fact
about x and y + 3 settles a question about x and y.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
The limit governs how much work an adversarial expression can provoke, and
the growth is steep: on a nest of min(x, y) - min(z, w) the simplify test
costs 0.02s at a limit of 1 or 2, 0.11s at 3 and 0.72s at 4. Nothing needs
the extra depth -- instrumenting every correctness test shows the deepest
nesting any of them reaches is one -- and correctness_likely and
correctness_autodiff are unchanged across limits of 1, 2, 4 and 8.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
Two constants, and a min or max compared against one of its own operands,
bound their difference on their own. Deriving those needs no facts, no
recursion and no allocation -- a node type check and a couple of the inlined
equal() comparisons -- so fold them in alongside what the fact table says
rather than treating facts as the only source of knowledge. The fact table
being empty must no longer short-circuit the whole query, since that would
skip these too.

No rule needs this yet: the max and min rules that consume min_diff are
already covered for these shapes by dedicated rewrite rules, so this changes
no behaviour on its own. It is what makes the difference helpers strong
enough to replace can_prove in rules that currently rely on it proving things
structurally, which without this loses cancellations such as
min(x, y) - min(x, w) where y is min(a, b) and w is a.

Cost is confined to a synthetic max/min chain (0.070 to 0.079 ms on a
200-deep nest); correctness_likely and correctness_autodiff are unchanged.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
A min is at most either of its operands and a max is at least either, which
bounds their difference on one side without any facts. Knowing the two are
unequal removes the endpoint of that bound, and the two together decide a
comparison that neither decides alone -- which is what makes these reachable
through the max and min rules, where the shapes that structural knowledge
settles on its own are already covered by dedicated rewrite rules.

The two negative cases pin that down: drop the inequality and the difference
could still be zero, drop the shape and there is no bound to tighten.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
The fact list is not short in practice. Lowering lens_blur performs 35594
difference lookups, about two thirds of them with 39 to 54 facts in scope, and
not one of them matches: every lookup scanned the whole list, following two
pointers per record, to establish nothing. That scan was most of what the
fact-driven max and min rules cost.

Summarize each side of a record by its node type, plus the name or value of the
leaves that distinguish otherwise identical nodes. Equal Exprs always summarize
alike, so a mismatched summary rules a record out without touching the Exprs,
and the scan becomes a pass over integers stored in the record itself.

Measured on lens_blur lowering in retired instructions, which wall time is far
too noisy to resolve: 2.187G on main, 2.297G before this change, 2.218G after,
so it removes about seventy percent of the overhead. Of what remains, 18M is
the rules being attempted on every max and min at all, and only 13M is the
scan -- so an associative container in place of the vector could recover at
most a further half percent, while costing the O(1) scope teardown that
truncating a vector gives.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
has_facts is true whenever anything at all has been learned, but a fact only
leaves a record for min_diff and max_diff to find if it is a comparison of
non-overflowing integers. A boolean fact, or one about a type that can wrap,
satisfies has_facts while leaving the difference table empty, so the max and
min rules were running lookups that could not possibly match.

Lowering lens_blur did that 6998 times, a fifth of all its difference lookups.
They scanned nothing -- there was nothing to scan -- but still paid for the
call, the constant peeling and the structural check. Gating on the table the
predicates actually read removes them: 35594 lookups become 28596, with the
records scanned unchanged.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
Xoring the two fingerprints gives a key that is the same whichever way round
the pair is asked about, so a single bit serves both directions of a record.
Keeping a bit per key over the whole table turns the common answer -- that
nothing is known about this pair -- into one test instead of a walk.

The summary belongs to the table rather than to each record: the fallback scan
walks every record, so keeping those small matters more than where the summary
lives, and a scope can then save and restore it wholesale, which is what makes
undoing it free when bits cannot be cleared one at a time. Four words rather
than one because a table of a few dozen facts saturates 64 bits and lets four
queries in ten through; at 256 it rejects 79.5% of them.

Lowering lens_blur, in retired instructions against 2.187G on main: 2.216G
before, 2.210G at 64 bits, 2.208G at 256. Skipping the scan entirely would be
2.205G, so what remains of it is 3M instructions, or 0.14%. An associative
container cannot do better than not looking at all, so that is the whole of
what one could still win here.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
…e bit

Only leaves carry anything that tells two nodes of the same type apart, so
every Add summarizes alike, as does every Min. Xoring a pair of them therefore
gives zero whatever the type, and Add against Add, Min against Min and every
other same-type pair shared a single bit of the table summary.

Keying that case by the kind instead lifts rejection on lens_blur from 79.5%
to 81.6% for the cost of one comparison, and the summary is no sparser for it:
32.8 bits of 256 either way.

Two larger changes were tried first and both measured worse. Summarizing an
Expr recursively rather than only at its root costs more to compute than the
scan it saves (2.212G against 2.208G). Replacing the xor with a key built from
the sum as well spreads same-type pairs properly but aligns query keys with
record keys far more often, dropping rejection to 52.3%. The scan that is left
is 3M instructions, so there was never much here to win.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S1YKwTyubRmLMfA58gM1Pu
@mcourteaux
mcourteaux force-pushed the mcourteaux/can-prove-facts branch from 032f724 to 260cc16 Compare September 5, 2026 18:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants