Add `SP_ENOMEM` test cases

[randoragon]

One way to achieve this is to redefine malloc to fail in a predictable way. Implementation could be sketchy and is rather low-priority, I may drop this idea entirely if it turns out too complicated.