Give it one more try and add another swapfile or grow the existing one (see my post how to, but don’t set the swappiness value).
At least in theory, the memory that’s useable to processes is not RAM but the virtual memory which is including swap so no Linux should be killing processes unless swap is exhausted, too.
Dunno if Raspbian works different but it’s worth a try.
