OpenSSH 3.7p1 doesn't seem to want to run correctly on Mac OS X (the uidswap.c file has changed a lot since the version in my local Darwin cvs checkout). A few minutes of fiddling with it didn't yield a quick solution.
So, I've decided to apply the FreeBSD patch to my copy of the source of the version that shipped with the OS. This should fix the problem. I'll install it over the Apple-supplied binaries so that if/when Apple releases a security update it'll wipe out my version.
One thing I found interesting is that the firewall isn't dropping a lot of connection attempts to ssh on the machine (so either there isn't a lot of widespread scanning going on, or I'm just lucky).
If I get some time later, I'll try and make 3.7p1 work.