To tell the port build to link to the XFree86 4.x libraries, add the following to /etc/make.conf, (if you do not have this file, create it):
XFREE86_VERSION= 4