Turns out the reason behind my failed attempts at connecting to the VPN I was setting up yesterday was because another VPN running at the time was masking my external IP address. Completely forgot about that one. Turning it off has resolved the issue.