Go.Right, but I'd still have to deal with them.
Just go.
If you can't go because there's actually a car in the space then follow these rules.
Watch the tires of the approaching car.
If they turn right, it's for sure your time to go, at the split second you see them just starting to turn right, go no matter what.
If they turn left you "may" need to wait for the next car whose tires you see turn right. Or not.
If you can't tell what the tires are doing that guy just stole your turn and you are obligated to tailgate him through.