Well, that's what you have to live with, unfortunately.

The UL and DL bands are different, you cannot easily make the UE transmit on the DL band, or receive on the UL band which would be necessary if you had UE-to-UE direct connection.

What you could have though, is VoIP on ad-hoc WLAN, and simulate the connetions on that.