So much of communication between people, especially with strangers, is in body language. There are both pros and cons to not being able to see the other participants. One of my rules is that if I wouldn’t say it directly in person you don’t say it. It is very easy to say derogatory things to or about a person when not facing them.
Going for an inexpensive poor quality speaker phone for your conference room is false economy.