I have two things to say about this:

1. Servers usually hold a quantity of 20 to 100 people on them, depending on the resources required to run the game. There are dozens if not hundreds of servers in each designated country so there aren't 5 or 2 as you say, there are many more. The ones you must be referring to must be the matchmaking servers which are different from the servers the match is played on. Or maybe you are actually referring to the gameplay servers and it's just that there are only two locations now or three in which EA has servers hired but in any case there are always dozens of servers and not just 2 or 5.

2. Your case clearly demonstrates that servers are causing a huge latency disadvantage to a LOT of users. They do not reduce latency or delay, or act as a common meeting point which could reduce latency, the only thing they achieve is doubling input delay and increasing latency by 1 or 2 hundreds.

We need, P2P, as an option EA. This guy could be playing with US folks at 15ms and instead is being redirected to 300ms Brazil servers where he's cursing his life.