Who were the men refusing the call of Gondor?

[Elmo]

During the Council of Elrond Boromir says

Only from Rohan now will any men ride to us when we call

What men other then the Rohirrim would have riden to GOndor before? None are mentioned anyhwere I can find. Maybe from Dale but I assumed they'd be too far away from Gondor to ride their. Maybe the Rangers but I can't imagine them riding in an army to help Gondor especially when they seem so few of them and they have to guard the whole of Eriador. Maybe Barliman would lead the Breemen? (that's a joke by the way)