Technically it could be seen that way because a financial trade doesn't create value as which happens with the rest of society's work. So wall st etc can only present trades where one person wins and the other loses.

(It's actually a little worse than win-lose or a zero-sum game ... because the financial system also has to take a cut!)