The phrase 'surpassed in numerical strength' means that there are fewer of us than there are of them. In this context, it means that we are fewer than they are.