There are no enemies left for the shek guards to beat. There is no manual labor left for the human men to perform. Both groups can sit and do nothing for a while. The human men have nothing to worry about - there are 18 of them, and only 9 shek women. There is a safety in numbers, even though there are bottles of sake in that building, and many empty beds.