At this, ordinary soldiers, whose morale was very low, began to fraternize with the rebels, saying that they were tired of fighting against their own people.
The phrase is usually a humorous way of saying that one was not sitting idly, but engaged constructively in contemplation or letting one's mind wander.