It's up stumps and retire to the pavilion

What does this sentence exactly convey? You can find it by googling it, one of the main references being the movie "Brazil"