Many color document images have been printed with different regions to highlight the content. Each region has different background color. Conventional document binarization methods cannot threshold these kind documents properly. Moreover, most of them are not efficient for processing color document with big image size. For example, the size of one page pdf file journal article is converted to 300 pixels per inch TIFF file format is 2481×3296. Conventional document binarization methods to threshold these big document images will take a lot of time. Thus, this paper proposes an efficient and effective two-stage background determination method for color document images to solve aforementioned problems. This novel method is very efficient because it only analysis the border pixels in the color document and the region images. Our experiments include various color document images. Experiment results show that the performance of the proposal method is better than other available thresholding methods in visual measurement.