Pixel-value differencing (PVD) steganography generates step effects or abnormal high fluctuations in PVD histogram. Since steganalysis exploits these artifacts to defeat the PVD steyanography, modified PVD (MPVD) steganography preserving the PVD histogram is recently presented. This paper proposes a novel steganalysis method, in which we embed message one more time into the suspicious image to generate multiple features in image histogram and pixel value differencing histogram. These features are used to defeat the MPVD steganography. In our experiment, the proposed method is tested on more than 2,000 images. The result shows that our method can defeat the MPVD steganography method at high embedding rate.