We studied quantitative phase imaging (QPI) using coherent laser illumination coupled with static and moving optical diffusers. The spatial coherence of a continuous-wave laser was controlled by tuning the particle size and the diffusion angle of optical diffusers for speckle-reduced 3D phase imaging of transparent objects. We used a common-path QPI configuration to investigate the coherent phase mapping of polystyrene micro-beads and breast cancer cells (MCF-7) under different degrees of coherent speckles. The proposed speckle reduction method could provide an avenue for enhancing lateral resolution and suppressing coherent artifacts of the phase images from QPI.