A real-time encoding and decoding system (REDS) for HDTV that can be used for nonlinear HDTV editing in studio has been developed. The intrapicture coding of motion JPEG is implemented and optimized in the REDS so that a high-quality image can be recovered for the nonlinear editing. The REDS has a parallel architecture with multiple programmable digital signal processors (DSP) and reconfigurable field programmable logic devices (FPLD). The HDTV Image is spatially partitioned and concurrently processed by the multiple processors. The programmable DSPs perform the discrete cosine transform and quantization to reduce the spatial redundancy of the HDTV image, whereas the FPLDs perform the variable length coding to reduce the statistical redundancy. In addition, field-based quantization matrices are developed for HDTV images. The REDS has the programmability and the random accessibility of image frames, the two most Important features for a nonlinear HDTV editing system. (C) 2000 John Wiley & Sons. Inc.