Oxide semiconductors are crucial for the display backplanes. The demand for high-mobility oxide TFTs is increasing due to driver circuit integration in display backplanes. High-mobility oxide semiconductors such as $In_2O_3$ are sensitive to the materials and deposition conditions of interfacing layers. Previously, $In_2O_3$ TFT using trench structure was fabricated using two different buffer layers. The role of bottom buffer layer was to create a conducting path inside the channel by modulating hydrogen and oxygen vacancy content of the adjacent $In_2O_3$ active layer. In this study, the thickness as well as material of the buffer layer is modulated to control the TFT characteristics. Increasing thickness of both $Al_2O_3$ and $SiO_2$ buffer layers resulted in more negative shift in VON, and the VON shift saturated at buffer layer thicknesses over 30 nm. Thin-film analysis revealed that hydrogen and oxygen vacancy diffusion from the buffer layers into the active layer occurred, and the amount of diffusion is dependent on the buffer layer thickness. Roughness of the films did not depend on the buffer layer thickness, and it was concluded that the diffusion of shallow donors is more dominant factor in VON shift.