There are limits to power, and the Son of Heaven cannot do as he pleases. This was the foundation of Confucianism's founding.
As the Son of Heaven, the most he could do was correct the mistakes, audit the crimes, and not actually control the country.
The inner court and outer court were all controlled by people. Since they were people, they would have their own opinions