Book Four opens with the now-retired Emperor Takakura's pilgrimage to Itsukushima, the favored shrine of Kiyomori, in order to try to smooth relations with the Taira. This effort is unsuccessful, however: Go-Shirakawa remains under house arrest, and Kiyomori continues to govern poorly. In this context, the aged warrior Minamoto no Yorimasa incites Prince Mochihito, a son of Go-Shirakawa, to challenge the placement of the infant Antoku on the throne. Before the two have time to properly rebel, their plot is discovered and they seek refuge at Miidera. Escorted by Miidera monks toward Nara and allies as Kōfukuji, they are intercepted at Uji, where a battle ensues. Yorimasa, Mochihito, and many others die. The Book ends ominously: the Taira burn Miidera.
Retired emperor Takakura's went to Itsukushima shrine in the time of anxiety. Although things were not ideal, the poems created on the way definitely made a difference.
Yorimasa decided to rebel against the Taira. He got Prince Mochihito on his side as well as other Minamotos and the monks of Miidera. Unfortunately, the secret was revealed too soon for the rebels to gather their power. Yorimasa and Prince Mochihito had to flee. Not long later though, they were caught at the Uji river and defeated.
Anyone related to the rebels were punished, anyone contributed to put down the rebellion was rewarded. Miidera was attacked and burned for helping the rebels.