The pagoda was originally at Hisodera Temple (present-day Sesonji Temple) in Yoshino, Nara Prefecture. It was moved by Toyotomi Hideyoshito to his Fushimi Castle and moved by Ieyasu Tokugawa to Miidera in 1601.