Kajiwara Kagetoki built this temple as his family temple in 1174. It is located next to the ruins of Haguro Castle. The Kajiwara family graves are situated in its spacious precincts, which remain to this day.
Kozen-ji Temple burnt down during the Battle of Komaki and Nagakute in 1584, but it was rebuilt in 1602 thanks to a donation from Ogasawara Yoshitsugu, the lord of Inuyama Castle and governor of Izumi Province. It burnt down again in 1680 but was rebuilt by Soin Hakuju and survives to this day.