The Sorrow Remembrancer has to absorb all of the pieces of its lost brothers and sisters.
Pulling them into its void they disappear from memory, everyone forgets except the sorrow remembrancer, doomed to be filled with sadness to protect the rest from pain.
It's too painful to the others what really happened.