Geralt tends to be most understanding with people who have a troubled or difficult past like abandonment or (violent) trauma, so we can go for that! especially if it's something rooted in childhood. He's also less guarded about similar topics on his end - not that it isn't a personal memory, but to him, it's also just how he grew up and he's put a certain distance between it at this juncture.