The British beauty dated The Libertines star for two years until their split in 2007, and he has now revealed the depths of hatred Moss had for him following the break-up.
He is convinced she was determined to cause him "as much emotional damage as possible", so she targeted his most precious item and torched it.
Doherty tells British magazine Event, "It's a big, genuine and totally heartfelt regret that I didn't keep my eye on Pandy, who was my first-ever teddy bear. My sister gave him to me as a huge gesture of love and kinship.
"I held on to Pandy all my life but he ended up getting burned by Kate, along with a lot of other stuff, when we split up. There was no need for that unless she simply wanted to cause me as much emotional damage as possible."