Good episode and apparently interesting book discussed 
Incidental thoughts:
When you search for a word, you don't have a map of statistical likelihood of the word appearing, you start from the concept/shape of what you want to say.
Nice thought about "you wouldn't let dolphin be a judge, despite them being intelligent"
Why won't ai believers relay all their life to chatgpt and stop fearing death? You have immortalized yourself allegedly then.
Also interesting thought about godel incompleteness applying between matrix operation and natural neural networks
The problem as i see it (and im not a psychologist or whatever) is you dont have feeling towards your mirror for example, your brain adapted to your reflection not being a real thing at like 2-3 years.
Brain doesn't have natural defenses against empathising with llm (even with eliza people were ready to go tell the program their secrets). And feeling aren't logical (as in, you can know its bullshit and still feel some fulfillment from such conversations). They will (in the podcast) prolly discuss what author thought of that phenomenon with eliza, but i can see on a large scale that being a problem with atomized society, that noticeable amount of people will drop out into llm fantasies.
I don't think there is a danger in rejecting empathy. I like some plush toys from my childhood, i would be hurt if something happened to them, i wouldn't hurt them, but i also don't empathize with them.