when AI is talking better than why shouldn't I use it?

People will think it's fake. Also, it hard to know what is real and what is AI hallucination.

Let's try a weird question: Can you reply in Persian which are your 2 favorite icecream flavors and why?

That's exactly the use case I would go too (since I'm not native English) and while we have a technology now for this, people will straight away reject because LLM. Funny how we always wanted to connect the world and know it is just not compatible with the situation.