I’ve had exactly this discussion with a friend recently. I share your opinion, he shared what seems to be the view of the majority here. I just don’t see what the qualitative difference between the brain and a data-based AI would be. It almost seems to me like people have problems accepting the fact that they’re not more than biological machines. Like there must be something that makes them special, that gives them some sort of “soul” even when it’s in a non-religious and non-spiritual way. Some qualitative difference between them and the computer. I don’t think there necessarily is one. Look at how many things people get wrong. Look at how bad we are at simple logic sometimes. We have a better sense of some things like plausibility because we have a different set of experiences that is rooted in our physical life. I think it’s entirely possible that we will be able to create robots that are more similar to human beings than we’d like them to be. I even think it’s possible that they would have qualia. I just don’t see why not.
I know that there is a debate about machine learning AI and symbolic AI. I’m not an expert to be fair, but I have not seen any possible explanation as to why only symbolic AI would be “true” AI, even though many people seem to believe that.
MKBHD made an interesting video about this already a year ago:
https://www.youtube.com/watch?v=MZ8giCWDcyE