The mechanism of our minds vs. an AI, and the question of "consciousness", are utterly irrelevant.

The mechanism doesn't matter because the only thing that does matter is results ("do submarines swim?"). Even the fact that current AI require more examples compared to a human matters less than the magnitude of the difference — given the speed difference between transistors and organic synapses is on-par with "runner vs. continental drift", the limit of current GenAI models is running out of training data, which we humans don't live long enough to do.

"Consciousness" doesn't matter because that word has about 40 different definitions, many so bad that tape recorders pass some of the tests and humans fail to pass others.

Economically speaking, it doesn't matter if an AI (be it narrow or general or anywhere between, or on the other axis be it sub/medi/superhuman) is a P-Zombie or not.

… it doesn't matter if a transformer model feels something, only if it might take my job by writing code that works well enough that the market for software developers disappears. (This may be a higher or lower standard than "is it as good as a human?" due to it being unclear at what performance level the tool saturates demand: as a toy model, if it turns out 90% of apps are a CRUD database feeding a JSON API feeding a trivial UI, I can easily imagine an LLM (or even a future version of Figma) automating all that and forcing all the devs to compete for the remaining 10% of tasks and there's no guarantee whether or not the remaining 10% of tasks will expand to fit the supply of developers).

… it doesn't matter if a diffusion model has a love of art, is inspired by the beauty of nature, genuinely empathises with newlyweds who ask for their alter photo to be transformed into a renaissance oil painting; I imagine that artists only care if demand for their services has gone down (see all the artist saying both that it threatens their livelihood and that it sucks).

… it doesn't matter if a business agent has a monomaniacal focus on profits or if it has side-interests, hobbies, and a pet giraffe; the only thing that matters is if the business may harm my interests. (See any discussion along the lines "are corporations a type of AI? And are they aligned?" regardless of how you feel about terminology).

… it doesn't matter if the Google search engine experiences joy when I click on a result it provides, just that it gets me results.

… it doesn't matter if Deep Blue or AlphaZero enjoy winning, just that they did.

There are two ways "consciousness" (in the sense of qualia) matter to me, but they are not performance issues:

1) Brain uploads, where anyone who wants to use it to circumvent death wants consciousness to be present

2) Slavery: Will this economic value be an accidental re-invention of slavery, where we use exactly the same "they're not really people" arguments to avoid the cognitive dissonance of how we treat conscious beings that we own, create, and destroy on a whim.

These are ethical issues, which are not at all relevant to the question of "what do we need to get human-level capabilities?", any more than Eli Whitney needed to ask "what's the ethical aspect of this?" to be capable of actually inventing his cotton gin.