Latest AI ChatGPT do not understand math ?  - Page 1
Forum section: electronics / projects

author: szan
author_rank: Regular Contributor
timestamp: January 07, 2023, 12:00:35 am
content: Hello,I've marked in a yellow in a screenshot attached to this post, where latest artificial intelligence ChatGPT says something like this:QuoteI was interested to know something more about AVX2 instruction set extension available in my Intel Core i3 processor and at some point of this "conversation" with ChatGPT available here:https://beta.openai.com/playground/p/8coAfEUgFHTTsMJXKBF3Uli5?model=text-davinci-003I've noticed that AI ChatGPT defines array of 8 numbers insteed of 4, since on 64 bit machine "unsigned long long int" has size 8 bytes, which means we need only 4 such numbers to fill 256 bit AVX2 registersI said:QuoteI saw ChatGPT answer like shown above, which means that... nasty things can happen when AI will be used instead of humans in our everyday livesQuoteLet us know what do you think about this ChatGPTQuote

author: szan
author_rank: Regular Contributor
timestamp: January 07, 2023, 12:54:14 am
content: Anyway, google search helped me find much better portable solution for Linux gcc than chatgptIt makes sense and humans response gives clean example howto allocate such memory for use in AVX2 too, since we need 32 byte memory alignmentWhat does posix_memalign/memalign dohttps://stackoverflow.com/questions/6563120/what-does-posix-memalign-memalign-doQuote

author: tooki
author_rank: Super Contributor
timestamp: January 07, 2023, 02:10:28 am
content: Quote from: szan on January 07, 2023, 12:00:35 amJust to be clear: what you tested and screenshotted there isnotChatGPT. You tested GPT-3, which is different:https://dev.to/ben/the-difference-between-chatgpt-and-gpt-3-19dhIf you look at your own screenshot, there's a text saying "Looking for ChatGPT?" next to a button called "try it now".

author: szan
author_rank: Regular Contributor
timestamp: January 07, 2023, 03:15:55 am
content: Quote from: tooki on January 07, 2023, 02:10:28 amI've tested one of the most powerful language models currently available as you can findout in this link above:QuoteSo, the only difference is that ChatGPT could be useless in this case, while Generative Pretrained Transformer 3 (GPT-3) - one of the most powerful language models currently available - I've used showed me this hopeless answer:Quote

author: SiliconWizard
author_rank: Super Contributor
timestamp: January 07, 2023, 03:17:35 am
content: Why bother though?

author: bidrohini
author_rank: Regular Contributor
timestamp: January 07, 2023, 07:31:02 am
content: This is the first time I am hearing/reading about ChatGPT. Gotta try it someday.

author: Siwastaja
author_rank: Super Contributor
timestamp: January 07, 2023, 10:49:56 am
content: I think these AI chat threads are pretty interesting, because they show the AI has reached the level of some actual engineers. There are surprisingly many people who know how to spew utter bullshit with tech words in it, so that it still "sounds right", we even have seen that on the EEVblog forum from time to time.Sometimes these people are even successful, which tells quite a lot about the system. Of course, someone else has to do the actual design work.I wouldn't mind the slightest if this group of people was replaced by AI, no harm done. I despise people like that, because they are so dishonest.

author: tretecou
author_rank: Newbie
timestamp: January 07, 2023, 12:43:42 pm
content: I tested some basic trigonometry and geometry tasks with triangles and it failed on basic european high school/ freshman college math homework which was pretty easy so i dont think chatgpt is in this state ever going to be a danger to humanity as all the youtubers say...

author: tooki
author_rank: Super Contributor
timestamp: January 07, 2023, 02:12:49 pm
content: Quote from: szan on January 07, 2023, 03:15:55 amI didn’t say it wasn’t powerful. I just said it’s not the one you claimed to be using. That’s your mistake, not mine.

author: tooki
author_rank: Super Contributor
timestamp: January 07, 2023, 02:14:47 pm
content: Quote from: bidrohini on January 07, 2023, 07:31:02 amAsk it to write you a song about something. It’s surprisingly good at that!On the other hand, its success at creating recipes is… amusing. Like, it’ll get the general idea perfectly, but the amounts will be way off. (For example, I asked it to show me how to make shrimp pad thai, and the recipe used twice as much shrimp as noodles!)

author: S57UUU
author_rank: Regular Contributor
timestamp: January 07, 2023, 03:45:00 pm
content: This is a LANGUAGE model (even has "chat" in it's name), not intended to do math. Like a kid, that has just learned to speak well (say, a six year old) isn't very good at math.

author: SiliconWizard
author_rank: Super Contributor
timestamp: January 07, 2023, 08:34:18 pm
content: Quote from: Siwastaja on January 07, 2023, 10:49:56 amIt's not mutually exclusive, though (and unfortunately.)Both are very likely to coexist and actually feed from each other.

author: szan
author_rank: Regular Contributor
timestamp: January 08, 2023, 04:28:56 am
content: Quote from: Siwastaja on January 07, 2023, 10:49:56 amIt is a long way to go. It might be interesting, but typing with AI in humans natural language is horrible experience, when you get so sick responses for simple math problems?Now, internet will be full of art and nonsense claims created by AI.

author: Terry Bites
author_rank: Super Contributor
timestamp: January 08, 2023, 10:10:56 am
content: Well you've just put string of symbols in the prompt. WDYE?You need a question or some context.Let botty macbot face explain.Botty is not on the blog yet........it will be soon. Watch out.

author: szan
author_rank: Regular Contributor
timestamp: January 08, 2023, 06:08:33 pm
content: Quote from: Terry Bites on January 08, 2023, 10:10:56 amThere was a context, while many other posts were made until I've noticed that latest GPT3 AI do not understand that unsigned long long int on typical x86_64 Linux machine under GCC is 8 bytes long which gives us 64 bits, so two times bigger array is not needed to feed 256 bits to AVX2 registersAnyway, in screenshots you've attached from another ugly looking conversation, AI tries to force us humans to... use parentheses in mathematical expressions to show multiplication in simply math calculations like this?!: 1+2*3 + 4 ... Even idiot knows that we do multiplication before addition, and many ordinary pocket calculators would have been able to handle such calculations a few decades agoI wrote in my conversation with GPT3 AI that:QuoteHopefully, Google does not deny such obvious facts and gives as a chance to survive in an AI worldQuote

author: igendel
author_rank: Frequent Contributor
timestamp: January 08, 2023, 07:21:23 pm
content: On the general topic of ChatGPT: I've seen a lot of people lauding it as a useful tool (and, sometimes, replacement) for programmers, so, out of curiosity, I asked it to write something simple - Arduino code that does LED "breathe" effect. The funny part of the result is in the attached image. The less funny part was that I really tried to explain why this won't work as promised, and ChatGPT agreed with me - but continued to produce variations of the same fundamental issue.ChatGPT is like Flat Earthers: At first it appears to be reasonable, knowledgeable, its communication makes sense, then all of a sudden this huge void is revealed[Edit: Breathe, not Breath]

author: szan
author_rank: Regular Contributor
timestamp: January 08, 2023, 11:10:16 pm
content: Quote from: igendel on January 08, 2023, 07:21:23 pmYep, I needed today repair broken thin wires very close to standard USB A male connector and wanted to see this connector with pins description, while I had to solder new +/- wires, but I was unlucky and I was involved in this strange conversation with GPT3 chatgpt AI linked belowhttps://beta.openai.com/playground/p/94yIT9JWxiFU3SHsYFBuMehs?model=text-davinci-003QuoteOf course Google search was very successful and I was able to quickly solder new wires with the correct polarity and make job done

author: bson
author_rank: Unknown
timestamp: January 09, 2023, 08:40:19 pm
content: I suspect it has no understanding of math, so if asked a*b it only knows the answer if it has seen this particular product. Now as if that's not relatively poor, the worst part is if it hasn't seen that it picks something similar. As a result you get totally incorrect results:Mathematica:39383*923833=36383315039ChatGPT:The result of 39383 multiplied by 923833 is 36432476129.In general, recognizing when you don't know the answer to something is a critical step towards correctness. Frequently, "I don't know" is the intelligent answer.The second big problem apart from recognizing it doesn't know something, or can't think of how to find out (for example by ordering a textbook off Amazon rather than the equivalent of googling for more nonsense), is it blindly and naively believes everything it's fed is axiomatic truths.The third problem is it can't derive possible 'working axioms' or patterns - its patterns are purely language based like templates.And since it's so bad, I'd like to point out the fourth problem which is the same as the first, that when it doesn't know it pulls something out of its ass.

author: bson
author_rank: Unknown
timestamp: January 09, 2023, 08:57:17 pm
content: Thinking about it some more, say you're a PhD student. You've done a bunch of research, and have bits and pieces of your thesis drafted, and now you have ChatGPT generate the thesis document for you. So you feed it what you have, including all your data along with explanations of what it is, how it relates to your work, and a page or two about the subject of your thesis. So far so good. But to output a thesis it needs to have looked at a huge number of quality papers and prior theses, to know what it should look like. So you feed it a dataset for this. Now, the first problem you're going to have is that all the data, research, and conclusions of these will pollute thecorrectnessof yours. You can't trust the output to be correct, because it will fill in gaps with nonsense. The second problem is you will be accused of plagiarism, and rightfully so, since it effectively takes someone else's document and reasoning and drops in your data...

author: Terry Bites
author_rank: Super Contributor
timestamp: January 11, 2023, 05:04:24 pm
content: GPT wont empty my bins or wash my face. The programmers must surely be morons!

author: szan
author_rank: Regular Contributor
timestamp: January 11, 2023, 05:23:25 pm
content: Quote from: bson on January 09, 2023, 08:40:19 pmMaxima also gives different result of this multiplication than AI chatboot:maximaQuoteThe answerr is as simple ass it is - this tool (chat boot) was created only to STEEL phone numbers, because of it is one of the requirements when registering to this bullshit web site

author: szan
author_rank: Regular Contributor
timestamp: January 11, 2023, 05:56:16 pm
content: Quote from: karpouzi9 on January 09, 2023, 09:20:54 pmYou do not have to use any calculator to have correct result, because of... you can use your brain and sheet of paper with pencil to obtain correct result ?!Decades ago any pocket calculator could give you correct result, so it doesn't make any sense to use thisAI chatboot's to solve real engeenering problems, but art designs, with stupid graphics.

author: SiliconWizard
author_rank: Super Contributor
timestamp: January 11, 2023, 07:08:27 pm
content: The problem that some seem to fail to recognize is that this "AI" stuff isn't meant to be useful to us, end-users (past the fun, toying around, discovery period.)

author: tszaboo
author_rank: Super Contributor
timestamp: January 12, 2023, 01:51:53 pm
content: Quote from: Siwastaja on January 07, 2023, 10:49:56 amI think the ChatGPT reached the level of most managers already. I mean it replies to questions in finite amount of time and the reply is coherent and feels like the AI actually read the question, 100% better than most managers.

author: BrianHG
author_rank: Super Contributor
timestamp: January 13, 2023, 08:13:56 am
content: ChatGPT4 is coming and it will roast #3.It's going over 1 trillion parameters.

author: szan
author_rank: Regular Contributor
timestamp: January 13, 2023, 06:37:16 pm
content: Quote from: tszaboo on January 12, 2023, 01:51:53 pmNope, managers are capable to make basic math, but chatgpt has problems to understand it as I've shown in this thread

author: bson
author_rank: Unknown
timestamp: January 13, 2023, 06:54:07 pm
content: Quote from: karpouzi9 on January 09, 2023, 09:20:54 pmThat's not the point. The point is it has ingested tons of papers, articles, web sites, -pedias, etc. Yet despite all this it hasn't even understood how to multiply two integers. I bet if you were to use addition instead the situation would be exactly the same. This shows there is no reasoning, no thinking, only dumb rote pattern matching, proximity fudging and a more sophisticated copy-and-paste. It can't figure out anything original, all it is is a fancy search engine and document creator.

author: SiliconWizard
author_rank: Super Contributor
timestamp: January 13, 2023, 07:48:22 pm
content: Quote from: bson on January 13, 2023, 06:54:07 pmIt clearly shows that machine learning, at this point, has little to do with learning as we know it.

author: szan
author_rank: Regular Contributor
timestamp: January 15, 2023, 12:07:58 am
content: Quote from: SiliconWizard on January 13, 2023, 07:48:22 pmIt is strange, that today I've asked GPT3 something like this:Quotebecause of I'm interested in hardware accelerated some kind of -1/0/1 three state logic by using pure binary operations and answer is shown in attached image, but when we try to search google for:Quoteintrinsic to swap each two bits in AVX2 extension instructions I get among others this search result:QuoteI didn't tested suggested chatGPT code yet, but it is very disappointing that google search was not able to find any hints about_mm256_swap_epi64intrinsic ?!BTW: I do not include chatGPT response as a text, just to do not spread AI artificial inteligence text on humans forum website, which I think is a must now, to do not let AIs to try to teach humans its language

author: mathsquid
author_rank: Frequent Contributor
timestamp: January 15, 2023, 12:12:46 am
content: I generated two large primes and multiplied them together, then asked chatGPT to factor it, knowing that it was essentially impossible. I figured that it would say that factoring such a large number was beyond its capabilities, but that didn't happen. It gave me an incorrect prime factorization.So I thought I'd give it an easier one. I asked it to factor 1009 (the smallest 4-digit prime), and it said that it factors into 17*59, which is 1003.

author: szan
author_rank: Regular Contributor
timestamp: January 15, 2023, 12:37:49 am
content: Quote from: szan on January 15, 2023, 12:07:58 amOK, now I've tried to compile code suggested by chatGPT from source file in avx2_swap.c:Quoteby using GCC C compiler under Fedora 32 Linux:Quoteand I've got warning about implicit declaration of function ‘_mm256_swap_epi64’ as well as error: incompatible types when initializing type ‘__m256i’ using type ‘int’QuoteSo, still thanks to chatGPT I have no idea howto use AVX2 to perform swap of each 2 bits operation something like in this example in AVX2 256 bit register:QuoteResult should look like this:Quote

author: SiliconWizard
author_rank: Super Contributor
timestamp: January 15, 2023, 02:04:51 am
content: There shouldn't be much longer before someidiotsactivists start calling us oppressive towards AI and making it a national cause.