skysight-inc/HackerNews huggingface dataset:
> Hallucinations are an engineering problem and can be solved.

I'd like a little more background on that claim.

As far as I've been able to tell from my understanding of LLMs, everything they create is a hallucination. It's just a case of "text that could plausibly come next based on the patterns of language they were trained on". When an LLM gets stuff correct, that doesn't make it not a hallucination, it's just that enough correct stuff was in the training data that a fair amount of hallucinations will turn out to be correct. Meanwhile, the LLM has no concept of "true" or "false" or "reality" or "fiction".

There's no meta-cognition. It's just "what word probably comes next?" How is that just "an engineering problem [that] can be solved"?
It was hell, but perhaps out of that hell was fashioned a sort of paradise.

If the framers of the Internet had not been faced with disparate systems all speaking different languages and protocols, if they had not been introduced to computing as a babel of vendors all wanting to do their own thing, then perhaps they would not have longed for vendor-neutral, interoperable protocols, such as we have today.

The drive in the 70s to hook up very different computing platforms and have them all talking to one another, that's what gave us the Internet today. Perhaps the choices in OS have diminished since the demise of proprietary systems and bespoke OS for so many platforms, but from where I sit, I still see a wide diversity of devices all connecting to the same Internet, all speaking the same protocol, and I'm thankful for that development.
That's what happened with the internet, which was supposed to be the new Library of Alexandria, educating the world, liberating the masses from the grip of corporate ownership of data and government surveillance, and enabling free global communication and publishing.

It's almost entirely shit now. Instead of being educated, people are manipulated into bubbles of paranoid delusion and unreality, fed by memes and disinformation. Instead of liberation from corporate ownership, everything is infested with dark patterns, data mining, advertising, DRM and subscriptions. You will own nothing and be happy. Instead of liberation from government, the internet has become a platform for government surveillance, propaganda and psyops. Everyone used to have personal webpages and blogs, now everything is siloed into algorithmically-driven social media silos, gatekeeping content unless it drives addiction, parasociality or clickbait. What little that remains on the internet that's even worth anyone's time is all but impossible to find, and will eventually succumb to the cancer in due time.

LLMs will go the same way, because there is no other way for technology to go. Everything will be corrupted by the capitalist imperative, everything will be debased by the tragedy of the commons, every app, service and cool new thing will claw its way down the lobster bucket of society, across our beaten and scarred backs, to find the bottom common denominator of value and suck the marrow its bones.

But at least I'll be able to run it on a cellphone. Score for progress?
What's Wikipedia Worth Today?
as a musician, did you ever stop to consider the ethical implications of the emissions created by your particular frivolous hobby?
it costs 0.001$ per 1K which is slightly cheaper than GPT-3.5-turbo. I have just tested it and it shows extremely worse results on the tasks in my pipelines. Not a game change, unfortunately.
Actually it was Paradise PD https://www.youtube.com/watch?v=jOuD3KJ-a7w
Yes, this interpretation is correct.

It should be noted that not all of the hardware is strictly "emulated" (or simulated, if you prefer that term) in the traditional sense of interpreting each hardware instruction. The DPS in the name means "distributed processing system", and this is not merely a marketing term.

The DPS series, like many other mainframes, have multiple independent systems working together. For example, IO is handled by a FNP (frontend network processor) which was a (physically) separate minicomputer, with its own CPU, OS, etc. There were various FNP models (16-bit and 18-bit systems) produced. The DPS8M software implements the FNP at a high level, rather than running its original software (though there is both an FNP software simulator and a FPGA FNP project underway).

We did have some internal debate on if the system is a "simulator" or an "emulator", but really, it can be both, depending on how pedantic you want to be.

The biggest reason for the name being what it is, however, is that since the beginning, the software was called the "DPS8M Simulator", and even if emulator might be (arguably) a better name, it's not worth changing it at this point.

Disclosure: I'm one of the developers.

Edit: There are also some optimizations in place (https://dps8m.gitlab.io/dps8m-r3.0.1-archive/R3.0.1/global/S...) that blur the lines between emulator, simulator, and virtual machine.
isn't this what pastebin is for?
Since you're the creator you can add 'Show HN' to the title. Then it will in the https://news.ycombinator.com/show list which requires less upvotes.
At the surface this looks cool but I wonder if the data is actually reliable.

That heatmap is pretty.
It appears to be sponsored by Cisco these days and is intended to scan email attachments, so signature-only is probably adequate for that purpose.
> I feel this is an obsolete view. React has been on top since what, 2017?

React is obsolete. Cool kids are now using Svelte or Qwik.
Author of fst and regex crates here.

No, it isn't. The only similarity between them is finite state machines. Cox's article is about regexes. The fst crate is a data structure for storing keys and optional values. Two completely different things.
Like social media ruined the world despite it's initial promises, like crypto ended up with grifters of all kinds, AI will follow.

Yes, there are some narrow applications that will be GOOD. But will the good outweigh the bad? No, not at all. It never has.

We'd all be happier as a society if we went back in time.
I asked you to explicitly state how the social justice causes increase access to information.

You replied sure but then didn't do this.

I asked you again.

You didn't do this.

You may get more attention and interest from other people if you stop pretending to respond to them.
My genuine deep love for numpy extends to them doing these things without me knowing anything about it.
> I'm confident they crunched the numbers and did the tradeoffs;

Here is the math they did.

Pros: Looks good in my promotion packet.

Cons: Need a bigger garage to fit all of these new sports cars.
I think if you can't answer this, you're likely to face other issues down the road. If they're offering to pay you they'll no doubt want you to sign a contract which will give them all your IP. You won't have a business after that.
You're going to need some sources for these assertions you are making.

> The world is richer because of it, even if the japanese didn't get to own a share of that wealth directly

Japan, SK and Taiwan are all export economies, they import energy, build sophisticated products in more or less similar industries, export them and punch way above their weight on the list of world's top exporters. If Hyundai grabs a chunk of Toyota's market around the world, and Samsung replaces Sony, that is a direct loss for the Japanese with no "indirect benefits" in sight.
> SEO hacking content farms dominating search results

It seems like LLMs are destroying traditional search engines (Google) much faster than they are enabling new ones (Bing + GPT).

Are we going to enter a dark age of search where the signal is drowned out by the noise for a few years? SEO blogspam was bad enough when humans had to write it, now it's becoming impossible to avoid.
Using such donation page I managed to collect $2K+ donations for repo: https://github.com/karfly/chatgpt_telegram_bot.

I'd be happy if this helps anyone!
If Palmer Lucky is on a good quest by making arms dealing “better”, then how is yachting around at 35 a bad quest?

Substack really needs a “confirm my bias” filter to complete its quest.
I don't see how the mixedness of the environment changes anything; sure, a mixed-driver environment is more difficult to navigate because traffic participants are less predictable, but this effectively just delayes the point slightly at which AI will simply outperform even the best humans, right?
And governments with teams devoted entirely to regulate this industries and manage ecosystems.
Clicking on any of the examples causes my browser to go into an infinite loop of opening new tabs
It’s extremely rare for a system to be 10x slower, much less 100x, and developer productivity is huge. When you see huge numbers being tossed around for an entire system, they almost always mean “our first architecture wasn’t right for the problem” and the question to ask is how much time it would have taken the same team to discover the correct shape of the problem with the other candidates.
While I agree with the prediction, the tone they use seems somewhat too close to "well, if we're not going to make it anyway, how about we sell some more fossil fuels?"
Wouldn't this just be ImmutableArray or ReadOnlyCollection?

> “Frozen collections” and ImmutableArray<T> can solve this issue, but the latter is essentially just a defensive copy of the array, but in a special type

OK. Or just declare your parameter as IEnumerable<>? This has the effect of restricting the operations on the incoming collection in the same way.
I have decision paralysis and therefore I can only watch TV. Many of my friends think how can I watch TV when I don't even know the local language and I have no control over it, but its still less stress free for me since I can't navigate through the mazes built by Youtube & Netflix
> Say that again when your AI physician prescribes you the wrong medication because it hallucinated your medical history.

You say that like humans don't err, either though malice or madness or mistake.

https://www.npr.org/2019/10/02/766403612/doctor-gets-40-year...

https://edition.cnn.com/2021/05/18/us/virginia-former-ob-gyn...

https://www.npr.org/sections/health-shots/2022/03/25/1088902...

https://www.theguardian.com/uk-news/2023/aug/22/lucy-letby-w...

https://en.wikipedia.org/wiki/Harold_Shipman

https://www.nationalgeographic.com/history/article/handwashi...

https://en.wikipedia.org/wiki/Andrew_Wakefield
The richest countries in the world choose not to produce enough competent doctors because of capitalist incentives, not because it's actually impossible.
As with all absolutes* exceptions exist:

Viagra Boys - In Spite Of Ourselves (with Amy Taylor)

I absolutely love that the entirety of the video is unpurchased stock footage with the watermark still on it. This is cinematic gold.

https://www.youtube.com/watch?v=WLl1qpDL7YA

* well, most ...
Got it, thank you so much! Kinda new to hackernews and trying things out! I will post again tomorrow.
North America is generally on 220-240V split phase with NEMA compatible plugs. In Mexico, the plugs are often ungrounded and only compatible, not identical to NEMA. In my house in the US I have mostly 120V circuits with a few 240V for appliances.

Brazil is a bizarre mess of 127V single phase in most of the south and 220V single phase in the rest. They are supposed to use euro-style grounded receptacles but often have installed euro and NEMA bi-compatible plugs at 220V or 127V. A lot of 220 circuits only carry 8-10A.

Argentina uses the Australian style receptacle with 220V 50Hz.

I'm not sure about the rest of South America but I think Uruguay and Paraguay are compatible with Argentina and the rest are on 60Hz and generally 220V.

I'm surprised nobody mentioned Japan, and its varied system.
Well summarized. This general approach (create tokens/interpreter for tokens/program as token tree) can be found in other functional design patterns too, like the Free Monad pattern. Even decoupled from any one specific design pattern, I find myself reaching for this general approach when modeling a complex domain.
Its still not very easy to understand if this is now good or not.

3-5k requests per second is not that much and highly depends on what you actually do.

A lot of things can be done just with nginx. nginx is very fast.
Exxon produces less than 3% of the world's daily crude demand and in May its shareholders overwhelmingly rejected calls for stronger measures to mitigate climate change.

What else can be said, there are assholes that are legally allowed to actually pursue this and there is absolutely nothing in the way of the law that's going to stop it.

Our current system of governance isn't equipped for this.
Despite the danger of being considered too cynical...

"When your OOP support sucks so bad, the people might as well just use maps."
I feel like blimps wouldn’t be anywhere near as noisy as planes so people on flight routes might really appreciate that.

Hopefully one day we can get passenger blimps.
note: it was just an example. but in the end from a performance optimization standpoint it is a lot about what information you want to give to help the compiler along at doing its best job. with many compilers/languages that tends to be value semantics; however specifically in Fortran, which defaults to immutable reference semantics, reference types tend to be very straightforward to work together with the machine, avoid additional and keep functions inline-able. Overall from my experience this creates a more performant baseline when non-engineers work with it.
It is true. It is totally wasteful and it wastes lots of water as well [0].

Even before that, there aren't any efficient methods of training, inference and fine-tuning available today that are viable alternatives in the field of deep learning, especially after a decade of existing.

Drew's point still stands, unchallenged.

[0] https://gizmodo.com/chatgpt-ai-water-185000-gallons-training...
I thougth to myself that surely there would be a CIL backend for LLVM, and why didn't the author just use it? But amazingly there doesn't seem to be.
> They can be annoying to travel with

That's my main problem since I travel a lot, or used to at least.
> I wasn't talking about right wing nutjobs getting screen time

You mean like Friedrich Merz, who coined the term "Sozialtourismus" ("social (welfare) tourism")? Horst Seehofer, the previous minister of the interior, who called migration the "mother of all problems in this country"? Last time I checked even the left treated them as "serious politicians" regardless of ther character.

The question really is what is it that you think you can't have a "sane right leaning discussion" about anymore? Usually when I hear people say that, it's about topics like race and IQ (and why we should treat people of different races differently because of that), sex differences (and why we should treat people of different sexes differently because of that), hetero- vs homosexuality (and why we should treat people with different sexual orientations differently because of that), poor people underachieving (and why we should treat them worse because of that) or trans people (and why we should treat them as sexual perverts).

If it's any comfort to you: I live in the North-West of Germany and most people I know think there's some meaningful difference between races (but we shouldn't treat people of other races worse for it), some meaningful difference between sexes (but we shouldn't treat people of other sexes worse for it), homosexuality is kinda icky and abnormal (but we shouldn't treat them worse for it), poor people are mostly at fault for where they are in life (but we should still generally support them) and trans people are weird freaks (but we should still treat them somewhat respectfully). I'm decidedly to the left of all of these stances and you can find plenty of people to have a "right leaning discussion" about these issues with, though I can't vouch for the sanity of it or how far right it will lean. I suspect the same is true in the South and especially the East of Germany, and even city centers like Berlin or Hamburg.
Using more threads usually makes I/O-bound tasks slower, not faster, unless they're working with different devices or resources.

What you need to be fast is a systems engineer.
yes but besides a somehow snarky comment, it doesn't make sense from a company perspective.

This wasn't done to have mone to donate to Elixir but for revenue.

And besides that, you don't even know if they do
Speak with your wallet, and with your voice, and with your keyboard. Sometimes with your feet and a placard.

If we restrict ourselves to speaking with the wallet, the 'discourse' gets more inegalitarian and less democratic
> It is where a lot of the women I know go to for ideas for just about everything, from house decor to even the ideas for our wedding.

So much for the idea that men are more "vision-oriented" than women.
All Hail the Kaggle-Bot
Interesting -- the one that I know of isn't listed on the Seattle Area page.

https://www.openstreetmap.org/query?lat=48.06021&lon=-122.46...
The AI will have more experience composing bullshit put-offs, but even less access to the systems that control the systems that are exhibiting problems customers currently experience. We'll see the problem of layered customer-service (where the first two layers have no power, other than to maybe turn on some pre-configured bonus/offset/coupon) made worse by further automation.
The title mentions "Providing actionable info" but I don't see what's actually actionable here? The text also mentions "Actionable tips to minimize pollen exposure", what besides avoid going outside or wearing a mask could you actually do?
This is one of those problems that takes either collapse or dictator to fix. It's just too big and nebulous for society as it is to even acknowledge it across the board.

The problem with both of those things is all the dead people.

But we seem to think we can just keep skating by like we are in perpetuity.
- Neither of these scandals, if true, would bring down Wikipedia. Not even close. Wikipedia's history is full of drama.

- Not every huge outlet you contact is going to run with a story on a tip like this, especially if you aren't majorly involved with the stories themselves.
C# really is a brilliant language, but all of the awful microsoft bullshit surrounding it ruins its image.
Though if people consistently over decades sing a language's praises on a single point consistently like they do the beam on this point, it's usually not without merit
Our profits margins are lacking, please do force some artificial scarcity so we get some of our power back after the competition in our field eroded our power!

Notice how every suggestion for fighting climate change always involves preventing new oil competitors from developing while doing nothing about existing oil fields?

They are laughing all the way to the bank as they know the world depends on them and can't possibly detach that dependence, renewables barely make a dent in that. They don't care about total oil consumption only profit margins.
That’s true, but weirdly the right answer has changed during the 30 years I’ve been in the industry.
I even go as far as not doing the self checkout at the supermarkets. But In the end I don’t think it will make a difference.
Thank you. It seems that it was a customary unit in my area of the country as well. Never heard about it.
https://news.ycombinator.com/submitted?id=VarunPotti
I mean there are plenty of examples in the wild left and right.

Have you ever seen basic db optimization? Alone in my companies people were just using stuff wrong.

Performance and Architecture are a after thought in our industry. A normal developer doesn't think about it.

There was one query in my company which was running in one region slower than in another one and there was also an explain statment available. No one looked at the explain statement and thought "huh why does this simple select use so much memory". People weretrying to see why the regions themselfs were different not what the problem with the query was.
> If you’re poor you watch shitty, AI-generated movies on Netflix for $1.50/mo.

I suspect even worse scenario. If you're poor you watch shitty, ai-generated content for the current price. If you're persuaded to belive that you're middle class you cough up twice more to watch shitty, ai-generated content called premium becuase it will be "artisanely curated by humans (tm)". If you're really rich you will go to the theatre or opera.
I settled down on SideBerry after having used Tree Tab Style for ages: https://addons.mozilla.org/en-US/firefox/addon/sidebery/

It adds contexts/categories. So you can have trees of tabs per topic.
I have a neighbor that buys spoon collections at estate sales any chance he gets.

They're cheap and they're almost always Sterling silver.
...."thanks to us".
Why do people bring this up? People are not LLMs and the issues are not the same.
Speaking from one of the formerly rich countries (UK), we treat our doctors and teachers incredibly shabbily - long hours, low pay, terrible conditions. It's frankly a miracle that anyone over the last 15 years has gone into either profession.

Fix the low pay and terrible conditions and yeah, you'll easily produce enough doctors and teachers, but late-stage capitalism isn't going to do that...
Back in the early 90's (post Valdez), a friend of mine had a tshirt:

At Exxon, we don't have to care,
Because at Exxon,
We're Part of the Problem
Re: Africa. One costs a couple pennies per day per person, the other dollars per day per person. The latter is more useful, but given the cost difference I'd certainly hope so.
I think AI has the potential to level up the plain field.

Speaking from an entrepreneur's POV, AI gives me an unfair advantage with respect to the large whales. It lets us complete projects (specifically, software projects) 10 times faster and achieve things before I had to raise millions to achieve them.

I can't tell if the net negative/positive is + or -, but it's not clear-cut for sure.
Is that supposed to be a serious opinion about contemporary AI..?

Because that's crazy to me. Humans can be reasoned with. AI can't. My experience with the likes of ChatGPT tells me that if the AI is wrong about something (which it very very often is), there's no point trying to explain to it that it's wrong or how it's wrong, it will say something like "You are right, sorry for the confusion." and follow up with the same or a similar error again.

AI might eventually become an alright first line, but losing the option to speak with a human -- an intelligent entity which can actually be reasoned with -- seems dystopic.
>Best way to preserve your families legacy

Do something important for humanity, so others will preserve it?
Disney, the New York Times and CNN Blocking Access to ChatGPT
There’s nothing artificial about the budget of carbon emissions we have before each temperature increase is bought. Increasing the cost of fossil fuel is a good way to make alternative energy more appealing to investors
> require a similar number of dead individuals.

That's fine - I'm sure we'll get them one way or another
It's one thing to use Pinterest intentionally, a whole other to have it shoved down your throat.
> It is the definition of an internship.

No, it's not.
https://archive.is/aLW0B
A few unpopular opinions about AI
I tried eliminating repetition in back end development
Hey everyone! I'm currently working on Visual Backend, a desktop app which aims to make backend dev more efficient by eliminating repetition like setting up boilerplate code. Long story short, after working on many backend projects, I realised that some aspects are quite repetitive. For instance, when writing a CRUD function, I always follow the same steps of configuring the router and creating / editing new files before actually writing the actual function, so I decided to see if I could automate those processes.

I'd love to hear from you if this is a problem that you face as well and whether you think Visual Backend effectively solves it. Thank you!