skysight-inc/HackerNews huggingface dataset:
Catching "hallucinations" is quite useful for many applications. I'm doing some research in mitigating effects of factual errors in LLM generated answers for public agencies, where giving a factually wrong answer may be illegal. If those could be detected (with sufficient accuracy), the system could simply decline to give an answer and ask the user to contact the agency.

Training the models not to give wrong answers (or giving them less) in the first place would of course be even better.

Unnecessary complications come also from the use of pre-trained commercial black-box LLMs through APIs, which is (sadly) the way LLMs are used in applications in vast majority of times. These could perhaps be fine tuned through the APIs too, but it tends to be rather fiddly and limited and very expensive to do for large synthetic datasets like would be used here.

P.S. I found it quite difficult to figure out from the article how the "semantic entropy" (actually multiple different entropies) is concretely computed. If somebody is interested in this, it's a lot easier to figure out from the code: https://github.com/jlko/semantic_uncertainty/blob/master/sem...
They all can be colored in 4 colors - if you don't care about giving the enclave the same color as the parent country.

If you insist giving those little islands the same color as the country they belong to, then things get difficult. That's not always doable in 4 colors.

see: https://upload.wikimedia.org/wikipedia/commons/thumb/b/b5/4C...
The calculations you do to make sure that the bridge doesn’t collapse also require that the steel matched whatever properties your formula assumes. That doesn’t make the calculations useless.
You are correct, it's either point-to-point, like direct cross-connects with the exchange or it's a relatively small intranet.
Additionally, an overwhelming majority of packets flying around are market data. You don't want to re-transmit lost ones because by the time you do, the data is already outdated.
Do you generally expect anyone to be able to create a drawing/painting of anything in their visual field? Just because I'm staring at the grand canyon doesn't mean I can put it to paper. That takes extensive practice and skill.
I think we are re-inventing the wheel of using biochemical process to grow protein. Current meats have millions of years of evolution. Sure the types eaten most are not bred out of efficiency. Why don't we choose other starting points, possibly insect, e.g. grasshopper or maggot and grow them in the lab?
Surfing the (Human-Made) Internet
> All licenses are perpetual (non-expiring) for the current major version, and include free minor updates.

Major version are: LINQPad 2, 4, 5, 7 and 8. The official page seems to disagree. There is nothing about LTS.

Sure, I can skip 7 and wait for 8, but that kind of defeats the purpose.
Cosmopolitan v3.5
A long term storage that can also be used as a trap wire to catch pathogens.

[1]: https://en.wikipedia.org/wiki/Neutrophil_extracellular_traps
Firmwares shouldn't need that many updates in the first place. Frequency of updates should be taken as inverse of its code quality.

Sadly there are too many low quality firmwares and even more below and below the floor, but that should be the theory.
When reading the title, the first thing that struck me too was division by zero.

I doubt this is a common misunderstanding among any but the most junior of devs.
Source code to an implementation of TECO I wrote back in 1991 in Turbo Pascal. I've had a few hard disk crashes in the last 40 years, I might have older stuff on 5 1/4" floppy disks.
Ikea also doesn't use Philips screws. They have pozidriv screws and need pozidriv bits if you dont want to strip the screw heads. I learned the hard way.
You should read that entire wikipedia article because the EMH is useful but clearly extremely false.
There’s nothing wrong with “i’ll get back to you”, provided you do quickly and comprehensively.
China has spent at least $230B to develop its EV industry
We should have a TLA+^2 then.
Oh the complexity has to be expressed anyway? Uh
Oh and users mostly rather suffer from bugs than give up complex desires and features? Uh
We’re doomed haha
US prosecutors recommend Justice Department criminally charge Boeing
In the end, if you want the map to represent the landscape 100% you end up with another landscape.

Granted. But engineering is about making sure we don't make mistakes and just like in math class a good way to assure that is to take two different paths and arrive at the same place.
In 2021 I decided to move from San Francisco to Venice, Italy - where obviously there are no cars.

People walk a lot more. The level of noise in this city is by far the weakest compared even to a small village town, because of lack of cars.

I love it here. It's only anecdotal, but I am sure that this positively affect many things in my life, including my stress levels and the quality of my sleep.
Tinyvvm – a simple window manager written in vlang
Software gets used for mission critical things all the time, with the same level of assuredness. What you are complaining about is that people making apps to show you the right advertisement or a website to watch pictures of cats sometimes is buggy and gets deployed without proper tests.

Meanwhile almost every medical device under the sun today has software, nuclear powerplants run on software, space missions use software, airplanes drive themselves and land through software, etc.
Ask HN: What is the best LLM API with raw probabilities and backtracking?
I'd like to get the raw LLM outputs and choose the next token myself. Being able to go back and discard the last few tokens without losing prefix optimization (with appropriate billing) would also be very useful.

The APIs I looked at are all way too high-level. I can go open-source and run things on my own hardware, but that would rule out all the best models.
Better is! Look what i was replying to.
For that you would need a proper, well-grounded type system and a language that doesn’t stray from it.

Some fp languages are close enough to fit that bill; Rust too is going down this path: its type system was built to make a proof, after all.
> I don't expect to see code evaluation on untrusted input as intended features in web browser

I'm not sure whether to laugh or cry at that. Suffice to say that ship has sailed all the way around the world several times, to the great detriment of everyone who isn't a advertising or other malware-development corporation.
> cards would be awkward in the latter case

Do you mean it would be hard for staff to scan cards? Here in the Netherlands both qr and cards (travel cards + bank cards) can be used at stations, and are read by the staff on the train.
One side effect would probably be, that anti-science rulers would turn this into a weapon against unliked scientific results. Think vaccines. The Damocles sword of endless litigation would hang over every scientific research concerning public policy.

Maybe it's overall better to let science sort out science things.
You ignore the robots.txt file, you will be fed garbage....All is fair in War and Love...
Why lab-grown meat will never happen
https://en.wikipedia.org/wiki/Anki_(software)

https://en.wikipedia.org/wiki/Spaced_repetition
>there may not have been any predecessors in the circular-spaghetti game

Except in Sicily, where this type of pasta is traditionally called anelli.
Economics itself is a product of thermodynamics.
This tool is for software engineers, not database engineers. .NET is a Microsoft tool, and one that was tied to Windows for a long time, so most tooling is Windows-only too.

What makes Linux uniquely appropriate for database engineering? Why not *BSD? What OS do you think engineers working with Microsoft SQL Server use?
Ask HN: Forums.autodesk.com reload loop, can't "Report a Website Issue" anyone?
https://forums.autodesk.com must be logged-in.

Happening on Brave and Firefox latest stable.

Such quality!
Astronomy can have even wider absolute error margins for dates. Especially for dates that are in the future.
> and 4 isn't borne out in my experience

To bolster your point, aren't there whole countries where stores and street sales float on top of QR codes?
Isn't this what i was saying from the beginning?

Box plots are made for visualizing generalized normal distributions and nothing else.

And now people in this thread argue you can calculate them from something else. Not sure if you are replying to the right post.
Lua is a great language, I happen to be a lot productive with it, its simplicity reminds me that of C. You don’t fight the language, you actually implement things
Apple is dominated by ruthless managers and is an evil corporation. I'm not surprised.

Imagine if you happen to be a neighbor and a disaster happens in the fab. That's just nuts.
As someone that used it in languages like Clipper, or Emacs Lisp, and ADL rule in C++ templates, cool to make programming tricks of wonder, a pain to debug when something goes wrong several months later.
Apple, you have infinite money. Just pay this lady the $50,000,000 she wants so she can move to a nice clean place over in Atherton.

And pay your fines to the government and move your fabs to remote areas so this doesn’t happen again.

There, problem solved. I’ve saved everyone millions of dollars in litigation fees, time, and now our judiciary system can tackle other problems.
I assume the executables won't run on ARM platforms? So modern Macs are out, etc.
The halting problem is not an actual issue. It’s a darling of computer science classes, but is you need to prove that your program halts, it’s not that hard to write it in a language subset that is not turing-complete.
If earth were a smooth sphere, the water would be about 2500m deep.

You can't get that amount of water from lakes, rivers and puddles.

If you want to less of earth by water (than the oceans cover today), you need those parts to be covered in deeper water (on average) than the oceans are today.
Discussion (72 points, 4 hours ago, 29 comments) https://news.ycombinator.com/item?id=40772224
DARPA search for fields quantum computers could revolutionize: mixed results
I don't know if that's always the case. My understanding is that TLA+ is really designed to prove properties about algorithms. Knowing that complex algorithms are correct is very useful eventually if it doesn't provide a correct implementation in a real world language.

But TLA+ is a bit of an unusual proof language. I think most of them are like you describe: SPARK, Dafny, F*, CBMC, all the Rust ones, etc. I'm not sure about the interactive proof languages (Coq et al), they are too complicated for my normal sized brain.
Interesting discussions in the comments regarding reuse, waste, QR codes, etc.

Worth bearing in mind that in the UK train stations have mixed NFC, QR and magnetic readers. The ones which are the least reliable are the magnetic readers which operate on paper cards. The NFC readers are used for pre-paid ticket cards and credit/debit cards. The QR scanners for so called "E-Tickets".

I don't really ever see anyone have problems with the QR tickets (they're static and distributed as PDF or pkpass). Likewise with NFC. Only the paper magstripe cards commonly cause problems.

Meanwhile in the Shanghai metro they use chip coins. Small, reusable and NFC.

I think these paper NFC things are a unique combination of non-reusable, prone to damage, prone to jamming.

But they are cool.
Yeah but you need to port the SIMD before shipping anyways?

So if you're doing incremental stuff might as well stub out the calls with "not implemented", and start filling them in.
> Interesting, I remember having to adapt some idioms around caching and storing iterators in particular, but very quickly I felt like there wasn't that many hoops and they weren't that weird.

I generally didn't feel that way. I didn't need to change much of my use because O barely ran into the borrow checker. The time I did, was recursively accessing different parts of a pretty central struct but the borrow checker concidered the entire struct a borrowed object. Effectively I couldn't access multiple different fields of the struct if I have the larger struct already as a mutable borrow even though I only access one part of it. It was pretty trivial to confirm that the different functions in fact do not touch the same parts of the struct however the borrow checker simply could not do that. Maybe it's changed recently but I required an actual significant change to the code with several abstractions added when it really wasn't necessary.

I did actually agree with you regarding reviewing code to get rid of UB, I was just a little too verbose maybe. Regarding false positives and negatives with santizers and static analysis, I feel it's worth the pain for a language which I find more expressive for my use case, I'm not against usig rust, I'm against saying it's the universal solution to every problem needing to be solved when in my experience I haven't been able to reproduce that view. There are problems it solves well, I don't run into those often.

I'm also happy more data is coming out on productivity, I feel like it can only help light a fire under people on the standards committee who are indifferent to the issues of C++ to actually push to fix some of the issues which are currently solveable.

Ironically I see with your last point regarding golang that we are very different people ans thats fine. For me I would much rather lean back towards C if I can guarantee safety than the more abstract and high level rust. Honestly I am extremely intrigued by zig but until it's stable I'm not going near it.

We want different things from languages and that is fine.
i'd assume the QR code would contain a record of the transactions, but yea, i hadn't thought about multiple trips that overlap.
Disney employees sue company over canceled relocation to Lake Nona
Also our brains and our language are co-optimised to be compatible.

ChatGPT has to deal with the languages we already created, it doesn't get to co-adapt.
Discussion (74 points, 4 hours ago, 29 comments) https://news.ycombinator.com/item?id=40772224
If the goal is to make a window-based store, then why do you need AI at all? Just release the hat once payment goes through.

This reminds me of thousands of blockchain projects that used the technology to flip on light switch.
It's too doggone hot outside and I'm too busy with working (from home) to go traveling.

What, am I going to join a six hour Teams call from the airport? News painted by numbers, make your own determination
When Omega and Swatch did a collab and released a series of plastic watches it was the poor who stood in lines around the block to get them and immediately resell at an obscene profit. There is a benefit to the poor if the figure out how to play that game.
So is this Arm64EC Windows-only? Is it standardized?

If not, is this not just another target architecture? You cannot use it on arm64 architectures, and your app already supports x86.
AFAIR it was sent there after an auction during the online European Lisp Symposium 2021.
Gensyms and packages are not required to make lexical scope work. Macros in an unhygienic macro system use these internally so that their expansions don't have unexpected behaviors in the scope where they are planted. The problems avoided by gensyms or packages are affect both dynamic and lexical scopes. A dynamic variable can be wrongly captured by an internal macro variable, not only a lexical variable.

It may be there are solutions favored in Picolisp without using macros that would be done using macros in idiomatic Common Lisp, and so those solutions don't need gensyms and whatnot.
Show HN: Bodhi App – Run Open Source/Weights HuggingFace LLMs Locally
Hi HN,

I'm excited to share Bodhi App, a tool designed to simplify running open-source Large Language Models (LLMs) locally on your laptops. While we currently support M2 Macs, we plan to support other platforms as our community grows.

# Problem

To use LLMs, you typically need to purchase a subscription from providers like OpenAI or Anthropic, or use OpenAI API credits with compatible Chat UIs. These options can not only burden you financially, but also raise data security and privacy concerns.

Many laptops are capable of running powerful open-source LLMs, but for non-tech users, setting them up can be challenging.

# Solution: Bodhi App

Bodhi App allows you to run LLMs on your own hardware, ensuring data privacy and cost savings. Our goal is to bring the power of LLMs to everyone.

Built with non-tech users in mind, Bodhi App ships with a simple Chat UI, making it easy to start conversing with an LLM. It also exposes OpenAI-compatible APIs, enabling other apps to use LLM services without relying on external providers.

# Features

Bodhi App currently supports:

1. Running GGUF format open-source LLMs from the Huggingface repository.

2. An in-built Chat UI to quickly start conversations with an LLM.

3. A powerful and familiar CLI to download and configure models from the Huggingface ecosystem.

4. Exposing LLMs as OpenAI-compatible APIs for use by other apps.

--

# Feature Comparison: Bodhi App vs. Ollama

## Bodhi App

- Targeted at non-tech users.

- Includes a simple Chat UI to get started quickly.

- Integrates well with the Huggingface ecosystem:

- Use Huggingface repo/filename to run a model.

- Use tokenizer_config.json for chat templates.

- Currently only supports Mac M2.

## Ollama

- Requires some technical insight.

- No inbuilt Chat UI.

- Requires baking the model using a custom process:

- Modelfile

- Golang template to specify chat templates.

- Supports various OS platforms.

Bodhi App leverages the Huggingface ecosystem, avoiding the need to reinvent the wheel with Modelfile etc., and making it easier to get started quickly.

# Quickstart

Try Bodhi App today by following these simple steps:

```bash

brew tap BodhiSearch/apps

brew install --cask bodhi

bodhi run llama3:instruct

```

# Documentation and Tutorials

- Technical docs on GitHub (README.md, docs folder): https://github.com/BodhiSearch/BodhiApp

- YouTube playlist covering Bodhi App features in detail: https://www.youtube.com/playlist?list=PLavvg7KIktFI1ZaFc2nLe...

# Conclusion

We would love for HN to try out Bodhi App and provide feedback. You can reach us through:

- Raising an issue on GitHub: https://github.com/BodhiSearch/BodhiApp

- Connecting with the developer on Twitter: https://twitter.com/AmirNagri

- Leaving a comment on our YouTube tutorials: https://www.youtube.com/playlist?list=PLavvg7KIktFI1ZaFc2nLe...

Please show your support by starring the repo on Github.

Thank you for your time!

Best,
The Bodhi Team
> AlphaGo (or AlphaGo Zero) would be a better example.

Yes, they are better examples, but still not great examples: neither of them are LLMs.

In general, I have very high hopes for AI, but I would be surprised if LLMs are the one universal hammer for every nail. (We already have lots of other network architectures.)
> There are many things humans do that are very different from next token prediction, and those things we do all combine together to produce human level intelligence.

Exactly
LLMs didn't resolve knowledge representation problems. We still don't know how it's going in our brains, but at least we know, we may do internal symbolic knowledge representation and reasoning. LLMs don't. We need a kind of different math for ANNs, a new convolution but for text where layers extract features through the lexical analysis and ontology utilisation, and then train the network.
About Quantum Benchmarking program: https://www.darpa.mil/news-events/2024-06-20

Quantum Computing Applications Preprints: https://www.darpa.mil/work-with-us/publications-highlighting...
In China, QR Codes are used for public transport too, and I found them just as fast as NFC readers (and faster than the slow readers used by the NS in The Netherlands)
Claiming that someone attains Arhat (or Arahant, if you are used to Theravada texts) with just a couple of meditation retreats is just wild. Because the 9 dhyana, or 9 samadhi, or 9 Juana corresponded to the level of wisdom of an Arhat. It corresponds to enlightenment in Theravada, and in Mahayana too - just not the "biggest" one.

So it's actually very harmful to do these claims; each dhyana (or jhana) level corresponds to a certain level of wisdom, and you are supposed to have less and less afflictions as you move up. The problem with meditation training is that is very common (and easy) to get sidetracked for 10 years thinking you have attainment but you are stuck. The Chinese style is to find a good teacher, an enlightened teacher, a so called Good Knowing Advisor who can certify your attainment or put you on the right track. Because otherwise it's just wishful thinking.

Best or luck to the author, but like the GP said, have some humility and find a competent, certified teacher. Making false claims, even out of ignorance will prevent you from accessing the proper instructions in the future.
It works on AMD64 and ARM64 both.

It makes two architecture fat binary, but removes all code not needed. Resulting binary is typically only 30-50% larger than 1-architecture binary.
Americans discovering the real reason why things are made in China
UG Krishnamurti, is that you?
>It's kind of sad systems research pretty much stopped at this point.

No, it has not.[0]

0. https://trustworthy.systems/publications/
The inspiration is linked in the article - I saw emacsomancer's machine-typeset Y Combinator Codex and I thought, "oh, I'll show you the Y Combinator Codex". The rest is about two weeks of intermittent calligraphic work.
While I don't doubt the facts and EPA analysis around the case and the measurements, how many other local residents reported this and are fighting it?
Amazing work, not sure how I missed that!
> It's actually arrogant as hell to assume that we can achieve a higher level of energy efficiency than billions of years of evolution, particularly so early in the game.

You are right that LLMs are still far off from the performance of the human brain. Both in absolute terms, and also relative to the power used.

However, I don't see anything arrogant here. We have lots of machines that can do many tasks more energy efficient (and better) than humans. Both mechanical and intellectual tasks.
> That being said, I don't see the problem with declaring config bankruptcy

The downside is, that it costs time and attention.
An important part of doing calligraphy (or any other work where Ctrl+Z is not an option) is improvising of how to cover things up so that such mistakes become invisible.

I have actually made a huge mistake in the original, and then managed to cover it up. (Hint: the metallic paint I used is highly opaque.)
Europe was making luxury goods before the USA existed. You could just as well say that the US threw the towel in having a good taste or knowing what's beautiful and just saw it's more lucrative to monetise science and technology and resell it to the masses buried up to their necks in debt.
Yes, I just cannot share the flame graph publicly, but I can describe parts of it. A big chunk is taken up by the Mapbox GL SDK (Vector maps, 35%), Sentry (Telemetry and monitoring, 14%), and Vuetify (component framework, 10%). The rest are small dependencies and application code.
Direct link to those who want to see that response: https://www.jwz.org/blog/2024/06/mozillas-original-sin/
Why was the previous discussion flagged?
This seems unusually problematic. A Bhopal Gas Tragedy waiting to happen.
IME the loudest are bikes and metro (inside). There's an occasional mustang, but bikes are still louder.
Interesting opinion but no

AI is a science
ML is just one of the areas of this science
> It'd likely be in Taiwan.

For sampling new nodes and producing the bulk of their chips, sure. But anything that's not tied to ASML doesn't inherently need to take place in Taiwan. TSMC is in a hugely advantaged position with IP and scalability, but I think it's feasible that Apple could test new lithography techniques or large-scale dies in any sort of environment they choose. Nobody is necessarily implying that they're prototyping low-yield iPhone hardware there.