skysight-inc/HackerNews huggingface dataset:
Related? "Let's Think Dot by Dot: Hidden Computation in Transformer Language Models"
https://arxiv.org/abs/2404.15758

> Chain-of-thought responses from language models improve performance across most benchmarks. However, it remains unclear to what extent these performance gains can be attributed to human-like task decomposition or simply the greater computation that additional tokens allow. We show that transformers can use meaningless filler tokens (e.g., '......') in place of a chain of thought to solve two hard algorithmic tasks they could not solve when responding without intermediate tokens. However, we find empirically that learning to use filler tokens is difficult and requires specific, dense supervision to converge. We also provide a theoretical characterization of the class of problems where filler tokens are useful in terms of the quantifier depth of a first-order formula. For problems satisfying this characterization, chain-of-thought tokens need not provide information about the intermediate computational steps involved in multi-token computations. In summary, our results show that additional tokens can provide computational benefits independent of token choice. The fact that intermediate tokens can act as filler tokens raises concerns about large language models engaging in unauditable, hidden computations that are increasingly detached from the observed chain-of-thought tokens.

> In this work, we demonstrate that transformers trained on the next-token prediction objective can achieve improved performance on certain tasks when given filler tokens, achieving perfect accuracy whereas the no-filler, immediate-answer setting achieves only low accuracy.

--

I wonder if we could get benefits from adding special computation/register tokens to text LLMs?

More discussion:

- https://news.ycombinator.com/item?id=40182695

- https://www.reddit.com/r/LocalLLaMA/comments/1cf2w5a/transfo...
I live in a city where Walmart doesn't exist
>> The sample was immersed in preservatives and stained with heavy metals to make the cells easier to see.

Try experimenting with immersing your brain in preservatives and staining with heavy metals to see how would you be able to write the comment similar to the above.

No wonder that monkey methods continue to unveil monkey cognition.
CC-BY-SA is a copyright license. If LLMs are found to be fair use then there is no copyright infringement regardless of license.
>You've made effectively the same argument used against white students who went into the Deep South US in the 1960s to help the civil rights movement.

I'm sure I definitely haven't, but with enough mental gymnastics I see how one can draw such parallels.

>those benefits don't justify [X]

And where did I say it's justified?

All I did was point out the realities of what's happening, kind like a news reporter. I don't have a dog in this fight.
This misses the main benefit of RAII which is that you can't forget to close the file.
Right, usually it's "speculative theories that we can assemble evidence for by building upon prior work and known facts about the world", which the hydrothermal vent theory is. "Science" when talking about "how did life form" will always be "speculative theories" until we crack the time-travel nut.
Wetherspoons (pub chain in the UK, divisive in that it is a hive of villany while simultaneously being one of the few places you can get a well kept real ale) have individual carpets in each of their venues. This has, as you can imagine, become a hobby.

https://www.wetherspoonscarpets.co.uk
There are more details here on why the activists oppose the action [1].

> They cited the protection of water resources as their primary concern.

> Part of the Tesla site is located in a so-called ‘drinking water protection area.’

> The company's expansion plans for the car factory were rejected by the majority of the citizens of Grünheide. Almost two-thirds voted against the plans last week.

> The vote is not legally binding, but is considered an important milestone.

[1] https://www.thelocal.de/20240229/why-are-activists-building-...
Why not ask autistic people

Have you ever even seen someone with severe autism?
I use the <apps> key, usually I hit it with the base of my right hand.
not just usa, sadly
I develop games in 3D using Godot. It's quite good for the task. Especially 4.3 dev builds.
Father of SQL says yes to NoSQL
Seconding this; my HN feed got so much cleaner after I turned off the showdead option
This is the most wholesome thing I've ever read here on HN.
many people receive help and advice but way too few come back to express gratitude.

Cheers to you dude.
it's a standard stock footage trope
Yeah, that's all fair.

I recently tried playing the Spider-Man 3 game on the PS2, and while I thought the web slinging was better than Ultimate Spider-Man, it still wasn't as tight as Spider-Man 2. I'm not actually 100% sure why it's worse, it's the same company that made it (Treyarch), so presumably they'd have access to the same game engines and could effectively just redo Spider-Man 2 but refine the missions to make them more streamlined and less tedious. They did actually somewhat fix the latter part there, the missions are a lot less boring, but the web slinging just isn't as fun.

I wish someone would make a mod/romhack of Spider-Man 2 with unique missions that are actually fun.
Obligatory HN comment that Kagi already does this [1].

[1] https://help.kagi.com/kagi/ai/quick-answer.html
> Why they oppose

It doesn't actually matter, these groups pop up wherever someone stacks more than two bricks on top of each other, and they always have their valid concerns (endangered hamsters, someone heard someone else might've seen a rare street pigeon brood somewhere nearby possibly, that one extra building will completely ruin the landscape etc. etc.)
Also the patents in question are probably software patents which, in theory, are not granted in Europe.
Virtue signalling is a thing.
Why would one question the Holocaust?
That’s obviously coincidental. Many countries (and even parts of the US) that have no minorities to oppress developed car-dependent suburbs around the same time.
This is a good point. If a reporter chooses to only mention in passing that the protest is about polluting drinking water then that means that drinking water pollution must not be a big deal
>> what else were those people going to do?

My grandparents owned farms, my parents and stepparents all grew up on them. What they did was work.
Wouldn't you lose tab hibernation? Also with dozens of tabs does this not pollute the WM?
california is temperate but they put the solar farms in the desert
That’s deep red! Quite a different sight!
As long as they don't deny the fact that those industries funded their education, I don't think there's anything ironic about this. If your parents had slaves that grew and cooked your food, made clothes for you and taught you an education, would it mean you can never speak out against slavery?

I'm not supporting or opposing their point of view and actions here, but I do believe it is perfectly reasonable to take a stand against something you consider immoral or unfair.

My own decent lifestyle (and yours) can be traced to the technological progress that led to the current unfortunate climate and ecological trajectory - that doesn't mean I can't say "this isn't right, there are things we can do better". I won't, because ultimately I'm selfish and I really don't care, but if I did care, it wouldn't be wrong of me to stand up and be vocal about it.
I just dropped a pin in a random suburb outside Philadelphia, searched for churches, then tried to find the spot in the suburb that was the absolute furthest from a church. 0.8 miles, a 17 minute walk. Tried in again in a NY suburb and got 1.1 miles, a 22 minute walk. Tried in a suburb of LA, 0.6 miles, a 14 minute walk (and one that far was hard to find!). I'm deliberately avoiding the South where I expect this to be even more true.

Obviously this becomes harder if you need a particular denomination, but a lot of people just attend whatever's closest, and that's all my statement claimed—that there is a church within walking distance of basically everyone.

You're welcome to try this elsewhere and see if you get different results.
If you knew anything about how "diagnosis from specialist" works in practice you wouldn't dismiss self dismiss diagnosis so easily. "The specialist" usually spend a few hours at most on the diagnosis (if even that) while people who self diagnose live with the symptoms their whole life.

It would be such an easy world of you could go to a doctor and get answers but it's not the world we live in unless it's common cold (and even then a lot of doctors can't be bothered and prescribe antibiotics just in case).
This has got to be one of the biggest marketing pushes for an “indie” game I’ve every seen. Having not heard of the game prior to yesterday and now seeing it on a twitch stream I subscribe to, YouTube channels I subscribe to, and now HN is way too coordinated to be organic. Seeing Dan Adelman attached to marketing further confirms that (not a knock, but that’s kind of like attaching Wes Anderson to an “indie” movie).

The game looks awesome, is getting a lot of positive reviews from people I generally agree with, but it’s starting to feel like a lot of astroturf, which turns me off.
Now virtual and flexible hours, job guaranteed (fix pharma)
As a Brit, I've never noticed NASA spelt Nasa before, and I'm on the fence about Unesco, not because I recall seeing it title-caps, but because it doesn't look offensive to me.

That said, when I googled for the title-caps variants of both words, I saw the Guardian, Independent and Times all used it for Nasa, but only the Guardian and Times seem to use it for Unesco. There was also a page from the NYT that used Unesco, so a counter example from the US, but even the UK government pages refer to it in all caps, as do most other UK articles.

I certainly find it a weird generalisation that "UK English" (sic) prefers title-caps, as we tend to like our abbreviated names and pretty much always use all-caps when every letter comes from a separate word, and only title-caps when we use runs of letters from each different word - quango (quasi-NGO), Bakerloo (Baker St-Waterloo), Beeb (compared with BBC), Lib Dems, etc. We also have a few things that aren't consistent for government things - Defra (always used to be DEFRA, but they seem to have rebranded), MOD (always caps), Ofqual (=Office of Qualifications, always title case), Ofcom (=Office of Communications, now seems to officially be title case, but always used to be OFCOM), UCAS (University and Colleges Admission Scheme, always all-caps), etc.

Maybe the stylistic choice is based on how pronounceable it is as a word, but whatever I don't think there are any hard and fast rules!
IIRC it's not really masking, more that children of color are more likely to get labeled "disruptive" or "defiant" than diagnosed as autistic, at least compared to their white peers. Two kids could exhibit the same behavior, but one is correctly recognized as having a meltdown and the other is written off as a troublemaker.
I can relate to this. Could you point me to any resources about keto diets?
Yeah you're going to need to source such a bold claim.
Oh, I fixed the link. It was easy enough to figure out. It never bodes well when an author fails to proof their summary line, though.
German environmentalism is NIMBY with extra steps.
Why do you think Germany would be a better place with more Nazi talking points?
But nobody is using iPads as a sole production tool. It's part of the production tooling but it's not exactly an essential part or a part that can't get rid of or replace easily, unlike a "real" computer.

It's rather disingenuous to pretend that an iPad can be sufficient. At its price tag it is still a rather extremely expensive accessory and people pretending otherwise are just full of it. There are enough reviews/testimonies saying as much (even from the diehard fans) for it to be an obvious fact.
see section B of https://eprints.soton.ac.uk/267873/1/tcas1_cordic_review.pdf. Generalized cordic can compute hyperbolic trig functions which gives you exponentials. That said, it's still not useful for ML because it's pretty hard to beat polynomials and tables.
This is just ridiculous, just like some deaf people wanting their kids to be deaf to be part of the deaf community.

We were born with ears for a reason, same thing, our brains are to a huge percentage built for social skills for a reason.

We can call them however we want but all these are basically diseases of various forms.

People can choose their hair color, to grow their nails long, their clothes or the myriad other things that allow us to express our uniqueness, without making life stupidly difficult for no reason when it's already super hard.
The cheap monkey headset works in a similar way: monkeys just essentially continue to analyze trajectories of medieval cannon balls in the LHC and to count potatoes in the form of bytes.
Keygen: Open-Source Software Licensing
yea example now there are guys in this comment section claiming keto has cured their adhd/autism. Helped reduce symptoms, sure, but cure? (I've got both of them been on keto, like crazy strict ensuring i was in ketosis every two days type, and it only reduced brain fog personally)
I live in a pretty rural place, and around here they sell wild mushrooms in supermarkets. Sometimes the mighty porcini (boletus sp.) is available -- but there are frequently chanterelles and morels available, and sometimes other types. Kids and even toddlers eat them all the time, though admittedly they're usually well cooked, or dried and then cooked, or even cooked and then pureed.

I don't recommend doing it with kids (or at least eating them with kids) but mushroom foraging is a lot of fun.
If your needs are basic I just use tar. It's built into macOS and Windows 10. It even supports rar!
I've experienced it and it's markedly different how a laptop feels when plugged into the wall Vs not: it's because of a relatively high voltage (but also high impedance, so not dangerous, though sometimes painful if it focuses through a small point like a USB cable) hum you tend to see in the ground of most modern power adaptors due to noise reduction capacitors.
Gluten-free only makes a difference for those with an intolerance. Source: I am HF-ASD, my wife is gluten intolerant so my gluten intake is sporadic but bingey, gluten does nothing at all to me.

The only food that is objectively bad for every single human is processed food. Gluten tends to be processed, so people who needlessly go gluten-free may be incorrectly attributing improvements to that.

Also: if you're not actually intolerant, there is a high chance you're eating gluten without knowing it. Treat yourself to fast food fries? How sure are you that gluten (crumbed chicken) wasn't fried in the oil?
Some 787 Production Test Records Were Falsified, Boeing Says
> Try… immersing your brain in preservatives and staining with heavy metals

I think we all do every day
In case it's not clear - I'm willing to pay extra for this.
> … c-u c-x 1 would be consistent.

It seems like a Vim or a Kakoune thing to get stuck up attaching strict logic to the “command language”. Lisps have a concept of do-what-I-mean (DWIM)—the computer anticipates what the user intends to do, overlooking trivial errors.† There’s some subjectivity involved in making commands do-what-[you]-mean, but what’s the point of ‘C-x 1’-ing after we’ve just ‘C-x 1’-ed anyway? None. So why not make that into a convenient way to undo the previous ‘C-x 1’?

The ‘undo’ command only acts on changes in buffers, and there’s always winner-mode and its undo, but as a zygospore user—it seems very natural from the get go. I repeat the ‘C-x 1’ if I press it accidentally, and more often I find myself temporarily magnifying a buffer to take up the whole screen to do some focussed editing, which I can come out of with another ‘C-x 1’ (as long as I don’t change the window configuration further).

†: from https://en.wikipedia.org/wiki/DWIM
Science also requires a plausible mechanism and an understanding of statistics. "It must have randomly happened even though the chance was less than 1 in ten to the five hundred and twelfth" is about as far as these speculative theories have gotten so far.
Which app have you been using for the aurora warning?
SQUEEZED: Behind the scenes of the juice industry [pdf]
This study describes how orange juice gets onto the shelves of local supermarkets and discount stores – from the cultivation of the fruit to the marketing of the juice. Research findings from Brazil and Europe highlights issues that food retailers would prefer to keep hidden: Dependency and exploitation. The focus is on the juice producers Cutrale, Citrosuco and Louis Dreyfus company (LDC), and the main bottling companies in Europe.
Global crypto firms turn to Hong Kong for refuge – and opportunity
That's not a serious question. It's a sloppy and unfair assertion that is something you would only say if you'd already made up your mind. The wealthy are not a monolith - they are people. Judging one for the actions of another is fundamentally unjust. And equating layoffs to denial of medical care is a pretty big reach - there are a lot of mechanisms disconnecting the two. And even ignoring all of that, none of that adds up to a situation in which destroying people is either just or going to make things better.

Rage without justice or reason is a solid indication you're being exploited. Not generally for your benefit, either. The people who want you to help them destroy the wealthy don't intend to make you president when they're done.
The narrative of "Ignore this, it's a Deepfake" is very strong, and it's now clear that we as a society are being conditioned to react accordingly.

What happens if the 1TB "Insurance" folder on Anthony Weiner's laptop, the one that allegedly made seasoned NYPD officers vomit when they viewed the contents, is inevitably released? Would we all be told "Ignore this, it's a Deepfake"?
I dunno anyone who screams “Caw! CAW!”, raids garbage and poops in the street all day would probably be put in a mental institution. (Or just move to San Francisco.)
What tools or techniques do you think the developers used to build this ?
Kubernetes, which I would evict if it stopped paying rent.
What is so excellent about this game?
>The electrical signals in brain are chemical reactions, not conductivity like a metal wire.

Nerve signals are both chemical reactions and electrical impulses like metal wire. Electrical impulses are sent along the fat layer by ions Potassium , Calcium, Sodium etc.

Twitch responses are actually done in spinal cord. The signals are short circuited all along the spine and return back to muscle without touching the brain ever.
I am not jumping into any side of the argument here, but it is worth noting that the area of "my back yard" is much smaller, and more densely packed in European countries, as compared to the seemingly endless land of the USA.
Try using the protocols and doses from the original article.
Once you can feel it (say 50V) then you can have data problems with anything else plugged in.

So often worth fixing even if you don't worry about getting a shock.
There’s so much brain development that happens in the first few years after birth that there’s absolutely no way you can say that with confidence.
Where to buy premium white chalk in the U.S., like they have at RIMS?
It means the reporter thinks the claim of drinking water pollution isn’t a big deal.

Reporters, like software engineers, have a broad range of competency. It’s hard to draw firm conclusions from their editorial choices.
Le sigh.... dude mounted a bunch of underpowered CH32V203 microcontrollers on a bunch of simple boards and connected them by GPIOs. It is not a cluster in any traditional sense, and it is not 14.7 GHz.

Whoever wrote the wccftech article has both never heard of Amdahl's law AND was too busy making clickbait titles to view the original video...
I use the same keyboard and opted for the silent switches, which are red.

Works very well for me, except I use the button row right under the letters instead of the thumb keys.

The thumb keys force me to "open" my hand and that over time caused wrist pain, I was forced to stop.
funny enough going inward doesn't cause any pain to the wrist, even if considered way worse ergonomically speaking.
Mach3db: The Fastest Database as a Service
Hi,

I've just launched mach3db, the world's fastest database as a service (DBaaS).

It's Postgres compatible and it comes with these extensions installed:
https://www.timescale.com/blog/top-8-postgresql-extensions/

Every user gets their own Postgres compatible database hosted on the mach3db.com server.

We back up every database to Amazon S3 every day.
We retain the fourteen most recent backups as long as your subscription is current.

Currently, our server only has a 1 gigabit Internet connection.
However, we can easily upgrade to 10 gigabit if we see enough demand for the product.

We are flexible and we can make custom arrangements such as:
- more backups per day
- more backups retained
- dedicated servers
- technology licensing
- any reasonable request

Please email james@mach3db.com if you'd like access to a demo account to try it out for free.

Thanks!
I was at ICLR and this was one of the best of this year, it was also evident during the poster session. Congrats to the authors!!
They did not revert to coal: https://www.cleanenergywire.org/news/germanys-coal-power-pro...
What kind of Marxist keeps their ideas in line by collecting rent from some of them but not others?
Interesting. One other potential benefit is an easier quantization of the activations.
No, this is a different thing. It's leakage current from ungrounded power supplies (the two-prong apple power brick) and it's extremely noticeable. Couple hundred microamps, feels like licking a 9 volt battery.
They are protesting because:

1. Construction will require clearcutting forest.

2. The factory will use large amounts of water and is being built in a region where water is scarce.

3. The factory will use solvents and paints which can cause groundwater pollution.

4. The local population is opposed to construction on environmental grounds, yet it seems construction will proceed anyway.

Of course, there are also people who are opposed to Tesla or the car industry in general, for both good and foolish reasons. I'd wager Musk being an outspoken anti-Semite and Nazi sympathizer doesn't go over well in Germany.

It's shitty reporting, plain and simple. Even Wired got it right.
Debian maintainers are experts at touching things they shouldn't and creating a mess in the process. The worst case, by far, was when they broke the RNG of SSH key generation:

https://jblevins.org/log/ssh-vulnkey#:~:text=In%20May%202008....

Those guys are out of control and constantly having conflicts with upstream, I'm astounded to see the amount of support I see for debian in this thread.
Indeed. Porting it to an architecture that wasn't 36 bits wide would be a major undertaking. From my minimal reading of the source, PL/1 (or, perhaps, the dialect of it which was used on Multics?) lacks a real equivalent to C's typedef, and as a result you have explicitly sized types like "fixed bin(35)" and "bit(18)" and the like all over the place in the source.
Why writing by hand beats typing for thinking and learning
My undergrad math professor created one of the first fully online linear algebra texts: http://linear.ups.edu/html/fcla.html It's integrated with Sage, a Python library for studying (among other things) number theory. Another prof at the same university also wrote his own linear book, using a lot more illustrations, but as a traditional textbook.

I see this book as a solid evolution in both directions. Nicely done!
>1. They dislike Tesla in general because it's controlled by an anti-Semite and Nazi sympathizer.

This sort of casual slander reveals more about your viewpoint than it does about the protestors, or Elon.
I buy the cheapest. Have for years. no issues ever