skysight-inc/HackerNews huggingface dataset:
I personally think it’s safer to enforce data constraints in application code, because “bad” data won’t break it. Putting the constraints in the database means your application is coupled to whatever database you use. Worse, because databases only offer a small set of constraints, it’s often the case that constraints are split between the database and application code. You have “validations” in both the application code and database definitions, and data must be checked/transformed anyway whenever it is marshaled to and from the database. Constraints in the database are effectively implicit, living in a set of migrations or often not part of any source control.

EAV indexing is much easier, because EAV is naturally represented as a tree. The whole database is the index. You only have four universal indexes that cover every query: EAV, AEV, AVE, and VAE. The mutual likes example above is covered by these indexes. And you never had to worry about it!

See Datomic for real world example of an EAV architecture.
Jeebus, I guess it contributes to traffic mortality many times more than (most of) Europe or Australia.
It is an interesting time in internet history that we'll be looking back on. Twitter is eroding itself. Reddit closes itself off. Fb lost focus.

It's a ripe time for something new, or somethings new, to emerge, where people can go to discuss 'things'. But I'm not sure if it's going to take the forum like form we're expecting.
I went to this museum as a child. It was a great museum, it had a lot more than just the ship. I never knew this man's full story. It's very sad.
Existing code like the code in the sha2 crate??
Which app is best for this single player variety of chess? Focusing on bite sized puzzles etc.
Characters on fantasical drugs having superhuman abilities?
You'll get no argument from me that Reddit could achieve more by doing less content moderation.
The Fed says don’t worry about U.S. banks, but why should anyone believe them?
Jeb’s wife made me promise to get him home. No Kerbals left behind.
Why would horns need to be different for India?
I've recently started playing chess again a bit (after doing it a bit when I was a teen), and there's an interesting aspect of online chess that I began to realize:
When I was young you needed a local opponent to play chess, and that wasn't always easy. Why? Because most people around you were either significantly better (you always loose) or worse (you always win). It's not an interesting game if the outcome is almost always the same.

It's obviously a complete gamechanger when you have a plattform like chess.com which automatically figures out how good you are and matches you with a roughly equally skilled opponent.
Not very important in the context of Windows ARM laptops/workstations.

Interestingly, none use microarchitectures from ARM themselves, but are instead the work of ISA licensees.
> Emergence is something that is intuitively noticed by human observers.

If you can't quantify that, then it is just a hunch. What exactly do you think "observers already know"?
there's no such thing as a "woke" spam filter... i mean, it'd hafta be inclusive or whatever to make sure none of the email feels marginalized or sad... so to be "PC" it's gotta let everything through... which means it isn't filtering spam...
If you have texlive-extra installed, this mobile-friendly PDF can be converted to a desktop-readable format using:

pdfxup -o lbdla4.pdf -ow -im 10 -m 40 -is 0 -fw 0 --portrait -nup 2x2 lbdl.pdf
I believe their post said enough already.

The hardware is simply not competitive at the price, even if you ignore the hassles of hardware support.
I am a high schooler in the US who's played chess for around 4 years now. Chess has been popular at my school since COVID (perhaps 1/20 people played it), but around February of this year it suddenly exploded in popularity to maybe 1/5 people. I have no idea why.
Sure, for any sort of mineral or metal there's a hard limit to how much there is in the Earth's crust, and while the oil was created by a natural process, that process doesn't take place on a time frame that's useful to humans (and might not take place at all now that bacteria has evolved).

We don't sit around fretting about the limited supply of palladium or something, because there's never been as much of it that was easy to extract as we wanted. We do worry about lithium, because right now it's economic to extract it in very large quantities and we know that won't last forever. But my point is that we won't transition from the current abundance to "every last atom of mineable lithium has been extracted and if you want more you have to dig up a landfill and pull it out of discarded CR2032 batteries" overnight. When we've dug up all the lithium available at the current price, there will still be plenty more at a slightly higher price, and when that's used up, there will be more at a price slightly higher still, and so on. Yeah, there's a limit, but long before we hit the limit, the gradual price increases will have push society to find a way to go on without copious amounts of newly mined lithium.
HN doesn't have unique content, it has discussions about unique content. I don't think it will achieve internet immortality in the same way.
What do you mean "not particularly expensive", GPT-3 I think costs like $4M to train. And that is just the pre-training part.
Most of the “bad” microplastic pollution comes from clothes and disposable bags and utensils. Bags are clearly on their way out, being replaced by cardboard bags.

Clothes are trickier. Polyester is extremely versatile and durable. But newer formulations of nylon (which is biodegradable) or PTFE (aka "teflon") treated fabrics are comparable.
These things definitely go in cycles, in the 90s, in the UK "Twoccing" was a big deal, particularly in and around Newcastle. (The stem 'twoc' is derived from Taken Without Owners Consent)

It was almost entirely kids aged 8-18 stealing and racing cars until they ran out of gas, or crashed. Police had very little recourse given that the perpetrators were minors

https://wordhistories.net/2021/04/21/twoc/
https://github.com/koreader/koreader

koreader has a pdf reflow mode
Nice work! It takes decent dedication and effort to maintain an underappreciated low-level mathematics library.

Unfortunately, Google seemed to have developed its own multi-dimensional array library as well, featuring virtual views, handling of large arrays that cannot fit into main memory, compression and more:
https://github.com/google/tensorstore
https://ai.googleblog.com/2022/09/tensorstore-for-high-perfo...

What are `librapid`'s strengths and unique features compared to Google's `Tensor Store`? Being lightweight might be one.
At least they pronounce Kia correctly, although I wouldn't have named my car brand with the same letters as the abbreviation to "killed in action". Btw, their Kia brand means "rising from (ki) Asia (a)".
https://www.fischertechnik.de/en

https://en.wikipedia.org/wiki/Fischertechnik

We had those in primary school and I think it was electronically more advanced then Lego was at that time (they have added a CPU unit in 1980). We actually built a caterpillar based vehicle avoiding the obstacles using a photosensor in 8th grade, so this would be 1989/90. At that time Lego was just a toy (or maybe the Lego Technic wasnt available where I was living, I am just looking at wiki and it looks it was introduced in 1977 and they had a motor but no electronic counterparts yet) and I think Fishertechnik was mostly used in schools due to their electronic parts (at least in my country, I dont know for Germany).
Any good sources on the Philip Glass backstory?
The black sea is a sea.

Minnesota has no seas.

Minnesota has lakes, which are also landlocked, and rivers which lead to the sea, but it abuts no sea.
> Most contain both

Most installed water filters are not reverse osmosis because it takes up too much room, wastes a bunch of water, needs to be remineralized, is more expensive than a non-RO 3 stage filter, and is not significantly more effective than a 3 stage that includes carbon.
https://www.webmd.com/diet/distilled-water-overview#091e9c5e...

Distilled water lacks even electrolytes like potassium and other minerals your body needs. So you may miss out on a bit of these micronutrients if you drink only the distilled stuff.

Some studies have found a link between drinking water low in calcium and magnesium and tiredness, muscle cramps, weakness, and heart disease. Also, distilled water may not help you stay hydrated as well as other kinds of water.
>The Amiga is the 16-bit successor to the Atari 800 that Jay wanted to create at Atari but was told, "No".

Later, that same Amiga team finished Ranger, the next generation chipset, and was told "No." at Commodore.

Amiga's history gets more depressing the more you know about it.
API for Webassembly. Common interface.
This is such a amazing little book. I love it, AI is hard for me to understand but this book makes it very easy to grasp some of the concepts.

Thanks for sharing
maybe a screenshot of lisa in a xerox ?
Sure Netflix played a part but a larger portion of the growth was probably from popular twitch streamers/YouTubers who picked up the hobby and brought their young communities with them to chess tournaments vs other similar streamers etc in recent years.

It's become like a social status among people to have a decent elo, a horrible marker for intelligence but a growing popular one.
If you haven’t heard of the Kia boys over here in the states, it’s definitely something. This vid is…a bit controversial but the Kia boys are definitely a thing in Milwaukee:

https://www.youtube.com/watch?v=fbTrLyqL_nw
Well I agree with you regarding not having just any ol' startup do whatever they like with technology, I'm just not convinced China is something I'd be so worried about. They don't seem like the kind of country who likes things being out of control. Russia is maybe a different story but do they really have the know how, money, resources and talent to be a risk anymore? I don't think so.
> My standing argument is that they wouldn't hallucinate incorrect responses if they understood anything, the hallucination is when their approximation of what a real response would be falls short.

This doesn't seem to make sense. If anything the opposite is true - if the things that are hallucinated make sense (even if not true) it means there is some "understanding" or a world model.
Would love to understand the downvote ?
Right! Other commenters here seem to have interpreted the article backwards. How I read it: caring and working hard can get you punished; taking the safe and easy path can get you rewarded. Sadly, that lines up with my experience.

Although I still love the work (the real work) I hate The Game® more and more every year.
Food for thought: Under what license did you publish this comment?
I generally operate in life assuming the best intentions out of everyone unless proven otherwise. I don't try looking for an ulterior motive
The question is: Do I care? Particularly if I'm not super-competitive.

I play chess irregularly on a not very sophisticated level (ELO ~400). I get automatically assigned opponents. Sure, it's possible that some of them cheat. It's probably not super attractive, because I'm not sure what the fun is in "I beat random ELO 400 player on chess.com with a computer". So maybe one in a few dozend games I face a cheater.

If you get into much more competitive chess then people probably cheat more. But I guess for the vast majority of players it doesn't matter.
I'd argue that it's always been football for people who don't like football. What's really changed is that now it's also football for people who do like football! During online events Magnus was often seen watching football (and other sports) [1] on TV while simultaneously playing big money online events. His rest days during live events were often turned into sports days.

This has really always been the case, for instance you even had players like Simen Agdestein [2] who was a professional football player and a chess grandmaster - at the same time, but chess has been hounded by dumb and inappropriate stereotypes. You don't need to smart to play, you don't need some amazing memory, or whatever else. It's just a really awesome, enjoyable, and deeply satisfying and rewarding game.

[1] - https://youtu.be/6Xdeg-PZOMg?t=16024

[2] - https://en.wikipedia.org/wiki/Simen_Agdestein
it is. Some features only work on their edge runtime !
> Buying in a bad neighborhood and things just get worse.

I can tell you've never done property management, because the most profitable areas are bad neighborhoods. In the US, section 8 housing is effectively guaranteed income, at favorable rates. The tenants don't really have much say in the conditions of the apartment, and all that's needed is to pass the housing authority inspection (which only cares about safety, not quality), so costs are generally low.

Being a slumlord is extremely profitable.

> Tenant falling far behind for some reason then moving out.

For the vast majority of the US, you can evict a person for nearly any reason with 30 days notice, and can evict someone for non-payment with 5 days notice. Holidays can extend that by a few days here and there, but for the most part, you can avoid tenants being months behind in rent, especially if the market is saturated.

Some landlords like to let their tenants fall behind because as long as the tenants eventually pay the rent, they get the late fees, which can increase their rents by 20% or so. Preying on the poor is also very profitable.

> Overpaying or over capitalizing.

You can do the same with any investment. Unlike other investments, though, you can write off most of your expenses, and you can carryover loss for essentially forever. Even bad real estate investments can be beneficial. There's a reason real estate investment is heavily favored by the rich.

Landlords aren't guaranteed to get rich, but it's extremely difficult to actually lose money as a landlord, unless you're a really shitty investor. Nearly everything you spend money on can be used for tax deductions (sometimes for years or forever after the loss), so even losses tend to be beneficial, when you're diversified properly. The law is way too favorable to property investment.

> While looking for a buyer or tenant, squatters or looters move in.

I did property management for a long time and can tell you this simply isn't a real problem. Squatters rights take a long time, and the police will forcibly remove them.

No one loots an empty apartment.
Interesting, got a link to the product?
Eager to read it
That's q opens a can of worms around age discrimination. Best avoided.
So, the same as the Caspian (actually better because they connect to the ocean through rivers), only freshwater. By the same logic the Caspian Sea is a saltwater lake.
These are not artificial brains, not yet anyway. Perhaps not for a long while.

I hope that the rest of earth's currently living animals are granted rights before these digital creations.
I think you're right, and the reason is probably that more complex concepts are hierarchies relying on the lower-level concepts to be fully correct before the higher levels can function at all. This would create an inherent thresholding that could not be avoided by any choice of metric.

To be fair though, the paper's discussion says they are not claiming that models cannot display any emergent abilities, just that some may be mirages.
>No matter how little the chipset was doing, the CPU could only access RAM half the time.

Only applicable to CHIP RAM. CPU could access FAST RAM, the default allocation target, all the time.

It also was not as simple as odd/even, although there's sense to the simplification. 68000's design meant it could ultimately only access RAM every other cycle, thus it was sensible to aim for that as the default.

Higher 68000 models did not have that restriction.

And even the original chipset also wasn't limited to half the cycles. This was only true of the default video mode (4 color "hires", 640 pixels wide).

The blitter also had a flag (BITHOG) that allowed it to use full DMA, stealing cycles from the CPU.
Found an article: https://jalopnik.com/audi-is-designing-extra-loud-horns-for-...
We can do things to protect whistleblowers, but it's important to realize that whatever we do to encourage them could lead to more false claims. There's a balance. There should be a price for whistleblowing but maybe not as high as it is.
> The problem is, people make mistakes. All it takes is a crying child, a burned pot, a mistake in cooking (not thinking about it), and you've hit the wrong temp.

Then you turn off the cooking pot, and air the room. Burning teflon releases nasty stuff, but not much worse than burning oil. Unless you heat it up all the way until its thermal decomposition (your pan will be visibly glowing red at that temperature).

Also, it's time to switch from natural gas burners to electric stoves that can have automatic protection.
Clam Blitz
I'm going to lay it out flat with you: Family relations are shit. There are tons of toes that should not be stepped on, there are "we're family" reasonings that might as well be under-the-table dealings you need to keep track of, if inheritances are on the line then who knows who has a knife ready to stab you in the back.

Friends and neighbours by contrast are platonic, they are relatively simpler relationships. In fact, because they are so simple, there is much more value in trust and honesty because anyone who is dishonorable will instantly lose that relationship. Family relations aren't like that because most relationships can't be easily deleted.

As the saying goes, keep your friends close and your enemies closer. Your closest relationships are your family.
You think this is bad, never own a bicycle. My god the confusion.
I just wish all manufactures would name the product generation, and then incrementally increase numbers in the range based on quality and spec. Skylake-1 (basic) Skylike-1000 (really good) etc. Especially for chips, it seems the current naming specs across industry is needless complexity.
A natural spot to shout out Map Men on YouTube. [1]

[1] https://youtu.be/DeiATy-FfjI
Kids copy their parents, same as anywhere and anyone
I did build a podcast with it, check radio-hn.pages.dev
The BMW i3 when from 22kWh to 42kWh in a few years but that’s a bit the exception.
Thanks for the question, I completely missed that part. I'm using a homemade e-bike where the battery is just connected with a standard Anderson connector. A lot of off the shelf battery modules do have proprietary connectors, but a fair number have been documented.
The M365 scooter batteries for instance are 36V 9AH and they connect with a hobby XT series connector.
> why this was done?

Because they could.
>He probably could have attempted to only leak the domestic surveillance,

This was the whole point of giving the docs to the guardian and wapo. Wapo then decided to publish the non-domestic stuff that he asked them not to, entirely their decision and it would not have been published otherwise. Then wapo decided to lobby against Snowden's pardon because non-domestic stuff was published. By them. Just wow. Likewise the Nyt who Snowden did not trust and deliberately excluded, managed to get the archive from the guardian and then went nuts, also blaming snowden for what they themselves published that he asked them not to.

So yeah if you were following along at home it was really hard not to have the reputations of the wapo and nyt take a really massive hit. I genuinely didn't think there were so craven but they are and everything is worse for them being so. It makes me entertain conspiracy theories about how many cia agents are on staff there and in senior editorial positions. Everyone will call that a conspiracy theory and treat it with contempt today and I guess that's fair, no evidence, only stench. Then if & when it comes out in the future, those same people will claim everyone always knew...
No one will fall apart and burst into tears because of an adverb they read in the mountain of documentation we have to read to get the job done.

Navel-gazing of the highest order.
Russia no longer has sufficient conventional forces to defeat Ukraine. They just don't have the manpower. The only way they could do it is with nuclear weapons, and it still seems unlikely that Putin would escalate to that extent.
What's the difference between "hallucinating" and just getting something wrong?

Hallucinations are where you hear, see, smell, taste or feel things that appear to be real but only exist in your mind. Get medical help if you or someone else have hallucinations.

Why do we say LLMs hallucinate and why do people keep parroting the same thing "oh humans hallucinate", do we really hallucinate all the time? I can think of only one time a healthy adult hallucinates and it's not sitting around drinking a cup of tea.
Wasn't always in your pocket though
Indian drivers honk incessantly. It’s widely believed that driving there without honking frequently is unsafe, because concepts like lanes and signaling are… loosely followed, to put it mildly. Honking in North America or Europe either means an emergency or someone is pissed off. Honking in India means hello I am here.
> When using GPT-2 vs GPT-3 vs GPT-4, a human can easily tell that each is leaps and bounds "better" than its predecessor, with "deeper" understanding of the input and "more human-like" responses and reasoning. There is a strong impression that those models aren't just progressing along a scale, but changing qualitatively.

I agree with you about all of this.

> I simply doubt that any of the proposed metrics captures this intuitively observable quality. Furthermore, I claim that it is this quality that actually matters.

I think there are important qualitative observations about LLMs that create understanding and guide future research, but I think it's bad science/engineering to rely on some indescribable quality of "goodness" when it comes to developing new models.

Metrics may not be perfect, but they are all we have. You could train a model, send it to a bunch of human crowdworkers, and ask them to rate it on how good it is (Anthropic does this!), but the result of that is... another metric.

That said, yeah, I think we definitely could use better metrics. OpenAI agrees, which is why they're pushing their Evals project super hard. The paper we're commenting on agrees, which is why they're proposing alternatives to these step-function metrics.

> We don't need a language model in order to multiply two numbers. Any clearly defined and algorithmically solvable (and thus readily quantifiable) task is trivial for regular software.

A language model multiplying two numbers is the whole point of emergence.

Transformers were designed to translate between different natural languages and trained on completing sentences with some words masked out. As we scaled them bigger and bigger, we found that the same model architecture was suddenly capable of more than completing sentences: it was answering questions about high school geography (MMLU), writing computer programs, and - yes - doing basic arithmetic. New capabilities were emerging with scale.

This means that a "language model," at sufficient scale, is more than a language model. This is the closest thing we have right now to generalized AI, where one model can complete a variety of disparate tasks. The arithmetic thing is exciting and unexpected because of what it represents, and understanding it should be a priority, even if we have better non-ML ways of doing that particular task.
T-slot, and the better Japanese version the name of which escapes me but I found via HN so I hope someone will fill in.