skysight-inc/HackerNews huggingface dataset:
The 'world model' question seems "not even understood" by those in the field who provide these answers to it -- and use terms like "concepts" (see the linked paper on sentiment where the NN has apparently discovered a sentiment "concept").

Consider the world to contain causal properties which bring about regularities in text, eg., Alice likes chocolate so Alice says, "I like chocolate". Alice's liking, ie., her capacity for preference, desire, taste, asethetic juddgement etc is the cause of "like".

Now these causal properties brings about significant regularities in text, so "like" occurring early in the paragraph comes to be extremely predictive of other text tokens occurring (eg., b-e-s-t, etc.)

No one in this debate doubts, whatsoever, that NNs contain "subnetworks" which divide the problem up into detecting these token correlations. This is trivially observable in CNNs where it is trivial to demonstrate subnetworks "activating" on, say, an eye-shape.

The issue is that when a competent language user judges someone's sentiment, or the implied sentiment the speaker of some text would have -- they are not using a model of how some subset of terms (like, etc.) comes to be predictive of others.

They're using the fact that the know the relevant causal properties (liking, preference, desire, etc.) and how these cause certain linguistic phrases. It is for this reason a competent language user can trivially detect irony ("of course I like going to the dentist!" -- here since we know how unlikely it is to desire this, we know this phrase is unlikely to express such a preference, etc.).

To say NNs, or any ML system, is sensitive to these mere correlations is not to say that these correlations are not formed by tracking the symptoms of real causes (eg., desire). Rather it is to say they do not track desire.

This seems obvious, since the mechanism to train them is just sensitive to patterns in tokens. These patterns are not their causes, and are not models of their causes. They're only predictive of them under highly constrained circumstances.

Astrological signs are predictive of birth dates, but they arent models of being born -- nor of time, or anything else.

No one here doubts whether NNs are sensitive to patterns in text caused by causal properties -- the issue is that they arent models of these properties; they are models of (some of) their effects as encoded in text.
But if it produces the whole article verbatim, it should be relatively straightforward to match its output to the training set and give attribution, no?
How would it help a lot?

The issue with burning things is the pollution it can cause if not filtered properly before emissions released into the air. CO2 feeds plants to grow, which in turn provides more food and habitat for more life.

An incongruence in the West vs. the East's strategy is that we in the West have avoided nuclear - which generates zero CO2 - whereas the East's CO2 production (via building new coal power plants weekly) - has been skyrocketing:

https://ourworldindata.org/grapher/annual-co2-emissions-per-...

In this scenario with China doing the opposite to the rest of the world, there are exactly zero gains for CO2 reduction - far outweighed by the increase in CO2 production. And in this scenario as well the "polluter" or generator of the most CO2 is being rewarded for their behaviour by producing the cheapest energy possible, which allows their cost of production to be lower than the West, which allows their profits to be higher - for us to buy cheaper products to not only perpetuate but accelerate these current conditions.
Nothing racist about it. China has a global network of shadow secret police stations on universities, controlling and using Chinese studying abroad to spy. Its a documented fact. Would be racist to just deny Chinese students whole sales, but its just prudent to deny cases with obvious connections to Chinese military, intelligence, etc. Also for the protection of our expat Chinese students that are surveilled and can get in a lot of trouble back home if their behavior abroad is deemed subversive.
Tflop*
For things set in modern day America, I think it would be almost impossible to not be political. If you include minorities (especially LGBTQ minorities) then you can't write them realistically without politics coming into the picture. If you don't include minorities, then that is itself a political statement.

This is of course less the case for more fantastic settings.
https://github.com/knadh/listmonk

We use listmonk, extremely flexible and lightweight as well! I want to try to build a Hubspot integration to fetch contacts directly from Hubspot.
The profits from Bitcoin mining so far seems to have won out using this mechanism..
This comment isn't
That’s not right; there are many vectors that go unbuilt between unrelated tokens. Creating a ton of empty relationships would obviously generate an immense amount of useless data.

Your links are not about actually orthogonal vectors, so they’re not relevant. Also that’s not what superposition is defined as in your own links:

> In this paper, we use toy models — small ReLU networks trained on synthetic data with sparse input features — to investigate how and when models represent more features than they have dimensions. We call this phenomenon superposition
If you are using verified domain then this is 100% Inbox delivery.
I estimate to hit the 2028 in active passenger service timeframe they would have probably have needed at least thousands of flights by now demonstrating safety with a perfect track record.
I’ve got a sense that this is only true in the tech echo chamber. Is RSS really surging in a general way? Zero of the people I’m with right now even know what RSS is.
If you didn't, then your point is entirely invalid, isn't it.
The nyt isn't taking a stance against OpenAI. This is simply a negotiating tactic to get money for licensing
I would think of robots as tools.
And in that sense, over time humans tools have gotten more advanced and specialized.
Think about the various power tools & garden/yard tools a median DIY homeowner accumulates today vs 50 years ago.

So to me, robots make more sense in purpose driven forms than in some humanoid replica attempt. The humanoid walking form factor is far harder to accomplish, and in many senses possibly less useful.
Just being able to text and send location would be huge for emergency communications and letting people know you are ok. This will probably completely replace sat based communicators like Garmin inReach.
That door that fell off in the Alaskan Airlines flight the other day are plug-type doors. They're not actually doors with handles and passengers aren't able to open them.
He probably doesn't considering that the majority of americans don't rent. US home ownership rate is 66%.

Also you seem to have cause and effect backwards. When people like him buy new homes and put them on the market, rent goes down because there are now more landlords competing on price.
I miss the Zhou tong memes.
Not karmically neutral. They can not produce new reactions but consume older ones.

Once its bad reactions( because of which he had to take a life form with so little consciousness ) are over it can get a new form with more intelligence.

Soul never takes a form, it is distinct from matter. Dull matter takes the form. It only 'directs' matter. After old body is destroyed it gets a new body.
We used to use RTF for walls text in our game launcher (EULA, MOTD etc). We chose RTF because raw Win32 could render it without extra work and we wanted to minimize both launcher complexity and dependencies.

One thing we noticed was that RTF documents made in WordPad instead of Word were much, much smaller and since every byte added to our CDN bill we made a point of re-saving all our files in WordPad before publishing them. Sometimes simple is good.
But doesn’t that make the value in these human-y robots, simply impressing humans? I’m fine with theatrics and awe being the main purpose, but it’s really just the front end to get humans speaking to a hunk of metal without feeling weird. What difference does it make in utility if it was a screen with some 3D model talking back at you? That’s a lot easier to make feel “human”. And now you’ve freed up the design of the robot behind the scenes that actually does the task to be shaped in whatever format is useful.

Is the retail space going to get similar value from the robot once the initial “oh wow robot cool” factor wears off?
Because current AI leaders have read way too much science fiction, and it's constrained their thinking.

This is exactly why so many people expect ChatGPT to turn into The Terminator.
Are you surprised that it took you longer with a tool you don't know compared to a tool you do know? IMO, that should be expected.
If you copy every NYT article and publish them on your own site, writing "this is from the NYT" under it doesn't make it legal.
> You are bored of many artists being in a similar region on the political spectrum?

Yes, there should be a bit more diversity in the type of stories/heroes/villains we're being presented with. The fact that US culture has two poles of thought makes for many unexplored avenues. Stories like Sandman or the Metabarons would have a hard time in being explored in modern US paradigms, since everything would need to be deformed to fit into boxes. At least that's my interpretation.
> That is, chronic procrastinators receive a greater reward when they wait until the deadline.

Yeah, absolutely. I have severe ADHD and this is my experience. I usually can't do something until it's completely necessary, and doing it at the last second is the most exciting/rewarding.

In school I used to finish all my homework before I even went home, because forcing myself to do that was more exciting/rewarding than doing it any other way. But this same mechanism is responsible for a bunch of my procrastination, too :)

I also tend to hate my chores a lot, absolutely despise doing them, but I think that's on purpose to try to make the act of completing them more rewarding. Completing something I don't care about is meh, getting rid of something I absolutely hate is good.
So like gig workers essentially?

> I'm talking about legalized and legitimized unorganized untaxed day-labor, so people who can't hold down a regular job can at least easily earn irregular money whenever they find themselves able.

Doing what exactly? How would the labor discovery process work here? The only people I know who do this kind of "untaxed day labor" are semi-legal immigrants in front of home improvement stores.

> end result of making it a job you have to apply for in advance and show up for later. And once this is done, it will be no different from the normal sort of job that some people can't hold onto because they can't bring themselves to show up reliably.

Has it ever crossed your mind that reliability is a big component of gainful employment? In your example of this word salad arrangement (legalized and legitimized unorganized untaxed, whatever that means) what's stopping from a more reliable company to swoop in with their employees and starting taking this type of labor from "people who can't show up on time" ?
I think it's (increasingly) not as binary as either MPA or SPA. Although it has been for quite some time now.

A lot of web developers strive for some amount of templating and client-side interactivity on their websites. And when frameworks like React came up they solved interactivity issues but made it hard to integrate into existing server-side templating systems, which were mostly using different programming languages.

So because integrating the frameworks for client-side interactivity was hard, the frameworks also took on the job of templating the entire site and suddenly SPAs were popular. I think a big draw here was that the entire tooling became JavaScript.

But the drawbacks were apparent, I guess a big one was that search engines could not index these sites and of course performance, so the frameworks got SSR support. The site was still written in the framework, rendered to HTML on the server and then hydrated back to a SPA on the client.

Now, even more recently we got stuff like islands, where you still use the handy web framework but can choose which parts of your site should actually be interactive (i.e. hydrated) on the client. And I believe this is the capability that has just long been missing. Some sites require no JS on the client (could even be SSGs), others require a little interactivity, and some make most sense as full blown SPAs.

We're finally entering the era where the developer has that choice even though they use the same underlying framework.
Does anyone have an explanation for brain that doesn’t understand it’s time to sleep? I often lose around 2 hours of my nights because at 11pm I get sleepy but it doesn’t even occur to me that I need to sleep. The result is that I go to bed when I’m completely exhausted at +1am.
Presumably you get your monthly fee back if not.
For those interested, the competitive AoE2 scene is alive and well with one of its biggest tournaments, NAC5, going on now, an in-person LAN in Berlin.

https://liquipedia.net/ageofempires/Nili%27s_Apartment_Cup/5

https://www.twitch.tv/nili_aoe

https://www.youtube.com/channel/UCXeY7zz-1LsyZdnpFbffdqA
> societal impact of AI is weighed fairly

It's doubtful that the courts are going to accomplish anything so broad. And the media is unlikely to accomplish anything so nuanced.
Well, if all you want is entertainment then it doesn't matter. If you want factual information then getting it without any way to check its veracity makes for a huge amount of work if you actually want to use that information for something important. After you've verified the output it might be useful if it is correct.
Yep, that’s what I meant with the reverse lookup strategy.
There's probably an unavoidable element of trade-off in the design of a door which normally must not open, yet must do so in a wide variety of abnormal situations.

https://en.wikipedia.org/wiki/Plug_door#Spacecraft
This is an actual paragraph from a real news story, not some sort of backstory from an alt history sci fi RPG:

> United Launch Alliance (ULA)'s Vulcan Centaur rocket is now officially scheduled to launch the robotic Peregrine lunar lander from Florida's Cape Canaveral Space Force Station
> Especially that computers can decide what comes next, but only a human can choose what to do.

I don't understand this, all the programs I've ever written make decisions based on some factors.

Are you talking about free will? If so, what is free will?
> And so there will continue to be people who are unemployable because they're unreliable. We need both kinds of jobs; it shouldn't be impossible to have an economy where both exist...

I think I would rather these unreliable people be paid basic income to just live than to try and invent some convoluted employment scheme for them, that will ultimately 90% benefit the bureaucrats and 10% to those people and that will also inevitably balloon to 5x its intended original size.
There is a robots.txt. If this mechanism would not exist, I would argue that the publishers have a case regarding Google (they are trying). But it does exist and so they shouldn‘t.
Congratulations on releasing your product! It looks super interesting. Some questions from the top of my head:
- Where is the data stored geographically? (US, EU, or a specific country)
- Do you plan on having multiple options for the web version (cloud vs self-hosted)

I find that data sovereignty is very important to me (it might not be for everyone), which is why I ask about those points specifically ;)
Effortlessly Create PDFs and Screenshots
Unfortunately the text is too small for me to comfortably read, and the website is incompatible with Safari’s Reader Mode.
There are two C# services which do some background bits and pieces.

This logic could have been put within pocketbase as well, but the body of work they depend on was already .net.

Other than that it's just little JavaScript callbacks in the back and typescript in the front.

There isn't much missing that you truly need to bolt things on for, provided SQLite is appropriate for your usecase.
Several people in this thread appear to have misunderstood due to the way this article was written.
It turns out, 50 years later, that Eliza was on the right track.
DNS can switch to tcp for this reason
Weird how they don't even understand themselves.
Worth noting that even the complete abolishment of copyright would not kill the arts entirely. There would still be many who make it to be heard, to bring joy to others or as a patreon type arrangement.
> These requirements are what humans are held to

If only. Tracking down the original source of quotes and/or stats is a bit of a hobby of mine, and it's extremely difficult to do. News sources will regularly cite "a recent study" with little additional information to help identify it. Pithy quotes attributed to famous authors never contain a reference to the work, it's always just the author's name, and if you go digging the quote is misattributed as often as not. Full-on plagiarism with no attribution is rampant, even in reputable places where you'd think they'd have it under control.

Like with self-driving cars, we expect AI to be better than the average human, which I think is the correct attitude, but we should acknowledge that that's what we're asking for.
So was Eliza from 1966 more intelligent than Dr SBAITSO from 1990?

https://en.wikipedia.org/wiki/Dr._Sbaitso
Nice. Have you built the landing page from scratch? Or is it a pre-made template?
Yes, but an LLM can’t distinguish out of the box what needs to be cited or not. So you need another processing layer (and probably a search engine layer on top of that) to do that.
Imagine a site like news.ycombinator.com. The browser uses that name to lookup the IP from a specialized server. So for the domain it might have this saved:

A IP = ...1

AAAA IP = ...2

Where 'a' is the type of record. But there are other types of records:

TXT gender = 'male'

So there's a few assumptions here about DNS that are normally true:

1. People are using DNS as a switch board to other services.

2. The values in the switchboard are normally static.

With this setup they're doing something completely different because they're serving back changing values based on the domain. To do this you would need to write a custom DNS server (though the DNS protocol is quite simple.) The reasons this is a clever hack though are as follows:

1. DNS is one of the most widely used and supported protocols. All mainstream programming libraries support it. This includes numerous command-line tools already in operating system. By providing this as a service over DNS it provides an elegant way for command-line tools and libraries to access services with minimal dependencies.

2. It challenges the way the DNS system should be used by tipping the normal assumptions behind its use on its head (direct usage for information, dynamic content for values.) This makes it possible to use DNS directly as an application service rather than as a switch board operator for regular internet services.

3. DNS is so integral that a complex integration wouldn't be needed to add it to existing software. A DNS request is arguably more straight-forwards than a typical web API. Chances are this also has benefits for censorship resistance, too.

All in all a clever hack.
"GPT-4 achieved a success rate of 41 percent, second only to actual humans" also feels like a (much bigger) lie of omission looking at the original paper. GPT4's performance was in the range of 6% to 41%, Eliza's 27% score sat in the upper middle of that range, and considering the bots tested consisted of 8 GPT4 prompts, 2 GPT3.5 prompts and a naive script from the 1960s, GPT4 would have had to be remarkably consistently inhuman not to finish "second only to humans" with its highest scoring prompt

The blog appears to have been updated to specify GPT3.5, but the original version was accurate.

The paper itself is interesting as it covers the limitations (it has big methodological issues), how the GPT prompts attempted to overridei default chatGPT tone and reasons why ELIZA performed surprisingly well (some thought it was so uncooperative, it must be human!)
https://arxiv.org/pdf/2310.20216.pdf
> Also, what is the point of giving this service your AWS creds rather than them using AWS directly? Since they charge you anyway?

Presumably so that if/when the service gets abused and Amazon decides to ban the offending account, it doesn't take down absolutely everyone on their service.
These are famously the types of questions surfaced in countless sci-fi books. And as long as humans don’t destroy themselves first, it is likely that we will have to address them eventually. In most stories it generally happens too late after some terrible war/conflict, so it wouldn’t be unreasonable to tackle them proactively. And then maybe it’s not so weird to think about these concepts even if their realization isn’t imminent. Working backwards in such a framework would probably give much better laws for today.
I'm using this since 30 days while building this. it's working perfectly fine.

Use verified domain and that's all.
DirectDraw wasn't really meant as a drawing toolkit; you _did_ have blits, but they were not hardware accelerated AFAIK and not nearly flexible enough for what the article suggests (mirror, stiple, probably other stuff). In general, what DirectDraw gave you was a rectangle you could draw pixels into, and a way to get those pixels efficiently to the screen. In other words, more like a clean abstraction over the display driver.
Location: Europe (can work US timezones)
Remote: Yes (Preferred)
Willing to relocate: Depends on location. Otherwise happy to travel
Technologies: Python, PyTorch, Transformers, Diffusion models, NLP, LLMs, RAG, CFG guided generation, semantic search, LlamaIndex, Langchain, Guidance, Outlines, Vector DBs, Rust, C#, AWS, distributed systems, Ray.io, Modal
Résumé/CV: Available upon request
Email: hnthrowaway0@gmail.com

Senior engineer with 7y of experience. For the past year studying and working with LLMs, building RAG-enabled applications and other R&D work. Please get in touch if you're interested in details.

I'm interested in this area of work and would like to apply what I've been learning so far.

Posting from a throwaway because folks from my current company tend to lurk here ;)
Right. But it does not matter in this case - Meta rolls out its own kernel (we employ a lot of kernel engineers, and PSA our Linux teams are hiring software engineers!) and we maintain our systemd backports and some other packages in the CentOS Hyperscale SIG
My opinion is towards the end of this decade. Hardware is mostly there - the collection of actuators, metal bits, batteries, cameras and inference chips means you can probably build this today at scale for the price of mid-range car, but of course it wouldn't do anything useful. But given the rate of progress in AI over the last few years and the increasing rate of investment in the field, I'd be shocked if another 6 years of progress would amount to nothing.
> Why doesn't Google need licensing to scrape and reproduce NYT snippets in their results?

Because Google established that it was fair use in a court of law.

> Any given content site has authors that read stuff that is copyrighted and produce their own take.

That's fine as long as you're human, if you're a machine then it's a purely mechanical process and subject to copyright.
Tech's richest plan to save themselves after the apocalypse
Paywall your existing Android phone number for free using the built-in "Do Not Disturb" with the "Priority Only" setting --- no screening app with Google trackers required.

This is one of the first things I do with a new phone. People not on my contacts list can't make my phone ring for any price. You can include SMS in this too if you want.

Amazing how many people don't know this.
Thanks, I built from scratch using Nextjs
I want a job as a comedy arbitrator.
AA and AAA are a statement of budget, size and scope of a project.

BG3 is a rare example of a AAA indie game.