skysight-inc/HackerNews huggingface dataset:
> Searching for Gaussian would't give me Gaussian blur

On the contrary, it's the first item in search results. The very first one.
New research protocol yields ultra-high replication rate
Costs translate to losses when they’re larger than revenues. And specifically, ads are not assets. Let’s not get ahead of ourselves here and make our own accounting rules, ok?
Sssh don't tell anyone that's our secret!
She doesn't even have to opine, she could just state how important the policy decision could be and make sure people are aware of it.
The blog post format is so much nicer than a PDF paper!

More seriously, this does feel like a real advance. Vector search+context stuffing (RAG) is clearly a hack that doesn't resemble how we actually think or do things in reality. I've been wondering for the last year whether it's possible to extend the attention mechanism to more naturally connect to a bigger set of per-session weights or activations. The moment you encounter the query/key/value analogy it's an obvious idea, the problem being that you need a very strong grip on the low level details of neural architecture to actually do it. Now apparently it is possible! And the way the topk knob actually maps to abstraction is quite amazing.

Still, this doesn't eliminate context window constraints. The memories themselves have a form of context window in this technique. Context size (what they call sequence length) does still matter.

Additionally, the memories have to actually fit in GPU memory (at least in their implementation). And the memories appear to be nearly full snapshots of the network, so they will get quite large (much larger than text grabbed using RAG). So there's going to be a painful tradeoff here for the forseeable future where you'll have to decide whether you want a bigger smarter base model with a bigger context window but less space for memory, or a smaller model with a smaller context window but bigger memory.

This is the first I've heard of Normal Computing, who are these guys/gals exactly?

> Normal is a deep-tech startup founded by former Google Brain & X engineers

Ah. That explains it. "X" here also refers to Google, not Twitter/Musk devs.
1. Good for you. But for most people, cleaning is a big problem. Otherwise dentists wouldn't exist.
2. Yes we did. Based on our info and tests over the last 3 years, a European university just started a large clinical study with the Blizzbrush. To examine whether it can even be used in care homes.
3. If you define it this way, then nothing is 100% recyclable, there is always some loss. Your comment seems irrelevant for real life.
Why are people so unaware of what is happening? The leap in quality from DALL-E 2 to DALL-E 3 was due to improvements in the prompts used for training. With countless people using ChatGPT, it will reach a point where OpenAI will have enough data to train on. There are ideas not yet explored that will be connected to the system. At this point, the pace of development is exponential. Unless it flattens out, we will witness AI being able to engineer, code, craft, design, and build a product on its own.

So, what is the basis for my statement? We are just mediators at this point. We don't need to be there. Currently GPT-4 translates our requirements to DALL-E 3 during image generation process. What I want to say is, there is no reason to give any form of signal as an "initial seed." Has anyone tried creating an automatic agent that, when turned on, receives a signal from the external world, whatever it may be, and triggers a chain of thoughts in these LLMs?

We, as humans, rely on signals. Currently, we are providing signals to LLMs in the form of text. There will and there must come a point where agents will feed signals to each other. They will perceive signals from the environment on their own and move on from there. This is not far away. It is near because all the components are laid out there.

And people argue over things like, "Oh, but I need to prompt it." No, you don't. It will take one engineer to define a way to process signals, then write an objective for the AI and train it. Once trained, it will continue on its own. The projection might sound off to you all, but there is no one stopping you from not doing it. Do you know what the limiting factor is? Capital. Yes, capital. So, as long as the power law holds, we will keep seeing strides in improvement. If you have capital and skills, you can do it right now.

I am not saying the signal is "real world physical environment". Say you have a crawler that scrapes the website. You hook it to a summarizer. The summarizer fires the signals and then it calls AIs to create product. This whole thing once created doesn't need a human in the loop. Once something is built, it is done. Also, add to the fact that these AI system only trust other AI system's code. Why? Because human are untrustable. Now you will have an ecosystem designed by AI for AI and to be integrated with AI. Why do we need humans at this point? Like why would a company want humans at this point?
> the Cybertruck, which I believe is going to be a huge failure (but we'll see).

I'd probably take that bet, although of course it depends how we define success vs. failure.

I suspect short-to-medium term, it will be a big success, as there's a lot of pent-up desire for one: hardcore Tesla fans, Tesla fans who want a pickup, people that like to be first-movers, people that like how it looks, people that want a pickup and appreciate the benefits that Tesla still brings (efficiency, supercharger network, etc.), and so on. The billion-dollar question, of course, is how it will fare in the market once that initial demand has been satisfied.

--

Aside from this, the interesting thing about the Cybertruck is that originally, the odd looks and build style (i.e. the flat sheets of stainless steel) were meant to be engineering-driven: the concept discussed on stage when it was first announced was that it was an exoskeleton, or a stressed-skin design, meaning that in theory it wouldn't need a traditional chassis, and would have weight-savings over a traditional pickup (or car) design. IIRC there was talk of a Model 2 (i.e. a smaller hatchback than the M3) being built using the same approach.

Then, somewhere along the line, this was lost (too difficult? or always just a pipedream?) and it was ultimately built using a very similar approach to Tesla's other cars, without the benefits originally discussed. I'm interested whether we'll learn what happened with this, one day.

(This is a reasonable precis: https://www.autoevolution.com/news/tesla-cybertruck-went-fro...)
SiOLED, MicroOLED and MicroLED: The Future of AR/VR Displays
Indeed it looks like all the text is grayed out... like "I'm waiting for you to click that damn accept-cookie button before actually showing the page".
Best AI NSFW Art Generators - With the advent of Artificial Intelligence (AI), artists and enthusiasts now have a plethora of tools at their disposal to create, modify, and explore NSFW art and NSFW AI Girlfriends in a way that was unimaginable before.
Apprenticeships are open to 16 year-olds - in much more dangerous professions. Metalworking, construction, mining, etc.

And of course if it is deemed too dangerous for them to join any of these professions, your local military recruitment center, acceptong applicants aged 16 and above, is right this way...
Because you trust closeed-source from Microsoft, Google and Apple? Seriously?

Open standards, open-source code. That's really the only option for code people are supposed to trust.
Makes lot of sense. In some EU countries like Finland the privacy of communication is a CONSTITUTIONAL right. So you need good reason to break it. And I don't think generic muh terrorism passes the bar.
> I think almost everyone has that “this is neat but it’s not there yet” moment.

I rather have this moment without the “this is neat” part. :-) i.e. a clear “not there yet” moment, but with serious doubts whether it will be there anytime in the foreseeable future.
An Ancient Greek Computer
How do you manage the quality of data?
Hi All,

In the company I am working on, we have a set of devices which send us some events. These events are programatically sent by the developers but we find more than often that the values of the events are wrong or missing. This generates very important data quality problems. Sadly, I can not force the developers to do it properly, yet.

I was wondering if there is some standard method to control this problem. First I thought on develop some parser with regexps to ensure the proper syntax of the values. This works but I need more control. I would like even to verify the values with the database to enure the correctness of values in relation on the context.

I thought that may be I could use something like antlr[1] to ensure the syntax and semnatic based on a certain grammar. But I am not sure if this is an overkill.

Does any one of you faced this problem before ?, how did you solve it?

[1] - https://www.antlr.org/

Regards
Constraints on physical computers in holographic spacetimes
Beijing asked Hikvision to identify fasting students
So just like politicians (cough, Lindsay Graham, cough)...
Unlikely. What will happen is that instead of one big push to the EU they will try again on the local level. That's how companies abuse the EU all the time. First try to lobby the EU itself for a one-stop-shop approach, and if that fails they go after the member states.
17 years old are allowed to work, however there are different regulations about it the the ones for adults.
The author used popovers to store state and calculate results. They also used JavaScript to generate the HTML. And hate properly capitalising “MB”.

The demo indicates it only works on Chrome, however it worked fine on Firefox on iOS (so just Safari, presumably).
Good point.

Technical mastery is one part of the equation that may or may not need to be built over the decades (but is too often arrested along the way).

However simple random occurrence is still a component and you would expect two decades of effort to double your chances of a breakthrough compared to a single decade, but in an environment of declining opportunity those earlier wins might be far more valuable than the same thing happening later on.

I think many of us are seeing the creativity here and recognizing it's one of the things that can lead toward unprecedented discovery which is where some of the most major impact comes from.

That path to discovery sure is impossible to pinpoint, especially when a certain amount of technical mastery combined with significant good fortune along with true creative effort are still not enough most of the time.

There's just something to be said about starting out more advanced in some way or another than others your own age, and maintaining that over the long term.
Well no, you shouldn't use it for your top-end problems, but your bottom-end problems. Aren't there things that you have to do in your job that really could be done by a junior programmer? Don't you ever have one-off (or once-a-year) things you have to do that each time you have to invest a lot of time refreshing in your brain, and then basically forgetting for lack of use?

Here's an example I used the other day: Our project had lost access to our YT channel, which had 350+ videos on it (due to someone's untimely passing and a lack of redundancy). I had used yt-dlp to download all the old videos, including descriptions. Our community manager had uploaded all the videos, but wasn't looking forward to copy-and-pasting every description into the new video.

So I offered to use GPT-4 to write a python script to use the API to do that for her. I didn't know anything about the YT API, nor am I an expert in python. I wouldn't have invested the time learning the YT API (and trying to work through my rudimentary python knowledge) for a one-off thing like this, but I knew that GPT-4 would be able to help me focus on what to do rather than how to do it. The transcript is here:

https://chat.openai.com/share/936e35f9-e500-4a4d-aa76-273f63...

By contrast, I don't think there's any possible way the current generation could have identified, or helped fix, this problem that I fixed a few years ago:

https://xenbits.xenproject.org/xsa/xsa299/0011-x86-mm-Don-t-...

(Although it would be interesting to try to ask it about that to see how well it does.)

The point of using GPT-4 should be to take over the "low value" work from you, so that you have more time and mental space to focus on the "high value" work.
I think we're partially mistaken about the true value and reason for lobbying existing as a concept. It's a cover that muddies the waters in discussion about laws, a coping mechanism for "The Other Side" and at the same time an endless stream of content for potential reporting by reporters/media.
Excellent point, but I'll add:

World #1 would probably replace all other kinds of jobs. A part of programming, sure, is about languages, syntax, fixing bugs, functionality, etc. But the other part is about robustness, organization, and simplification. This other part won't die.
Are you aware of why we stopped letting the children work in the mines?
Like, where do you draw the line on the expendability of a child's life?
Why do you think this is post-scarcity?
> This is an inversion of priorities. The dev's profession exits to create useful things for users. The users don't exist to enable the devs profession. If the only way an app can come into existence is through the exploitation and disadvantage of its users then the world would be better off if it didn't exist.

That statement just oozes entitlement...
Why spend so much time on purposefully misunderstanding the original question?
I never argued for banning Musks opinion, and I wont. Regarding the radical feminist in South Africa, call.me again when she has a realistic shot at becoming President there
Sure, Musk didn' propose camps as far as I can tell. He is, squarely by his own words, in the right leaning political camp in the US. Amd the current front runner for the presidencial candidacy of that camp called for all of those things, publicly, during a rally on Veterans Day.

Also, one opinion piece regarding the rescriction of voting, which is just a nut job idea, is quite different from gerryandering, reducing poling places and planning to impeach judges wjo said they don'z like gerrymandering (which actually is a thing, multiple courts in the US threw out district maps because of it). Actions weigh heavier than words, always.

Funny that you think I'm leaning communist, were I live my political opinion is somewhere left / social liberal of the center but a far cry from the left extreme of the political spectrum. No surprise so, it just shows the difference between the US and Europe.
I wonder this myself, also with document attachments and multi modal input (e.g. voice). I also wonder how much they really train on the chat history. I have it disabled but maybe I am too cautious and I am missing out on convenience.
I think you’re taking what I’m saying the opposite of the way I intended it. With enough time and effort, I could probably implement the relevant papers and then use various tools to prove my implementation free of subtle edge cases. But, Flink (and other stream processing frameworks) let me not spend the complexity budget on implementing watermarks, temporal joins and the various other primitives that my application needs. As a result, I can spend more of my complexity budget within my domain and not on implementation details.
Thank you for taking the time to call BS on someone who obviously never tried asking a LLM AI to decipher a string's encoding. That is exactly the kind of thing they are good ar.
> If this is considered dehumanizing, I'm concerned for the future of our industry. Anyone with even a first undergraduate algorithms course should immediately spit out "sort by customer and page, then stream the output".

Well yes, but that's not what this is about. It's about social pressure, not ability.

I could program this for you right now if I wanted to; most "optimisations" seemed the "obvious ones" to me, so I guess I would have passed. I could also program it in a hurry at ludicrous speed under pressure because all of production is down or whatever.

But ... I wouldn't be able to program this in an interview setting.

Last time I was asked a bunch of even easier things (in a timed interview, no less), where I literally have some exact code on my GitHub. I just couldn't finish it. Not because I can't "get" it, but because programming while two strangers are judging your every keystroke and commenting on what you're doing is just nerve-wrecking.

Or, basically this sketch: https://www.youtube.com/watch?v=kQa5NsdYSts
The main problem the author is talking about is actually about version updates, which in Maven as well as crates.io is up to each lib's author, and is not curated in any way.

There's no technical solution to that, really. Do you think Nexus Firewall can pick up every exploit, or even most? How confident of that are you, and what data do you have to back that up? I don't have any myself, but would not be surprised at all if "hackers" can easily work around their scanning.

However, I don't have a better approach than using scanning tools like Nexus, or as the author proposes, use a curated library repository like Debian is doing (which hopefully gets enough eyeballs to remain secure) or the https://github.com/crev-dev/cargo-crev project (manually reviewed code) also mentioned. It's interesting that they mention C/C++ just rely on distros providing dynamic libs instead which means you don't even control your dependencies versions, some distro does (how reliable is the distro?)... I wonder if that could work for other languages or if it's just as painful as it looks in the C world.
The first general secretary of NATO put it best on what NATO always was meant to be: "To keep the Americans in, the Russians out and the Germans down". If you actually look at what happened in the years to come after that quote, it perfectly fits into that narrative.

The assertion that "the US did try to bring China and Russia into the fold" is also quite acutely wrong. Remember when Yeltsin tried to join NATO after the end of the cold war, or how even Putin tried to integrate into NATO and the Western system? Who was it, that was vehemently opposed to that?

Even more so is the possible Eurasian integration which US grand strategy has always seen as one of the worst case scenarios for US hegemony.

You could call that a failure but you should assess on why it is one.

The US China strategy was also always very obvious, open up their huge population for capitalist globalization and keep the sleeping dragon in a perpetual state of democratic dysfunction and underdevelopment (just look at India). What the US didn't expect was the iron grip of the CPC on power and economy, fully rejecting US planned shock therapy. The moment China became a state that could even think about challenging US hegemony was the moment the US completely pivoted to an aggressive containment strategy.
Fediverse is the name of a decentralized protocol in which different servers federate with one another, a bit like email. Mastodon is decentralized Twitter, Lemmy is decentralized Reddit, and there are a lot of others.
Reality check is that those coal mines children had high mortality, suffered life long injuries and no future at all.

You could have picked example of child employment that does not harm, but somehow you picked the one that had done significant damage to them.
The wall of HTML soup he shows for facet "component" (time 11.33) is something I don't want to ever see again in professional setting.

Stringly typed logic and CSS / JS somewhere miles away in directory structure making it very hard to reason about.

I very much prefer sticking to small, composable, encapsulated, actual components made in React or sth similar.
The European Parliament has no saying in what laws it votes. The European Commission draft those, and the Parliament can at best rectify or reject them.
"Please derive in this 90-minute exam what took 100 years to comprehend"
I'm amazed by the fact that this was written by a human when AI would have done a good job.
Do you have examples? Ideally related to digital things or privacy.

(Thanks)
Whatever engagement and reach Trump gets from Truth Social is a tiny fraction of what he would get for posting to Twitter. Don't forget he had what? Over 100 million followers? That would cost him nothing.

Granted, TS was started when he was banned on Twitter but now? He could both save money and have more reach by shutting the whole thing down and going back to Twitter.
That money is just to employ lobbyists and their associated expenses.

I'm sure there is additional money for lobbying that is not on the books. Holidays, houses, good bullion, crypto, free memberships to exclusive clubs and the like that is gifted to politician's and their spouses by big industry.
If I'm standing in the shop looking at different tomatoes I have no idea how any of them taste. The only information I have is their country of origin and their physical appearance.

If I've never read about trends in tomato genetics, presumably like most people, I'm just going to figure that the juiciest tastiest ones are the big red ones.
This is not even remotely correct. In the US, you usually pay a monthly premium which is only a portion of the actual cost, and the remainder is paid by your employer. On top of that, yes, you pay your deductible. A $2,000 deductible could be considered a low deductible--it could be double that or more with lower premiums.

After that, you have the "out-of-pocket" maximum. You pay 20% of costs until you hit the "out-of-pocket" maximum, which is typically thousands of dollars per year.

Beyond that, there are actually two different deductibles and two different out-of-pocket maximums. One for in-network services, and one for out-of-network services. You can go to an in-network facility and see out-of-network providers without notice.

And even beyond that, while it has been curbed with some recent legislation, if your insurance provider decides to pay less than the provider believes they are owed, the provider can bill you independently for the remainder.

So NO, it is definitely not $2k per year for a good health insurance plan in the US. FAR from it.
> Most people shitting on GPT-4 are not really using it in the right context.

Old excuse: "You're Holding It Wrong" (Apple's Response to the iPhone 4 antenna problem)

> https://www.wired.com/2010/06/iphone-4-holding-it-wrong/

New excuse: "You are not using GPT-4 in the right context."
> But _not even their own devs_ can't explain logically why a rectangle or a circle drawing tool is a no-no.

...while making shape-drawing tools an item in the roadmap? :)

> And go forbid if you criticize that fact in front of them.

Nothing will happen.
> “If AI makes developers twice as productive (maybe a few years down the road with GPT-6), will this additional supply of developer capacity get absorbed by existing and new demand? Or will there be half as many developers? Or will the same number of developers get paid far less than today?”

Something to remember is that every new innovation in software development only raises the expectations of the people paying the software developers.

If developers are 3x as productive, then the goals and features will be 3x big.

The reason for this is that companies are in competition, if they lag behind, then others will eat up the market.

The company that fires 50% of their staff because of “AI Assistance” is not going to be able to compete with the company that doesn’t fire their staff and still uses “AI Assistance”…
> Every single website having full access to every single pixel and keystroke going into every single application on my entire machine

Could you cite something for that?