skysight-inc/HackerNews huggingface dataset:
Not really, I have a Pixel 4a 5G that doesn't come with magic eraser but because I pay for Google One, they gave me access to it.

So I doubt there are really any limitations on the hardware themselves or that you absolutely need the new version. Google just paywalling the features.

I bet you all those will be available very soon for Google One subscribers.
You’re right, it’s not better. That’s why I didn’t say it was. I’m just offering another possible motivation.
In defense of Apple, there's various issues with using that common solution on their macbooks (I've seen it never go to sleep to randomly starting up).

Now Apple not releasing the tool is silly and stupid.
A warm-up exercise before going into any programming task is coming up with names for the methods and interfaces I intend to implement.

A more difficult exercise is coming up with apt names without anthropomorphising--something I rarely succeed at. I'm often drawn to analogs in the musical realm (Scales, Sequences, Signals, Tuning), carpentry (Blueprints, Components, Scaffolding), libraries (Resources, Pages, Indices), the natural world (Roots, Trees, Seeds, Leaves), physical media (Slots, Packages), publishing (Versions, Releases) and even cooking (Mixers, Recipes).

We often understand technology by way of analogy or prior experiences. Whenever dealing with the abstract or unknown, metaphors are often the first tool to make sense of them [0].

[0]: https://en.m.wikipedia.org/wiki/Metaphors_We_Live_By
> that the speed of light is 299,792,458 m/s

This is currently a fixed constant, not an observed quantity, because of the way the metre is defined.
It seems really neat! I recently received a .usdz file and was hoping this would be able to work with it. Unfortunately, that's not the case yet (but there's an issue about it [0]). Compiling the entire OpenUSD framework was a bit of a failure here on Void Linux.

[0]: https://github.com/f3d-app/f3d/issues/780
Your article says "there is no empirical reduction in bugs" and nothing else.
> I don't think a lot of people back in 2007 could have predicted that
the biggest thing to come from mobile would be an app that let teens
remix music videos and share with their friends.

That's funny for me to read almost 15 years after rjdj [0] There is a
difference between an idea that is possible, and an idea whose time
has come.

[0] https://en.wikipedia.org/wiki/RjDj
https://archive.ph/hWXMz
Personally I think the key/value/query terminology is kind of crappy, but at this point we're stuck with it.

Think of the "fast" network as being like a hashmap. It stores key-value pairs. You feed it a query, which is a key that you're looking for, and it gives you back the corresponding value. Unlike the hashmaps you're used to, however, this is sort of a "blurry hashmap". If you ask for a key you'll get sort of a blend of the values nearby it -- even if the key isn't in the hashmap.

> Are the key value pairs a vector and the last layer an actual token in a simple LLM, for example?

Almost.

Firstly, the image I linked depicts only one attention head in one layer of an LLM. So you have to imagine that replicated several times in parallel, and then repeated several times serially. The Fast Weight Programmer paper does a better job of explaining the fundamental unit; to see how they are replicated and repeated the block diagrams in Attention is All You Need are easy to understand.

Secondly, getting back to the "hashmap" analogy, you might imagine that the hashmap key-type and value-type are LLM tokens, but in fact that's not quite how it works. There are two other types. One is the embedding space and another is the key space, and the hash map keys and values are both of that type. Yeah this is why the key/value terminology really sucks. There is a feed-forward layer that translates input tokens into the embedding space, another that translates embedded space to key space (before the hashmap lookup) and a third one that translates hashmap-outputs back from key space to embedding space. I wouldn't get too hung up on all of these; it's sort of like if you learn a foreign language but still "think" in your native language... the embedding space is sort of like the LLM's native language that it invents for itself. The whole business with the key space is mostly sort of a hack... in order to have multiple attention heads and train on current GPUs efficiently you want the embedding space to be NUM_HEADS times larger than the key space. So the whole key space not being the embedding space is mostly just a kludge to make this work well on GPUs. Unless you're planning on writing your own LLM from scratch it's mostly safe to pretend that the key space and embedding space are the same thing. In practice people have tried taking apart small transformers and the key space appears to work like "parts of speech"... when it reads a sentence like "I walked the dog" the attention heads tend to create mappings vaguely similar to I=subject, walked=verb, dog=object, and then later on the slow network will produce queries like "what verb was applied to the dog?". This is an oversimplification, but it gives a general idea of what's going on.

Also if you like maths, equations (4)-(19) from https://arxiv.org/abs/2102.11174 are a really spectacular example of using math when it's the right way to explain something, instead of using it to hide things.
Fraunhofer claims record efficiency of 36.1% for silicon-based solar cell
In my opinion is much worse to spend a whole hour writing a cover letter to have to explain the reason why someone is applying, go through the special form to apply for the job answering a number of questions and get no feedback. A person spends 8 hours a day if not more applying, when could spend time doing other things in life that matter most. When lucky, have to go through a 5 stage interview process with changes of getting ghosted at the very end, with 4 hour take home tests that take a whole day.
> I am outright saying I won't engage in a conversation.

It's actually arrogant and dismissive because you say that in a way clearly intended to spark a conversation.

Also, pretty much all arguments for explicit typing suffer from mechanistic bias (see, https://www.youtube.com/watch?v=NmJsCaQTXiE&t=143s). I'm comfortable saying I just enjoy tinkering with a formal description of a data structure, because I'm a type enjoyer, not a type fan.
It really doesn't

the secondary meaning describes a symptom of brain disorder.

> The hypothesis is that the patient generates information as a compensatory mechanism to fill holes in one’s memories. It functions for self-coherence, integration of memories, and self-relevance. [1]

Which is not what the LLM is doing. The LLM is choosing a statistically relevant next token, which is wrong because its missed some context.

There are much better psych terms out there, hell, even aphasia is a better term, but its still wrong.

What it actually is, is noise. Its noise that dilutes the signal we really want.

but thats much harder to use, and you won't be remembered as the person who coined that phrase.

[1]https://www.ncbi.nlm.nih.gov/books/NBK536961/#:~:text=Confab....
Wasm runtimes are great for stuff like plugins! Seems like this static_zone thing was something like that (but they call them apps)
> Capitalism is buyer, seller, and marketplace with "enough" regulatory feedback to stabilize the system.

Capitalism is “a small elite possess the means of production”, what you are describing is “market economy”, those two concepts have been muddled by cold war propaganda but they aren't the same thing.

Crony capitalism, monopolies and regulatory captures are all features of Capitalism, but they work against the goals of a market economy.
"big", "fast", and "heavy" all mean different things to programmers, train engineers, rocket designers, and astronomers, but they all still manage to quantify things.

If I love someone, I find them interesting, I feel bad when they feel bad, I want to spend time around them and get one-on-one attention from them, especially physical attention. That's at least half a definition for one person.
What tech stack does this app use? Is it open source?
UK cloud computing market faces formal inquiry
I think "a key" makes it clear that there is one key, could be any of them, but you need to select one key. "Make any 3 key presses" would in my mind finally allow QWE and QQQ.
One of many reasons I just cannot in good conscious buy Apple products, beyond the questionable design and quality, hostility to users and repair a like is the straw that broke the camel's back.
I've used DDG for years, and while initially Google gave much better results, for the past year or so, i've found that DDG usually finds what i want within the first page of results, where Google will have it on page 2-3-4, if at all.

It may just be that i've "gotten used" to using DDG, but i generally think it's better than Google at this point in time.

The only winning point (in my books) for Google goes to Shopping.
Tim Sweeney has said things along these lines about Fortnite as have other commentators. Roblox is often compared to RecRoom and Meta Horizons in terms or market share and functionality

What is it you object to about this particular definition? The fact they don't run in a headset? (Roblox now does). What is your definition?
Sorry, but the very real alternative to regulation is the loss of people's life.

> For all we know, in the absence of government, when planes were invented and accidents started happening, people got together and started doing this on their own.

Thousands of people had to die until we arrived at the regulation we have today. As the saying goes, every rule is written in blood.
I really enjoyed the beginning of this page, where it talked about embeddings and such.
But starting with the self attention, it gets a bit fussy. How, based on what does the attention mechanism work? The similarity of embeddings can't be all of it - "it", "dog" and "bone" will alwats have the same similarity, even if the surrounding sentence changes.
Can someone in simple terms describe how thus works?

Extra: the embedding explanation works great with words, but with actual tokens it gets way weirder... e.g. in German tokens are often just 1-3 characters, which do not contain any meaning in the normal sense.
So the fact, that this works for example with the "hu" from "Hund", "fl" from "Flasche" and "fl" from "Fleisch" is interesting, as "Fleisch" is probably more similar to "Hund" then "Flasche". (Tokens are just examples, not sure how this wird's are broken down).
I guess the solution to this is related to the question above? For this kind of embedding to be useful it is important to look at more than just the two tokens, but their complete surroundings?
Well... no, I don't want to redefine "intelligence". I don't know how you got this idea.

What I'm saying is that "intelligence" didn't mean "guessing the best answer by averaging many known, externally generated answers" before neural network approach became popular. Intelligence was always about finding good solutions to problems.

In rare cases doing nothing is a good solution to a problem, in less rare cases, statistically guessing is a good solution, but it still doesn't answer the question of how to find a good solution. No amount of improving the accuracy of statistical guess will answer this question because what we need is a proof that the claim is correct, but the guess is the opposite of a proof -- it's asking you to take the claim on faith.

In practical terms, compare these two scenarios:

1. A neural net AI is diagnosing breast cancer in a patient. Suppose, it was a male patient (a very rare occurrence, that's likely to fail statistically guessing AI). AI fails to find cancer and the patient dies.

2. A radiologist diagnosing breast cancer in a patient. Same circumstances as before. The radiologist fails to identify cancer, the patient subsequently dies.

In the first case, we don't even expect the AI to be correct. Nobody's taking the blame, because, well... we've constructed this AI to be guessing statistically. It couldn't have enough data to guess reliably because in order to do so it needed to see more breast cancer in male patients than we have data for.

In the case of a radiologist, we expect the radiologist to understand that they are treating an exceptional case. We will blame them, and probably sue for malpractice because we expect them to be able to reason, to be able to explain why what they see "makes sense" and why their response to what they saw "made sense". We will hold them responsible for failing this patient.

In common understanding of the word "intelligence", the radiologist is intelligent (or, at least, we expect them to be), while neural net isn't.
I have the 9 and it's a fairly good phone, but seems to have a hard time working with UK phone networks. I get patchy 4G, not sure I've ever seen 5G, and there seems to be a very magic combination of settings that allows me to actually make and receive calls (turning of VoLTE, and a bunch of other things need to be on or off). A shame, because otherwise I love the form factor and other features.
Yeah, this was definitely not more than meets the eye.
https://youtu.be/uwr14Q4C9gY?feature=shared&t=292

This youtube reviewer suggests that while fan noise was his primary complaint with the intel model, this amd version is much improved in that regard.
Micrograd in C
Prev: After Shunning Scientist, University of Pennsylvania Celebrates Her Nobel Prize

https://www.wsj.com/health/after-shunning-scientist-universi...

18 points|gnicholas|15 hours ago|9 comments

https://news.ycombinator.com/item?id=37770109
> That is inferior to new, considering physical goods have a limited mechanical lifespan.

Maybe. The bathtub curve exists. I trust the certification process. I’m sure used parts are serviceable in some cases.

> Either way, it misses the point that the product is a lie sold on false pretenses.

It doesn’t because I am only offering an explanation of why someone would lie.

> At this point I already know I’d pick the plane with genuine certified parts if I had the choice.

Of course.

It seems like you interpreted my comment as some kind of defense of these parts or the people selling them. That was not my intent.
They keep selling a better camera. Constantly. Every year.

Yet, can you really look at your old photos and say "my God, those 2017 photos. Could you imagine taking such crappy photos with such a bad phone?" I doubt it. That hasn't been true in more than a decade even for challenging environments like in low light.

They're selling you on a better camera each year because there's basically no useful way to measure its impact anymore aside from in really technical conditions that don't affect anyone practically.
> Everything becomes a custom cut, often in multiple dimensions and all earlier errors cascade all the way to the end.

Unrelated, but that sounds exactly like many software projects I've been unfortunately part of.
Serious question, do you think the current generation of llm cannot pass the Turing test?

If you think it can, did you not put much stock on the Turing test before they passed it?
> Little in this article is very clear

It also wasn't clear why finding duplicated images requires "AI" or in what sense Imagetwin, which advertises:

Imagetwin is an AI-based software for detecting integrity issues in figures of scientific articles.

is AI. Perhaps it's just marketing.
This is a disingenuous argument because it does not respect all the millions of plane passengers who didn't die. You're also mixing up failing hardware parts with failing software, a subject that is famously underregulated in commercial aircraft.
Do your imaginary friends fit into one of the existing categories? Fun, mutual interest, backstage intimate?
Dreams involve the concept of self, consciousness and an understanding of reality. all of it is far too anthropomorphic.

Hallucinations are much better described as noise. Its noise that lowers the quality of the signal. its just unlike white noise, this is in the form of coherent sentences/imagery.
Aren't you concerned about the lack of security updates for the mini super computer attached to every facet of your life and authorized to act as you?
C software really needs to be used in a sandbox because this stuff is inevitable.
For anyone wondering how they got the approximation sqrt(2)=1+24/60+51/60^2+10/60^3.

It's based on the simple idea that:

Z = (a + b)^2 = (a^2 + (2a+b)*b)
=> (2a+b)* b < Z-a^2

Given an initial estimate "a", we need to find the largest "b" such that the term on the left is less than the term on the right. Therefore our estimate will always be slightly less than the actual answer and we can repeat the process to get slightly closer.

For the first iteration, Z=2 and a=1. We choose b=x/60:

(2+x/60)*x/60 < 2-1^2
120x + x^2 < 3600
x = 24 ... 3456 < 3600
x = 25 ... 3625 > 3600

So our first term is 24/60.

Repeat with a=1+24/60 and b=x/60^2:

(2(1+24/60)+x/60^2)*x/60^2< 2-(1+24/60)^2
10080x+x^2 < 518_400
x = 51 ... 516_681 < 518_400
x = 52 ... 526_864 > 518_400

Repeat multiple times.

Writing this in code I can easily get:
1;24,51,10,7,46,6,4,44,50,28 = 1.4142135623730951

This whole process can be codified into the long division algorithm for square roots which works quite neatly with base 10.

Edit: formatting
If the landing pages are not tidy, I'm not going to put my credit card anywhere on the site.
Confabulate means that in english as well. the psych meaning is very much secondary.

That's why cardinals are trapped in a "confab"
Only a psycho wants to know "why" someone applies to a job.

Jobs are exchanging work for money. Asking more than that turns it into a cult.

I wonder if psycho employers think they are Jesus.
Does Google rely soley on it's tech edge?

I'm not so sure. Don't they have a huge data moat that's hard to compete with in a data driven age?

I'm thinking the data that optimises advertising rather than the data that feeds google translate etc.
> So in one usage someone who is kinda dumb would still be intelligent, just less intelligent than others.

100 IQ = 50% of the population is smarter than this.

80 IQ = not sure what the percentage is, but >50% of the population is smarter than this.

If any of the tables here are to be believed:

https://en.wikipedia.org/wiki/IQ_classification#Historical_I...

then 80 IQ could mean 80% of the population is smarter.

I'll rephrase my "kinda dumb" to "dumb as rocks".
Absolutely this (with caveats).

You might argue that the idea of an MVP has shifted more towards "quality", but if you're not in a crowded market (I am, OnlineOrNot got significantly more users when I started caring about landing pages), and fixing expensive problems, you can get away with a lot.

In a previous gig I worked at a startup so early stage they had hardcoded their logins in the backend, and users could not change anything without emailing us. The problem we were solving was worth tens of thousands of dollars to the users, so they didn't care.
If you shine solar radiation on a nice black carbon sphere, practically all of those photons are absorbed, right? The sphere gets hotter, and starts emitting IR photons.

My idea was to now enclose this sphere in TPV modules - except in places where the parabolic mirror puts sunlight on it Let's say that's half of the sphere (but you could cut this number down if you chose a parabolic mirror with a long focal point).

Now you lose IR photons in across the part of the surface that you didn't cover in TPV modules. But you could but a IR mirror there, that is transparent for most of sunlight.
> Some authentic parts break, some inauthentic parts don't.

When authentic parts break they can be traced back to the origin, investigated why did they break and what changes are needed in manufacturing to prevent future parts from also breaking, and whether the process could mean other planes need to be grounded before the part fails on them too.

With inauthentic parts you don't know why it works and you don't know how it fails and you can't track back anything in the chain of manufacturing because you don't know who you're dealing with. Which is why aerospace industry doesn't use anything but original parts with tractable history.
https://news.ycombinator.com/item?id=37776800

If by "intelligent" you're comparing with other primates, too, sure :-)
What We Can Learn from an Insomniac Fish
is there something like crystaldiskinfo for iOS?
Yes I think they can pass the Turing test, yes I think this was a poor test to begin with if we are attempting to clarify what machine intelligence is and how it compares to human intelligence.
Whether in the proper spirit of HN or not, I very much appreciated both stories. Made me glad I posted my attempted humorous comment. Thank you :)

> watches in horror as my brother discards another one.

Love it.

Edited to add after further thought, bringing it back into relevance with the topic:

To steal a Hunter S. Thompson quote, the "too weird to live, too rare to die" friend: someone that just seems to attract unusual experiences and has great value merely for the volume of weird life stories they're happy to share and also somehow continue to collect.

Inevitably overlaps with other categories, but also absolutely require a category of their own.

I believe that I fit into this category for some of my more "vanilla" acquaintances (and even some family members).
Frankly it’s a bit confusing.
Some wrapper around qemu and firecracker. This is what I gathered from this link after 5 minutes of skimming.
I don't get how the link is about Common Ground. I followed it, and I found a den of Web3 stuff I'm not interested in at all.
TBH this should not be too hard for a macOS developer, since there is a C++ and python API to use.
How useful are universal truths compared to getting shit done?

I only see theorems as useful for complex societies. The son of a gem dealer would have the time to work out universal truths.

The reputation of everyone doing it without numbers would reveal the pattern of the universal truth.

Finally this looks like it was all done using cuneiform.

Which brings up questions of notation and the language to describe a square root.
Exactly. The relentless "humanising" of LLMs really doesn't help.

Its a noisy signal generated from either imprecise data, or not enough context to make a valid token choice.
Russia would gladly buy the fake parts and say they are manufacturing it themselves!
Well, it's a viewer of 3D files. You have a 3D file, you double click on it, it opens, you can look around.
"Computer" being a former job title would've been on my list :)
Thank you for an awesome, accurate post.

and, FWIW, confabulation is a lifetime terror for me -- with lucid dreams and https://www.psychologytoday.com/us/blog/dream-catcher/201909...

i fully wonder if LLMs are just trying to fill in gaps in direct knowledge, and seeking the closest parable they can find. So definitely confabulation rather than hallucination
Yeah, we wanted to include usd support in this release but it proved very challenging. We aim for it in 2.3.
It's in the tradition of maths that things are named after the second person to prove them/make them well known. There are numerous examples, but one of my favourites is Venn diagrams, which were called (by Venn) "Eulerean Circles" because he took them from Euler. Everyone else is like "Nope - Venn Diagrams."

It's probably just as well because otherwise just about everything would be named after Gauss which would make learning maths even more difficult than it already is.

The Pythagoreans did make a number of important discoveries to do with number theory, the ratios between string lengths for various musical notes (eg twice as long is an octave lower etc), cosmology and some other results in geometry to do with the properties of various 3-d shapes and stuff.