skysight-inc/HackerNews huggingface dataset:
The author should really take a long pass through the multidisciplinary investigation of what embodiment means.

Multi-modal is just a start, physical agency and proception are the cores of what is missing from LLM that people mean when they say such systems don't "know" what things are.

What they don't have is not just the sorts of categorizations and propositional reasoning around it implicit in e.g. Wikidata entity maps and Prolog/Wolfram like propositional reasoning.

It's also having a body that inhabits space and time with other agents and bodies.
Back when I was working on hololens 1 stuff, I was very surprised how the bad resolution wasn’t actually much of an issue. I think since we’re always slightly moving, our brain makes some kind of natural temporal antialiasing ? And it’s not awful like VR since it’s super imposed on the real world and not a feed of it
You’re still getting more information, which allows you to be more accurate with your inputs e.g. tracking a moving target.
I suspect it might've been a couple of reasons:

1. I actually preferred this link that showed the highlights in a compact format.

2. There are some other HN user(s) who seem to be obsessed with posting [dupe] comments like their lives depended on it, and others may find it off putting. I know I do. Unless it's an exact dupe and very recent, for me it has "ha-ha, gotcha!" or Wikipedia deletionist vibes. For some reason, "See also:" doesn't bug me nearly so much. Maybe because that seems like a notice for the benefit of the reader, but "dupe" sounds to me like a callout to a moderator to hide the story.
There are a couple of new books on the topic that are slated to drop any day now, IIRC. Of what's already published, a few I'm familiar with include:

Transformers for Natural Language Processing and Computer Vision: Explore Generative AI and Large Language Models with Hugging Face, ChatGPT, GPT-4V, and DALL-E 3

https://www.amazon.com/gp/product/1805128728/

Transformer, BERT, and GPT: Including ChatGPT and Prompt Engineering

https://www.amazon.com/gp/product/1683928989/

Introduction to Transformers for NLP: With the Hugging Face Library and Models to Solve Problems

https://www.amazon.com/gp/product/1484288432

Transformers for Machine Learning: A Deep Dive

https://www.amazon.com/gp/product/0367767341/

Natural Language Processing with Transformers, Revised Edition

https://www.amazon.com/gp/product/1098136799

EDIT:

a couple of the ones that I thought were still pending have now been released. I haven't read any of these, but they are ones that caught my eye and that I was planning to get:

Large Language Models: A Deep Dive: Bridging Theory and Practice

https://www.amazon.com/gp/product/3031656466

Building LLMs for Production: Enhancing LLM Abilities and Reliability with Prompting, Fine-Tuning, and RAG

https://www.amazon.com/gp/product/B0D4FFPFW8

Building LLM Powered Applications: Create intelligent apps and agents with large language models

https://www.amazon.com/gp/product/1835462316

The "not yet released" group still includes:

Build a Large Language Model (From Scratch) (ships Oct. 29th)

https://www.amazon.com/gp/product/1633437167

LLM Engineer's Handbook: Master the art of engineering Large Language Models from concept to production (ships Nov. 11th)

https://www.amazon.com/gp/product/1836200072

Hands-On Large Language Models: Language Understanding and Generation (ships ???)

https://www.amazon.com/gp/product/1098150961
First of all, it is extremely difficult to say whether certain actions are good for society. I think there are some things that you can say are clearly good or bad for society, but what about all the stuff in the middle?

Would the Coca-Cola company be allowed to exist in this world? Are professional sports team good for society?
> proliferation of LLM: that it will make reading communications from other workers less utterly painful.

By somehow magically inferring what the person was trying to say and padding it with pointless verbosity?

I'm afraid we'll need to wait for Neuralink 20.0 to solve this problem...
At least they're fairly honest about it in places where government mandated backdoors aren't kept under wraps: https://support.apple.com/en-us/111754

Further evidence that Apple is simply right about everything they do, even when their actions directly contradict how they market their brand!
And a fair chunk of pre-WWII Germany ended up in Poland. Poland basically moved westward, losing parts in the east and gaining territory in the west.
Emails don't need OCR and are usually html with attachments, not structured pdfs.

If you want to process contracts or business letters... Then yes, that'd be a good choice.
Saying I'm punk, and you are not punk, is about the least punk thing you can do.
But what does seem difficult is for you to use words for understanding instead of throwing throwing them in people's faces.

It is true what they said within the context of the conversation where the standard notes are either explicitly or implicitly rejected.

> that is probably so fit for purpose.

Or probably not. Unlike in this case where apostrophe is definitely fit for purpose
AlphaFold doesn’t work for engineering though. Getting a shitty answer ends up being worse than useless.

It seems to really accelerate productivity of researchers investigating bio molecules or molecules very similar to existing bio molecules. But not de novo stuff.
Giving your lambdas names defeats part of their purpose though.
The grandmother received her qualification in Warsaw, which is part of modern day Poland and has never been part of the USSR - so her qualification explains nothing about dentistry in the USSR - as per the comment I was responding to.

Warsaw itself was in ruins. A great portion of the country’s doctors had been killed, and there was a desperate need for medical professionals of every kind. The intensity of this demand led to a certain loosening of standards in training. This relaxation was even more pronounced in the sister discipline of dentistry. Instead of going to years of medical school, all Zosia had to do to become a dentist was endure a short practicum and pass a test. The test was a set essay, on the “role of the mouth in the beauty of the face”.
> Handed in my notice the week before, because passing probation would increase my notice period from two weeks to twelve weeks.

Is this the notice that you're required to give them? How can they enforce a notice period (genuine question)? Or is it just them trying to tell you that you need to let them know _three entire months_ in advance but without any real way to enforce it?

I never thought this was enforceable.
Misfits

Black Flag

Ramones

TSOL

SNFU

Dead Kennedy's

Bad Brains

Descendents

Minor Threat

I think Punk was in its heyday in the 80's. I think its evolved over time and many people don't believe "pop punk" is really considered "punk" even though a lot of the themes we saw in the 80's punk bands are very clear and present in Green Day's music.

Which then begs the question what really defines punk music? I'm honestly not sure because many of the hallmarks of the 80's punk was the poor production, guitars out of tune, singers who couldn't sing very well - all of which have been greatly improved when you consider Green Day's music.

Billy Joe Armstrong is a phenomenal singer. Even on Dookie, the producer said a majority of the songs he did in a single take - which is staggering to think about. Their musical abilities are unquestionably much better than any of the 80's punk bands. Tre Cool's drumming is just on another level and I'm not sure many 80's era punk band drummers could ever hang with his abilities. Even the production level of Dookie was light years ahead of many of the seminal punk albums that came out in the 80's.

Its easy to claim that Green Day isn't a "real" punk band, but when you start to compare them to the "prototypical" bands in the 80's, they sing about many of the same things, but have elevated the genre beyond what its really been known for. In the end, I have a harder time not calling them punk, there's just too many similarities to many of the most popular bands people know.
Yes, we do need to be aware of it and deal with it. But part of that awareness is building resilience into your company's brand. As in, have a brand identity separate from a specific domain name. That may sound crazy when so many tech companies do/did tie their brand to their domain, but they are not the same thing.
Building a swipe card jukebox using a Raspberry Pi (2019)
Wide Tables
Personally I'm just happy that you're performing, not undergoing, the surgeries.
It has been crazy to build an engine for this exact reason. You quickly see what you take for granted and what requires work to implement but "appears" effortless. Things that seem so obvious and core you quickly find don't come for free.

A simple example was that yesterday I was trying to debug why my MouseDown event wasn't firing every frame and was just firing once like MousePressed. After some digging in I realized that MouseDown isn't actually a primitive mouse event type in my platform wrapper code (Sokol). You get Up/Down. Doing this 1-to-1 wouldn't give people what they usually want (a MouseDown event that fires every frame), so you've got to figure out how to implement that yourself.

As for the Github, it's all a work in progress! I'm actively working on the engine but it isn't really "released" yet. I've got a very active dev branch and some docs I'm working on before I do a proper "reveal".

As for screenshots - what kind of stuff would you want to see? It's just a 2D engine so it's not like I have awesome graphics to show off. The point of it is that it's a code-only framework, there's no built-in editor or anything. I do want to have runnable embeds though of the demos!
can this be applied to 3d?
Mediatek Dimensity 9400 Benchmarking [Geekerwan] [video]
Uranium has been strategic mineral for nuclear weapons and yet still is traded free on the global market.

Every country that has nuclear weapons does have nuclear reactors, and supply is basically not an issue. The technology is the main moat (uranium enrichment & reactor tech & turbine tech & missile tech)
Great summary! I also recommend the "What Goes Around Comes Around" paper written by Mike Stonebraker and Joe Hellerstein: https://people.cs.umass.edu/~yanlei/courses/CS691LL-f06/pape...

It was written 20 years ago, but even today, the relational model and SQL are still the prevailing choices.
> nicely provide us with everything digitally that we could need... Advertising

Sorry for the snark, but no one anywhere needs advertising. Advertising in it's current form is a plague on humanity.
Are you sure? Google has a search and location data, Google email is on one side if not both of most email chains, receipts, etc.

I don't use meta for much. Google on the otherhand takes some pretty dedicated behavior to avoid.
The issue that phoronix is facing might be due to a power management bug that is not related to the driver at all.
I love Zod, but recently I've been converting to Effect's Data and Schema modules.

Previously I liked a combination of Zod and ts-pattern to create safe, pattern matching-oriented logic around my data. I find Effect is designed far better for this, so far. I'm enjoying it a lot. The Schema module has a nice convention for expressing validators, and it's very composable and flexible: https://effect.website/docs/guides/schema/introduction

There are also really nice aspects like the interoperability between Schema and Data, allowing you to safely parse data from outside your application boundary then perform safe operations like exhaustively matching on tagged types (essentially discriminated unions): https://effect.website/docs/other/data-types/data#is-and-mat...

It feels extremely productive and intuitive once you get the hang of it. I didn't expect to like it so much.

I think the real power here is that these modules also have full interop with the rest of Effect. Effects are like little lazy loaded logical bits that are all consistent in how they resolve, making it trivial to compose and execute logic. Data and Schema fit into the ecosystem perfectly, making it really easy to compose very resilient, scalable, reliable data pipelines for example. I'm a convert.

Zod is awesome if you don't want to adopt Effect wholesale, though.
Tell that to the people who downvote me which seems unprofessional as hell.

If I want to learn .Net which is more time consuming and more difficult to find employees why would I use it? Makes sense if you are in an area with a lot of windows people, but that’s not the case anywhere other than Texas.

And the compiler enforce typing. Admittedly not as nice as Go since you have to rely on external tools but workable.

People like their curly brackets though. Just not as helpful when dealing with system problems.
Seems like basic "you expected that, didn't you?" sort of findings, although they did verify the absence of a lot of correlations. But it's kind of cool that they can directly measure how much impairment a bad night's sleep causes.
Nah, sorry but it's literally not my job to redirect someone's question that went to the wrong spot. "Hey, not familiar with that, I'd ask X" is fine. This sounds like extra messaging on my part that the person with the question or request is perfectly capable of handling themselves. It's unneeded chatter or noise.

However, if I do think it falls under my responsibilities but then I find out for some reason it's not after learning new information or hitting a wall, then yes, I'll absolutely fill in whomever it's supposed to go to.
The GDP argument is weird. If Google being huge is good for GDP why don't we just let them own the whole country? One US company for everything, maximum GDP afterall!
Ha! The amount of gatekeeping on the definition of punk that I've lived through makes me feel so old, but it also tickles me a little to see it come up again today. The more things change ...
Unfortunately, if you did that, the businesses would still do their best to muscle in on the "information search" results. Marketers gotta Market, and placement on a SERP is a zero sum game. If one competitor managed to get themselves highly ranked in the "information search" then there would be incentive for all competitors to try.
Anyone who releases an album for sale is a poser. Trying to make money from music is unpunk.
Pakistani accents often perfectly coincide with Punjabi and UP (Indian states) accents.
The prices are insane to me but to be fair the people that remember this from 30 years ago will probably have some spare money to spend if they’re still interested

Edit: well to be fair I see now that they are very limited
Now another group of researchers have the opportunity to apply for a grant and propose new research on N=10
This site is unexpectedly AWESOME. The frontend is so nice! The audio perfectly syncs up to a video when you open up the accordion, and I love the giant fonts. The best part though is the bitcrushing image carousels omg. The images get higher res as they're scrolled into view! https://imgur.com/a/TIWA9FW

Kudos to the designers and devs on this.
Yeah, that seems like a very OpenBSD thing to do, and I mean that positively. It just initially struck me, like, "yay, I no longer have to install a ping daemon!" "A what daemon?"
I understand but that is not what I meant. What I meant was it is an inevitable drift (for a certain type of work to get outsourced) that cannot be stemmed unless the government does something. I still have no clue if doing something about this type of outsourcing is even a good idea. But I was just wondering if this discrimination is inevitable if outsourcing continues...
I was intrigued by the value so did some research.

I would guess the 15$/hour value was chosen to approximate an average gross salary. The annualized payment would be 31200$[1] and it seems the average annual salary was around 30359$.

Updated to 2022 values the annual gross pay would be 10033€ [3], current average annual gross salary is 20483€ [4].

[1] 15$ * 2080 hours
[2] https://www.repository.utl.pt/bitstream/10400.5/9819/1/ee-ja...
[3] https://www.ine.pt/xportal/xmain?xpid=INE&xpgid=ipc&xlang=en
[4] https://www.pordata.pt/pt/estatisticas/salarios-e-pensoes/sa...
Not sure if we need to support SRIOV on the HW. VirtIO GPU native contexts should be good enough for most consumers.

I imagine SRIOV would be useful for more advanced usecases
Yep. From what I've seen, if the head wants to do nothing, it can attend to itself = no inter-token communication.

Still, differential attention is pretty interesting & the benchmarking good, seems worth a try! It's in the same vein as linear or non-softmax attention, which also can work.

Note that there is an error below Eq. 1: W^V should be shape [d_model x d_model] not [d_model, 2*d_model] as in the Q, K matrices.

Idea: why not replace the lambda parameterization between softmax operations with something more general, like a matrix or MLP? E.g: Attention is the affine combination of N softmax attention operations (say, across heads). If the transformer learns an identity matrix here, then you know the original formulation was correct for the data; if it's sparse, these guys were right; if it's something else entirely then who knows...
That most wont get it is due to the fact that most are kind of "industrial programmers", who only learn and use mainstream OOP languages amd as such never actually use a mainly FP language a lot. Maybe on HN the ratio is better than on the whole market though.
To be honest, even when going to the original Pizzeria Uno (or Due) I’ll probably still call it “Uno’s” ‘cause it’s a weird part of the Chicago dialect. We do the same thing for the grocery store Jewel-Osco, calling it “da Jewels”
Ok but what if the landlord raises rent by $200, while commuting would cost me an extra $250. Or what if I move from a town with good public transit to one where I have to drive by your own admission, several towns over.

What if moving costs $1000, which is another $83 per month over a year.
1982 seem a bit early for the massive fiber rollout. My recollection was that Sprint was the driving factor for laying fiber, since they had the railroad right-of-ways. But that was quite a while back. Maybe there was also another dark-horse company laying fiber along railroads, but not operating as a phone company? Something not quite at the tip of my tongue. Seems like someone could have written a good history book about internet infrastructure, especially the mid-to-late 90s. Anyone have suggestions?
Requiring benefit is a huge step from where we are. Perhaps it would be easier periodically determine the n most harmful and dissolve them. Predation is known to make an ecosystem healthier.

This would sidestep the problem of:

> but what about all the stuff in the middle
> You can't just arbitrarily set the status quo that way, can't just sneak a premise that the state has default a right to collect a piece of arbitrary appreciation on an asset (as all assets are used for speculation) when the owner hasn't actually gotten cash from that, and that any government that doesn't tax that is just cutting someone a break on something rightfully owed.

That's a great point.

But note that you also cannot arbitrarily jump so far back in an implied chain of premises as if to suggest that you've somehow build your own (suspiciously libertarian-leaning) argument from first principles. For example:

> The state of nature is no tax

Well, the state of nature is also tribalistic. But imagine someone making an argument that collectivizing the farm in question is right because the state of nature is humans living in a collective.

You'd rightly reject such an appeal to nature in that case. Therefore, you should reject your own appeal above.
The issue is that humanity right now is sort of capped on innovation in any area outside AI. There is plenty of room for optimization of stuff. For example, quad rotor drones replaced the necessity to have a helicopter flying overhead for a lot of industries.
Are you sure it didn't cry in `bytes()`?
I think even with firehose monopoly money that Bell Labs would have eventually succumbed to cuts and general enshittification as the CEOs and shareholders wanted ever increasing pay and dividends. "Do more with less guys! You're smart you can figure it out! The Board really needs this 10,000% pay raise, they have families you know."
But it wasn't simply for their achievements that so many of these guys (many of whose achievements weren't all that impressive, actually) were hired. Rather, it was because they were perceived (by virtue of their Nazi credentials) as being solidly anti-communist, and hence, "reliable". That's where post-WW2 history starts to get wild again.
It'd be interesting if games can be revolutionized with realistic worlds and NPCs with the use of a dedicated NPU. Like how game graphics were revolutionized with the GPU.
This sounds very Midwestern to me. Where I come from that would happen a lot. It wasn't necessarily that people didn't know the real name of the place. It functioned more like an inflection that helps to distinguish between the company, and a specific storefront operated by that company. Compare it to the distinction between "Alice" and "Alice's". Alice is the person, and Alice's is her house.

For example, you you'd say "JCPenney stock is up by 32 cents this week," but you'd also say, "I bought this shirt at Penney's."
Sure.. but this law was never challenged and thus it was never deemed unconstitutional.. Something only the supreme court can do when the proper process is started..

Until this happen the courts must assume the law is valid and apply it as such..
> A lot of punk has always had an anti-success edge

I think you hit it on the nail. What makes some people uptight about Green Day being punk is not the music -- because objectively, punk's pretty much on point. It's the fact that they were wildly successful. Can't be punk any more when that happens.
fMRIs can show you, at best, when more or less blood is flowing to a certain part of the brain.

Is that sufficient to make any claims about what the brain is actually doing?
It also enables you do things like:

a) store caches & libdata on different disk

b) consistently 'reset' cached data for kiosk style logins

c) make config read-only, or reset to a known good state

d) Roaming profiles where the cache is excluded from sync across machines

Most computers + home directories are 'personal' where this largly doesn't matter, but there are often sound operational reasons for this seperation in cases where you are responsible for a fleet of computers. I too perfer the 'everything related to this app in one dir' approach. Crazy idea: for apps adhering to XDG, you could point all these vars at a directory under a FUSE-style mount, which then remaps the storage any way you'd like. :)
What is the purpose of the moving banners?
> And wherever there are ads there are privacy concerns.

Not necessarily true. Physical billboards are ads but (mostly) without privacy concerns, until they start putting cameras on them watching who walks by and looks.
Dang this looks like SPAM.

Edit: Nope. Definitely SPAM.
And yet all the most prosperous countries in the world are the ones that allow individuals to seek unbounded profits, and all the darkest holes of history are in situations that attempt to tell people how to live