skysight-inc/HackerNews huggingface dataset:
I went to the University of Waterloo in the mid 2000s and never heard this kind of philosophy.

Still, having quite a bit of experience under my belt, I don’t think it’s actually going to be uniquely helpful at writing code. As I’ve gained more mastery, I’ve started to think more abstractly about the system as a whole. Sure, data flow is one aspect and you should consider. The mechanical aspects of code are necessary to consider too (eg what makes code maintainable and robust against mistakes). But how all the different pieces cooperate to create a complex system that’s solving your problem, that’s the way to get some real insights. Thinking about the system, you can start to think about how to change requirements rather than just trying to solve within some external constraints. Being able to move seamlessly up and down the abstraction stack is hugely important.

I agree 100% that focusing on the code is completely misguided. But so is focusing on data. Data by itself is useless. It’s what you can do with the data and how you can use it. Just shuttling bits around is by itself pointless unless all you’re building is basic data viz. And ultimately, this by itself is only one approach. For example, AI systems depend on data cleaning today. That’s not at all about how you shuttle data around not will that perspective help you. ML systems depend on more scientific rigor approaches. A data perspective might help you optimize the performance of those systems, but that’s a smaller aspect of what AI systems are trying to solve (not unimportant, but smaller than the entire thing itself). Smaller perspectives aren’t bad but they limit the space you can play in (which may be the goal some times but keep that in mind).

All that being said, a system’s level perspective is also limiting. You’re some times not going to have the domain expertise to actually solve some problems by yourself. You want to take on lots of different perspectives and have a good sense of which situation falls for a given perspective more. And some times, you may not have the ability to take a certain perspective. That’s where colleagues can help to complement your weaknesses.
The ai bubble has popped in the past and shall again.
Dude these articles are so cringe. Why not just go and learn computer science and research and build your own AI that’s more ethical or whatever?

People should all try to be as smart as possible and change the headwinds and not just complain.
>I really think we need a non-profit foundation for the social media

So much this! It is not like it requires faang level engineering to provide the valuable parts (to the user) of these services. I'd gladly donate to a nonprofit whose only political agenda is privacy and data sovereignty.
Most of Apache OpenOffice commits are just removing whitespace
https://github.com/apache/openoffice/commits/trunk
If you want to spend $4800.00 on just the computer, you can get a Mac Studio with 128G of memory with 400GB/s bandwidth. There are sparse reports out there of folks running 65B models on it. I've seen no performance measurements though.
Is that a 737 Max reference?
Another cool way to do this would be an ADS-B receiver on your roof. They're about $30-40, and when paired with a Raspberry Pi, a waterproof box, and free software[0] they work really well. Plus, you get a free subscription to a lot of flight tracking services like FR24.

[0]: https://flightaware.com/adsb/piaware/
Numbers stations are still pretty fun. Here's a video I got of the Cuban one, which is relatively easy to pick up in the US:

https://twitter.com/systematikk/status/1072960631916027904

Last I checked, they were using Windows XP freeware for data encryption.

There's also the shortwave radiogram and other interesting stuff if you go deep. The portable receivers and straight up SDRs they sell these days are pretty amazing in terms of sheer availability.

This receiver has been fun to use on the go:

https://www.youtube.com/watch?v=j3WQQn7rM3k

And the more consumer receiver stuff is now starting to ship with remote app control as well. A pretty awesome time for radio really.
Sounds quite dangerous...
Build your own ADS-B receiver
UX nitpick: Nothing on this page describes what a passkey _is_ - I'm not a 1password user, so I have no idea what they're talking about
TBH I don't find this exposition enlightening. If you don't already know the pytorch API, the code will be pretty obscure. And if you do understand the API, it's still not very clarifying.

Instead, it's a lot easier IMO to understand self attention in just plain English. If you understand the words, and also understand the torch API (or tensorflow or numpy, they're all more or less fungible), then it should also be straightforward to implement it.

Here's how I explain it to my grad students:

You have a collection of N things, with some fixed number of features each (doesn't matter how many, but call it d_f). Call that collection {x_i}. You have two learnable matrices Q and K, which learn to project those items into some collection of "questions" and "answers", respectively. Doesn't really matter what those questions or answers are, the NN will figure out what they should be during training.

These projection matrices map x_i -> k_i, and x_i -> q_i. k and q are each d_k-dimensional vectors (d_k is a number you choose) of features, so Q and K are d_k-by-d_f matrices. To measure the "compatibility" between questions q and answers k, we take the dot product of them. Ones which are similar (large, positive dot products) means the NN likes the answer k for question q.

So, here's what you do. For each token i, you compare it's "question" against every other token j's answer. I.e. you compute dot(q_i, k_j), which itself can be considered an NxN matrix of scalar numbers, qk_{ij}. Each element of this matrix contains the answer to the question "how well did item j answer the question of item i?"

Applying softmax to this matrix just converts the dot product values into a score from 0-1 over all the items. I.e., you convert the question to "on a scale from 0-1, how well did item j answer the question of item i?". The only subtlety here is that all the scores over all items j have to sum to 1 for each question i.

Finally, we have a third projection matrix, V, which maps x_j -> v_j. The v_j are d_v-dimensional vectors (doesn't have to equal d_k, and again something you arbitrarily choose). These represent the values that the NN would like to pass on from item j to any other item which decides it "likes" the answer of item j.

So now, for each item i we have a score for "how well does item j answer my question i?". And we also have the list of values v_j that each item j would like to pass to item i. So, to compute the new information to add to item i, we take the weighted sum of the values v_j that item i liked, using these compatibility scores as a weight. In math, this reads:
y_i = sum_over_j [ softmax(qk_ij) v_j ]

* Technically it's also empirically found that normalizing the argument of softmax by a factor 1/sqrt(d_k) helps. But it's not really germane to understanding and also not strictly necessary since a NN is of course free to simply learn to include an overall factor proportional to 1/sqrt(d_k) in the parameters of one of the projection matrices. Actually the use of softmax at all is also arbitrary, but encourages the attention to be sparse, which again is empirically known to be helpful.
How is that even a question? AI will be the most powerful technology ever invented. More powerful than nuclear tech. Obviously it follows that we will need policies and laws at least as strong and comprehensive as those surrounding nuclear technology.
I just assumed they went to Ken Thompson directly.
That's a question of policy, not of repo structure. A monorepo can still have certain parts of the repo protected by access control. One repo doesn't mean "all files share one read permission".
What am I worried about? Well, let me share a scenario
That whole MIT course, Intro to Deep Learning, is great and a really nice introduction to the field.
Need more chips !!!
>> took a shot at one another

which doesn't necessarily mean a "feud," a rather strong word i find. if faulkner and hemingway had such a "feud" why would faulker say the following in his art of fiction interview: "If I had not existed, someone else would have written me, Hemingway, Dostoevsky, all of us."

> This was far from the only feud. Hemingway got in a fist fight with Wallace Stevens--or perhaps the other way around.

who hasn't been in a fist fight with a friend by day and met later that same day without a word about the quarrel, implicitly disregarding it as mere heatful play of the moment. but otherwise, wallace stevens is on my to-read list after having read "The House Was Quiet and The World Was Calm"[1], you might enjoy it

1: https://www.poetryfoundation.org/poems/57607/the-house-was-q...
There’s a similar probably-unwarranted-on-paper fear of GPL in other ecosystems but I think GNU/Free Software advocates are often eager to reinforce the fear, presumably for ideological reinforcement. I’ve avoided GPL dependencies in my own projects because of express concerns in the team despite the fact that I don’t need a lawyer to know we’d be in compliance with the licenses.

The thread is interesting for other reasons, mostly OP ignoring obvious solutions offered by respondents and what would look like an implicit demand from Apple if OP didn’t seem so personally interested in the outcome.

It’s also interesting because the responses are surprisingly consistent in minimizing potential conflicting views and generally just encouraging free use and appropriate upstream contribution, a stark contrast to how a lot of FOSS advocates present this divide.
This is The Way.

The psychopathy of modern applicant hazing will persist until it's publicly documented.
Mathieu's Harmonic Experience. Definitive book on reconciling just & equal temperament and how to develop embodied understanding of the relationships between notes.
Thanks for posting this!

I see a lot of people getting riled up about "space junk" and how we have filled the space with tons of junk.

Humans are really bad at understanding things that are really big, and the amount of space is incredibly larger than they realize, to the scale where these satellites are literally like a gallon of water in the ocean.
I’m from a third world country, and now live in the Bay.

To give you context our place in SA was having a couple hours loadshedding a day, and here in one of the wealthiest neighborhoods our power was gone for three fucking weeks, and just yesterday was in and out three times.

It’s absolutely third world country level when the weather is anything but exactly 70 degrees. You have zero idea what you’re talking about, the original guy is correct.
I just checked and the attention matrix is 768x768. Basically, I reshape each sample to be a single step with an embed size of 768. I hope this makes sense. I may rewrite the README later tonight to make this point clear.

Let me know if you think I still don't got it!!!
So much this.

And also, in many fields there is lots of professional content that's been fully paid for before it hits YouTube - for example, professors make available to the public work that they've already been paid for, and they have no need at all to get paid twice.
I find it the worst when giving driving directions for most streets and towns in New Zealand because Siri has not been trained recognize or pronounce Maori names. So you ask for directions to ie Oneroa (oh-ner-ROW-a) will attempt to find own-ERRR-ua and explain that it doesn't exist. What laziness! How hard is it to train siri in all languages?
Levi Clay has done a bunch of ear training content which is fantastic, but it's only available via his Patreon page. Notably, he's going for hearing intervals first (that is, hearing it internally before playing the interval), then playing them/singing them/etc. Made a huge difference for me. [1]

This short video is awesome for ear-training for anyone -- it's presented for guitar, but it's general, with some fantastic exercises. Pretty audacious claim at the end, which I intend to test over the next few weeks :-) [2]

1: https://www.patreon.com/m/578011/posts?filters[tag]=Ear%20Tr...

2: https://www.youtube.com/watch?v=NX61J18YcHk
> mostly OP ignoring obvious solutions offered by respondents

Which obvious solutions? The only one I saw getting ignored was the suggestion to use MacPorts. That's great for a machine, but I was under the impression OP wanted nano to come back in a future version of macOS for all machines.

But I may have missed something.
My dad studied CS at UW in the 70s. He told me about using a language called “WATFIV” (pronounced “Wat Five”), which stood for “Waterloo FORTRAN Four.”

Now that is Waterloo Style.
Install Hacker's Keyboard from Google Play or F-Droid.
Well they might not be your use cases, but surely you can imagine them, right?

A build tool, that reads input files and writes output files, and nothing else.

A CLI that interacts with the bug tracker, and needs to read the environment and do networking, but doesn't need to read the filesystem, launch subprocesses, etc.

A serverless function that doesn't need anything but networking.

Even when you need to allow whatever you're building to read the filesystem, just specifying which files/folders can be read is in an of itself a huge win.

Thinking on it a little more, I wonder what kind of gigantic monolith use cases are there that need to read/write completely arbitrary filesystem locations, and need to spawn subprocesses that can't be known ahead of time, and need to do networking, and need to read arbitrary environment variables that can't be specified ahead of time, and also need to load dynamic libraries, and also need that other permission I'm forgetting?

I mean, I am sure there are some, but that certainly isn't the default I'd choose.
How does this compare to tsl::robin_map?
Neat! Bit too busy now, but we'll hopefully put some technical blogs over time to explain these things.

We don't do any predictive scaling yet; only when a call hits the queue do we scale replicas. Replicas cold boot (pod scheduling + application loading models into GPU memory) then subscribe to the queue.

Moving away from this replica + queue design very soon; using K8s primitives has gotten us this far but impossible to hit 1s cold boots with orchestration overhead. Building our own orchestrator and python runtime now.
If you have a single embedded vector, it should be clear that the self-attention matrix cannot be an arbitrary NxN but only a 1x1, follow the fix I have added to my previous comment.

Also if K, Q, V and the self-attention matrix have the same dimensions even when the embed_d and sequence dim have different sizes there is something wrong.
Why did it take them nearly 30 million in grants and 20 years to just now speak about delivering a prototype next year.

Engines can be prototyped on the time scale of months not decades.

Now they are soliciting the public to "invest" in their business.
My favorite C compiler flags during development
More a general reference to the fineness ratio[1].

[1] https://en.m.wikipedia.org/wiki/Fineness_ratio
I have no idea what the reasoning behind it was then, but it was a standard carried over from yugoslav times (usually 3 gas + 1 electric or 2+2) :) So yeah, could be redundancy...

https://i.imgur.com/rHDaZxm.png <- something like this was standard, also back in the time the colors were browner ( eg. https://i.imgur.com/RJkq5GK.png ) :)

The modern variants look more like this: https://i.imgur.com/iJvKQjy.png or with inductive heat instead of resistive: https://i.imgur.com/BOetXJz.png

I remember only one gas outage (some repair work done somewhere and they closed the valves) but there were quite a few power outages, where you had to use a lighter.
Then we can all get back to writing instead. Good.
I say they should keep it for old times sake
I remember that one of the financial banking software we were using had an internal chat that was basically using "write"(?) underneath to send messages to another users terminal (it was running on Sun Solaris I think).
I, of course, did not have root access or any access that I shouldn't have had.

/etc/passwd indeed stored the hashes in SVR3, and there was no such thing as /etc/shadow. I was naive enough not to understand hashes, and so I figured that those jumbled letters in the file had to be the actual passwords, and if "*" was in an entry then "*" was, of course, the password! Why didn't it work?!!?
I never write on an iphone, so didn't know today's ridiculous apostrophizing is an autocorrect thing - but that could explain why people sound like idiots or would that be sound like idiot's on the internet.
I was just able to get to it, odd it fails and later on works. But nice article!
This is clearly false. The limitations on BasicMed are different from those of a standard medical certificate [0], and have to do with your physician's medical opinion about your ability to operate a plane. There are a few conditions that specifically require a new SI [1] but this is not some pseudo-legal/badfaith game.

[0] https://www.faa.gov/documentLibrary/media/Form/FAA_Form_8700...
[1] https://www.aopa.org/advocacy/pilots/medical/basicmed/basicm...
Oh, so that’s what those are! I’ve got a few USB-mini cables (that I think came with a PS3) that have those.
Most of these dorks have no idea what they want, but boy can they talk about they think they want.
It's only dangerous in very predictable circumstances :)

Type-safety guarantees that you won't get any side-effects where the types don't fit.

And if you really want to run untrusted code, scraps are designed to be very easy to inspect :)
Debian-based distros have adopted PEP 668
They're comparable in the same way that 1 year and 50 years are comparable.

Bit of a copout, tbh. I'm gonna assume you don't have a good response for how you somehow aren't culpable for your part in these crimes.
I miss those times, thanks for reminding
Is there any way a stretch limo is more comfortable than an SUV or a minivan? I always suspected that the limo was an artifact of the days when everyone drove sedans.

Doesn't the President of the United States still ride in a stretch limousine? What about other heads of state?
I made something similar for an old nyc apartment intercom buzzer.

Also
Hooked it up to Twilio so I could text a number and it would let me in.

Added passwords and such so I could share it with friends.
I am old enough to remember youtube before monetization, like, comment, and subscribe. It was great. Better than it is now. If others remember the dawn of the Internet, it was a similar feel. People definitely did and still do make videos for free, and actually for free in the sense of the improvement of mankind, not "free" but they are still getting some benefit out of it. If you ask me, those videos are much better than the revenue optimized spam videos made by "content creators".

Wouldn't be sad to see the current ecosystem go. Yes, people would probably start watching more again if they didn't need to wade through ads and pseudo ads.
Recovering from such a mistake is pretty easy too. Roll backs are usually very easy.
I want to be enthusiastic about this technology and at first I was, but it's getting harder. I tried to set up passkeys with the sites listed here that I already have accounts on. Results:

1. PayPal: I could not find an option to do it on either a phone or a web browser even after reading the linked instructions. Perhaps it thinks neither device is compatible (they are).

2. Microsoft: After eventually I found an option inside its settings to go "Passwordless" which sounds right, it instead tries to ram an app called Microsoft Authenticator down my throat. On passkeys.directory I check the instructions for insight and I see it says "All you’ll need is a device running Windows 11 and the Microsoft Edge browser." So much for cross-platform standards. If I had been using Windows 11, I assume I would have still needed my password to log in on my phone or anywhere else.

3. Kayak: Works fine, although the log in option is not as discoverable as it could be (I had to click to log in via email, and then click in the email field, and then an option appeared).

4. Shop Pay: Works fine, the only one about which I have no complaints.
You should check out spark social, I have a plot there and it gets great sunlight. It's a little pricy, but what isn't in sf
therapy notes should be confidential. the patient, and only the patient or a person explicitly authorized by them should have access after the therapy concluded
Same advice applies. Most people have an unnecessary amount of clothing which makes laundry a big job.

You need one set of sheets. But you only need to wash once every 2-4 weeks if you shower before bed. If you do gym and sport, you only need one pair of shorts and jersey. With daily sport, that’s only two outfits to hand wash per day - a quick job.

If you have multiple kids, sure, you might want a washing machine. With minimal clothing you should only need to do one load. Folding can be avoided by hanging clothes.

Alternatively, you could take the opposite route. Have 15-30 outfits and multiple sets of sheets, and only do a big laundry session once per month ;)
Yeah, i hold a simliar view to this author. I think in the next couple years there will be an undercurrent of chaos bubbling from widespread a.i integration and our systems (social systems especially) are not equipped for it.
you're 100% right. people will readily jockey, compete, and gloat over the most artificial relative measures of heirarchy. think parking spots or badges in a video game.
This is the wavefront of a bunch of useful tools to come. I very rarely watch video (for many reasons but mainly because the value/unit time is so low, especially compared to reading) and never listen to podcasts. I get a lot of redundant articles in my various streams (RSS feeds mainly, but twitter, FB, HN, slack, even email and messages).

Would love to funnel all that into a huge summarizer that would pull out the interesting stuff, combine scraps from otherwise mostly overlapping articles, and, yes, even YouTube etc, so I could get the gist plus get to “the” original if desired. I expect to be able to do this very soon (and expect some of those channels to resist…which will simply finish driving me away.
Interesting, I also play jazz with perfect pitch, but I always just think in absolute pitch even when there's a lot of modulation (and also learned my instrument in concert pitch).