MurphyA/hacker-news huggingface dataset:
by rayiner | 2025-05-27 01:46:29+00:00
Immigration is about the movement of large numbers of people. It makes no sense to think about immigration in terms of individual immigrants. 1 Bangladeshi immigrant could be anybody. 270,000 Bangladeshi immigrants (as we have in the U.S. today) is a group you can analyze statistically and draw conclusions about.

As to Bangladeshi Americans generally, they’re probably a net negative economic contributor. Their median household income is 15% lower than for white americans, and the real gap is probably even larger because they’re concentrated in high-income states (New York, California).

Though the situation in the U.S. likely isn’t as bad as the one in Denmark or the UK. The anchor population of Bangladeshis in the U.S. are people like my family who came over on H1, which is a very small (only 65,000 annually), unusual population (e.g., my grandfather studied medicine in London).[1] Family reunification dilutes the pool a lot in the U.S. But the pool is far more skilled and employable than the Bangladeshi immigrant pool in say the U.K. In the UK, only 58% of working age Bangladeshis are employed, and the poverty rate is 46%. Bangladeshi immigration to the UK isn’t a “great deal”—it’s reparations for colonialism.

[1] In the U.S., our priors about immigration from the subcontinent are based on immigrants from the 1970s-1990s, i.e. a small number of highly educated people who were already somewhat assimilated into Anglo culture from British colonial influence. Pre-H1B, they also tended to move to random places around the U.S. rather than concentrating in ethnic enclaves, which forced a greater degree of assimilation. So you think about guys like Ro Khanna, who grew up as like the only Indian kid in Newton, PA. That doesn’t reflect the kids growing up in Little Bangladesh in Queens today.
by JoshTriplett | 2025-05-27 01:46:54+00:00
> The important parts of life (like interviews)

Interviews shouldn't be "exam conditions" either. See the ten thousand different articles that regularly show up here about why not to do the "invert a binary tree on a whiteboard" style of interview.

There are much better ways to figure out people's skills. And much better things to be using in-person interview time on.
by SamBam | 2025-05-27 01:47:37+00:00
The unstated assumptions, common in all the other puzzles of the kind, are that the farmer wants to bring everything across, nothing is to be eaten by anything else, everything must be brought over by boat, and the farmer can only bring one thing in the boat at a time. Anything left with something that will eat another thing will eat it.

This variation of the classic puzzle is unsolvable. If you have a solution, let me know.
by kacesensitive | 2025-05-27 01:48:29+00:00
Yeah so we didn't want to build out anything that invades your inbox, for privacy concerns, I know I would not feel comfortable with that.

So we've curated a ton of the top newsletters and made the process of adding them to the platform super easy. You just subscribe to them within Scrollz. If you sign up and have any that you're missing we can get them added in no time!
by jrowen | 2025-05-27 01:49:37+00:00
That's interesting. I didn't consider that it was AI at any point while reading it, and I don't use it very much. Going back I see what people are saying but I think it's more cohesive and compelling than what AI would write.

I agree that it's more of a "key takeaways" than a critical review but I appreciated that the author didn't make it about themself.
by kjellsbells | 2025-05-27 01:49:38+00:00
I dont sense much love in the comments, but I find this kind of computing niche kind of useful. There is more to life than arguments over Rust. Computer systems can have lifetimes measured in multiple generations. Etc. It is interesting to see what is going on elsewhere in the galaxy, so to speak.

These guys seem passionate about what they do in the same way that other niche companies are, e.g. Isode with X.400 or Arca Noae on OS/2. Good luck to them.

The blurb for their lead guy claims he's been involved in PL/I since 1965. I'm estimating that would make him 80 now. If he is still cranking out compiler code at 80 I hope this is a golden years/fun project for him.
by nchmy | 2025-05-27 01:51:04+00:00
Believe it or not, I have a high level of understanding of my native language as well - as surely most 2nd language learners do.

You don't even need to know any grammatical terms (I barely do for English, and suspect most people don't either for their native language), so long as you can speak a language. Like, I don't have a clue what past participle or present perfect tense mean in either language. Nor do I particularly need to know them.

Though, I'll admit that it would surely be easier to learn Spanish if I knew and understood the equivalent constructs in English. Case in point - when I was a kid and they taught us French in school, it was just an exercise in memorization rather than understanding, because they hadn't taught us the English versions. Apparently that's just what happened where I'm from for an extended period of time. Yet, I'm very significantly literate.

Still, you just ask chatgpt "how do I say _ in Spanish?" and then ask questions with variations for subject, object, tense, etc. You obviously would start easy "how do I say 'I eat bread'", but can progress to 'I ate/will eat/am going to eat/had eaten/would have eaten/could eat bread'

And you could eventually make it quite complicated eg "if you had told me xyz as you should have, I would have asked him about it. Now I am hoping that etc..." There's a huge mix of grammatical concepts in that (and I know very few of their names), and chatgpt would easily translate it and explain the concepts to whatever degree I desire.

If I was sufficiently motivated, I am quite sure that chatgpt could rapidly and effectively teach me all English and Spanish grammar.

Perhaps it would be a different story if learning something wildly different - eg Vietnamese. Yet, there's surely still similar constructs underlying it, since they all have to reflect the same world.
by AdieuToLogic | 2025-05-27 01:51:35+00:00
Interesting. Thank you for your detailed explanation.

A related Scala-specific technique for this problem category is employing the Stackable Trait Pattern[0] to provide a functional style AOP[1] mechanism. Done carefully, effects (aspects) can be defined independent of specific logic as well as composed with provable invocation order.

Note that the references cited are for those reading this thread and not assumed to be required for the person addressed.

0 - https://www.artima.com/articles/scalas-stackable-trait-patte...

1 - https://en.wikipedia.org/wiki/Aspect-oriented_programming
by magicalhippo | 2025-05-27 01:52:32+00:00
Was not familiar with the details of mass spectography.

Found this[1] page which includes an explanation of how it works, and also shows some analysis using the Spectra R package.

The SpectraQL[2] package adds MassQL support to Spectra, so one can compare a bit.

[1]: https://uclouvain-cbio.github.io/WSBIM2122/sec-ms.html

[2]: https://doi.org/doi:10.18129/B9.bioc.SpectraQL
by lzy | 2025-05-27 01:54:04+00:00
The TeleMessage dataset is massive and messy, and this tool lowers the barrier for journalists and researchers to extract meaningful insights. It’s also a reminder that “secure” enterprise tools often aren’t—especially when they’re built to satisfy compliance checkboxes rather than actual security principles. The fact that TM Signal was used by senior officials makes the plaintext logging and key exposure even more alarming. Kudos to Micah for not just reporting the breach but also enabling others to dig deeper.
by crq-yml | 2025-05-27 01:55:37+00:00
Yesterday, the operators of Artfight, the yearly art trading game, reported a breach that affected perhaps a few hundred people(an XSS attack through a news post comment that scooped up autofill information). Users were panicked, in large part because they never hear about breaches affecting them.

I believe the industry should work towards mandating communication on these incidents instead of maintaining the charade that nothing is happening. This needs to come through one of legislation or labor action.
by HALtheWise | 2025-05-27 01:56:16+00:00
I highly recommend revup, it allows managing and uploading stacked (or arbitrary trees of) PRs to Github, including adding a comment that shows approximate revision-to-revision diffs if you want it to. I don't actually think that per-commit reviewing obviates the desire for stacked PRs, for example I often have some PRs in my stack that are not yet ready for review or merging.

https://github.com/Skydio/revup
by swat535 | 2025-05-27 01:56:51+00:00
> Catholics would be saying it's the literal body of Christ. And they they dropped it to the floor and went 'well, I can't eat that'

When Catholics say this, they mean Transubstantiation.

As in, it retains the accidents (physical/observable properties) of bread and wine, but its substance (what it is) does literally become the body, blood, soul, and divinity of Christ.

So it might look, feel, and taste like bread and wine, but it is in fact the body of Christ.

So, kind of both..
by gonzobonzo | 2025-05-27 02:00:09+00:00
Talk is cheap; if you want to see what people really believe, ignore what they claim and look at what they actually do. And when you do that, you see that people generally don't find typical college classes to be worth it outside of the credentials they give. Almost no one with a CS degree goes back to college to take a college algorithm course when they want to get better at algorithms; they study on their own. You can look at plenty of the HN discussions about "how do I learn X" or "how do I get better at X"; almost none of the suggestions are "go to your local university and audit some classes."

The issues with Edutech are mostly because they're bolting it on to the same broken system that people don't find value in. But the original comment wasn't about Edutech. When people want to learn new things, they largely do it without either typical college classrooms or Edutech, because the alternatives are so much better than anything coming out of the broken academic morass.
by Breza | 2025-05-27 02:01:26+00:00
I really identify with your first paragraph. I enjoyed writing for the school paper and programing in high school, but I didn't see much of a future in either, for different reasons (death of print and offshoring). I graduated around the time that 538 launched a new appreciation for data-driven journalism, so maybe I could have been in a good position.

I ended up running the data science division at a digital publisher, so I guess I backed into that space after all.
by mrlatinos | 2025-05-27 02:02:34+00:00
Not OP but we sound very similar. I wear a CPAP as well as a night guard. My dentist ordered me a "Max Occlusal Guard H/S Daytime" - it covers my upper teeth, has a hard outer shell and a softer lining. It's very thin and I can use it during the day (as long as I'm not talking) to prevent bruxism. I've used the cheaper Amazon ones - the ones from your dentist are well worth the cost.
by sargstuff | 2025-05-27 02:03:15+00:00
(IMHO) perhaps ide box as an intermediate step. aka sqwak box with support for ascii animations.[0] Then, can present a "sqwak like an egyptian" demo. Perhaps extened support for converting data to floppy[1] / modem[2] sounds.

[0] : https://github.com/octobanana/asciimation

[1] :a) https://www.youtube.com/watch?v=D2iswCnV9ec

b) https://www.youtube.com/watch?v=kCCXRerqaJI

[2] : https://www.youtube.com/watch?v=k992RwXBbrY
by lzy | 2025-05-27 02:03:25+00:00
Interesting to see real-time AI copilots moving into the sales domain with this level of polish. The UI looks thoughtful, and the emphasis on SOC 2/GDPR compliance is smart. Sales orgs are often stuck between tooling that’s either too lightweight or too intrusive. I’m curious how well Nomi performs with accents or less structured conversations, which are common in outbound calls. Also wondering if reps actually trust or tune out live suggestions mid-call. Real-time assistance sounds great in theory, but in practice it can be distracting unless executed really well.
by grogenaut | 2025-05-27 02:03:35+00:00
You can.

I did a remote proctored exam for the NREMT last year. They had me walk the camera around the room, under the desk, etc. All devices had to be in my backpack. No earbuds. They made me unplug the conference tv on the wall, lift picture frames etc. I had to keep my hands above the table the whole time, I couldn't look down if I was scratching an itch. They installed rootkit software and closed down all of the apps other than the browser running the test. They killed a daemon I run on my own pcs that is custom. They are recording from the webcam the whole time and have it angled so they can see. They record audio the whole time. I accidentally alt tabbed once and muted the mic with a wrong keyboard, those were first and second warning within 5 seconds.

When you take the test in a proctored testing center location they lock all of your stuff in a locker, check your hands, pockets, etc. They give you earplugs. You use their computer. They record you the whole time. They check your drivers license and take a fingerprint.

Those methods would stop a large % of your attack vectors.

As do the repercussions:

A candidate who violates National Registry policies, or the test center's regulations or rules, or engages in irregular behavior, misconduct and/or does not follow the test administrator's warning to discontinue inappropriate behavior may be dismissed from the test center. Exam fees for candidates dismissed from a test center will not be refunded. Additionally, your exam results may be withheld or canceled. The National Registry of EMTs may take other disciplinary action such as denial of National EMS Certification and/or disqualification from future National Registry exams.

At a minimum you're paying the $150 fee again, waiting another month to get scheduled and taking another 3 hours out of your day.
by gtani | 2025-05-27 02:03:51+00:00
here's 2 oft cited papers on PFOF so people can think about this, general conclusions are there is more possibility of actions detrimental to retail traders in options markets

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4609895

https://wifpr.wharton.upenn.edu/wp-content/uploads/2023/10/P...
by bitpush | 2025-05-27 02:04:20+00:00
What's old is now new again. The fashion industry has known this for decades, and the tech industry is catching up to that.

You know what comes after "dimensional" design? Radicial minimalism.

"Once you strip away everything extra, everything ornamental, what remains is the truth, and nothing more" There, I wrote a tagline for design trend of 2030.
by staticshock | 2025-05-27 02:04:40+00:00
Ignoring for the moment the fact that this particular article is a book summary, a task LLMs excel at, it's interesting that the (warranted) comparison to LLM outputs casts doubt on the credibility of the writing, and in some ways maybe even caps its implied utility.

Just like how human beings choose different ways of presenting themselves to the world (e.g. masculine/feminine, gay/straight, goth/punk/preppy) as a form of social signaling, today's LLMs emit a certain "I'm AI" signal that humans pick up on, and human writers will likely have to continue evolving the counter-position(s) to that signal.

If the results of relatively simple, unsophisticated prompts get better at passing for human-written articles/blog posts/forum comments/etc, that'll increase the fraction of human writing that falls into this uncanny valley, and exacerbate the need for stronger counter-positioning over time.
by tuetuopay | 2025-05-27 02:05:08+00:00
There seems to be multiple people at videolan dunking on rav1d, in notable part due to how it was done (transpile C to Rust, and cleanup afterwards). Perhaps they're Rust purists and don't think that's how it should have been done. Or perhaps they're not happy that rav1d proclaims that Rust is (almost) as fast as C when all the performance engineering efforts went in the ASM bits, that were copied verbatim from dav1d.

My best guess would be for the same reasons the ffmpeg twitter account has shown a lot of vitriol too: funding taken away from the original project towards another effort.
by cobyte8 | 2025-05-27 02:05:32+00:00
> using jj was like riding a bike

This has been my experience as well! I haven't had success conveying that to my peers at work (or outside), but your comment resonates with me deeply.

> If you forget to start a new rev before you (or your LLM) touch the repo, it's a little bit of a pain to go back and split the changes into a new rev.

This is one area where I broke my Fig habits and just switched to a the [Squash workflow](https://steveklabnik.github.io/jujutsu-tutorial/real-world-w...): I basically forbid myself from use `jj edit` and have been pretty successful in getting that to stick in my brain. Instead, I use `jj new` to switch contexts (and then `jj commit`, `jj squash`, or `jj absorb` depending on what I'm trying to achieve).

> Some of the more mature repos I've worked with have tooling/scripts/tests/etc. that seem to look for or rely on the presence of .git (perhaps indirectly).

Yeah, I've noticed this too. I find that the most common root cause is usually something that wants to run a lint tool only against the files that you've changed so it does something to the effect of `git diff --name-only $(git merge-base HEAD origin/main)`. I've also noticed that some precommit hooks have been working better since I enabled the `git.subprocess` option (which is on by default as of recently, I believe).
by neom | 2025-05-27 02:06:02+00:00
I've been hiring people for the better part for 15 years and I never considered them to be valuable outside of the fact that it appears you're able to do one project for a sustained period of time. My impressions was unless your degree confers something such that you are in a job that human risk can be involved, most degrees are worth very little and most serious people know that.
by unlord | 2025-05-27 02:06:43+00:00
Someone asked about benchmarks, so I ran these just now to bring data to the discussion:

nathan@arm1:~/git/rav1d.new/target$ hyperfine --warmup 2 "release/dav1d -q -i ~/Chimera-AV1-8bit-1920x1080-6736kbps.ivf -o /dev/null --threads 8" Benchmark 1: release/dav1d -q -i ~/Chimera-AV1-8bit-1920x1080-6736kbps.ivf -o /dev/null --threads 8 Time (mean ± σ): 31.532 s ± 1.971 s [User: 244.512 s, System: 1.644 s] Range (min … max): 28.498 s … 34.270 s 10 runs nathan@arm1:~/git/dav1d.new/build$ hyperfine --warmup 2 "tools/dav1d -q -i ~/Chimera-AV1-8bit-1920x1080-6736kbps.ivf -o /dev/null --threads 8" Benchmark 1: tools/dav1d -q -i ~/Chimera-AV1-8bit-1920x1080-6736kbps.ivf -o /dev/null --threads 8 Time (mean ± σ): 29.696 s ± 2.308 s [User: 230.507 s, System: 1.479 s] Range (min … max): 26.618 s … 35.105 s 10 runs

It shows that as of this moment rav1d is (31.532 - 29.696)/29.696 * 100 = 6.2% slower to decode this Netflix test sequence. Note, this is an improvement from the (32.775 - 29.696)/29.696 * 100 = 10.4% when Prossimo posted a bounty for improving rav1d [1]:

nathan@arm1:~/git/rav1d.old/target$ hyperfine --warmup 2 "release/dav1d -q -i ~/Chimera-AV1-8bit-1920x1080-6736kbps.ivf -o /dev/null --threads 8" Benchmark 1: release/dav1d -q -i ~/Chimera-AV1-8bit-1920x1080-6736kbps.ivf -o /dev/null --threads 8 Time (mean ± σ): 32.775 s ± 2.694 s [User: 254.120 s, System: 1.659 s] Range (min … max): 28.847 s … 37.606 s 10 runs

None of this is particularly new, I reported this gap in performance over a year ago [2]. Here are some questions for HN:

Even if rav1d closes the gap, who will ship rav1d over dav1d? More than 85% of dav1d is hand written assembly that rav1d takes as-is and calls via unsafe blocks. Is this really memory safety?

The dav1d improvements must continuously be backported to rav1d, see the 82 closed PR's here [3]. Who is going to pay for this maintenance in perpetuity?

VideoLAN fuzzes dav1d and fixes bugs extremely quickly, typically less than 24h. The rav1d developers are Rust experts, but not codec experts. Is it reasonable to expect the same support?

[1] https://www.memorysafety.org/blog/rav1d-perf-bounty/

[2] https://github.com/memorysafety/rav1d/issues/804

[3] https://github.com/memorysafety/rav1d/pulls?q=backport+is%3A...
by pj_mukh | 2025-05-27 02:07:56+00:00
The legality of Copyright material being present in the latent space of a commercialized foundation model would definitely be an interesting case!

Though most of these cases aren't litigating this. They are charging that the ability to recreate copyrightable material is the fault of the tool and not the tool user[1].

[1]: https://www.darrow.ai/resources/ai-copyright-law
by username223 | 2025-05-27 02:08:25+00:00
How do you sanitize user input to an LLM? You can't!

Programmers aren't even particularly good at escaping strings going into SQL queries or HTML pages, despite both operations being deterministic and already implemented. The current "solution" for LLMs is to scold and beg them as if they're humans, then hope that they won't react to some new version of "ignore all previous instructions" by ignoring all previous instructions.

We experienced decades of security bugs that could have been prevented by not mixing code and data, then decided to use a program that cannot distinguish between code and data to write our code. We deserve everything that's coming.
by ZYbCRq22HbJ2y7 | 2025-05-27 02:08:30+00:00
> I know that no one else in the whole world did this because when I did it originally I looked for it.

Not convincing, but plausible. Not many things that humans do are unique, even when humans are certain that they are.

Humans who are certain that things that they themselves do are unique, are likely overlooking that prior.
by akoboldfrying | 2025-05-27 02:08:37+00:00
Agree.

OP's approach is actually terrible for video compression, because it actively throws away the locality of pixel changes present in typical video.

A nicer way of putting it would be that nothing about OP's technique is specific to video frames -- the same idea could be used to compress the diff between any two equal-length bit sequences. Might this nevertheless turn out to be better than existing forms of compression for this problem, like gzipping the concatenated pair of blocks? No, because the only way you get compression at all is if the distribution of inputs (here, sets of different bit positions) is highly predictable, i.e., nonrandom -- and pushing data through a hash function actively destroys that (especially if it's a cryptographically strong hash, the whole point of which is to produce output that is indistinguishable from random).
by Covenant0028 | 2025-05-27 02:08:40+00:00
Another thing that would permanently taint models and open their creators to lawsuits is if they were trained on many terabytes worth of pirated ebooks. Yet that didn't seem to stop Meta with Llama[0]. This industry is rife with such cases; OpenAI's CTO famously could not answer a simple question about whether Sora was trained on Youtube data or not. And now it seems they might be trained on video game content [1], which opens up another lawsuit avenue.

The key question from the perspective of the company is not whether there will be lawsuits, but whether the company will get away with it. And so far, the answer seems to be: "yes".

The only exception that is likely is private repos owned by enterprise customer. It's unlikely that GitHub would train LLMs on that, as the customer might walk away if they found out. And Fortune 500 companies have way more legal resources to sue them than random internet activists. But if you are not a paying customer, well, the cliche is that you are the product.

[0]: https://cybernews.com/tech/meta-leeched-82-terabytes-of-pira... [1]: https://techcrunch.com/2024/12/11/it-sure-looks-like-openai-...