MurphyA/hacker-news huggingface dataset:
by loganye | 2025-10-23 01:47:30+00:00
Hi thanks for the reply. We are open-sourced as well! Feel free to check deeptutor repo

https://github.com/KnoWhiz/DeepTutor

https://github.com/KnoWhiz/DeepTutorZotero

https://github.com/KnoWhiz/DeepTutorZotero-reader
by yowlingcat | 2025-10-23 01:49:16+00:00
That's a very good point, and there is probably enough appetite in the endowments (nevermind the other large LP archetypes such as pension funds, hospital systems, family offices, etc) to make up for any pullout.

To go one step further, I think I recall recently that Sequoia also moved to an evergreen RIA structure (as well as several other large funds such as a16z, Lightspeed, Thrive, etc), so that's even less of a concern and makes it possible for these firms to capture exits in the evergreen structure and recycle it into earlier stage funds.

Maybe I went overboard trying to soften how non-material this event really seems.
by glenstein | 2025-10-23 01:49:20+00:00
>Given that the "percentage of stars with planets" part of the Drake equation has recently been determined to be close to 100%

I'm fully with you that the sheer number of planets is one of, if not the most powerful data point we know for sure, that points toward the plausibility of extraterrestrial life. One thing I haven't heard discussed a whole lot though is, what if it's a tug of war, between a preposterously large number of planets, and a correspondingly preposterously small chance of life, that is every bit as impressively small as the number of planets is impressively big?

For whatever reason, it seems like the default attitude is to treat the sheer volume of planets like they more than compensate for the rarity of life. But what it doesn't work like that? There are different versions of this argument that apply to any life at all, and then to intelligent life, so take your pick for the more interesting question.

But in principle it seems like life, and especially multicellular and even more especially intelligent life, very well could be kind of vanishingly rare that's effectively a match in rareness to the universe's vastness.
by throwawayty456 | 2025-10-23 01:49:20+00:00
Your lawyers were probably right, i can see plenty of situations where this would be necessary to strength the notion that the sister company is independent. Sometimes you do not care, but there are situations where this independence is key.

Also keep in mind that if you go court, the judge will be in his 70s as well so is likely to interpret things the same way your lawyers do.
by wahern | 2025-10-23 01:51:02+00:00
There is the old theory about how life is entropy accelerating, and therefore in a grand sense the emergence of life is thermodynamically favored. Though, that says nothing about the absolute chance of it occurring.[1] Our observable universe is far from infinite.

[1] Though maybe it does speak to life tending toward evolving more complex, energy consuming systems, and its propensity to spread out into the universe.
by quantumcotton | 2025-10-23 01:51:43+00:00
It's actually not bad the issue is you need perfect prep and conditions.

We don't pour concrete underneath covers very often. They need it to be perfectly broom, swept and clean. They also need to cover over it just in case to moisture humidity gets down. Once it prints it does stay.

Dusty is a little bit better. The benefit is HP works off of Trimble so if you're in that ecosystem.

Trimble changed their business model so they've increased their profits but they haven't gained any more clients. Essentially they've learned how to double how much they make off of everyone.

You can shoot control off some of these generic models now that cost like four grand and they work just as good. That's less than Trimble subscription cost. I can only imagine the hp bundle coming soon.
by listenallyall | 2025-10-23 01:51:50+00:00
Isn't the job post a joke? The idea was to communicate - to companies looking for an advertising/PR firm - that the owner and existing employees work super-hard and don't take weekends off. Clearly they are exaggerating but a) they did get a lot of attention, b) seem to have a sense of humor and c) let you know they will return your call/email quickly.

Plus maybe the job post will attract one or two lunatics who are passionate and very hard-working.
by liquid_thyme | 2025-10-23 01:51:53+00:00
>You might not think it is, but internet is filled utterly dangerous, scammy, phisy, malwary websites

Google is happy to take their money and show scammy ads. Google ads are the most common vector for fake software support scams. Most people google something like "microsoft support" and end up there. Has Google ever banned their own ad domains?

Google is the last entity I would trust to be neutral here.
by harimau777 | 2025-10-23 01:52:05+00:00
The vast majority of political killers are right wing.

Saying that his daughter is dead to him because she transitioned and working to remove trans rights is a bit more than just being "critical of the trans movement".

Again I don't know what to say. If sharing neo-Nazi material and doing a Hitler salute isn't anti-semitic then I don't know what is.
by FireBeyond | 2025-10-23 01:52:29+00:00
> Meetings upon meetings upon meetings because we are so top heavy that if they weren't constantly in meetings, I honestly don't know what leadership would do all day.

Hah, at a previous employer (and we were only ~300 people), we went through three or four rounds of layoffs in the space of a year (and two were fairly sizeable), ending up with ~200. But the "leadership team" of about 12-15 always somehow found it necessary to have an offsite after each round to ... tell themselves that they'd made the right choice, and we were better positioned for success and whatever other BS. And there was never really any official posting about this on company Slack, etc. (I wonder why?) but some of the C-suite liked to post about them on their LI, and a lot of very nice locations, even international.

Just burning those VC bucks.

> You have to go through a change committee to do basic maintenance. Director levels gatekeep core tools and tech. Lower levels are blamed when projects faceplant because of decades of technical debt.

I had a "post-final round" "quick chat" with a CEO at another company. His first question (literally), as he multitasked coordinating some wine deliveries for Christmas, was "Your engineers come to you wanting to do a rewrite, mentioning tech debt. How do you respond?" Huh, that's an eye-opening question. Especially since I'm being hired as a PM...
by jmcmichael | 2025-10-23 01:53:02+00:00
Regarding Newsom, US states are far more constrained in their spending bc they cannot create money, and must account for their expenditures more like a household or corporation. Social benefit programs, entitlements, etc. must therefore by managed and paid for at the Federal level, just like all of the goods and services that we, as a society, deem it necessary to produce regardless of whether it makes a profit or not - like most of the core transportation infrastructure, the global military empire, fundamental science, engineering, medical research and services, etc.
by paranoidrobot | 2025-10-23 01:53:34+00:00
Lets not leave the Service people out, they want to get a bonus this year, too.

So make the sponge replaceable, but only with a field maintenance call-out. The sponge unit will have an NFC chip in it that if it's removed will lock the unit out until a Technician access code is entered to restore the unit.

We can sell it as a whole periodic maintenance thing - give the service guy a can of air-duster and a roll of paper towel to wipe the thing off.

(I feel dirty even writing this because I'm sure someone is taking notes and thinking these are great ideas)
by Aerroon | 2025-10-23 01:53:37+00:00
>where you can then recast and retrigger them based on present-day experience. It literally is implanting false memories - that’s the point - but you want false memory of the event because the true emotional memory is no longer serving you well in the present.

I have a hard time seeing this. I find it incredibly difficult to fool myself intentionally. Any time I try my brain just remembers it in a way where I don't get fooled.

Also, the mechanism you explained implies that you could get rid of trauma by yourself any time you remembered the traumatic experience and just blasted yourself with another emotion. Eg eat chocolate when you remember that painful fall.
by dangus | 2025-10-23 01:54:41+00:00
Yeah that’s a Toyota problem, not a typical experience of old wired CarPlay systems at all.

And again I’m not making some kind of pro-consumerism buy a new car right now argument, I’m just saying that in 2025 CarPlay and Android Auto are high demand features that a lot of people insist upon.

I’m not making some kind of profound statement on the state of the car industry or whether infotainment is too deeply integrated into vehicles.

I’m just saying if it was time for me to buy a new car I’m thinking twice about buying something that’s not giving me phone mirroring, just like I want my car to have FM radio even if I rarely or never use it.
by gnabgib | 2025-10-23 01:55:45+00:00
56 bytes (9 months ago - Popular, 138 points, 14 comments): https://news.ycombinator.com/item?id=42675882

57 bytes (2024): https://news.ycombinator.com/item?id=42348294

61 bytes (2024): https://news.ycombinator.com/item?id=38962792

67 bytes (2023): https://news.ycombinator.com/item?id=38060165

85 bytes (2023 - Popular, 134 points, 24 comments): https://news.ycombinator.com/item?id=36999463

89 bytes (2023): https://news.ycombinator.com/item?id=36940010

100 bytes (2023): https://news.ycombinator.com/item?id=36933804

134 bytes (2023): https://news.ycombinator.com/item?id=36733256
by CJefferson | 2025-10-23 01:55:51+00:00
I used to use a python program called ‘fabricate’ which did this. If you track every file a compiler opens, then id the same compiler is run with the same flags, and no input changed, you can just drop a cached copy of the outputs in place.

I’m actually disappointed this type of thing never caught on, it’s fairly easy on Linux to track every file a program accesses, so why do I need to write dependency lists?
by Nursie | 2025-10-23 01:56:37+00:00
> I think there is a bit of a crowd that is pushing the idea that you can make events worse by telling people that they are forever scarred from them?

There was certainly a fairly prominent British psychologist (IIRC) a handful of years ago who disparaged some of the anxiety and depression awareness campaigns on the grounds that being more aware of psychological ailments like that, when they were on the minor end of the scale and not actually debilitating, was probably unhelpful. That actually in his opinion "suck it up and get on with your life" might be the best advice sometimes, because such conditions can become self-fulfilling, and getting on with your life, doing stuff and achieving things might be the best remedy. Rather than dwelling on the problem and giving yourself the excuse "I am depressed/anxious"

I don't know how/if that maps to trauma, and there was a lot of backlash...
by NoMoreNicksLeft | 2025-10-23 01:58:40+00:00
Those are poor identifiers. A numeric or short alphanumeric identifier that can be part of the filename is important... I have as many as 5 different editions of the same title so title+author doesn't do the trick. Nor am I putting a url into the filename, couldn't if I wanted to as there are disallowed characters in a url in every filesystem I've ever heard of. How difficult is it to keep a incrementing catalog number like Project Gutenberg does? Anything that doesn't have a proper unique just seems unprofessional.
by xp84 | 2025-10-23 01:59:22+00:00
Sounds reasonable enough to me. 99.99% of the times you’re in an actual script, if you mean to execute code, you’d just execute it yourself, rather than making a script tag full of code and sticking that tag into a random DOM element. That’s why the default wouldn’t honor the script tag and there’d be an “unsafe” method explicitly named as such to hint you that you’re doing something weird.
by scotty79 | 2025-10-23 02:00:54+00:00
I couldn't imagine how rendering text tokens to images could bring any savings, but then I remembered esch token is converted into hundreds of floating point numbers before feeding it to neural network. So in a way it's already rendered into a multidimensional pixel (or hundreds of arbitrary 2-dimensional pixels). This papers shows that you don't need that many numbers to keep the accuracy and that using numbers that represent the text visually (which is pretty chaotic) is just as good as the way we currently do it.
by 0xbadcafebee | 2025-10-23 02:02:11+00:00
In the past, browsers used an algorithm which only denied setting wide-ranging cookies for top-level domains with no dots (e.g. com or org). However, this did not work for top-level domains where only third-level registrations are allowed (e.g. co.uk). In these cases, websites could set a cookie for .co.uk which would be passed onto every website registered under co.uk. Since there was and remains no algorithmic method of finding the highest level at which a domain may be registered for a particular top-level domain (the policies differ with each registry), the only method is to create a list. This is the aim of the Public Suffix List. (https://publicsuffix.org/learn/)

So, once they realized web browsers are all inherently flawed, their solution was to maintain a static list of websites.

God I hate the web. The engineering equivalent of a car made of duct tape.
by tharkun__ | 2025-10-23 02:02:58+00:00
This.

3 year is not a beater. My dad used to buy a new car every 3 years, back in the hey days when his company would have a deal with the local dealership (of one particular brand that they like for some reason - probably CEO friendship or something) to get their employees better terms (without negotiating), so we enjoyed a new car every 3-ish years when I was a kid. But that's not a beater.

The beater cars I owned were about 10 years old when I bought them. And I drove them for like 3-ish more years before selling again.
by quotemstr | 2025-10-23 02:03:03+00:00
The earlier Galileo hack was also impressive. The high gain antenna (necessary for its high speed data link) got stuck trying to unfurl and so the whole mission had to rely on the low-gain, low-speed backup antenna --- which topped out at a glorious speed of ~10 bits per second.

"The Galileo mission operations concept is undergoing substantial redesign, necessitated by the deployment failure of the High Gain Antenna, while the spacecraft is on its way to Jupiter. The new design applies state-of-the-art technology and processes to increase the telemetry rate available through the Low Gain Antenna and to increase the information density of the telemetry. This paper describes the mission planning process being developed as part of this redesign. Principal topics include a brief description of the new mission concept and anticipated science return (these have been covered more extensively in earlier papers), identification of key drivers on the mission planning process, a description of the process and its implementation schedule, a discussion of the application of automated mission planning tool to the process, and a status report on mission planning work to date. Galileo enhancements include extensive reprogramming of on-board computers and substantial hard ware and software upgrades for the Deep Space Network (DSN). The principal mode of operation will be onboard recording of science data followed by extended playback periods. A variety of techniques will be used to compress and edit the data both before recording and during playback. A highly-compressed real-time science data stream will also be important. The telemetry rate will be increased using advanced coding techniques and advanced receivers. Galileo mission planning for orbital operations now involves partitioning of several scarce resources. Particularly difficult are division of the telemetry among the many users (eleven instruments, radio science, engineering monitoring, and navigation) and allocation of space on the tape recorder at each of the ten satellite encounters. The planning process is complicated by uncertainty in forecast performance of the DSN modifications and the non-deterministic nature of the new data compression schemes. Key mission planning steps include quantifying resource or capabilities to be allocated, prioritizing science observations and estimating resource needs for each, working inter-and intra-orbit trades of these resources among the Project elements, and planning real-time science activity. The first major mission planning activity, a high level, orbit-by-orbit allocation of resources among science objectives, has already been completed; and results are illustrated in the paper. To make efficient use of limited resources, Galileo mission planning will rely on automated mission planning tools capable of dealing with interactions among time-varying downlink capability, real-time science and engineering data transmission, and playback of recorded data. A new generic mission planning tool is being adapted for this purpose."

https://ui.adsabs.harvard.edu/abs/1994smog.symp..279G/abstra...
by nl | 2025-10-23 02:03:19+00:00
Kapathy's points are correct (of course).

One thing I like about text tokens though is that it learns some understanding of the text input method (particularly the QWERTY keyboard).

"Hello" and "Hwllo" are closer in semantic space than you'd think because "w" and "e" are next to each other.

This is much easier to see in hand coded spelling models, where you can get better results by including a "keybaord distance" metric along with a string distance metric.
by qnleigh | 2025-10-23 02:03:57+00:00
The quantum algorithm that would break certain kinds of public key cryptography schemes (not even the core part of Bitcoin blockchains, which are not vulnerable to quantum computers) will take days to weeks to break a single key [0]. This is another reason why we will have plenty of warning before quantum computing causes any major disruptions to daily life.

What I would start worrying about is the security of things like messages sent via end-to-end encrypted services like WhatsApp and Signal. Intercepted messages can be saved now and decrypted any time in the future, so it's better to switch to more robust cryptography sooner rather than later. Signal has taken steps in this direction recently: https://arstechnica.com/security/2025/10/why-signals-post-qu....

[0] https://arxiv.org/pdf/2505.15917
by dinkelberg | 2025-10-23 02:05:06+00:00
I do not think that GP's comment was meant that way. GP simply wanted to clear up a misunderstanding that was apparently created by the renaming of this thread to "Greg Newby, CEO of Project Gutenberg, has died", which has been undone since. I am sure GP did not mean to detract from Greg Newby's contributions to the project.
by dcassett | 2025-10-23 02:05:23+00:00
I find that I like working with the directory stack and having a shortened version of the directory stack in the title bar, e.g. by modifying the stock Debian .bashrc

# If this is an xterm set the title to the directory stack case "$TERM" in xterm*|rxvt*) if [ -x ~/bin/shorten-ds.pl ]; then PS1="\[\e]0;\$(dirs -v | ~/bin/shorten-ds.pl)\a\]$PS1" else PS1="\[\e]0;${debian_chroot:+($debian_chroot)}\u@\h: \w\a\]$PS1" fi ;; \*) ;; esac

The script shorten_ds.pl takes e.g.

0 /var/log/apt 1 ~/Downloads 2 ~

and shortens it to:

0:apt 1:Downloads 2:~ #!/usr/bin/perl -w use strict; my @lines; while (<>) { chomp; s%^ (\d+) %$1:%; s%:.*/([^/]+)$%:$1%; push @lines, $_ } print join ' ', @lines;

That coupled with functions that take 'u 2' as shorthand for 'pushd +2' and 'o 2' for 'popd +2' make for easy manipulation of the directory stack:

u() { if [[ $1 =~ ^[0-9]+$ ]]; then pushd "+$1" else pushd "$@" fi } o() { if [[ $1 =~ ^[0-9]+$ ]]; then popd "+$1" else popd "$@" # lazy way to cause an error fi }
by antonvs | 2025-10-23 02:05:39+00:00
It was technically "interstellar", but given its actual position - still inside the Oort Cloud, for example - it's a bit misleading.

It'd still take another 70+ thousand years for it to reach another star, if it was even heading in the optimal direction for that. That makes it less than 0.07% of the way to the nearest star. At interstellar scales, it's basically still on Earth's surface.
by elevation | 2025-10-23 02:07:07+00:00
I followed a story of a Californian mining company, hoping to develop a new rare earth mine. At market rates for rare earth materials, it would have been about 50 years before investors would see a return on investment. So when China temporarily flooded the market with rare earth materials, investors vanished.

Is there a mutual fund I could buy that would invest in strategic US mining ventures? And wouldn’t drop them at the first sign of market manipulation?
Ask HN: Should my business focus on AI training data instead?
by aluxnder | 2025-10-23 02:08:02+00:00
I run a YouTube operation built on high-quality, screen-recorded software tutorials. We’ve produced 75k videos (2–5 min each) in a couple of months using a trained team of 20 operators. The business is profitable, and the production pipeline is consistent, cheap and scalable.

However, I’m considering whether what we’ve built is more valuable as AI agent training/evaluation data. Beyond videos, we can reliably produce:

- Human demonstrations of web tasks

- Event logs, (click/type/url/timing, JSONL) and replay scripts (e.g Playwright)

- Evaluation runs, (pass/fail, action scoring, error taxonomy)

- Preference labels with rationales (RLAIF/RLHF)

- PII-safe/redacted outputs with QA metrics

I’m looking for some validation from anyone in the industry:

1. Is large-scale human web-task data (video + structured logs) actually useful for training or benchmarking browser/agent systems?

2. What formats/metadata are most useful (schemas, DOM cues, screenshots, replays, rationales)?

3. Do teams prefer custom task generation on demand or curated non-exclusive corpora?

4. Is there any demand for this? If so any recommendations of where to start? (I think i have a decent idea about this)

Im trying to decide whether to formalise this into a structured data/eval offering. Technical, candid feedback is much appreciated!
by tharkun__ | 2025-10-23 02:08:18+00:00
Hey, personally I agree. Why would I ever go with Oracle.

But that's A) me personally and B) me in Cloud/Startup type companies, so of course we don't got with Oracle.

But like you mentioned, inertia. So my previous gigs that were large multi-national of course were all Oracle. And they were all huge and had zero reason to not just buy the Oracle tax. Which is why Oracle is going strong.

Despite all the rage, Oracle can still survive quite some time on running boring things like I don't know, many large banks and other boring old businesses. Which of those is really gonna go "AWS Aurora MySQL" when the have had an in-house "Oracle Exadata" run their entire business operation "just fine" for longer than those Cloud providers have even be around?
by frumplestlatz | 2025-10-23 02:09:57+00:00
Sounds like it :) I’ve been very happy with Mail.app since MacOS 10.0. My use has always been with my employer’s IMAP servers, and my own cryus (and eventually) dovecot self-hosted IMAP servers.

Mail.app is what NeXT used internally, and Apple uses to this day AFAIK. Steve Jobs historically paid a lot of attention to it and wasn’t shy about weighing in on any changes.

Most of the complaints that I’ve heard about it seemed to stem from poor IMAP servers (e.g. Gmail), but it sounds like your knowledge in the space would be a lot more detailed and recent than mine, so I would be very interested in your thoughts.