MurphyA/hacker-news huggingface dataset:
by chasil | 2025-05-12 16:40:29+00:00
Shell vi mode is part of the POSIX standard, but emacs is not.

Dash has an option to be built with libedit that supports set -o vi. It should very much be built this way.

"[set -o] vi: Allow shell command line editing using the built-in vi editor. Enabling vi mode shall disable any other command line editing mode provided as an implementation extension. This option shall be supported if the system supports the User Portability Utilities option.

"It need not be possible to set vi mode on for certain block-mode terminals."

https://pubs.opengroup.org/onlinepubs/9799919799/utilities/ [V3_chap02.html]
by Retric | 2025-05-12 16:40:47+00:00
France lost an incredible amount of money on nuclear through capacity factor issues. The numbers are so bad they don’t want to admit what they are.

However a reasonable argument can be made the public benefited from externalities like lower pollution and subsidized electricity prices even if it was a money pit and much of the benefit was exported to other countries via cheap off peak prices while France was forced to import at peak rates.
by Timon3 | 2025-05-12 16:42:07+00:00
I mean sure, I can probably find Lazarus if searching for a Delphi IDE. But please explain: what's the advantage? They save a couple of bytes in storage for the forum post, and besides that, what do you get apart from a sense of elitism due to those outside of the ecosystem not getting much from the announcement post? I don't see anything besides gatekeeping.

Fewer people will know the project in the context it's meant to be used. That seems strictly negative. What's the positive?
by monster_truck | 2025-05-12 16:42:57+00:00
That's the fun part, you can use all of them! And you don't need to use browser plugins or console scripts to auto-retry failures (there aren't any) or queue up a ton of tasks overnight.

Have a 3950X w/ 32GB ram, Radeon VII & 6900XT sitting in the closet hosting smaller models then a 5800X3D/128GB/7900XTX as my main machine.

Most any quantized model that fits in half of the vram of a single gpu (and ideally supports flash attention, optionally speculative decoding) will give you far faster autocompletes. This is especially the case with the Radeon VII thanks to the memory bandwidth.
by tedivm | 2025-05-12 16:43:59+00:00
No one said that TOS's override the law.

If you shout something in public, someone might hear you. If you shout in a locked house they won't hear you unless they break in.

If you post something publicly on the internet, then people can look at it. If you post something privately on the internet, people have to agree to your terms to view it.

That's it, that's the logic the government uses to allow website scraping.
by 1vuio0pswjnm7 | 2025-05-12 16:44:39+00:00
Works where archive.ph is blocked:

https://www.msn.com/en-us/money/careersandeducation/the-high...

Text-only:

https://assets.msn.com/content/view/v2/Detail/en-in/AA1EjI7E
by usrbinenv | 2025-05-12 16:44:40+00:00
On a purely syntactic level snake_case gives me a clear indication this is something different (not a module). But the underlying mechanics of how namespaces would work, as I've mentioned in another comment, is that the choice of picking namespace identifiers is shifted to users of gems/libraries. I think the proposal might further benefit from maybe giving libraries default namespaces and, for example, Go does exactly this: you can import a package with the namespace prefix defined by package author, but you can also change it or import it without a namespace prefix at all.
by potato3732842 | 2025-05-12 16:45:48+00:00
We have a used tool store like this near where I live. While technically being within city limits of the county seat it's located in the kind of population density that HN turns up its nose at for being unsustainable. But it's fairly easy to get to off a couple major highways so in practice it's more accessible to the kind of people who tend to need rebar tying guns and chain come alongs than it would be if it were downtown. It's possible it couldn't even exist downtown because its inventory might not turn over fast enough to pay the rent.
by winwang | 2025-05-12 16:45:59+00:00
Still figuring out pricing! For our first customers, we're doing pricing as either bytes scanned or by compute time, similar to BigQuery. Also experimenting with a contract that also gives the minimum of the two potential charges (up to a sustainable limit).

However, for deployments to the customer's cloud, it would be a stereotypical enterprise license + support.

Can't wait to actually add an FAQ to the site, hopefully based off the questions asked here. Pricing is one of the things preventing me from just allowing self-serve, since it has to be stable, sustainable, and cheap!

Also, with the GPU clouds, pricing would have to be different per cloud, though I guess I can worry about that later. Would be crazy cheap(er) to process on them.

As far as I know, GPUs are definitely still being used in crypto/web3... and AI for that matter :P
by jrussino | 2025-05-12 16:46:12+00:00
> 1.1. Homework set #0: Diagnostic > This is a special problem set: Its main purpose is to give you an idea of what is to come in this course, and to give me an idea of your level of familiarity with certain things (including proof writing). Do not expect to solve all these problems

I love this, and I wish I had seen more regular calibration-type assessments in my own education.

> 1.2. Homework set #0B: Additional problems > The following problems are not solved in these notes; they shall be used for future homework sets.

Here's a set of problems that are representative of the prerequisite material, to give us both a sense of how well your foundations match what I'm assuming at the start of the course. And here's a second set of problems that represent the sort of things you can expect to be able to solve once you've completed this course.

What a beautiful way to start.
by johannes1234321 | 2025-05-12 16:46:15+00:00
There is a lot one could do offline. Highlight close by stations, have overlays/styles for transport focus (they got an overlay for "Subway", which in some areas includes commuter trains but not for bus/tram/light rail/...)

And in theory one could add bundles of data based on GTFS data which many transport organisations these days publish and do routing at least based on schedule times.
by margalabargala | 2025-05-12 16:46:45+00:00
Houses themselves don't really appreciate in and of themselves, not the way a stock might. It's more that the land price goes up, as does the cost of replacement due to materials and labor prices also increasing.

If you have two identical lots side by side, and you build a house one one and 10 years later build the identical floor plan next door, they will not sell for particularly different prices.
by minimaxir | 2025-05-12 16:46:51+00:00
> The BERT-like and other transformer embeddings far outperform word vectors because they can take into account the context of the word.

In addition to being able to utilize attention mechanisms, modern embedding models use a form of tokenization such as BPE which a) includes punctuation which is incredibly important for extracting semantic meaning and b) includes case, without as much memory requirements as a cased model.

The original BERT used an uncased, SentencePiece tokenizer which is out of date nowadays.
by Etheryte | 2025-05-12 16:46:57+00:00
This whole interaction is weird to me. Multiple commentators here have confirmed that your site is broken due to a, let say, somewhat unorthodox technical choice you've made. Rather than fix it, which would've probably taken less time than the thread here, you're trying to convince everyone else that they're holding it wrong. As an aside, it's not surprising that nearly none of your users access your webpage from mobile when it's broken on mobile.
by winwang | 2025-05-12 16:47:07+00:00
No relationship... yet! Hoping to have a good relationship in the future so I have a business reason to fly to Japan :D

Btw, interesting thing they said here: "By utilization of GPU (Graphic Processor Unit) device which has thousands cores per chip"

It's more like "hundreds", since the number of "real" cores is like (CUDA cores / 32). Though I think we're about to see 1k cores (SMSPs).

That being said, I do believe CUDA cores have more interesting capabilities than a typical vector lane, i.e. for memory operations (thank the compiler). Would love to be corrected!
by VirusNewbie | 2025-05-12 16:47:35+00:00
The optionality is quite nice though if you can still get a long vesting grant.

Think about it - if you join Meta today, get a four year grant at say, 125k a year for four years... if it pops 20% by next year, that's "free money". If it doesn't, well, you can probably still go on the open market and get a competing offer.

I've made about 125k per year OVER my target comp working at FAANG in some good years.
by RandallBrown | 2025-05-12 16:48:20+00:00
If you told me that I would ask for some clarification.

The UT system has a very large endowment, (which appears to be a little smaller than Harvard's), but UT Austin is much smaller (but still very large for a public university.)

I'd also ask why you included the University of Florida in that list, since it appears their endowment is pretty small (at least compared to the other schools in that list.)
by benatkin | 2025-05-12 16:49:23+00:00
> Machine learning (ML) has the potential to advance the state of the art in technical writing. No, I’m not talking about text generation models like Claude, Gemini, LLaMa, GPT, etc. The ML technology that might end up having the biggest impact on technical writing is embeddings.

This is maybe showing some age as well, or maybe not. It seems that text generation will soon be writing top tier technical docs - the research done on the problem with sycophancy will likely result something significantly better than what LLMs had before the regression to sycophancy. Either way, I take "having the biggest impact on technical writing" to mean in the near term. If having great search and organization tools (ambient findability and such) is going to steal the thunder from LLMs writing really good technical docs, it's going to need to happen fast.
by A_D_E_P_T | 2025-05-12 16:49:33+00:00
There's a lot wrong with that reply -- it mostly just shifts the goalposts without answering the central objections raised in the comment.

Much of the reply revolves around whether the mixed invariant G=E⋅B appears at leading or higher order in the QED Schwinger result. But the comment's critique used the constant-field Schwinger problem only as a check that the authors' master formula fails against a case with an exact answer; the real complaint is that the same failure occurs for curved-spacetime examples where the exact result is known to vanish. Debating G is fine, but you can't ignore the gravitational case either.

The reply repeatedly says the comment is "outside the realm of applicability" of the formula -- as though that were the comment's fault! But if the formula cannot survive the very checks the authors themselves hold up (Schwinger with B≠0, Ricci-flat space), the burden is on the authors to (severely) restrict their own claims, not on critics to ignore the failure modes.
by qq99 | 2025-05-12 16:50:06+00:00
I was wondering about this. I was hesitant to add embedding-based search to my app because I didn't want to incur the latency to the embedding API provider blocking every search on initial render. Granted, you can cache the embeddings for common searches. OTOH, I also don't want to render something without them, perform the embedding async, and then have to reify the results list once the embedding arrives. Seems hard to sensibly do that from a UX perspective.

To render locally, you need access to the model right? I just wonder how good those embeddings will be compared to those from OpenAI/Google/etc in terms of semantic search. I do like the free/instant aspect though
by taylodl | 2025-05-12 16:50:13+00:00
The challenge is, you really have to ask: what problem are we actually trying to solve? Sure, it's homelessness - but homelessness is a symptom, not the root issue. The real issues are:

- Lack of affordable housing

- Lack of stable, livable-wage jobs

- Lack of accessible mental health care

- Lack of adequate retirement support (fixed incomes that can’t keep up)

That’s why most governments struggle with this - it’s not just one problem, it’s a web of them. And honestly, it seems like Newsom would rather sweep it under the rug rather than untangle it.
by minimaxir | 2025-05-12 16:50:50+00:00
For small datasets, the original UMAP package is fine: https://umap-learn.readthedocs.io/en/latest/

For large datasets (as the UMAP algorithm scales in exponential compute), you will need to use the GPU-accelerated UMAP from cuML. https://docs.rapids.ai/api/cuml/stable/api/#umap
by cayley_graph | 2025-05-12 16:50:55+00:00
I'm guessing they relied on an LLM response. That was my thought, and having tried it they indeed generate lots of garbage for this topic. I got a ChatGPT A/B test for this and both options were incorrect (one obviously and the other subtly, due to misinterpreting a bond rating page's discussion of the PUF and just blindly regurgitating the number from there).
by choward | 2025-05-12 16:51:00+00:00
Ruby doesn't have real modules. You're right, that they are just namespaces. They are global variables with extra typing.

If you use a third party library, when you require something, you have no idea what "modules" or other values it creates polluting the global namespace. This at least assigns those values to a local variable where they can be accessed and doesn't make them global.

That said, I'm not a fan of ruby and all the workarounds to try to make it like a more sane language that it isn't.
by PaulHoule | 2025-05-12 16:51:34+00:00
I was working at a startup that was trying to develop foundation models around at time and BPE was such a huge improvement over everything else we'd tried at that time. We had endless meetings where people proposed that we use various embeddings that would lose 100% of the information for out-of-dictionary words and I'd point out that out-of-dictionary words (particularly from the viewpoint of the pretrained model) frequently meant something critical and if we lost that information up front we couldn't get it back.

Little did I know that people were going to have a lot of tolerance for "short circuiting" of LLMs, that is getting the right answer by the wrong path, so I'd say now that my methodology of "predictive evaluation" that would put an upper bound on what a system could do was pessimistic. Still I don't like giving credit for "right answer by wrong means" since you can't count on it.
by tristor | 2025-05-12 16:51:49+00:00
Tool quality has definitely improved over time, but... and this is a big but... many people buy lower quality tools now than were available previously because of their low cost. I would put any of my Japanese or German/Czech hand tools up against any of the big brands of the past (many of which I also own thanks to yard/garage sales) and say they're better, not just from an ergonomics and design perspective but from an actual strength/reliability perspective. Most people, at least in the US, though are only familiar with low-quality China/Taiwan made tools which have lower quality metals and a lot of plastic content when it comes to hand tools.

If you invest a bit of effort into finding good hand tools, the options are much better these days but you have to be willing to pay.
by geor9e | 2025-05-12 16:52:03+00:00
I wish it was unlimited for me. I got 500 fast requests, about 500 slow requests, then at some point it started some kind of exponential backoff, and became unbearably slow. 60+ second hangs with every prompt, at least, sometimes 5 minutes. I used that period to try out windsurf, vscode copilot, etc and found they weren't as good. Finally the month refreshed and I'm back to fast requests. I'm hoping they get the capacity to actually become usably unlimited.
by alwa | 2025-05-12 16:52:10+00:00
I seem to remember Uber’s tilt to profitability coinciding with a move to extend their “dynamic pricing” to a driver-side reverse auction for fares, which they called “Trip Radar.”

Mysteriously I’m having trouble finding much reference to it now, although I remember it being discussed at the time… the only real discussion I can find now is recent and vaguely agenda-flavored [0]. Complete with extra-weaselly non-denial denials from Uber’s PR.

> In 2024, American media non-profit More Perfect Union conducted an experiment to discover whether Uber’s algorithms facilitate wage discrimination. It gathered seven experienced Uber drivers together in a high-traffic area in Los Angeles and asked each of them to open up the app and place their phones on a table next to each other. It found that Uber offered the same rides 46 times to multiple drivers, and that there was discrepancy between fares for 63% of those trips. Uber refuted that this was discrimination, saying in a blog post that differing pay was due to GPS discrepancies.

So the drivers bid each other down, while the riders bid each other up through “surge pricing” (even as they’re individually priced according to their willingness to pay). Nice market position if you can get it…

It’s a good party trick if they’ve clocked you, like they apparently have me, as a total cheapskate. As a rider I routinely see prices 50%-70% of those Uber offers to my richer and less price-sensitive friends when we call for the exact same ride from the same place at the same time, whether I call first or second…

[0] https://novaramedia.com/2025/03/06/taken-for-a-ride-inside-u...
by dexterlagan | 2025-05-12 16:52:32+00:00
From my experience Claude 3.7 seems to make less mistakes when you provide detailed specs. It saves a lot of back and forth, especially at the beginning, when you're trying to 'de-noise' the idea. I find that the best way is using a hybrid approach: going between iterating over specs to iterating over code, and once I have the MVP I update the specs one last time. I pass these specs to another session and continue working. It solves multiple problems at once: context getting full, LLM getting lost etc.
by onlyrealcuzzo | 2025-05-12 16:52:40+00:00
You realize this is what people said about solar energy and nuclear energy at one point, right

And before someone chimes in and says Nuclear doesn't make sense - it made sense at plenty of times and in different places.

It doesn't make sense in Western countries that are hell bent on making it as expensive as possible, strictly to ensure it doesn't get built, so we stick on fossil fuels as long as possible.
by hotrod46 | 2025-05-12 16:53:04+00:00
Hey guys, Ive built useprd.com , which is supposed to help you plan new features on existing codebases, or plan out new apps from scratch. Havent had the chance to test it on larger codebases(actually any codebases other than the ones ive built), curious to see how it goes. If you do use it, please let me know what sucked/ what was great, and what could be improved.

Contact Me: email - cs23b102@smail.iitm.ac.in X: https://x.com/aryanjain46 LinkedIn: https://www.linkedin.com/in/aryanjain4623/
by gruez | 2025-05-12 16:53:15+00:00
>The fatal flaw in your reasoning: machines aren't humans. You can't reason that a machine has rights from the fact a human has them. Otherwise it's murder to recycle a car.

That might be true but I don't see how it's relevant. There's no provision in copyright law that gives a free pass to humans vs machines, or makes a distinction between them.
by kanjus | 2025-05-12 16:53:19+00:00
Can't find the citation, but remember gwern mentioning a study in one of his posts on replication that found that unintuitive findings tend to be both less replicable and more cited than intuitive ones.

Psychology is the field that is most hit with replication failures and has a slew of unintuitive results that turn out to be malpractice.
by fuzzfactor | 2025-05-12 16:53:49+00:00
Why, absolute doom, of course :)

If you're going to get to 4 easy steps and then outperform Bell Labs, you have to figure that first you need to negotiate a thousand-step process that's completely uncharted so you can come to terms about exactly what that kind of doom consists of in such a worst-case scenario. Without obliterating the slim chances for the kind of major breakthrough where the chances are already elusive under ideal conditions.

People aren't accustomed to this.

Conceptual advances here seem to always lag technology advances so this is where more massive room for improvement really exists.

There will probably always be those who "fail upward" and go forward with undue resources, at the same time as there will be earth-shaking solutions almost within reach that become unsupported prematurely, lost in the weeds with the bulk of truly unfeasibles.

Like betting on the wrong horse, you can lose everything :\

Bell labs was really fortunate to have money on every horse in the stable :)

For a small number X, odds would be best if every lab was the product of a highly motivated individual's million-dollar ambition, with their only previous obstacle a lack of resources. Not everybody promising is business-like to the same degree, and it can be worth the time for this to develop along with the technology because the idea is for them both to snowball. Most of the time I think there would be fairly early indications in the first few years if things were going to fall badly short of a million-dollar return by a strict deadline on a case-by-case basis.

I personally get way more accomplished without a deadline but it takes a lot of effort to get there, I would make sure to never rule it out though. If I was running things I would probably be a lot less strict than most.
by ty6853 | 2025-05-12 16:54:07+00:00
4 years to get a license in my state. 2 nights to get the EPA 608 cert which is the only real education you get, the rest is slave labor to get the sign-off for the license. The whole regulatory apparatus was co-opted by current industry to stop 'disruptions', you're going to have to go through the ol boy club to even get a seat at the table and even then they will just regulate your edge away.

This is the thing 'disruptors' don't get about the trades. It's heads I win, tails you lose. They just coopt the laws to ensure the fundamentals don't change.
by philipwhiuk | 2025-05-12 16:54:19+00:00
> In https://nlp.stanford.edu/projects/glove/ there are a number of graphs where they have about N=20 points that seem to fall in "the right place" but there are a lot of dimensions involved and with 50 dimensions to play with you can always find a projection that makes the 20 points fall exactly where you want them fall.

Ramsey theory (or 'the Woolworths store alignment hypothesis')
by fiddlerwoaroof | 2025-05-12 16:54:28+00:00
This is a reductive view of the economy: one pays for something whenever one trades something of value to one’s counterparty to something that’s of value to oneself. In many cases, in fact, it’s preferable to do this sort of “bartering” to reduce the expenditure of money you might need for other things.

Finally, I have, in fact, benefitted personally from products that were advertised to me on the basis of user tracking data so a bit ambivalent about the anti-tracking argument.
by thinkcontext | 2025-05-12 16:54:58+00:00
40% of US corn acreage is used for something like 10% of gasoline. This is an unfathomable amount of land. Solar yields 20x the amount of energy per acre. On top of that many are finding efficiencies of colocating solar with agricultural activities (agrivoltaics). And there's also replacing agricultural activities on marginal or water stressed land.

Conclusion, land isn't really a constraint in the US.
by jasonjmcghee | 2025-05-12 16:55:18+00:00
checkout MTEB (https://huggingface.co/spaces/mteb/leaderboard) many of the open source ones are actually _better_.

I've had a particularly good experiences with nomic, bge, gte, and all-MiniLM-L6-v2. All are hundreds of MB (except all-minilm which is like 87MB)