skysight-inc/HackerNews huggingface dataset:
Politicians should not time such things so that the giveaways they propose are conditioned on their getting re-elected. If Trump promised a bunch of people $10-20k on the condition that he’s re-elected, I bet you’d not be quite so generous.
By this reasoning, not only is writing video games an IQ shredder, all sorts of pursuits in the arts are IQ shredders, all the way back to Shakespeare writing plays which distract people from doing useful things.
It's hard to imagine what could happen instead. Even with a model with infinite context, where we imagine you could supply e.g. your entire email archive with each message in order to ask questions about one email, the inference time is still proportional to each input token.

So you'd still want to use RAG as a performance optimization, even though today it's being used as more of a "there is no other way to supply enough of your own data to the LLM" must-have.
i've long assumed that is a "feature" of PDF akin to DRM. Making copying text from a PDF makes sense from a publisher's standpoint.
Patchscopes: A framework for viewing hidden representations of language models
One of the driving forces in steel making is high capital cost which drives the need to keep operating at full capacity, driving prices to margin.

There are not many industries like that anymore - steel still is, oil, and some industrial chemicals. But even Pharma has slightly different cost structures.

The big remining one is chip making - I wonder if “data centres” counts too?
I like Primeagen, he brings entertainment to boring topics, I understand others might not like his style. I think we can leave it at that and not accuse him of drug abuse, lol.
This doesn’t consider compute cost; the RAG model is much more efficient compared to infinite context length.
Is this an ad for AWS?
Oops, I've since learned this site is Australia's version of The Onion.

My bad for submitting this.

I totally do think it'd be an interesting experiment to allow People to bring some of these items on planes, especially welders.
There's more reason than that for Western hostility to China, not least of which is that it is an authoritarian regime with aggressive expansionist goals.

Let's also not forget the reciprocity of the hostilities.
NASA hasn't been to the surface of the Moon in any meaningful way since the 70s.

So, you're correct, but how is that relevant?

Obviously all discussions about "NASA plans to do X on the Moon" and "if NASA's doing X on the Moon, we've worked out that they can use Y to accomplish X" are hypothetical at this point.

So, in that context, what's the relevance of your claim that "GPS cannot be used on the Moon".

I agree that if you're going to insist on empirical evidence that no, we don't actually know if it works on the Moon.

But if that's your goalposts then I'd think you'd worry more about the hypothetical astronaut reading that GPS position or GPS time having long since asphyxiated.

After all we've got no empirical evidence that the space suits planned for use on the Moon actually work there, etc.

It's all inferred at this point, we'll see about the experiment. But if I had to bet that signal propagation works the way we expect (GPS), v.s. say some joint failing when filled with lunar regolith (spacesuit), then my money's on the GPS experiment.
It's very sad. DSM was never strictly meant to be a clinical diagnostic tool, but rather it was originally meant to define specific illnesses in a manner that would facilitate further research by allowing investigators to at least be talking about the same phenomena when comparing results. (and it unintentionally became very popular with lawyers, who argued that presence in the DSM equated to unimpeachable evidence of an illness in a client, another use that it was never designed to accommodate)

It's still true that there are only on the order of 8-12 well-validated diagnoses in the manual. Increases in the number of included diagnoses over editions is primarily due to concessions to important researchers as opposed to clear identification of previously undescribed illnesses.

There are lumpers and splitters in academic psychiatry. Lumpers are suspicious that there are several hundred discrete disorders of the brain that can't be more parsimoniously explained with existing, better validated illnesses.
China has never been a western ally
I’d say it’s like the mental health distinction of a trait versus a disorder: if this is negatively impacting your day to day life, consider therapy / counseling.

(As an aside, I think of counseling as “optimizing my life”. Perhaps that framing may help those that find the idea off-putting.)
Yes. Particularly for anybody named "Ballmer".
SF traffic fatalities have not been increasing year-over-year. You can't cast blame for an outcome that doesn't exist.

Data: https://www.chp.ca.gov/programs-services/services-informatio.... SWITRS hasn't published a report since 2020 due to the pandemic, but that works perfectly fine for my purposes because I'd have probably had to discard those years for other reasons, and since we're talking about a ten- or fifteen-year trend I'm perfectly okay coming to a conclusion based on data from 2011 to 2020. Traffic fatalities per city are in section 8 chart E.

Fatalities have also not been increasing per mile traveled. Data: https://vitalsigns.mtc.ca.gov/indicators/daily-miles-travele...

I choose traffic fatalities as the metric because federal and state reporting laws mean that these numbers will be effectively complete - there is no sampling or selection effect, unlike numbers about traffic enforcement.
The goal is to have a convenient API to work with common data structures, with an SQL backend and all the benefits it provides. Such as:

— Small memory footprint even for large datasets.

— ACID transactions.

— SQL interface for introspection and reporting.
Do you use one of the vim plugins in vscode?
For people with bad security practices... VPNs still have virtually no benefit.
Ask HN: What do you need to know to be good at the Unix Command Line?
Unix famously comes with a lot of documentation, but it's still famously hard to learn. Why?

As a teacher and cognitive scientist, the reason is interesting: Unix
documentation, starting with its man pages, is presented in a format
that makes it easy for experts to look up details, not for beginners
to learn concepts or build skills. O'Reilly, Sam's, APress and others
have built large businesses selling second-best solutions to this
problem.

This is a teaching anti-pattern that emerges when domain experts --
but teaching novices -- try to write a curriculum from scratch.
They don't realize that teaching is a separate skill from the material
to be taught, and that a great deal of effort is needed to break a
domain down into right-sized, self-sufficient chunks for the reader to
consume. Instead, they produce big volumes of unorganized knowledge
(man pages) that reflects their expert-level understanding, that the
reader tries to sift through and, as often as not, gives up on in
frustration. Even when you pay experts to write beginner-friendly
books, you get separate books on bash, awk, sed, grep, regexes, files,
processes, packages and so on. These put the onus on the reader to
remember all the details and put them all together into something
useful.

Having dumped all this information on you, I always get the feeling
that the gurus are patting you on the head and saying, "Well, learning
is hard. You have to work at it. Be sure you practice enough and
you'll figure it all out eventually." Learning is not supposed to be
easy, and you do have to practice, but too often that attitude serves
as an excuse to stop looking for better teaching methods.

So I'd like to propose one here.

The interactive piece takes place on the user's machine. They clone a
git repository that contains lots of text files that they can
manipulate with complex commands, according to lessons and exercises
delivered via a web app. The web app helps the user remember using a
technique I call graduated spaced repetition, which extends the basic
SuperMemo algorithm to test concepts, not just facts, with
progressively more elaborate questions.

All of this should be relatively simple to write. The main
differentiator will be good instructional design which -- sorry if I
sound like a jerk here -- I have not seen much in evidence in the 20
years I've spent learning this material.

Which brings me to my questions for you:

1. I know a lot of people have already tried to do this. Can you point to any existing learning tools that have really knocked it out of the park?

2. What text processing tasks do you consider absolutely essential to Unix command line proficiency?

3. What kinds of text files (Natural language text, CSV, logfiles, etc) would it be useful to practice on to get there? Where can I find some?

If you want to talk about building the training set or the
extensions I've made to the SuperMemo protocol, or if you just want to
spitball ideas, you can email me at $MY_HN_USERNAME@gmail.com
Essentially the same things but reimplemented safely - see WTF in webkit.

There are still issues (the iterator API used by for(:) is very hard to make safe without terrible perf issues, though I was looking at this recently and the compilers are doing much better than they used to).

Things like unique_ptr and shared_ptr do not meaningfully improve the security of c++ despite being presented as if they did (all serious c++ projects already had smart pointers before the stl finally built them in so presenting them as a security improvement is disingenuous), and because of the desire to have shared_ptr be noninvasive it’s strictly worse than most other shared ownership smart pointers I’ve used.
> I had to fill out a report about how I was observing myself working safety while management still had no clue what was happening.

see also https://eddiots.com/2301

> How do you know what's going on if you're not there?
> Ask a restaurant manager. Or a bartender. Or the manager of a retail shop. Or a call center or an office. Or the supervisor of a factory or warehouse floor. What do you think they'd say? [...]
> Ask anyone responsible for something, "How do you know what's going on if you're not there?" and you'll always get the same answer: "You won't."
> Unless they were an I.T. manager.
Fight Club and The Matrix, but I only understood the latter several years later.
You can "solve" Japan owning US Steel by the army showing up tomorrow. You can't move a steel mill.

You can't "solve" TikTok short of shutting them down.
> Today, it makes just 12% of American steel...and employs around the same number of people as online pet retailer Chewy.

That's...surprising.
Could you please not break the site guidelines like this? We have to ban accounts that post this way. If you'd please review https://news.ycombinator.com/newsguidelines.html and stick to the rules when posting to HN, we'd appreciate it.
Because they already have the ability to turn portions off. Installing a lot of new equipment means regulatory effort to get a plan approved, and a lot of installation labor.

I imagine these systems will be put in place over time, but I was just looking at Wikipedia on Reclosers and they said Sensitive Ground Fault protection reduces the risk by 80%; if the risk is high enough, that probably still warrants deenergizing risky lines at times.
I followed the primagen briefly, and then unsubscribed. The primagen occasionally does super interesting content like this one video but otherwise his content is useless garbage on average.

Some examples: reaction to other videos rating programming languages, reading out articles (like one guy shutting down some cloud services and instantly realising half a million bucks savings for the company) while commenting out loud but adding little to nothing useful, and some neovim videos where he basically copy-pastes some code here and there and sone functionality appears (without any actual explanation about how the code he pasted actually works).

I like the guy, but i’ve realised that:

1. His content is not a good use of my time (wrt my interests and my skill level)

2. When he makes actually good content (like this one in this case) it’ll reach me anyway, somehow.

Hence I unsubscribed.
What I really want is the next step: the one where it manages user groups and roles. :)
The factories aren’t going anywhere. If Japan and the U.S. go to war, we can nationalize them.
The creator of this (Chee Aun) is quite prolific and creative with their work (https://cheeaun.com/projects/).

They created https://cheeaun.life, a timeline of their life, more than 10 years ago (which looks to be kept up to date), which was my inspiration for markwhen (https://markwhen.com).
Review of 1984 by Isaac Asimov
To make a LLM relevant to you, your intuition might be to fine-tune it with your data, but:

1. Training a LLM is expensive.

2. Due to the cost to train, it’s hard to update a LLM with latest information.

3. Observability is lacking. When you ask a LLM a question, it’s not obvious how the LLM arrived at its answer.

There’s a different approach: Retrieval-Augmented Generation (RAG). Instead of asking LLM to generate an answer immediately, frameworks like LlamaIndex:

1. retrieves information from your data sources first,

2. adds it to your question as context, and

3. asks the LLM to answer based on the enriched prompt.

RAG overcomes all three weaknesses of the fine-tuning approach:

1. There’s no training involved, so it’s cheap.

2. Data is fetched only when you ask for them, so it’s always up to date.

3. The framework can show you the retrieved documents, so it’s more trustworthy.

(https://lmy.medium.com/why-rag-is-big-aa60282693dc)
I'm sure he wants to head up the committee for deciding what pursuits are intellectually acceptable.

It's word salad contrariness and I'm giving up on links pointing into this source, they're very predictable.

(Not a gamer btw)
It’s an odd situation when an acquaintance dies. It affects you but it can also feel like you don’t have a right to grieve compared to those who knew them closely.

Some years ago a neighbor of mine was hit by a light rail train after darting across the street, biking during his lunch break at work. I’d talked to him for a couple minutes almost every day for two years in the parking lot while he worked on his car or arrived home from work. Just like that he was gone. I have a vivid memory of a neighbor sharing the news. We went to his funeral. His parents and young wife were devastated of course. It was so unexpected. Thought about him for years afterwards.
>> In contrast, regular package managers solve this problem pretty well.

Except the upstream dev's are sick of dealing with "It doesn't work in my distro" ... there are plenty of instances of these sorts of pissing matches.

bwrap, flatpack, containers... were really talking about software distribution. I dont think any of these solutions "solve" the problem, we're just putting all the bullshit in one bag, not getting rid of it.
> But in 9 years, that was the only time she did it while I was sleeping.

... that you know of
Climategate (2009)
I'm not against systemd, it's just that the muscle memory takes a _long_ time to change, particularly for things that you don't do frequently.
+1. I read this a few weeks back and it really stuck with me.
Really? I see the same 44 minute BART ride, with the same average train frequency, though admittedly it's direct from SFO vs you have to make a connection from OAK
Thanks!

Sorry it's not clearer but you can skip the screenshot in the Urlbox API if you want to with:

curl -X POST \
https://api.urlbox.io/v1/render/sync \
-H 'Authorization: Bearer YOUR_URLBOX_SECRET' \
-H 'Content-Type: application/json' \
-d '
{
"url": "example.com",
"format": "md"
}
'

Here's the result of that:
https://renders.urlbox.io/urlbox1/renders/5799274d37a8b4e604...

Sorry the pricing isn't a good fit for you. Urlbox has been running for over 11 years. We're bootstrapped and profitable with a team of 3 (plus a few contractors). We're priced to be sustainable so our customers can depend on us in the long term. We automatically give volume discounts as your usage grows.
Saskatoon freezing deaths
For profit corporations should also be held to the standard that they are a net benefit to society. Otherwise, why bother?

Of course it's hard to measure that benefit.
Reads like an AI generated Luke Smith rant.
I'm sure Peter Roberts is a fine professional, however, I have passed border patrol/immigration personally this way dozens of times and know of many other people who do it. You can find people doing this in an instant if you want.

I once got in trouble with BP because they didn't believe me that I was coming in to work on a project and thought I would be looking for a job to stay illegally. BP finally decided to let me in and told me that what I was doing was fine, but they just didn't find it credible that I would leave my GF alone for a month in Argentina.
Because you only need to carry the DECT phone while the mobile is charging. And they're usually good for a week or more on one charge.

The point is: how do you ensure that you always have a phone on you?
that's what we get!
never heard of this before. I looked it up https://en.wikipedia.org/wiki/Token_bucket

I think this would be like a firewall or ingress thing that would drop packets that resulted in excess load before they make it to the application server.
Certainly a possibility, but that's everywhere. You trot out the Blue Angels to get people to sign up to the Navy.
In most (quite possibly all) cases I don't know the upper bound even at runtime. So, this ends up requiring allocation.
It does all of that now.
Perhaps you are forgetting WWII, when China was a main member of a group which literally called themselves "The Allies"
https://en.wikipedia.org/wiki/Four_Policemen
> - F*ing templates - for those who like them, did you ever see a C++ core file? Or tried to understand a single symbol?

I have 20+ years of experience writing C++.

Yes, I've looked at "core" C++ headers and source. The most annoying part to me is style (mixed tabs and spaces, curly braces at wrong places, parenthesis or not, the usual style complaints). But other than that they're very readable to a seasoned C++ engineer.

I've also tried to understand symbols. You're right, they're difficult. But there's also tooling available to do it automatically. Even if you don't want to use the tools, there is a method to the madness and it's documented...

Let me ask ChatGPT:

> What tool lets me translate an exported symbol name to a C++ name?

C++filt

It's categorized as a demangler. That's your search term to look for (I had to remember what it was).

Then I asked:

> Is there a function in the standard library which allows to mangle or demangle a given name or symbol?

It tells about `__cxa_demangle` for GCC. While I had forgotten about that, I'm pretty sure there is (or perhaps something similar) in the standard library.

It also suggests to use a library such as `abi::__cxa_demangle`. Hah, that's what I was looking for. It's an implementation-specific API (eg, compiler-specific) API used as an example. It was mentioned on `std::type_info::name()` page here:

https://en.cppreference.com/w/cpp/types/type_info/name

So, to continue replying to you: yes, it's annoying but it's solvable with tools that you can absolutely integrate into your IDE or command-line workflow.

> - Standarization that feels like pulling more Boost into the language, which means more templates.

The boost libraries are open source and their mailing lists are active. If you don't like a given library because it has too many templates then you could make one with fewer templates.

And, as standardization goes, it's also quite open source. The C++ committee is very open and receptive to improvements. The committee are volunteers (so their time is limited) and (usually) have their own improvements to the standard that they want. So you have to drive the changes you want (eg, actively seek feedback and engagement).

> P.S. Example from recent core file, one line in the stack trace:

I've seen much longer -- I've seen templates entirely fill a terminal buffer for a single line. That's extremely rare, definitely not fun, and debuggability is absolutely a valid reason to refactor the application design (or contribute library changes).

I find it useful to copy the template vomit into a temporary file and then run a formatter (eg clang-format), or search/replace `s/(<\({[)/\1\n/g` and manually indent. Then the compiled type is easier to read.

Some debuggers also understand type aliases. They'll replace the aliased type with the name you actually used, and then separately emit a message (eg, on another line) indicating the type alias definition (eg, so you can see it if you don't have a copy of the source)
Even if we, as humans, collectively have the knowledge to reduce something down to some fundamental axioms, it does not mean there is no value to separating the disciplines. All fields of engineering are fundamentally just physics, math, and some civil knowledge. Likewise, being a biologist doesn't necessarily qualify you to be a doctor.
China was very notably an ally while the KMT was in power of mainland China.
Japan never had nuclear weapons.

China has like ten times the population of japan, is now a dictatorship (like the roman republic, maybe?), the territory is massive, is a russian ally and a couple more reasons.
TLDR but I'm responding to let you know that I'm grumpy, got that? I am grumpy, carry on.
Yes and further to that, not properly handling octal properly has led to security exploits. There is a whole defcon talk on this topic.
A cringe Roblox group has hacked Iranian government website on behalf of Israel
Can you explain what nefarious things Japan - one of the US’s closest allies by the way - could do by owning 12% of the USA’s steel output in the form of physical factories that are on US soil?
I think that "next level" would essentially be a RAG referential information system that gets data via search engines or databases. Maybe we will have the "google search" equivalent completely intended for LLM clients where all data is stored, searched, and returned via vector embeddings, but it could tap on exabytes of information.
A lot redis's fantastic performance evaporates when network IO is added to the equation. Of course, you can host your own redis, but as soon as people start using a SaaS hosted redis service, performance usually takes a huge hit. If this makes running your own redis compatible key/val store easier for people in your own cluster, that's a win.
I dunno – I look at the original Jurassic Park and it still looks pretty amazing to me. Same with Terminator II. In many ways I feel like as directors got more and more capabilities with the tools they became comically overused. I don't think it's the sophistication of the tools, but the way that they're wielded that will make them look dated, or timeless.
WTAF is "codesoy?"

Hiding this bullshit
If your tests pass, why not?
Thanks for sharing. This is a disturbing read in some ways:

> To maintain prices in the face of fluctuating demand, Gary would gather the industry’s leadership together in regular “Gary Dinners,” where price levels would be agreed upon and Gary would “exhort the chairmen, presidents, or other major owners of steel companies to maintain rank.” Those who refused to cooperate would be “disciplined” by the others. Many former Carnegie Steel executives, schooled in the intense competition of the Carnegie years, were allergic to this strategy, and departed for other steel companies.

> Under his leadership, the company successfully fought off a Justice Department lawsuit to break up the company as an illegal monopoly. (Perversely, the court ruled that the Gary Dinners proved that US Steel did not have the power to set prices, and thus couldn’t be a monopoly).

This makes me wonder if we just need totally different laws that are not going to be mired in lawsuits that drag out for years while monopolies and oligopolies continue making money. Maybe we just need higher taxes for the biggest corporations.