skysight-inc/HackerNews huggingface dataset:
Ask HN: Recommendations for Running LLMs Locally
Hi folks

I'm looking for hardware recommendations for running LLMs locally. Specifically, best bang for bucks at the following price points:
$2,000
$5,000
$10,000

What more could you do with a 10k budget than with a 5k budget?

Thank you
You're assuming the CDC is democrats? You don't think maybe the CDC staff were just rushed and scared by a rampaging executive?
the moves away from the US are already being discussed in cabinet rooms all over the world

countries will not want military bases from a nation that threatens annexation, will not want their media companies broadcasting to their citizens, will not want to buy their weapons, and will not want their financial system dependent on them

the US just handed the world to the Chinese

on a platter
Maybe it will be an opportunity to “build back better”, like in 2021. However, that’s assuming he actually leaves office which is not a given.
OP, your presence is requested.
Happy New Year Dang and Thank you for running the show.
In refining 2126C5:9B4FF3 (Minsk) in 00h 04m 42s 365ms I have brought glory to the company.
Praise Kier.
7⃣9⃣5⃣2⃣1⃣
5⃣8⃣4⃣5⃣7⃣
8⃣8⃣0⃣4⃣7⃣
5⃣2⃣5⃣5⃣8⃣
3⃣1⃣8⃣3⃣5⃣
#mdrlumon #severance
lumon-industries.com
Isn't this whole thing just a bunch of political grandstanding?

Train v. City of New York isn't a constitutional case. So if Congress controls spending, it's a power they gave to themselves. Any other portion of government could likewise determine they control spending. So maybe it goes back to the SCOTUS because they agree to hear another case about it. Maybe they like the idea that the executive branch controls spending? Or maybe they don't after all. The tell the President to stop doing that. But the president does not. Does Congress pass another law reaffirming they control the power for spending?

If the executive branch is in charge of running the government and they listen to the President & the President decide's they aren't spending any money, who exactly is going to change that? Would Congress fund another department to change this? Would it also just report to the President?

From what I understand it's actually pretty common for the executive branch not to actually be able to spend appropriated money. The simplest case would be if you put out a contract and get no bids on it. There are other cases, like Congress agreeing to fund military submarines for Taiwan. But no one is going to build them internationally and we don't build diesel-electric combat submarines in the US as a matter of policy.
I used C# on .NET framework (the old .NET running only on Windows) 10 years ago at work. Then I had to use it 2 years ago again, and man, did it change! ASP.NET Minimal API is absolutely awesome, as the Generic Host integrating config, logging and DI is a great too. A very mature and complete framework.

It brings everything to the table a great modern language and ecosystem needs. Even null safety.

Regarding error handling, I don't have a strong opinion yet. I think Rust has nailed it, but C# (with unchecked exceptions) didn't create any issues in the projects I worked on.
The Era of Tab Continuation
Tbh, the preference may work for one set of things but not for the other. It should be a per-app per-site setting with a system default. But not in-the-site, obviously.

This is not a realistic change though, cause systems and browsers vendors are absolutely deaf to this and don’t let users choose. In contrast to Dark Reader extension, which does the thing for all sites, light and dark.
This comment [1] links to a post of side by side videos of the gesture Musk did and people doing what is definitely a Nazi salute. The motions match pretty much exactly.

Whether he intended it as a Nazi salute is not really relevant. The Nazis so completely tainted that gesture that any normal person, if they inadvertently make it, pretty quickly offers an explanation when it is called to their attention.

Not Musk. No explanation of what he was actually going for.

[1] https://news.ycombinator.com/item?id=42846630
I wouldn't be afraid of it in any capacity. I'd plan for it to happen
Rewriting a Coin Flipping Script
> Some of the comments here about ISP behaviour are crazy.

It depends on the ISP. Over 25 years of IT support I've had to fight with about 30% of them to bring in my own device.

Most notable screwery was with Verizon DSL. They'd lease a new public IP every time we tried an incoming connection. As fast as I could record the new IP in the remote config and reconnect - my IP would change. I was able to push it past six changes/min.
I'm not sure that really captures how it works. For a given individual, being blamed for something you didn't do, maybe even shunned for it, sucks regardless of the reason. I don't think it's productive to try the weigh one person's emotional hurt from being shunned against another's.
[dupe] https://news.ycombinator.com/item?id=42903595
Perhaps you can cite when this was tested in court, because "robot punches man" isn't something I've noted in the headlines. Otherwise, it's nothing but speculation.
I have never seen any article saying tariffs will "only" hurt American consumers. They hurt both sides and every article I have seen acknowledges this. However, American news sites tend to focus on the effects in the US, while Canadian news sites focus on the effects in Canada.
Absolutely. Even with a temperature parameter, at the core they are machines for following existing popular patterns.

That works provided "popular" is also "best", and sometimes it isn't.
It's funny how people are concerned about things that haven't happened yet, but the same people for 5 years overlooked the Biden/Ukraine bribery scandal which actually happened, along with a bunch of abuses surrounding that. Not least of which is Biden pardoning his whole family for any unspecified crimes they did since 2014.
No, I telling you the CDC people are the same ones who were there under Biden. They haven't been replaced. They might be replaced, but they haven't been replaced yet.

Sure, they might be "scared", but being scared isn't an excuse for going overboard and doing things that aren't required.

They could have just left the data up and complied with the EO through the Director by saying "we are currently reviewing the data and how to comply with the EO, but will leave the existing data up until such time it can be replaced with the updated data".

But they score way more political points by yanking it all down and getting the media to fan the flames.
i hope so at $100-$125/port
Yeah no it wasn’t just three, actually listen to the ATC auto between PAT25 calls into the controller and the crash — not to mention it’s still far more than a single aircraft on a remote planet
The technique might have 'merely' prevented deep sleep due to interruptions; similar to why uberman[1] doesn't work.

When I was younger I stayed up to see what happens. The worst experience of my life was when I lied down to sleep and felt 'too tired to go to sleep' and then started hallucinating sirens. I have no idea how long I was up; after a few days I lost track. I had to paced to stay awake, which I did the entire time. I got pronounced disassociative symptoms - which I'm prone to anyway - ("it's not me in control of my body; there is a mutiny", "my reflection is weird/scary/different; that is not me", "the lines that make up the walls and reality don't seem to lay correctly"), gaps in memory, broken pattern matching (everything looks like a spider, chasing down mundane sounds to figure out what they are), and mixing up memories and imagined thoughts (e.g., fill up a cup, go to drink from it, it is empty and I'm not sure if I filled it up and then drank from it or imagined filling it up or if my memories are out of order).

Given the loss of contact with reality, I could see it being easy to manipulate people if you are in the room with them. I was alone, but if someone told me another me talked to them and then drank from the cup, the mix up could easily seem like evidence that it had actually happened that way, especially if I was trusting, vulnerable and open-minded. And once someone has a model that suggests that, they would probably make up stories on their own to support it.

So, yeah, definitely agree on the importance of sleep.

--

1: https://polysleep.org/wiki/Uberman
I suppose you could argue it may have helped keep the boat afloat before they launched Zen, but as far as I know the margins on their game console chips are terrible.
> Are you maybe suggesting that what is good for an individual is not good for society?

I don't read any such suggestion into the person's post; to me, it seems to mean what it says. As to whether individual needs and societal needs always align, I would guess you probably know the answer is "no" -- but also far from "never"
Both work, seems funny to run in a loop.
What are you referring to as the LoC triple classification?

I've spent quite some time looking at both the LoC Classification and the LoC Subject Headings. Sadly the LoC don't make either freely available in a useful machine-readable form, though it's possible to play games with the PDF versions. I'd been impressed by a few aspects of this, one point that particularly sticks in my mind is that the state-law section of the Classification shows a very nonuniform density of classifications amongst states. If memory serves, NY and CA are by far the most complex, with PA a somewhat distant third, and many of the "flyover" states having almost absurdly simple classifications, often quite similar. I suspect that this reflects the underlying statutory, regulatory, and judical / caselaw complexity.

Another interesting historical factoid is that the classification and its alphabetic top-level segmentation apparently spring directly from Thomas Jefferson's personal library, which formed the origin of the LoC itself.

For those interested, there's a lot of history of the development and enlargement of the Classification in the annual reports of the Librarian of Congress to Congress, which are available at Hathi Trust.

Classification: <https://www.loc.gov/catdir/cpso/lcco/>

Subject headings: <https://id.loc.gov/authorities/subjects.html>

Annual reports:

- Recent: <https://www.loc.gov/about/reports-and-budgets/annual-reports...>

- Historical archive to ~1866: <https://catalog.hathitrust.org/Record/000072049>
This is one of the things that pisses me off about MacOS. Every other majot OS out there at least offers a good failsafe keyboard navigation built in to each UI component. In a pinch, the keyboard is your friend, at least until your pointing device is back up.

MacOS: lol, sorry, bluetooth settings require a pointing device to add a new one. Keyboard navigation? Sure. It worked up until this part, but we didn't bother to allow the add button to be selectable. Why? Reasons.
most 2025 headline I have yet to see
98% seems pretty damn unreliable to me given that a computer ought to be able to do that addition with probably about 12 nines instead of 1 without really putting much effort into reliability.
Vimium is absolutely life-changing and I can't believe I've been forced to browse the internet like a caveman for my entire life.
https://gitea.wildfiregames.com/0ad/0ad/wiki/Alpha27
I think the things you're calling out are accurate. There are more people, and especially more prominent/influential people, who are willing to press the seams of the justice system to use it for personal grievances or vendettas.

The existing protections against this are not sufficient: where anti-SLAPP laws exist, they're often not expansive enough to cover the novel ways that the courts are being weaponized, and where they don't exist, plaintiffs continue to venue shop to improve their position.

That still doesn't suggest to me that the solution is for otherwise well-intentioned actors to steer into the skid. At best, Lego/Nestle/etc would make a political point and then lose their case. At worst, they would win, setting damaging precedent for future suits by the very people they're trying to oppose.
This is an excellent explanation of the flaws inherent in the rationalist philosophy. I’m not deeply involved in the community but it seems like there’s very little appreciation of the limits of first principles based reasoning. To put it simply, there are ideas and phenomena that are strictly inaccessible to pure logical deduction. This also infects their thoughts about AI doom. There’s very little mention of how the AI will collect data or marshall physical resources. Instead it just reads physics textbooks then infers an infallible plan to amass infinite power. It’s worth noting that the AGI god’s abilities seem to align pretty well with Yudkowsky’s conception of why he is a superior person.
Cool Rick is in Severance.
It’s not about blood libel or attribution of evil. But even trans people acknowledge that transness is comorbid with other personality disorders.
I’m sorry, I’m no fan of the dems but if you think Trump isn’t above and beyond when it comes to lying and twisting truth you’re either a shill or just ignorant
There are far more nerds (bitter or not) who were not so successful yet are far more clever than these "leaders" are, and they aren't the type to tolerate intolerance...
But is boycotts illegal? Consumer boycotts aren't illegal, so why is commercial boycott illegal?
The charge is Stranger tricked me. The Prosecutor (you) repeatedly rely on an unproven universal negative claim that miracles never happen, a claim that would require watching all of history and show every event has a natural physical explanation.

Defense submitted evidence which the prosecution refuses to consider closely because of the universal negative (unproven) claim.

Prosecution submitted evidence (youtube video) which the defense examined (demonstrating better involvement in the case than the prosecution) and found to be irrelevant: _all_ tricks required holding the mark's ankles/feet off the ground and required dexterity. Stranger's fingers were straight and I was on the ground.

It's as if Stranger was charged with murder using a blade and Prosecution submitted examples involving only firearms! What!

Prosecution refers to the prevalence of many other tricksters. But the defense points out simply the guilt of others implies nothing about the guilt or innocence of the Stranger.

Prosecution argues the mind can trick itself into feeling sensations that are easily checked and verified as imagined. But I ___did___ check by sight and touch over several seconds (not to mention X-ray).

So prosecution's argument contradicts itself --giving himself the benefit of the doubt when dispelling the sensation of an imaginary bug on his skin, but ___denying___ the same benefit to the defense without reason. This argument is tossed out of court with prejudice.

Prosecution refuses to put in the work of building a theory of the case: ___what___ is the recipe for tricking someone who is wearing jeans, seated fully on the ground, using only your fingers fully extended (no pinching of fabric, moving the mark's body in any way disallowed) ... Followed by an X-ray that shows the result (and proceeded by an X-ray that shows the contrary)?

Prosecution has high IQ but wants the defense to do his job. What? Try to figure out a recipe. Or __you__ go do the prosecution's research and see if they can explain it. You said watching the video would be hard but I did it. Now it's your turn.

By the way, if nothing exists outside matter and energy then you are deeply at odds with reality: your reactions to any violation of human dignity are all just chemicals bouncing around. There's no such real thing as human dignity either. Squashing a tomato or a human -- it's just a rearrangement of matter and energy.
Posts no. Comments yes.

Especially comments on productivity boosts and outright lies when someone “builds a few side projects in the last month with AI”. It feels either like a sponsored roleplay or a competence level where building a jsx form is a side project.
The worst for me is being able to select the non-default option in an alert window. Sometimes CMD + 'the first letter of the word in the button' works, but that's like a 30% chance. How is there not a standard for that? I'd even accept the arrow keys + Enter at this point.
When making requests, does your tool use the normal chrome user agent header or does it specify the request is coming from meha?
I think this chapter just proves GP's point, rather than refuting it. It's much cleaner than the Wikipedia article and it mentions the zero share problem, but it doesn't mention any other concern like constant time implementations, cache side channel attacks or the leading zero coefficient that I pointed to at the other post.

It's a good guide to learn about Secret Sharing, but it doesn't give you even 1% of what you need to know implement it safely by yourself.
The state of decarbonization in five charts
There's definitely a lot to shovel.
Minimum effective dose
I agree. I just finished porting a python module to go. Go was certainly more tedious to code and was 1.6x (not 5x) the size. Explicit error handling not only means you have to check e v e r y t h i n g that returns an error code but also you can't embed calls within calls. For example, to convert text to b64 and then to gzip that, in python you can write b = gzip(b64(text)). In go you have to call the b64 routing first and save the result and check the error, then do the same for the gzip call. (insert sweat emogi here).
Tidal – A History in Types
What?! All HN does is chatting about AI perspectives and politics. Never seen a tutorial or an in-depth article here. And I visit here like a lot.
Unless the world demand for these raw material goes down or production elsewhere goes up someone will still buy these raw materials. If tarriff is high enough to force US to source from and Canada to sell to more distant places the world will be less efficient.
"Why didn't you stop me from putting my hand in the pain hole?"
Because for many conforming (not necessarily strictly conforming) programs, should and does are different things and many programs are written to be conforming rather than strictly conforming (hence why most non-trivial sane projects (including Clang in some cases, amusingly enough) builds themselves with flags that disable many of these style of checks).

The argument goes like this

Assuming that p lives at 0x0 and q lives at 0x1 (this is the only interesting case anyway, if this isn't the case the program clearly prints nothing)...

p[0] = {0}
q[0] = {0}

Line 1: ip = undefined, iq = undefined

Line 2: ip = 0x0 + 1 = 0x1 (assigned), iq = undefined

Line 3: ip = 0x1, iq = 0x1 (assigned)

Line 4: ip = 0x1, iq = 0x1 (ip == iq, so take branch, goto line 5)

Line 5: ip = 0x1, iq = 0x1

- p[1] = 0x10.

- Because p([0]) is at 0x0, p[1] must be at 0x1

- (address of p[1]) = 0x1 and (address of q[0]) = 0x1 and 0x1 == 0x1

- Therefore because these pointers have the same address, these two objects obviously must alias each other at this point

Line 6: print(q[0]); -- should print 10 because p[1] = 10 which means q[0] = 10 which because they're at the same location

The argument against this is that a pointer really is a address and some hidden data that tracks what allocation it was, therefore you can't treat p[1] as equaling q[0]. I find myself tending to agree with the original argument (this is C after all) rather than this counterargument, but I understand it nonetheless.

This touches a pain point on the evolution of C in general. C is a lot of the times the domain of stuff of it being a "portable assembler"[1] which many programmers who are writing C code for things like operating system kernels and other systems level code expect and like, but because a lot of these make non-strictly conforming programs, many popular compilers are writing optimizations in their evolution that attempt to target strictly conforming programs only at the expense of... well a lot of the reason people use (and have to use) C.

[1]: Many might take issue with the characterization of C, but it's how it was characterized even in things like the 1st ed of "The C Programming Language".
Although the title says "just discovered", obelisks were discovered a year ago. Obelisks are RNA elements inside bacteria inside humans. Here are some links for more information:

The publication in Cell: https://www.cell.com/cell/abstract/S0092-8674(24)01091-2

The preprint: https://www.biorxiv.org/content/10.1101/2024.01.20.576352v1

An article about obelisks in Science: https://www.science.org/content/article/it-s-insane-new-viru...

An article in Derek Lowe's popular "In the Pipeline": https://www.science.org/content/blog-post/what-s-obelisk-any...
I've been slacking but yeah it's on my list.
Could you give an example of something we recently solved that was considered an unsolvable problem six months beforehand? I don’t have any specific examples, but it seems like most of the huge breakthrough discoveries I’ve seen announced end up being overstated and for practical usage, our choice of LLM-driven tools is only marginally better than they were a couple of years ago. It seems like the preponderance of practical advancement in recent times has come from the tooling/interface improvements rather than generating miracles from the models themselves. But it could be that I just don’t have the right use cases.
Same way corporations do it, they hire humans and other companies to do things. Organisations already have a mind of their own with more drive to survive than an llm.
Trump and a section of the conservative elite are like why let COVID or Bird Flu fuck up administration number two? Biden left them this nice present of obfuscating the data on increasing disability until after the election.

https://fred.stlouisfed.org/series/LNU01074597
Cory Doctorow's books "Chokepoint Capitalism" and "The Internet Con" discuss a good number of possible reforms, if anyone is interested
For the non-video people lile me.

Background [0] THE ALLIES’ BILLION-DOLLAR SECRET: THE PROXIMITY FUZE OF WORLD WAR II

Great detail [1] VT FUZES FOR PROJECTILES AND SPIN-STABILIZED ROCKETS

Techie [2] RETROTECHTACULAR: A CLOSER LOOK AT THE VT PROXIMITY FUZE --- try reading a schematic from a video.

[0]https://www.historynet.com/proximity-fuze/

[1] http://michaelhiske.de/Allierte/USA/OrdnancePamphlets/OP1480...

[2] https://hackaday.com/2023/06/09/retrotechtacular-a-closer-lo...
Here's "Einstein’s puzzle" from this paper: https://www.researchgate.net/publication/341189675_Is_Einste...

H01 There are five houses.
H02 The Englishman lives in the red house.
H03 The Spaniard owns the dog.
H04 Coffee is drunk in the green house.
H05 The Ukrainian drinks tea.
H06 The green house is immediately to the right of the ivory house.
H07 The Old Gold smoker owns snails.
H08 Kools are smoked in the yellow house.
H09 Milk is drunk in the middle house.
H10 The Norwegian lives in the first house.
H11 The man who smokes Chesterfields lives in the house next to the man with the fox.
H12 Kools are smoked in a house next to the house where the horse is kept.
H13 The Lucky Strike smoker drinks orange juice.
H14 The Japanese smokes Parliaments.
H15 The Norwegian lives next to the blue house.
Now,
Q1 Who drinks water?
Q2 Who owns the zebra?
For all of the downsides to a Trump administration, one of the unexpected upsides is that the people who don't have a problem with Nazis will self-identify.

I feel really bad for the kids who've developed an alt-right persona during the pandemic, though. There used to be time to work that out for yourself, but now I think social media will provide the kiss of death for many career ambitions.