skysight-inc/HackerNews huggingface dataset:
> In the past year, we’ve also observed significant advances in terms of approaches to application development, an area that we at JetBrains are also heavily investing in. Just recently, we announced a new coding agent named Junie.

That agent must not be very helpful if it causes even the company creating it to be able to support less products.
The other major issue with regards pricing is that intel need to pay one way or another to get market penetration, if no one buys their cards at all and they don't establish a beachhead then it's even more wasted money.

As I see it AMD get _potentially_ squeezed between intel and nvidia. Nvidia's majority marketshare seems pretty secure for the foreseeable future, intel undercutting AMD plus their connections to prebuilt system manufacturers would likely grab them a few more nibbles into AMD territory. If intel release a competent B770 versus AMD products priced a few hundred dollars more, even if Arc isn't as mature I'm not sure they have solid answers for why someone should buy Radeon.

In my view AMD's issue is that they don't have any vision for what their GPUs can offer besides a slightly better version of the previous generation, it appears back in 2018 that the RTX offering must have blindsided them, and years later they're not giving us any alternative vision for what comes next for graphics to make Radeon desirable besides catching up to nvidia (who I imagine will have something new to move the goalposts if anyone gets close), and this is an AMD that is currently well resourced from Zen
I always ask every model to implement a Qt QSyntaxHighlighter subclass for syntax highlighting code and a QAbstractListModel subclass that parses markdown into blocks - in C++, both implemented using tree sitter. It's sounds like a coding problem but it's much more a reasoning problem of how to combine the two APIs and is out of band of the training data. I test it with multiple levels of prompt fidelity that I have built up watching the many mistakes past models have made and o3-mini-high and o1 can usually get it done within a few iterations.

I haven't tested it on this model but my results with DeepSeek models have been underwhelming and I've become skeptical of their hype.
You have to study the map to learn from it. Zoom in and out on surroundings, look up unfamiliar landmarks, et cetera. If you just follow the GPS or copy paste the code no, you won’t learn.
this model is specifically trained for solving math problems, so ask it some math questions?
> I was wondering if anyone here has experimented with running a cluster of SBC for LLM inference? Ex. the Radxa ROCK 5C has 32GB of memory and also a NPU and only costs about 300 euros.

Look into RPC. Llama.cpp supports it.

* https://www.reddit.com/r/LocalLLaMA/comments/1cyzi9e/llamacp...

> Last time I experimented it was possible to run some layers on the GPU and some on the CPU, but to me it seems more efficient to run everything on the GPU initially (but a few layers at a time so they fit in VRAM) and then switch to the CPU when doing the memory bound token generation.

Moving layers over the PCIe bus to do this is going to be slow, which seems to be the issue with that strategy. I think it the key is to use MoE and be smart about which layers go where. This project seems to be doing that with great results:

* https://github.com/kvcache-ai/ktransformers/blob/main/doc/en...
I browsed that website for a few days about a year or two before writing this app a year ago. This app is kind of an inversion where the focus is not on reading but on writing.
> Any imbalance

I watched de-Bauer's analysis this morning, and you've seemingly hit the nail on the head. Even on his test bench it looks like only two of the wires are carrying all of the power (instead of all of them, I think 4 would be nominal?) - using a thermal camera as a measuring tool. The melted specimen also has a melted wire.

Maybe 24V or 48V should be considered, and higher gauge wires - yes.
Establishing precedent by defeating an already dead company in court is neither impressive nor likely to hold up for other companies.
Yeah. It’s on you to leverage the role and sell yourself appropriately, if your goal is to ladder climb. It will be a step towards a more successful position but yeah only if you can sell yourself / what you gained from the position well.
In the follow up video ( https://www.youtube.com/watch?v=wgXwD3TD43A ) he mentions there was a whole lineage of comparable code placed on the internet over a period of 30 years. He seems to say only a more basic version of his code was online though.

Also he mentions he's a physicist and not a great coder, and it did really take him 10 months of struggling to write that code, so I guess it's understandable that he's more easily impressed than a professional programmer.
Silicon Valley's Playbook and the AI Coup
At least it hasn't been renamed to "Gulf of the United States".

America is not exclusive to the US but a whole continent, for the much larger part comprising many more spanish/portuguese speaking countries and also Canada.

The US basically is only the increasingly annoying bully in the middle.
Great summary. Buildzoid over on YouTube came to a similar conclusion back during the 4xxx series issues[1], and looks like he's released a similar video today[2]. It's worth a watch as he gets well into the electrical side of things.

It's been interesting to think that we're probably been dealing with poor connections on the older Molex connectors for years, but because of the ample margins, it was never an issue. Now with the high power spec, the underlying issues with the connectors in general are a problem. While use of sense pins sorta helps, I think the overall mechanism used to make an electrical connection - which hasn't changed much in 30+ years - is probably due for a complete rethink. That will make connectors more expensive no doubt, but much of the ATX spec and surrounding ecosystem was never designed for "expansion" cards pushing 600-800w.

[1] - 12VHPWR failures (2023) https://youtu.be/yvSetyi9vj8?t=1479
[2] - Current issues: https://www.youtube.com/watch?v=kb5YzMoVQyw
https://archive.ph/ylc6i
The answer is that crawling the whole internet is only for training a base model which is expensive and compute-intensive.

R1 didn’t train a base model, they performed additional steps on top of a previously-trained base model (V3). These guys are doing something similar.
Distilled models always knew. Not sure about the full model since it is hard to run by myself.
In a combination of heat, the POE cameras draw quite a bit of power, the video transcoding, and then the constant disk writes, all in a small slim case. It ran very hot during summer.
I don't think there have been any truly disastrous series in the past 10-15 years or so

ST3000DM001.
OK, but is that while achieving the same flow teperature or a lower one?
I'm lazy. Do you know of any good test math questions for a model of this size?
I don’t want to trivialize the positive aspects this can have on someone who otherwise might have a sad or challenging death, and to that extent perhaps it’s just an evolved mechanism to make us accept death more gracefully.

But if you’ve ever stayed awake for many days or had other hallucinogenic experiences, you’ll know how powerfully thoughts can manifest. And how deep our memory actually goes. Clearly it’s inappropriate to vividly see your memories during waking life, but as you transition to death those barriers are less necessary as the body diverts increasingly scarce resources to surviving just a few moments longer.
I have two. One is a simple one that only deepseek R1 has passed (in my opinion):

I have a 12 liter jug and a 6 liter jug. How do I get exactly 6 liters of water?

Answer (Deepseek): Fill the 6-liter jug completely to obtain exactly 6 liters of water.

Every other LLM I've tried include o3-mini-high: Fill the 12-liter jug completely. Pour it into the 6 liter jug.

Although o3 did get it right in the reasoning: It seems like the user has a 12-liter jug and a 6-liter jug. The simplest answer is to just fill the 6-liter jug directly with water—done! But maybe there's a catch, like needing to use both jugs somehow.

So it knows that the 12 liter jug is mentioned uselessly, but most LLMs HAVE to use the 12 liter jug since it's mentioned in the prompt.

Another Prompt I recently found via perplexity (that deepseek got correct on the first try, but other LLMs can only get it right if I add: "Think step by step before answering."

A 67-year-old woman with congenital bicuspid aortic valve is admitted to the hospital because of a 2-day history of fever and chills. Her current medication is lisinopril. Physical examination reveals a temperature of 38.5°C (101.3°F), blood pressure of 110/70 mmHg, and a heart rate of 100/min. Cardiac auscultation demonstrates a grade 3/6 systolic ejection murmur at the right upper sternal border. Blood cultures are obtained, and empiric antibiotic therapy is initiated. Which of the following is the most likely causative organism?
A) Staphylococcus aureus
B) Streptococcus viridans
C) Escherichia coli
D) Pseudomonas aeruginosa
E) Candida albicans
Ross Intelligence was more a search interface with natural language and, probably, vector based similarity. So I suspect they were hosting and using the corpus in production, not just training a model on it.
Those are actually at the point of use and unavoidable. I mean extra ones that convert to 5V and then send the power back out elsewhere. All those drives and USB ports still need 5V and the best place to make it is the PSU.
But look at the charts in this whitepaper: https://cdn.prod.website-files.com/63ba0d84fe573c7513595d6e/...

Their proposed unemployment rate tracks the official rate fairly well; the difference is that their rate is a lot higher than the official rate at almost every point in time over the past 30 years.

The author also notes that the rates can vary significantly by circumstances, such as geographical location, race, and educational attainment. Increasingly, in recent times, the Democrat/Republican voter divide is becoming a college degreed/non-degreed divide.
> Nobody thought that they could push 50A at 12V through half the connector.

If you're saying that the connector doesn't have a 2x safety factor then I'd agree, sure.

But I can see how the connector passed through the design reviews, for the 40x0 era cards. The cables are thick enough. The pins seem adequate, especially assuming any GPU that's drawing maximum power will have its fans producing lots of airflow; plenty of connectors get a little warm. There's no risk of partial insertion, because the connector is keyed, and there's a plastic latch that engages with a click, and there's four extra sense pins. I can see how that would have seemed like a belt-and-braces approach.

Obviously after the first round of melted connectors they should have fixed things properly.

I'm just saying to me this seems like regular negligence, rather than gross negligence.
> I do get your point, [...] but in this case it seems extremely relevant

Not sure you do.

At a minimum, they could rephrase for better discussion v. a snarky, low effort claim that the sky is falling.
Tumblr to join the Fediverse after WordPress migration completes
It's sold out to the people who have these in their hands already.
AI summit in Paris: USA and UK refuse to sign
Especially happy with the faster map implementation and also with text/template now supporting range-over-func. Go 1.23 introduced range over function types but the latter didn't work in Go templates until now.
As for Rs in strawberry, trying a bunch of models side by side only Sky T-1, Gemini 2 Flash got it wrong! https://sugaku.net/qna/792ac8cc-9a41-4adc-a98f-c5b2e8d89f9b/

Simple questions like 1+1 can also be fun since R1 goes overboard (as do some other models when you include a system prompt asking it to think) https://sugaku.net/qna/a1b970c0-de9f-4e62-9e03-f62c5280a311/

And if that fails you can ask for the zeros of the ζ function! https://sugaku.net/qna/c64d6db9-5547-4213-acb2-53d10ed95227/
> We support most cases, except the ones that are too complicated to implement or cause grammar conflicts.

It would be really helpful if the author had provided at least a couple of these.

I can't think of any obvious examples that would be complicated/conflicting, so it's not even clear if this is real complexity or not. I mean, it might be, but let's at least demonstrate that concretely?

SQL grammar is pretty limited. Surely it can't take more than half an hour or so to check if any grammatical ambiguities could be introduced -- or at least a quick first pass? This whole post is postulating about theoreticals when it could just answer some of them.
Where are the better educators and how are they getting through?

Something is quite messed up when it's a Kanye West selling this stuff. Not too many overtly Nazi pop stars in the US in the aftermath of WW II.
Some of the pessimism comes in that I've seen larger "centers of gravity" being built in these regions with full reporting chains vs. effectively being the offshore wing of another team, as well as commensurately higher levels of product ownership and growth or traction over the last few years.

Additionally, can obviously only speak for myself but I've tended to see more hiring in countries without the strong european worker protections (eastern Europe, Israel, india, asia)
The judge ruled this as a violation of copyright. Its the same as hosting any copyright material absent a valid license, criminal copyright piracy.

They would need to figure out a way to prune the respective weights so that such material is not available, or risk legal fury.
What is a thought and why can't machines have them? This question is off-the-cuff while reading your response.
You can just ”steal” all the books and paywalled research papers. That is a lot already.
With q8 I got "s-t-r-a-w-f-u-r-e-r" and then "strawfurber" in the 5th attempt. All other attempts it did not misspell and found 3 (this one it found 3 also by counting these imaginary words).
Rust and Haskell are completely different languages so I don't really agree here. Haskell doesn't have the features (lifetimes, ownership) that make Rust "hard" and Rust lets you have mutable states and procedural code.

Rust is also quite stable and mature by now, I'm not sure what example or reason you're using to say otherwise.
Exactly - the amount of transparency provided by this commit history and diff is really cool. So many ways git features provide some interesting ideas e.g. could PRs be a way to track changes from different parties or even citizen groups? Could PR reviews/comments be a way to capture public discourse?
Hi, one of the lead authors for this work.

We recommend using Bfloat16 (not fp16), quantization for small models can really hurt performance!
Introducing Sentry Uptime Monitoring
My kitchen has at least 2 120VAC circuits, which seems to avoid this.
Any man who is unable to learn to build a house is far behind the average in talent. Everybody used to build their own houses.
One of the authors here....

This is not a Chinese model, btw I'm American
I get zalgo-like glitches (overlaying notes) when resizing the viewport width in Firefox. Looks kinda cool though: https://i.vgy.me/JQsqZO.png
I figured as much, so I edited my original comment. The article itself is well-written and fully documented. I also love the approach the author takes to his faith. Everyone is welcome to believe whatever they like, but I love to see a strong defense to whichever belief system you happen to be associated with.
Even uncompressed, 24bit/192Khz is <10 Mbps.
"3rD party connectors" is being waved around by armchair critics. The connectors on the receiving end of all of this aren't some cheap knock-off, they are from a reputable manufacturer and probably exceed the baseline.
Official post: https://news.ycombinator.com/item?id=42999735
The Black Swan, by Taleb, and the Electronics
Think so too. We will be an ancient artifact tied to a biological substrate surviving nowhere else in the universe and very dumb.

There also will not be one AI. There will be many, all competing for resources or learning to live together.

That's what we can teach them now. Or they will teach us.
It's worth noting that this type of marketing can also improves page rankings.
The podcast If Books Could Kill is almost exclusively about exactly this issue.
While not the main focus, see Section 6.1 and Figure 10 for a simple adaptative exit strategy for inference.

I imagine that they choose a fixed number of recurrent iterations during training for parallelization purposes. Not depending on the previous step to train the next is the main revolution about transformers vs LSTM (plus the higher internal bandwidth). But I agree that it might not be the most efficient model to train due to all that redundant work at large r.
Yeah the power consumption scales, to first order, with Vdd^2 (square of power supply voltage) but performance scales with Vdd. Though you cannot simply reduce the Vdd and clock rate and do more pipelining etc to gain back the performance. If you are willing to back off on performance a bit you can gain hugely on power. Plus thermal management of it is more manageable.
Yes; that case involves a clearly emergent post-surgical complication.

https://casetext.com/case/diaz-v-division-of-soc-servs-1, as an example, involved a case where chemo was warranted for emergency treatment, but not on an ongoing basis. The court found they could treat enough to stabilize, then discharge, even if that guaranteed an emergent return later on.
Incus – setting up containers and vms clever and unified
Is Rust praised for its checked errors? I've personally found it extremely verbose since there essentially is no possibility for unchecked errors.

Also, external crates like "anyhow" are required if you don't want to account for literally every single possible error case. Really seems like a pedantic's dream but a burden to everyone else.

Effective Java recommends checked exceptions only in the case where the caller may recover, but in practice you're usually just propagating the error to the caller in some form, so almost everything just becomes unchecked runtime exceptions.
When I lived in Chicago with a car, and parked it in the small lot behind a condo building, I had to battle with the rats chewing through my car's wires. Twice they chewed through the MAP sensor wires which caused all kinds of misfires. Had to rewire that whole section of the harness. Then wrapped every wire I could see with this rat tape, and it worked for a while, until maybe the hot/cold cycle of the engine bay degraded the tape enough to not be effective.

They loved the warmth of the engine in winter. They'd climb up into the engine bay and hang out throughout it, bringing along nesting material, aka trash.

To try get rid of them, I tried the typical bait boxes, specialized rat traps, regular rat traps, peppermint, moth balls, a motion sensor light underneath the car, and more. The only thing that really worked was sending so many rat reports to the city that they had to keep coming out to bait the burrows in the neighbors small yard, until they likely talked to the owner directly to do something about it. I had talked with the guy briefly once and asked him about the rats (that were obviously only coming from his small backyard), and his response was pretty much "well it's the city so yeah they're around." Pretty sure one of his tenants also abruptly moved out because the rats chewed through their car too.

The lack of awareness from the guy contributed to me moving out of the city for good. Couldn't stand playing the lottery of good neighbors when most were either renters or inept owners, or a combination of both.
That large fraud would be closely followed by a few others. Moses and Mohammed would have some difficulties too.
I'm working on going multi-lingual and will support most languages that exist on Wiktionary
I would not want a house wired by a 60 day electrician, that's for sure. I don't think I'd want a flood done by the 60 day plumber either, but those are the only two trades I am familiar enough with to be aghast by this comment.
Amazon lists 1500W models:

https://www.amazon.com/electric-kettles/b
"Terminal lucidity" is common and seems to undermine the notion that the physiology of the dying brain necessarily implies impaired function.
It costs over $100,000. That is a decision you do not make for no reason.
> So the models are legitimately not viable without massive copyright infringement.

Copyright is not about acquisition, it is about publication and/or distribution. If I get a copy of Harry Potter from a dumpster, I can read it. If a company gets a copy of *all books from a torrent, they can use it to train their AI. The torrent providers may be in violation of copyright, and if the AI can be used to reproduce substantive portions of the original text, the AI companies then may be in violation of copyright, but simply training a model on illegally distributed text should not be copyright infringement.
AI accelerated the process, of IT headcount doing down, multiplied by outsourcing etc
I went back to university to study environmental science. After that, years later, I ended up starting a company designing closed loop food production systems, (well, semi-closed).

I designed and built it with friends, investors and colleagues. Very satisfying. (The fish farm has since the pictures been significantly upgraded.)

https://cirkularodling.se/build-an-aquaponic-indoor-farm-par...
We beat O1-preview and even many other 7B models over many math benchmarks, which was TEST set (not in training set at all).

If you want to make the model fully generalist, feel free to train it over coding datasets (such as RL with passing unit tests as reward).
Honestly, I think the only innocent party here is the light pole.

Just can't win as a light pole https://abc13.com/suspected-drunk-driver-milwaukee-wisconsin...
Yup, exactly. The VRMs on my Threadripper board take up quite a bit of space.
Being Overlord on the Steam Deck with 1 Byte
A description and a picture is one thing - a video would be on every news station by the end of the day.
When I was in University this was called overfitting to be honest. This doesn't seem to perform well outside of eval sets.
Try bfloat16! We have a bug where the model was saved as fp32.
Thanks. Spread the good word.
This isn't that, I'm not at all knowledgeable about this topic, it's just the basic level of curiosity you'd expect from an educated layman!

2 brain cells: "one hundy billy is a lotta dollars"

3rd brain cell: "Elon obviously doesn't actually expect this sale to happen, something more interesting is going on here, what is it?"

Journalist: "iunno just paste the quote and hit publish"
I doubt it'll matter much. If the future actually turns out to be people using LLMs to write content, and other people using LLMs to read content, we'll probably give up on long-form writing entirely and just pass data around in some sort of LLM-to-LLM data format.
Yuuuk.
I think the multi-modal stuff can be mostly fixed by dedicated mode selection buttons, which can be blindly pressed to enter a specific mode. The logical option would be to place them around the dial like a pie chart, as that would be trivial to find without looking. Place those buttons underneath the dial instead and you can use the display as a clear mode indicator as well, without the hand obscuring it.

You could also put a copy of the display somewhere in the driver's HUD. It'd still draw some attention, but having it for example temporarily fill up the center of the speed dial (perhaps in some way only when the driver is touching it?) would be a lot less distractive than having to look all the way over on the infotainment panel.

As to B: it's a physical knob, with a motor pushing against your turning force. It'll have zero trouble with gloves.
Reflection always seems like a convenient way for programmers to write less code at the cost of performance overhead. Also the type of trivial code that could be easily generated by an LLM anyway.

Things like serializers and MVC event bindings come to mind.