skysight-inc/HackerNews huggingface dataset:
Discussion [0] (7 points, yesterday, 6 comments)

[0]: https://news.ycombinator.com/item?id=40280433
This feels only vaguely less affronting than "guns don't kill people, bullets do".

AI is, for the foreseeable, the work of extremely vast troves of resources. Countless of the most expensive chips on the planet, the best interconnects, the highest paid expert teams. Whatever the output is, these inputs are the firing mechanism that creates & keeps the AI firing.
Can someone explain why this is better than using a larger tokenizer? To me it seems like this would just make the LLM have a harder time understanding the content (when a token might have multiple meanings and isn't full, it can't have a good embedding)
If people were actually rational that might be true, but they aren't. Apple survives entirely on the fact that they have convinced people they are cool, not because they actually provide good value.
Previously [0] (10 points, 1 week ago)

[0]: https://news.ycombinator.com/item?id=40222219
14900k might be one of the least reliable CPUs in recent times, pairing it with ECC seems almost ironic!
Enshittification protests beget more enshittification
It also performs pretty well for the particular brand of web development I do, which basically boils down to running VS Code, a browser, and a lot of ssh.

It's fascinating to me how people are still attached to the hardware upgrade cycle as an idea that matters, and yet for a huge chunk of people and scenarios, basically an SSD, 8gb of RAM and an Intel i5 from a decade ago could have been the end of computing history with no real loss to productivity.

I honestly look at people who use Apple or Windows with a bit of pity, because those ecosystems would just give me more stuff to worry about.
I've had similar feelings of envy for my co-workers who appear to get superpowers from caffeine -- I steer clear as a general rule due to a bad bout with myocarditis in my early 20s :(
For “always” to be true, the behavior needs to extend to the present date. Otherwise, it’s only true to say “used to”.
Yikes, I want more competition as a consumer not less. I hope they will produce good chips of their own then. Nuts how this just keeps blowing up after trump started it
Same here and I have no idea - seems like it only limits their potential.
Because the institutions doing the against part are institutionally incapable of these type of creative endeavors
This sounds a lot like SimPy [1] / Simpy.io [2], but SimPy predates asycio by many years.

[1] https://simpy.readthedocs.io/en/latest/

[2] https://gitlab.com/team-simpy/simpy.io
No, it really is just snobbery.
usually in sharding schemes its a few bits of a hash of the id that are used to determine shard; the system or library you are using will take care of this transparently for you.
I suppose Flash was the new HyperCard.

Almost anyone could get an awful lot done without knowing much about anything.
> [she] retired at 49 with $1.3 million in savings.

That doesn't not seem like nearly enough. How does she afford health insurance?

I would be terrified that after a prolonged downturn you'd be left with nothing. And Social Security in the US pays less the less you work.
This is why Baen used to give away books for free: they said discovery was the biggest obstacle to a good book getting read.

"First one's free" works very well for good series
> I am a little jealous of my friends with switches. They seem to "just work" 99% of the time.

I don't know what our household's problem is then. We've had nothing but problems with joycon connections across three devices. Repeatedly one of the two controllers would fail to pair with the switches despite being physically docked. I've got to the point where I told my girls I'm not trying to help fix it anymore and they should play games on one of the many other options they have. Mostly they play games on PC now.
This is the NYT Magazine though. Longer pieces about less-important issues are common.
I have no idea why apple or Microsoft don't spend more effort making something like this for their OS for casual developers. VB and Python are fine, but sometimes I want something that is really tailor made for building small applications.
price-performance is not a thing for a vast majority of users. Sure I'd like a $40k car but I can only afford a $10k car. It's not nice but it gets me from a to b on my min-wage salary. Similarly, I know plenty of friends and family. They can either get 4 macs for $1000 each (mom, dad, sister, brother) so $4k. Or they can get 4 windows PCs for $250 so $1k total.

The cheap Windows PCs suck just like a cheap car sucks (ok, they suck more), but they still get the job done. You can still browse the web, read your email, watch a youtube video, post a youtube video, write a blog, etc.. My dad got some HP celeron. It took 4 minutes to boot. It still ran though and he paid probably $300 for it vs $999 for a mac. He didn't have $999.
Yep, they're essentially giant brute force machines. You can find the period of a function by passing all the inputs through it at once and destructively interfering the result.

Why is there a speedup in quantum, though? Why can't you just brute force classically? The answer is that whether quantum or classical, you can always build a hard-coded circuit that essentially swaps the time and space complexity - just make it so that for every operation you were doing in time, instead, every operation happens at its own place in space.

Quantum is special because it also takes the "log" of the space complexity b/c n qubits represent 2^n bits. So quantum lets you swap space with time and then take the log of time, lol. Superposition, interference, etc aren't really even needed in the explanation.
You've almost certainly come across them by now, but his novels are fantastic. I started with The Martian Chronicles and then The Illustrated Man, but ended up loving Something Wicked This Way Comes and even Dandelion Wine.

There's something about good fiction and youth that just went together so well -- maybe people who did a lot of, say, swimming in their formative years feel that way about "good swimming" and youth, but I have to believe that good fiction would still trump most everything else for the time period.
This is how you know 'coding interviews' are a scam for your time.

The candidate is probably better than the majority of so-called 'senior' engineers after looking at his long list of GitHub contributions alone. Every time I ask this, almost all of them avoid the question and do very poor in the interview. A great classic filter that works.

Either you ace the coding interview with little OSS contributions to show, or get >75% of the questions and show significant OSS or non-OSS projects that you've made which are useful and relevant for the job.

> Because I can't, of course, become a junior now—feels like I'm dealing with a Catch-22 situation where I need prior experience to gain my first experience.

Given that a 100% coding interview result and OSS contributions still isn't enough for these companies. You might as well make your own experience by building a startup.
It's actually a good idea. I have a question on how you will decide which resumes will pass the screening. like what will be the criteria.
> This is completely coherent with their privacy-first strategy (...)

I think you're trying too hard to rationalize this move as pro-privacy and pro-consumer.

Apple is charging a premium for hardware based on performance claims, which they need to create relevance and demand for it.

There is zero demand for the capacity for running computationally demanding workloads beyond very niche applications, for what classifies as demanding for the consumer-grade hardware being sold for the past two decades.

If Apple offloads these workloads to the customer's own hardware, they don't have to provide this computing capacity themselves. This means no global network of data centers, no infrastructure, no staff, no customer support, no lawyer, nothing.

More importantly, Apple claims to be pro privacy but their business moves are in reality in the direction of ensuring that they are in sole control of their users' data. Call it what you want but leveraging their position to ensure they hold a monopoly over a market created over their userbase is not a pro privacy move, just like Apple's abuse of their control over the app store is not a security move.
I’m confused by your confusion - not only is it the topic of this thread, it’s also literally the comment you were replying to.

> Most iPads are vastly overpowered and last for a long time. If someone needs more power/storage, then one usually passes them to the next person which might use it for many more years.

like again, this is in the context of tablets. Can you show a current-production model of an expandable, upgradable alternative from a vendor like google or Samsung or similar?

If not, I think it’s pretty clearly just wishful thinking and double-standards. Apple doesn’t need to solve the whole right-to-repair problem by themselves to go above and beyond the very low bar set by the market alternative vendors. Android’s lifecycle is abysmal for repairability and waste in practice - they are even more disposable devices than the iPad, with shorter software lifecycles and shorter parts lifecycles and much lower volume/worse parts commonality.

The wishful ability to install a custom rom and some Amazon knockoff parts doesn’t actually make that a significant factor within the actual realized lifecycle of these devices.
That’s not what “force” means.
Talking heads points. China isn’t the most powerful economy because of its headcount compared to India. But India is finally doing what it needs to build the necessary infrastructure. Unfortunately for you all the saber rattling towards India, Russia and China means that India too has been spending a lot of effort on building domestic infrastructure, working on swift alternatives, container shipping insurance, domestic high tech production etc. Just like they forced visa and Mastercard to either run on India infrastructure or pull out, they are working hard to make their own economy sanction proof from the west.

As night follows day you’ll either have to accept India as an equal or risk loosing that market as well.
And? I just read it that day
Might I suggest an insightful seminar for anyone curious about why gradient descent is even tractable in such high dimensions:

Stanford Seminar - A Picture of the Prediction Space of Deep Networks by Pratik Chadhari:

https://youtu.be/ZD2cL-QoI5g?si=hVFU5_4CeoLYtyuB
It benefits Apple to not have people thinking about or worrying about the amount of ram in their iPad. The OS doesn’t surface it anywhere.
Lol, dude, I was mainly referring to myself armchair speculating in the ether, which is exactly what I was doing in my comment above that you replied to. Maybe I should have been more explicit about that, but pro-tip: Stop being so sensitive on the internet man, you don't have to justify yourself to every online rando, and given your accomplishments it's not even worth your time to. Peace bro.
If a labor market somewhere is allowed to saturate, opportunities will end and centers of innovation, will be no more: they get this way because of course, to begin with, there are some condensation nuclei like a good uni doing research or a bunch of government contractors, but these are present in many places - and then, it needs some limitation on supply of labor. If it is present, people get to make a lot, raising cost of living and property, which pushes mediocre people out and attracts the best (increasing net benefit for the best and reducing, then making it negative for the mediocre ones), so you get a place where there is a high concentration of good people and thus high S/N ratio.

Remove limitation and you just stay in the mediocriland and these condensation nuclei result in no rain. Increased buying power of the newly forming local industry does not transpire in (sustained) higher wages because enough new people flock in to fill all the space, as a result there is no ripple effect, no higher SNR, and no reason for others to move in there (just because why, you don't get any benefits either as a worker nor as a business). Labour limitation and making people compete to get in the pool of candidates, is the key.

As a simple analogy, imagine a uni with a 100% acceptance rate. Even if it has some initial advantage like a few famous professors, it is bound to be a useless piece of shit and any initial advantage will quickly dissipate.

Filter is the key.
Becky Quick reads a portion of Charlie Munger's will
Dead Trout [video]
yeah, makes sense to me. it'll just result in unnecessarily antialiasing that pixel usually. unless it corrupts the definition of an object and then that object might disappear or become enormous, and probably most raytracing memory is objects, right? not rays being traced
Debatable. But it was never client work.

Truth is, I'd much rather hire someone who is interested in working for us for 2-4 weeks as a contractor instead of the normal interview process. But that usually doesn't work for the candidate.
We are two HN people who disagree. I think they're too attached to their ICJ procedural argument; it doesn't make much sense, and they don't need it to make the broader point they clearly want to make about Israel's moral culpability for genocide (an argument I don't agree with fully, but I disagree with less). That doesn't make them a liar or a propagandist.

If your arguments are strong, well-expressed, and calm, they'll do fine here, and there's no need to pick apart the people trying to rebut them. We know less than we think we do about people commenting here; I've spent 16 years watching people reach all sorts of weird conclusions about me. Let's not do that to someone else here. These threads are bad enough as it is.
iPhone Photos app already does incredible image subject search via ML locally. Versus Android which does it via cloud.
You need a slicing system that understands breakover angle. That's not unreasonable. There are CAM systems which really understand the boundaries of the tool, cutting head, and machine.[1] The best ones can work in very constrained situations. It's expensive software, because it has to actually work right to avoid expensive damage.

There's a whole frontier here, to build 3D printing systems that have more intelligent path planning than just slicing.

[1] https://www.youtube.com/watch?v=st4MqJZobCM
You can use the rootfs generated by a tool such as buildroot or yocto as a container layer.
> yet they thought they needed to hire people who could turn any O(N^2) algorithms into O(N) or O(Nlog(N))

And the great irony is that most software is slow as shit and resource intensive. Because yeah, knowing worst case performance is good to know, but what about mean? Or what you expect users to be doing? These can completely change the desired algorithm.

But there's the long joke "10 years of hardware advancements have been completely undone by 10 years of advancements in software."

Because people now rely on the hardware for doing things rather than trying to make software more optimal. It amazes me that gaming companies do this! And the root of the issue is trying to push things out quickly and so a lot of software is really just a Lovecraftian monster made of spaghetti and duct tape. And for what? Like Apple released the M4 today and who's going to use that power? Why did it take years for Apple to develop a fucking PDF reader that I can edit documents in? Why is it still a pain to open a PDF on my macbook and edit it on my iPad? Constantly fails and is unreliable, disconnecting despite being <2ft from one another. Why can't I use an iPad Pro as my glorified SSH machine? fuck man, that's why I have a laptop, so I can login to another machine and code there. The other things I need are latex, word, and a browser. I know I'm ranting a bit but I just feel like we in computer science have really lost this hacker mentality that was what made the field so great in the first place (and what brought about so many innovations). It just feels like there's too much momentum now and no one is __allowed__ to innovate.

To bring it back to interviewing signals, I do think the rant kinda relates. Because this same degradation makes it harder to determine in groups when there's so much pressure to be a textbook. But I guess this is why so many ML enthusiasts compare LLMs to humans, because we want humans to be machines.
None of that seems to be high loads or stuff that needs a lot of ram.
>$500

>Terrible in-house vendor locked Tensor CPU

>8GB RAM + 128GB combo in the EU

>Huge bezels

>8W wireless charging, are they for real

>Same camera setup on an "AI-powered Amazing Camera"

I don't know how to describe it, mediocre, I guess? Don't get me wrong, they surely did polish the phone, but apart from its out-of-the-box tuned camera, it has no value beyond actually mid-range phones in $300-400 range with a tuned GCam loaded on them.
DDR5 comes with on-die ECC. My understanding is this only checks errors occuring within the RAM itself, not errors that occur during transmission to and from RAM.

My question is, how common are transmission errors over errors happening within RAM?
Microsoft shuts down Bethesda studios behind Redfall and Hi-Fi Rush
IBM Research is hardcore.
Hate and Love Relationship with School
Why do I not wanna go to school and at the same time don't like people trashing higher level education like it's useless ?
People don’t generally run out of storage that often. I think perhaps you overestimate how much local data everyday people store.
Completely do not understand this play. We make money from selling consumer chips to China, possibly put backdoors in their laptops, and now we want to remove that?
Makes 0 sense from an economic AND national security standpoint considering these are laptop chips the US is banning.

Huawei is already banned from selling, why would they kick the dead horse so to say.

If anyone has any ideas, genuinely please let me know! I'm curious.
It stores lower res proxies on the device and full res in iCloud, iirc.
> Twitter/Mastodon/Blue sky is not the place to write long form posts.

Twitter is not the place to write/share much of anything. The other two, why aren't they for long form posts?
Brian Eno the same with music
Why sperm whale communication is much more complex than previously thought
Happily Yedit is supposed to make its debut in Windows in the near future. At least according to a thread at github.

Someone linked:
https://news.ycombinator.com/item?id=40293624
Agreed. For example their research lab in Zurich has been absolutely world-leading in things like atomic force microscopy (AFM) for four decades, including the Nobel prize in Physics in 1986 (AFM) and 1987 (high-temperature superconductivity). They also invented things like trellis coding and token ring.
I've not discarded them, it's just the the largest portion of data for where people in the US are, which NYC has an objectively good per capita murder rate compared to where most people live in the US. If we want to get data for the US as a whole, please point me in the direction where we can find the safety level of the median person, besides NYC having a 3.3 murder per capita rate while the US is ~6.5. Idk what % it is, but a large portion of Americans live in those lists of 100k+ cities.
I think King is a stranger to his own writing.

Having read a lot of his writing about writing, and having spent a lot of time (especially in my formative years) reading his writing, I think my understanding of his writing would sound totally foreign to him.

Like, I think he's got a lot of issues with father's and sex, to be blunt. I think Kubrick found a similar reading and built an excellent film around it. I think that King wrote an excellent novel about those themes precisely because he could do that with no self-consciousness, completely unburdened by that reading.

He focuses on craft, which is great and has made some terrific literature. At the same time, I think he too-easily dismisses reading text at any deeper level. That's great for writing but less helpful for digging up what makes the writing good. Similarly, it's helpful for living our day to day lives but less helpful for getting us out of dysfunctional patterns.
Discussion [0] (206 points, 15 hour ago, 192 comments)

[0]: https://news.ycombinator.com/item?id=40285476
And the results were quite awful... Steve Jobs couldn't wait to kill it.
This presumes that LLMs actually contain "reasoning" capability other than "the facts" and simple interpolation between them.

It is far from clear that this presumption holds.

Ingesting more text than a human could read in several lifetimes produces the ability to interpolate answers to a surprisingly large range of questions. This is not intuitive to humans, because we've never met anybody who could possibly read this much raw text, so we mistake this level of interpolation for reasoning since we've never met anybody who could possibly memorize-and-interpolate so much. The only thing we've ever seen that can answer questions like this is a human using reasoning capabilities, so we assume that's what this thing on the other side of the screen must be doing. Like chimpanzees mistaking their own reflection in a mirror for another ape.

This is the other "bitter lesson" of ML.

But if you spend enough time playing with these models you start to figure out what questions to ask to make them look foolish. And that is totally fair game for the Turing Test. Remember, there is no time limit on the Turing Test. However there is a strict requirement that the machine under test cannot be serviced, modified, or updated while the test is underway -- and because of this, nothing that OpenAI has produced is capable of even taking the test. We know that OpenAI tweaks and tunes their models whenever they please, as many times a day as they like, and that they use discussions here on HN to feed that process. So stick to the models you can download.

It's uncontroversial to say that this sort of "massive interpolation using superhuman text ingestion" is exactly how modern machine translation models work, and they work extremely well. LLMs were created by taking a machine translation model, throwing away half of it, and then fiddling with the leftovers.
On-die ECC is so they can give you a memory array with a few faults. It's a yield enhancement not an introduction of ECC as you think of it.

Adding protocol-level ECC on top only helps, although it is somewhat inefficient.
Phones and tablets are effectively single-tasking. They don’t need much more ram than that in practice.

I use my iPad Pro constantly for heavy stuff and I don’t know how much ram is in it; it has never been something I needed to think about. The OS doesn’t even expose it.
Is there a demo user/password for hn people to try this out? Signing up just to try something - will put off a lot of people.
For those wondering, we paid $50 an hour. It wasn't quite wage equivalent, but we felt it was reasonable to consider some of that "gap" as investment on the part of the applicant.
> If you think it true, then you are living in a bubble.

This is probably true. I only really talk to US startup devs.