skysight-inc/HackerNews huggingface dataset:
>No, the very specific field of AI. Holy crud. Even within computing, first-principle approaches are wildly useful as soon as you step outside of the field of AI, first-principle systems produce better and more accurate simulations, are better equipped to handle emergent systems, they're better equipped for complicated tasks like physical rendering. Outside of AI, nobody doubts that efficacy of first-principle reasoning about the world.

I never said first principle approaches were useless. I said they failed to model intelligence beyond a small niche and it wasn't for a lack of trying.

>I mean... it doesn't matter unless you want to be able to make accurate predictions about what the system will and won't excel at, or want to engage with the nuances of how the system works beyond the broad strokes. Are you seriously suggesting that it's of no importance that we figure out how large neural networks like GPT work internally? I don't think any serious AI researcher would agree with that.

You don't need to figure out how GPT works internally to make useful predictions on what it will and won't excel at. Humans haven't figured any of that out and we're not doing too bad. But that's not why i said, "It doesn't matter"

I meant that what dumb optimizer you use is not as big a deal as you think. a solution isn't some copyrighted piece. There's no solution police. 2 completely different optimizers could well stumble on the same solution.

>Citation needed. I believe it can result in very powerful solutions, I don't see any reason to believe that pure language prediction and evolution, two algorithms that are fed different inputs and optimize in different ways would produce identical results.

I didn't say anything about would. I said it could.

Yes every now and then, we find parallels.
https://arxiv.org/abs/2309.01660
https://www.nature.com/articles/s41562-022-01516-2

> This doesn't actually matter. A language model [not] is trying to predict the next token. It is trying to reverse engineer the computation that could have led to an utterance.

>I don't think OpenAI researchers would agree with you on this. Yes, GPT is building heuristics and models that allow it to better predict an utterance. It is not clear that it has any motivation to accurately model the underlying reality that led to that utterance. To be clear, we don't know how GPT models the world internally or what it models.

You added [not]. I did not intend that. A language model is trying to predict the next token. I am simply telling you what that means. It means modeling the underlying structure implicit in the creation of the data. It means that if you give a model a sequence of proteins only and nothing else, biological function and structure (secondary structure, contacts, and biological activity etc) will emerge in the inner layers. This is what it takes to predict the next token. https://www.pnas.org/doi/10.1073/pnas.2016239118

On the contrary, that is exactly what ilya sutskever (open ai's lead scientist) believes. Watch 3 minutes from here.

https://www.youtube.com/watch?v=SjhIlw3Iffs&t=903s
A whole decade of handover, holy shit!
It is an overview of what is new about their hardware and technical advice (but not overly technical) on how to maximize the GPUs performance.

I watched the full video and thought it was excellent. I wish other CPU/GPU manufacturers made technical overview videos like this. I've never programmed graphics targeting metal before, but I feel much more inclined after watching this so I guess it was good advertising.
The thing that seems to counteract my wrist pain is pulling exercises. Essentially anything where the wrist is pulled away from the forearm: pull ups, deadlifts, bent over rows, even stretches against the wall. Pushing against the wrist made things worse for me, but the pulling exercises counteract it.
LAWYERS and insane politicians are the reason why it is this way. Google is just working around all the BS which unfortunately leads to these bizarre behaviors.
It is much less challenging with Bambi[1] and brms[2].

[1] https://bambinos.github.io/bambi/
[2] https://paul-buerkner.github.io/brms/
Another version of what Bill Gates said: '640K software is all the memory anybody would ever need on a computer.'.
That's not the only other alternative.
You can borrow books on good parenting at your local library and/or family planning clinic
> The no-side effect philosophy is a dead end.

??? Erlang and Elixir have of tons of side effects. You must not either know the languages well—or maybe you mean immutability?

If you mean immutability, have fun building highly concurrent systems without it. The local reasoning and safety guarantees that immutability gives you makes building large scale applications sane—that’s the only way I’d want to program.
It’s absolutely not true and hasn’t been for at least the last 5 years, in my experience.

I have access to every building in my city despite only requiring access to one of them, and I didn’t have to request it.

When I visited Seattle, I had to request access (which required clicking a grand total of 5 buttons in an internal portal and was instantly auto approved) to “the Seattle campus” and was granted access to every building, and still have that access years later. It wasn’t temporary.

Ditto for the other offices I’ve visited, both domestic and abroad. One office internationally I literally showed up and walked to reception and said “hi I work here but I’m visiting from out of town” and they immediately gave me access. I don’t see how this is different from the “second passport” described in the article.*

There are a couple of limited-access offices such as for subsidiary companies, but those are not the majority.

* - the one big difference definitely is the amenities and food, though. Amazon offices don’t have great, or even good, food. And the amenities are lame, most offices don’t even have a gym. There isn’t much of a reason to stop by an office unless you’re specifically there to work.
Maybe one could just decide that concrete blocks and debris can be collected any time int the future from a field area and just allow it to launch
Some states do on the driver's license application, IIRC. So, situation is slowly improving.
Storms will also get worse and more frequent, so I assume storm surges will get worse as well.
Talk about adding insult to injury...
If you want to keep the embeddings relevant, you could train new models with the cosine distance to the current embeddings as part of the cost function, it would then get the new embeddings as close to the current ones as possible, like curve fitting.
The common for all three is how little they expected from the audience.
> t is my OPINION the article is in some ways wrong or incorrect about what the problem is.

Ok. What's wrong about it? That fertility rate is below replacement, or that this means population must eventually drop (already happening for Japan, for South Korea)?

> I don't think you can convince people to have children. They either want to or they do not want to.

That's silly. People's wants are not summoned from some ethereal void. Circumstances cause those desires, and the circumstances changes... so their wants did too.

A curious thing happened when I was raising my own children. They never heard me say anything that sounded like I didn't like being a father. None of the stupid sitcom jokes. Never a "I wish I didn't have kids" muttered under the breath. And now, they genuinely talk as if they want kids.

To make someone not want kids, you have to brainwash them through their early developmental years, making it seem like the worst fate possible. That's the only way to override the biological imperative, and even then they end up getting drunk and not using condoms someday only to go abort it.
> And then moving out of the California school districts, the new district didn't recognize those courses at all, so when she aced precalc and they didn't have enough kids to take calc, they had her take ... algebra 2. WTF? Then when she went to back to California for college, they made her take precalc AGAIN!

While these objections are totally legitimate and were terrible for your daughter to suffer through, they have little to do with Common Core other than it being an alternative math instruction method. Badly run districts not providing calc courses when a student is qualified and ready for them and colleges not accepting credits from other states is merely bad bureaucracy, uniquely impacted.
I work professionally as an elixir developer for longer than that before starting a PhD program; Elixir was and still is a gem. It’s not perfect. It holds up incredibly well though.
To be clear, I'm not a programmer, but...

Wouldn't you expect LOC shipped to go down as level of impact (eg, size of customer base) goes up?

100 lines on GMail has a lot more impact than 100 lines on a homegrown accounts receivable engine for a small business.

Feels like it should be (LOC * weekly_executions) at least. And that's before we get into the efficiency of the code.
You can always add more swap. /s
Yeah but how do they connect the eye nerves? We've been told over and over that modern surgery doesn't know how to do this.
It’s amazing how bad the competition is. The A17 pro has 2 performance cores and 4 efficiency cores. The Google G3 has 9 cores of 3 different types, the fastest being slower than Apple’s performance cores, the most efficient being less efficient than apple’s efficiency cores. And it’s a phone so you don’t take advantage of the extra parallelism. You just get the worst of both worlds. no wonder these android phones have 50% more battery and 50% less battery life. Is it that hard to just copy the winning formula?
My magic crystal ball just showed me that they're going to use your email for training AI models.

They're just trying to catch up with Google in any and every way they possibly can, users trust, privacy and security be damned.
SumUp (8B valuation) uses Elixir and I'm sure there are more.

https://www.crunchbase.com/organization/sumup
https://www.sumup.com/careers/positions/berlin-germany/engin...
> These days the cut should be closer to 5-10% at most.

It's interesting to see this randomly thrown out, I'm curious if there's any basis for this? Epic Games currently takes 12% and five years later they're still unable to turn a profit. That's for a store that wrote a brand new launcher that's worse than Steam's and they don't have nearly half the features Steam does.

I believe Humble takes 5% and they're also not doing that well.

5% would hardly even cover the CC fees. Not to mention refunds.
> For in-house stuff agree. There is no point to make excessive config layers if only developers will touch it anyway.

Yeah, I'm specifically talking about in-house DSLs or those that are only used by/from specific users. That doesn't have to be developers, but they should be using the host language as well - and in that case, an imperative host language can still make it able to use a declarative DSL. (in the most basic way for instance: generate a datastructure that essentially describes a json/yaml or whatever)

For non-inhouse DSL, I agree that it is usually worthwhile to make them standalone.
Stuff.... I had too much stuff.... when you've got things you haven't seen in a decade, and no longer want, still in the bag from the day you bought them... it changes your perspective.

I really need to spend far more time curating the objects in my life.
>Any competitive tournament with an entree fee is gambling?

technically yes. But not all gambling is illegal. because the legal definition of gambling is more precise.

I think that's the part that is forgotten in the discussions because we conflate the casual definition with the legal one.
I had bad RSI for ages. What helps me and other comments have agreed is pulling excercises. Specifically I have a bar at home attached to the ceiling. Just hanging from the bar as long as you can and doing that regularly seems to stretch out the right muscles/tendons. Don't over do it but at the beginning I could only do 20 seconds. Now I can hold on for 1 to 2 minutes depending on the day.

I have very little wrist pain any more.

I also have a kinesis pro keyboard and a MX master mouse. They both add to the improvement.
> driving through mostly forested areas

Yeah, well that's just not the case at all here. The drive from Stallings to downtown Charlotte is almost entirely on Independence Boulevard, which is very much a stroad ( https://en.wikipedia.org/wiki/Stroad ), very much developed with lots of pointless strip malls and office parks and little visible nature, and certainly not a foresty experience. The fact that you can see green nearby on satellite view has little to do with people's actual experience driving on these roads.
I think thay the complain here is more that it comes with 8GB of RAM and less that the upgrade costs 200$. Apple fans are people for whom the money are usually not a problem.
There is so much more to life than being productive. Many of us are living with "internalized capitalism".

Something that helps me get over that feeling of not-doing-enough is time tracking my work (using a tool like Toggl). After a few months you get the sense that a productive day for you is X hours of work, and that makes it easier to disengage from work once you hit that point in your day. Knowing what your "X" is per day also justifies taking a break at hour X+2 because you know that you're straining your body at that point.
Agree. just like you wouldn’t over do it walking the first time.
Does apple document exactly how many actual true cores there are inside their GPUs? It is always confusing they say "40 core GPU" but I assume these are shader cores which each inside them can execute (per the video) "many thousands" of parallel execution paths.

So how does one translate to an equivalent in "CUDA cores" type terminology?
I've never seen it on large logic chips, but this is pretty common on power ICs. Look up TI's HotRod QFNs for a particularly well-marketed example. Of course, the fab processes here are basically stone-age (for example, 0.6um BCD is still very common), so such things are easier to do and more beneficial for high-power parts.
8GB is still good enough for office workers and students. Heck, I used an M1 8GB Air for 1 year as a dev. Although I wish I had more RAM, it still served me well.

For $899 (on sale sometimes), the 8GB M2 Air is absolutely a steal. The screen quality, thinness, battery life, build quality, SoC, quietness, coolness, metal enclosure, touchpad, and speakers are simply unmatched by anything in the PC world at that price - sometimes any price. Those things cost Apple money. Other PC makers cheap out on them. In order for Apple to earn higher margins, they make the RAM and storage upgrades very expensive. So the base versions actually offer great values. It's the upgraded RAM/storage that decreases the value but still good value overall considering what you're getting.

I understand why 8GB is still the base. Everything except the RAM is outstanding and unmatched. Apple makes the money on RAM and storage upgrades.

Perhaps Apple will start at 12GB for M4 generation. Perhaps the arrival of local LLMs will skyrocket RAM upgrade demand such that Apple can start the base at 16GB and still have plenty of people who want to upgrade to 32GB. The problem for Apple will always be if they can increase the base without hurting upgrade profit.

On a slightly related note: $/GB for RAM hit a wall starting in 2011. https://assets.ourworldindata.org/grapher/exports/historical...
This will excerbate the problem with electronic waste by shortening the useful life

Apple should be more serious about their environmental commitments
For me, a huge part of it is that I find static typing to make the code a lot more self-documenting.

I can easily see what is passes or returned, and if I'm unsure about the details of the type the answer is a click away, or a short web search away at worst.

Significantly reduces my mental load, allowing me to be vastly more productive.
Bad integration is a problem with integration even if you personally do no integration
> Doctors complete first successful face and whole-eye transplant

Wha happened to the brain transplant ?
They should stop selling 8GB configs, but they shouldn't hike the price by $200 to do it. They'd make the same margin dollars (though not percentage) if they hiked the base prices by $40 and bumped them all to 16GB. But obviously this is Apple we're talking about, and they've been playing these cynical margin games with their customers for 30+ years.
When I started my current job they gave me an M1 Mac with 8GB because it’s what they had on hand.
I could barely run my IDE and a web browser. At least 1GB was for video memory, and it was swapping constantly.
I couldn’t run docker containers because of how much input lag I would get.
8GB is barely usable and shouldn’t even be an option for a Pro machine.

I used it for a week before switching to a personal desktop with 64GB.
There is something pretty similar this called Project-Based Learning which tries to get there. Kids are tasked to find something that they're interested in, then the lessons that need to happen are modulated by their unique personal projects. It doesn't produce useful things, but it does produce things that they care about, which is nearly as good.
I don't know about your facts, but

"Is it that hard to just copy the winning formula?"

yes it is, thanks to IP law. And back in the day Steve Jobs already wanted thermonuclear war on Samsung, because he felt their flagship at the time was too close to the IPhone.
The accuracy argument gives me flashbacks to the days of talk/ntalk/whatever conversations as a teenager, over 2400bps modems, cross country. I distinctly remember realizing I made a typo 3 words ago, while the cursor was several lines up, and being able to quickly backspace, fix it, and continue typing. It was so satisfying to finish my thought, and then watch as the cursor spewed out the words, the typo, go back, correct the typo, and continue on perfectly. This happened all the time.

My accuracy has only gotten worse as internet speeds have improved :)
Upgrading to 16GB costs as much as dinner for two at a moderately nice restaurant.
Or, you can do what I did when an evil manager tried to do this to me: tell the new hire what’s going on, work as a team to do a great job for your customers while turning them against management, then use managements opposition to all your great work together to get said management fired.
My question is will they still collate all that data. There is no point in charging us to just have our data harvested like Twitter is doing rn. I think they should make that clear, if so then it’s not the worst idea in the world because they make like 97% of their income from ads, so unless we’re willing to pay to use FB etc to stop it from happening.

Obv like I said will they still harvest and I think they will.
Show HN: I made an app to help strangers pair up and check on each other
Hi HN !
I've struggled with anxiety for most of my life.
But I was lucky to have a supporting family and friends.
Not everyone has this chance.
So I made Wiro Talk to help strangers pair up and check on each other.
Check it out and tell me what you think.
It's an mvp so yes it's using discord at the moment.
Without google translate (german): https://www.heise.de/news/Microsoft-krallt-sich-Zugangsdaten...
Yeah, probably the reason why it’s not only forum and screenshots? Don’t know.
I miss static typing for two separate and quite opposite cases:

* trivial errors, that still cause a crash and waste my time ("foo(:yo, 7)" but was "foo(7, :yo)") - sometimes spotted by Dyalizer

* complex nested structures. In Java I never have surprises as to what foo.bar.baz is and I can use autocomplete reliably. Expressing the same invariant in Elixir is something less straightforward
To go where? All the mainstream outlets are already like this. NYTimes/Vox ate jezebel lunch during the Trump years. There is nothing left to infect.

There is a lot of production of perma outraged progressive content. Problem is that the american PMC is not able to buy and consume all of it.

In the last year accusations of racism, sexism, transphobia and other tools of grievances politics just don't get traction
Eh, if you give more Ram developers will just take advantage of it. Realistically perf headroom just gets eaten up on shitty code and abstraction layers. Ever notice how word is always the same slow-ish speeds. Never really faster.
Pilots Have Their Own Secret Language. Here's What They Mean
Collaboration doesn't have to rely on everyone being in the same room or building.

At times I've even seen better collaboration between random open source maintainers working together than some of the companies where everyone was in an open office floorplan.
Ok but as a society we’ve settled on letting fully grown adults partake in some forms of gambling. Are we really equating loot boxes in a mature rated game to casinos that will empty your kids college fund in the span of 12 hours?
you could never hear the audio that cleanly on a VHS even with HiFi tracks.
Isn't this just LTT speculation and nothing is confirmed yet?
here have some Qualcomm Kool-Aid to go with that sweet Apple juice :-)

https://www.youtube.com/watch?v=h_vh7_n_OPs
He probably never said that.

https://www.computerworld.com/article/2534312/the--640k--quo...
Nice. Don’t have to have RSI to appreciate this. I think I prefer this to learning vim shortcuts. I would rather say U than Urge so I don’t need to think but the phonetic alphabet would do I guess.
In high school, I took two semesters of typing on typewriters. For our tests, Mrs. Beck would take the correction ribbons out. There was no point in trying to fix anything, keep going as fast as possible.

We went to a tri-county competition that used computers instead. I was the only one from my school that realized we could correct our mistakes during the competition. I sacrificed a bit of speed to get 100% accuracy and won the whole shebang. Mistakes were heavily penalized in the scoring.
Indeed. Without as much as a hint of questioning why they felt completely normal to write the previous article with such stupid headline and content. If it were a company, we’d say it was a non-apology apology and that it shows they don’t want to admit the problem.
Apple's memory and SSD prices are too damn high for what they're giving. Basically ~$200 per 8GB of RAM and ~$200 per half terabyte of SSD. This is well out of line what you pay for both in any other product or standalone, and there's nothing especially good about the RAM and NAND chips they use to justify anything close to those prices. If they were buying SSDs retail off of Amazon and marking them up 30 or 40 percent, that would be a bargain compared to what they charge for SSDs right now, and they're not paying anything close to retail prices themselves.
The video is just enough of a peek into the GPU's to encourage people to write using Metal API's (and by the way, use the new APIs and FP16).
React architecture patterns serve as the blueprint for structuring React applications on the web. These patterns streamline the handling of components, data flow, and state management. React patterns encompass popular models such as MVC, Flux, Redux, and MobX, each tailored to specific strengths and applications, fostering the development of robust and scalable web-based React applications.