MurphyA/hacker-news huggingface dataset:
by cma | 2025-04-23 00:26:35+00:00
Just since any continued training tends to cause catastrophic forgetting if the old info isn't regurgitated again.

Not specifically showing catastrophic forgetting, but hallucination for o3:

> From the results of this evaluation, o3's hallucination rate is 33 percent, and o4-mini's hallucination rate is 48 percent — almost half of the time. By comparison, o1's hallucination rate is 16 percent, meaning o3 hallucinated about twice as often.

https://mashable.com/article/openai-o3-o4-mini-hallucinate-h...

Deepseek R1 handles some of this by redistilling back in "factual Q&A" generated from original V3 model to make a new V3. The V3 paper mentions it incorporated an R1 pass too so it seems like: V3 base model, RL pass, V3 with RL distill and retraining a checkpoint for the final V3 release, additional RL pass for the final R1 release.

V3 Paper

> During the post-training stage, we distill the reasoning capability from the DeepSeekR1 series of models [I think that refers to the earlier checkpoint R1 after the first pass below]

R1 Paper:

> To address these issues and further enhance reasoning performance, we introduce DeepSeek-R1, which incorporates a small amount of cold-start data and a multi-stage training pipeline. Specifically, we begin by collecting thousands of cold-start data to fine-tune the DeepSeek-V3-Base model. Following this, we perform reasoning-oriented RL like DeepSeek-R1-Zero. Upon nearing convergence in the RL process, we create new SFT data through rejection sampling on the RL checkpoint, combined with supervised data from DeepSeek-V3 in domains such as writing, factual QA, and self-cognition, and then retrain the DeepSeek-V3-Base model. After fine-tuning with the new data, the checkpoint undergoes an additional RL process, taking into account prompts from all scenarios. After these steps, we obtained a checkpoint referred to as DeepSeek-R1, which achieves performance on par with OpenAI-o1-1217.

In general with fine-tuning you can avoid catastrophic forgetting by mixing in the original data during later fine tuning steps, and from this it seems the same is true of the RL phases, but they are also doing some amount of augmentation and selection on the the data involved.
by CJefferson | 2025-04-23 00:26:35+00:00
Honestly, that's still far too much help in lots of cases.

Finding a set of papers, whose results can be combined in a reasonable amount of time to make a new interesting result is itself a hard problem. This is often a thing Professors do for PhD students -- give them a general area to research and some papers to start reading.

It's still a contribution, but so much easier than just asking "Hey, choose a set of papers from which you can derive new interesting results"
by spudlyo | 2025-04-23 00:27:12+00:00
Thanks for the shout-out! I think org-babel is really well suited for this task, and can make some really great documentation. You can check out the video[0] from the talk and a git repo[1] with a more advanced demonstration.

[0]: https://www.youtube.com/watch?v=0g9BcZvQbXU

[1]: https://gitlab.com/spudlyo/orgdemo2
by kayodelycaon | 2025-04-23 00:27:14+00:00
I do feel the need to point out this model is far from universal.

For instance, I'm bipolar and my brain does not do effort/reward or duration. It also forgets, ignores, or refuses things no matter how much motivation I have.

I've had to find different strategies that do not rely on executive function. For example, buying a car that had a push button to start instead of a key.
by bloaf | 2025-04-23 00:27:23+00:00
I feel like there are a few ways in which science could be advanced by AI models.

1. We have the sense that "science progresses one funeral at a time." An AI model could be used to recognize situations where a single viewpoint is getting a disproportionate amount of attention in the literature, and warn journals+funding agencies about any disconnects between attention and quality of work.

2. We have the sense that "It Ain’t What You Don’t Know That Gets You Into Trouble. It’s What You Know for Sure That Just Ain’t So" An AI model could identify the most high-profile results in the literature that have contradicting evidence and call for further, decisive study.

3. Interdisciplinary translation. There are many many cases of different branches of science re-discovering each other's work. I believe I read an article a little bit ago about an academic in a somewhat softer science publishing a paper proudly claiming the discovery of linear regression. Obviously not all cases are so egregious, but an AI could advance a discipline just by pointing out areas where that discipline is using outdated/inferior methods compared to the state of the art.
by LeifCarrotson | 2025-04-23 00:28:00+00:00
> Maybe all the complexity around this is too much and people just want to plug it in and quick 100% as quick as possible and will change their phone regularly

It's this, 100%. The nerds that care about charge temperature and battery degradation and proliferation of incompatible charging standards are a rounding error, most people just want to know it can charge fast in case they forget and need to leave soon.

I am happy with my Chargie [1], an interposing dongle which provides a Bluetooth receiver and app that lets you set arbitrary preferences on your phone and fast charge, slow charge, or turn off the charger at configurable state of charge setpoints or times.

[1] https://chargie.org/product/chargie-c-basic/
by syntaxless | 2025-04-23 00:28:53+00:00
Fractional reserve banking means the bank only has a small percentage of the money its customers deposit on hand (currently 0% since 2020). What do they do with the rest of that money? They invest it. They take on risky investments because it will either pay off or they will be bailed out by the taxpayer through FDIC. There is zero risk on the banks part.
by pwndByDeath | 2025-04-23 00:29:37+00:00
Doing it wrong, the point of crypto was to liberate you from 3rd parties. Its also not exactly improving anything on an efficient and stable financial system.

If you live in a place, or trade with a place that doesn't have a good system, then you might have a reason to use crypto, but be responsible for your own wallet.

If you feel like your stable system might turn on you, it might be wise to have your own wallet and hide it someplace just in case.

I expect the killer app moment will be when nations or nation level entities realize they can conduct trade without the permission of the US.
by defrost | 2025-04-23 00:30:57+00:00
It hasn't been flagged, it's not dead.

It got eyeballs, it surged, it got pushed down. People that matter will likely notice to some degree, some here run their own analytics on what rises and falls.

Not a roaring success, not a waste of time failure either. :-)

For my part, I'm a fan of Gruen * but not in the trade .. I do have the power to flag [dead] obvious spam submissions and you passed my bar for minimal effort - no obvious green spruik accounts commenting inanely to boost traffic - an account with some history, etc.

If you're wanting to build rep on HN then don't be afraid to submit interesting material under this account that isn't just kupajo.com and kolyder.com .. this is a YC adjacent quasi independant forum with guidelines .. one of which is to avoid accounts that only self promote.

Please don't use HN primarily for promotion. It's ok to post your own stuff part of the time, but the primary use of the site should be for curiosity.

~ https://news.ycombinator.com/newsguidelines.html

* https://en.wikipedia.org/wiki/Gruen_transfer

* https://thetvdb.com/series/gruen

* https://iview.abc.net.au/show/gruen
by kirrent | 2025-04-23 00:32:14+00:00
Popularly it's been reported by mariners that the whales are asleep. It makes sense, they need to stay on the surface to breathe and there's no evolutionary reason not to sleep there. It's really not that simple though because whales are unihemispheric sleepers (one brain hemisphere sleeps at a time) who need to stay partially awake because all their breathing is voluntary. They maintain a degree of awareness to their environment because of this. It could be a factor though because it's possible that some whales lapse into a deeper sleep for periods between breaths (https://doi.org/10.1016/j.cub.2007.11.003) where they aren't responsive to approaching vessels.

When I was interested in whale collisions I was surprised to read this review (https://doi.org/10.3389/fmars.2020.00292) which didn't even consider sleeping as a large risk factor for collision. Instead, factors included:

- They're involved in distracting behaviours such as feeding, socialising, foraging, resting, etc.

- Acoustics are complex near the surface involving surface reflections and direct paths which can interfere.

- Ships may form an acoustic shadow in front of themselves. Not only the hull shadowing the propeller, but also other hull sounds.

- Sailing vessels, which are the source of a lot of reports (harder for them to miss it happened) are quiet.

- Even when they hear an approaching vessel, some species just move slowly to avoid them.

These collisions apparently used to be much rarer. Ironically, the increasing number of whale injuries and deaths are a result of recovering populations.
by cma | 2025-04-23 00:32:37+00:00
> Google has wanted to block third-party cookies for a long time and they can't because they're not allowed to, legally.

There's no reason they couldn't allow add-ons to do it: but instead with manifest v3 I think it is impossible to do it in a general way isn't it? Like with the other ad-blocking you have to have a hardcoded number of rules you can define for blocking cookies in the requests as well, at least through the declarativeNetRequest API.

Maybe it is possible for through one of the cookies APIs, but the cookie's API has race conditions where the site can still sometimes see them from what I understand and redirects can activate before your extension gets a chance to respond.

And then of course extensions don't even run on mobile and that isn't an accident.
by nunez | 2025-04-23 00:32:43+00:00
Spot on.

Reading through IBM computer brochures and fooling around with the desktops and laptops in our local Costco were favorite past-times of mine.

Cheap desktops existed but were universally terri-bad. Low spec Celeron processors with anemic memory and disk space. They _just barely_ ran Windows and ground to a halt after most users got done installing their IE toolbars and some form of Office. (Remember when Office Professional was EXPENSIVE?!)

Cheap laptops didn't exist before netbooks. Like, they just _weren't_ things.

You can get an M4 MacBook Air these days for $999. A laptop that can do just about anything, including and up to CAD and photoshop work, for at least $1000 (today's prices, NOT today's real prices) less than a middling Thinkpad 600 that had maybe three hours of battery life and was good enough for word docs but not much else.
by hifikuno | 2025-04-23 00:33:29+00:00
Oh wow that's neat! I honestly didn't think of using chunks instead of a single line and the result looks pretty good.

I love the fact the top (or first?) comment is by dllu, and looking on their webpage I saw the tram photo from Wikipedia! It's cool to see the photographer talking about their work. I think about that tram photo so much.
by FloorEgg | 2025-04-23 00:33:30+00:00
There is so much about your comment here that I appreciate (similar to your other reply to me). Thank you.

I wish I had time right now to thoughtfully ask a couple questions I have, but it will have to wait.

I am compelled to squeeze this in:

"As for the risk, a lot of these theories bear a deep legacy of overt racism just begin their skin; they've historically been used to devalue the abilities of the people who've made them (e.g., Great Zimbabwe). Nowadays, they've been modified to edit out the basic message of "white people taught everybody how to civilization," so it's no longer quite as overt as their late 19th century ancestors... but you can still see the lingering traces of it in "an ancient civilization taught everybody how to civilization.""

- Wow! Holy cow, I had no idea, and this hadn't remotely crossed my mind. If anything, I would have thought the opposite. (that evidence of incredible achievements by ancient civilizations would diminish [relatively] the achievements of modern ones).
by femto | 2025-04-23 00:35:56+00:00
This article is great: hard data from someone who is actually doing it.

The way solar panel prices are going, my suspicion is that the most economical way to get a reliable home system is to massively over specify the solar array so it puts out a decent amount of power on the worst possible day. The electronics would be sized to account for your maximum usage, even if that means dumping energy when the array output exceeds what you need. A battery would be sized to simply last overnight, on the assumption that the oversized solar array will be able to fully recharge it the next day whatever the weather. It would only be worth upgrading the electronics/battery if a buyer/money earner could be found for the excess capacity. I need to do the numbers to see if this hypothesis is true.
by osigurdson | 2025-04-23 00:37:54+00:00
Having a SQL like syntax where everything feels like a normal DB helps a lot I think. Of course, it works very differently behind the scenes but not having to learn a bunch of new things just to use a new data model is a good approach.

I get why some create new dialects and languages as that way there is less ambiguity and therefore harder to use incorrectly but I think ClickHouse made the right tradeoffs here.
by thomasfromcdnjs | 2025-04-23 00:38:00+00:00
Portions of the react community are excited about how it's starting to feel more like PHP with the movement towards server actions in "client" code etc

I personally don't like that direction so looking forward to exploring new frameworks.

What I've generally liked about React/Next setups is that the code is generally explicit and less magic (I also have gripes with hooks feeling like magic). Things like Vue/Svelte where they mash together css and js in the same file if you want kind of turns me off.

Does anyone know if SolidJs projects are fully js?
by llamavore | 2025-04-23 00:40:48+00:00
Agreed that behind every success is something which can be viewed retrospectively through a negative lens. The king of this is Uber.

Perhaps this is more a reflection of hyper-capitalism than tech itself but the is book is more about the ends and less about justifying the means. The word “hustle” is doing a lot of heavy lifting.

I imagine stories like gumroad and Basecamp are much better ones to idolize on a better way to create value in the world.

In some ways network effects and monopolies can be used synonymously and most would agree the later is a negative thing.
by simonw | 2025-04-23 00:41:18+00:00
"It’s becoming clear that real-world agentic systems work best when multiple agents collaborate, rather than having one agent attempt to do everything."

I'll be honest: I don't buy that premise (yet). It's clearly a popular idea and I see a lot of excitement about it (see Google's A2A thing) but it feels to me like a pattern that, in many cases, will make LLM code even harder to get reliable results from.

I worry it's the AI-equivalent of microservices: useful in a small set of hyper complex systems, the vast majority of applications that adopt it would have been better off without.

If there are strong arguments counter to what I've said here I'd love to hear them!
by stackskipton | 2025-04-23 00:41:55+00:00
None that I can think of. Maybe LLM that knows Terraform would help me out BUT I'm not sure I'd pay for it because most Ops people don't spend their entire life writing Terraform. They write few modules, publish them, update them occasionally and that's it.

Most of mine is hard political stuff which is to say getting Devs/Leadership to give a passing care about Ops. Outside FAANG/FAANG types, most companies are fine with Devs going "Light is green, trap is clean" and not caring about containment field (Ops). Paging me out at 2AM is not something Devs can get in trouble for.

This is common thing I see with most FAANG founders. People coming from Google Operations think, ok, it's probably 10x worse than horrors I saw. No, it's much worse.
by fzwang | 2025-04-23 00:44:34+00:00
After seeing a ton of teams and failed companies, I think people fall into two categories. The first group don't care much about what they work on, as long as it grows quickly. The second group is emotionally invested in an idea/space. This is obviously a gross generalization, but you get the idea. There are good and bad manifestations for each group. The anything-that-pops group can over-pivot and never stick it out, but obviously rolls the dice more which improves chances of a good outcome. The my-life-calling group can get too ideological and be stuck on something that's just not working/isn't the right time, but the endurance is necessary for building great companies. There is no right way. I think the most important thing is for you and your co-founders to understand each other's stances and the types of sacrifices you're willing to make. Your stance could also change with experience, so you should check in regularly. Nobody's born with a "calling" and it's developed over time. But should your stances diverge in a significant way, a lot of conflict can result.

For a good breakup, I usually think about 3 perspectives:

1) Relationship with your co-founder(s) - Unless there's some major violation of my values, I'd like to be on good terms even if the team fell apart. That means you might still grab dinner/beer with them and even help them out in their next venture. You all may end up co-founders in the future when you're all wiser and the opportunity presents itself.

2) Reputation with your investors - The VC space is smaller than you think, and you need to maintain goodwill. These investors did make a bet on you, and I think you'd want to demonstrate you tried your best. You might even return some of the money left (it's mostly symbolic, but w/e counts). Most VCs understand failures are inevitable, but you don't want to leave the impression that you were the problem.

3) Self-image/self-esteem - I think many founders underestimate the benefits of a good closure emotionally. A good breakup means you sleep well at night and are content with how you handled things. You don't want bad vibes to fester and ruin your motivation and focus for whatever you do next. Building a company is already hard enough, you don't need the debuff. Doing rash things you'd end up regretting will likely cost you more time and opportunities later.
by xracy | 2025-04-23 00:44:56+00:00
This is honestly insightful to me in a way that I struggle to relate to one of my family members because I try and make appeals to logic and the truth, and they make a ton of appeals to people they think I would find to be authority figures. I have never seen this stated in such a clean way that got me to that understanding.

I guess it doesn't help me solve it, but baby steps.
by shadowgovt | 2025-04-23 00:45:00+00:00
That's not really been the standard the world holds itself to since World War II.

Yes, aggressors in a just war are expected to care for the civilian population in conquered territory. Starvation as a war weapon against civilians is a war crime.

https://www.bsg.ox.ac.uk/sites/default/files/2019-11/BSG-WP-...

In fact, the only place it's currently legal (though generally frowned upon) is in the context of a civil war, and if this is a civil war we're back to asking the question: how does Israel expect to find peace when 9 million citizens are oppressing 5 million with brutal military violence?
by nunez | 2025-04-23 00:46:12+00:00
Agree big time on induction ranges and convection stoves.

This was one of the first appliances I got after buying a house. I LOVE using it. No fume, no waste heat, and, most importantly, I never have to worry about the range being left on by accident ever again! The cooktops won't turn on if there isn't a ferromagnetic surface on top, but even if they somehow did, the glass cooktop is cool to the touch.

Between this and our heat-pump dryer, I wish I could remove gas in our house for good. Unfortunately, gas furnaces are still much better than heat-pump options.
by eek2121 | 2025-04-23 00:48:19+00:00
“Your viewport concerns me. Hey! You're seeing this message because of your screen- specifically, the width of it. I'm hyped you're here, but this game wasn't designed for small screens, and you will not enjoy attempting it. I mean, would you write code on your phone? Actually, don't answer, because I don't want to know. Anyway, hope to see you soon on a desktop. -Marcos”

Hopefully “Marcos” doesn’t need a job any time soon! :D

Unsure if the site is supposed to be satire or something because that is the message I received, however, CSS, including responsive design, is actually simple to pick up.

Note that I’m not a designer at all (because THAT requires actual skill), just a dev.
by sandworm101 | 2025-04-23 00:48:20+00:00
Wolverines have soft tummies too. That we see cats as cute is not so much that they have evolved to be cute. They look little different than wild cats. We see the palus cat as cute but pet its tummy and you will lose some organs. Those humans who protected and nutured cats were better survivors. Having cats around gave them an advantage over people who were indiferent to cats. We finding them cute is a trait that has evolved in us.

https://en.wikipedia.org/wiki/Pallas%27s_cat
by cyp0633 | 2025-04-23 00:48:41+00:00
Many phones/chargers with propietary protocols are also equipped with USB PD compatibility. For example, you can pick up some random Xiaomi phone labelled at 90W and expect it to charge at more than 20W with USB PD, or even ~90W on some vivo models.

I don't see why the best charger is the old feature phone's charger - the point in fast charging is that you don't have to wait too long if in a hurry. That charger is the "best" if only you have almost unlimited time to charge, like during the night.
by nmfisher | 2025-04-23 00:49:01+00:00
I'm a happy Supabase customer. It's not just postgres, it's postgres + auth + functions + storage all in one place, with a very good local Docker environment and a variety of nice client SDKs.

It's a quick/convenient way to get a "full" backend up and running. The other option (Firebase) can't be self-hosted and has some absurd pricing footguns.
by sokoloff | 2025-04-23 00:49:22+00:00
There is a lot of distasteful enforcement and threatening/intimidation going on elsewhere.

I’m not sure that these are the cases that will evoke a lot of sympathy or cause a conclusion that this is unconscionable.

> The immigrants being targeted are generally people who were convicted of a crime after arriving in the U.S., making them eligible for deportation after their release from jail or prison.

> whose deportation orders have been on indefinite hold for years are being detained, and in some cases, deported
by Mawr | 2025-04-23 00:49:51+00:00
> Where is inheritance?

It's been widely considered as a mistake for about two decades now...

> I couldn't even find a standard linked list.

Even? If you need a linked list, then you have a 0.01% use case and shouldn't expect such a niche data structure to be easily available. That said, https://pkg.go.dev/container/list

> What if I have a list where I need to make lots of insertions in the middle?

Then you should use an array. If you're not making full use of the pointer-y nature of a linked list, you shouldn't be using it.

> Where is the data structures package?

Go only got generics in 2022 so the standard library is lacking in ergonomic data structures.