skysight-inc/HackerNews huggingface dataset:
This is extremely low quality data, if you can even call it data.

They used survey results from the Nurses Health Study (NHS), which are decades long studies, still running, where participants fill out a food frequency questionnaire once every few on how often they ate various foods.

Not only do these questionnaires rely on memory, they rely on memory of a perception, because people don't actually measure how many cups of broccoli they eat each day. It's the worst quality of data. It's a memory of a guess, there is no measurement involved whatsoever, which is why I hesitate to even call it data.

Not only is the data itself low quality, it is compounded by lifestyle factors that are impossible to fully correct for. As an example, people that eat red meat are more likely to smoke and have diabetes, more likely to eat fast food, more likely to exercise less, etc etc. Eating foods that are perceived as healthy is correlated with healthy lifestyles. Butter has been "unhealthy" for years, so it is almost certainly correlated with an unhealthy lifestyle.

The nurses health study has led to many incorrect conclusions for these very reasons:

- It suggested hormone replacement therapy reduced heart disease risk, but randomized trials later proved it increased it due to confounding factors like healthy user bias.

- It linked vitamin E to lower heart disease risk, but trials found no benefit, showing the association came from health conscious behavior.

- It linked beta carotene to reduced cancer risk, but trials revealed supplements could increase lung cancer risk in smokers, not prevent it.

Many weak associations from the study, like diet and disease, were overstated as causal but didn’t hold up in trials due to confounding and noise.

If you are interested in how often studies like this are wrong, see "Why Most Published Research Findings Are False" by Ioannidis (spoiler: 70%).
It's more about stalking strangers, less about using a phone to do it
Who says they arent?
1. It’s about the culture wars and also “evening the score” against opponents of Trump and MAGA. The Trump administration seems to be hellbent on “sticking it” to people, groups, institutions, and even nations that opposed him. Scientists and academics in general are on his hit list. There has always been an anti-intellectual bent on American society, but never have I seen it weaponized like this. Moreover, it’s unlikely that such policies will face blowback among Trump’s voting base. There are conservative scientists and academics whose careers have been upended by these moves, but they are a minority, and there aren’t enough of them to significantly erode the GOP’s electability.

2. It’s also about power and control. “He who pays the piper calls the tune,” and Trump and his administration are reveling in their abilities to withhold federal dollars (paid for with the tax monies from all American taxpayers, Trump- and non-Trump voter alike) from targeted agencies and institutions unless they meet whatever diktats they demand.

It’s a scary time for science in America now. Science is already dealing with the “publish-or-perish” culture of academia, the fact that academics are pressured to raise recurrent streams of grant money in order to earn tenure, and the fact that industrial labs are increasingly driven by short-term business pursuits instead of longer-term, more speculative projects. These disruptive freezes of NIH and NSF funds, as well as the targeted attacks on universities such as Columbia and UPenn over culture war matters, are reckless and destructive. If this does not stop soon, this could set back American science and research for decades.
> Box.

Ok, but this isn't a Portuguese/Spanish/French word that was borrowed into English that naturally got a final X because it suited English better.

I didn't say there are no words ending in X, but it isn't common and it's not a way to help borrow words from other languages, nor is the X also borrowed.
Yeah, I guess. Destroying the political "enemy" becomes more important than anything else.

I thought that only happened in socially backward, ideology-riddled, far-off places like Cambodia or China. Not advanced Western democracies.
More like: every time you tell o3 to do something, it will first reread the onboarding docs (and charge you for doing so) before it does anything else.
More people are capable of buying T-shirts than have the understanding to buy and operate their own domain. This doesn’t seem like a surprise to me.
Because, many autocrats do this, a recent example is the Cultural Revolution in China. It took 50 years and a lot of hard work for China to recover from that.

Destroying the educational system allows these people to consolidate and maintain power.
Much like America is taking a hit these days, only judges seem to care or be able to do anything. I was just having a bar discussion during happy hour how America is becoming a fascist country more in line with the way Turkey and India are, rather than Russia or Venezuela (more sudden)
>UBS and Walker are pushing to move the case out of the court system and into a Finra arbitration panel

Sad, but yeah that's the status quo. Equal protection under the law, except for companies who you can't sue ... but apparently they can show up at your divorce proceeding and demand money from you ...
Are visitors to the US now required to produce their phone and password to allow immigration to look at messages?

It's been a very long time (1972) since I traveled outside the US, so I'm obviously not up to speed on international travel, but I am really surprised that people are not permitted to cross international boundaries without producing a phone for inspection.
I think you are better served by superior search results than actually include information that may be highly relevant to a invading foreign power than by denying whatever nominal income is being paid to yandex.

If there is information available in yandex that can be a benefit to Ukraine (and there undoubtedly is) then this is a better outcome than pretending yandex doesn't exist.

Personally, I want to know that kagi will bring me information from the entire world, regardless of geopolitical conflicts. Thats what I pay them for. If they were to start censoring results to appease and/or punish any particular government I would be very concerned and disappointed.
> This will prevent the notebook from rerunning cells by accident.

Is that really what's wanted? If there's some cell that I need to run twice for some reason that I tried debugging but wasn't able to figure out why, or for debug just run cells 1-5 in order but on specific other (prod) systems, skip cell 4 and run 3 before 2. Now, arguably well written software would handle those things automatically, but we're not talking about battle hardened software that's had an SRE team vigorously refactor it until it's been proven suitable for such purpose by having been on call for it for months off not years. We're talking about notebooks, which have their time and place, but the entire point, I would argue, is to make it easier run notebooks in production without the added overhead of said SRE team. And in that world, the reality is the PhD is gonna have some things they know they should fix, but it's easier to just comment out the unneeded cells on the prod and hit run all, so shouldn't the tools better support that use case (by saving what was actually run and offering to rerun that) over caching based on input string and hoping for the best?
What a crazy way to frame it.
https://www.intel.com/content/www/us/en/docs/graphics-for-li...

edit: they are scary huge.
Like, it's the same?
what api do you use for video generation ?
It's not literally, definitionally one because a ponzi scheme is first and foremost a scheme -- fraud. Social security is literally, definitionally not a scheme; it's legal, audited, and fully transparent.

> new entrants are forced in.

Yes and that makes it materially different from a ponzi scheme.
Anthropic[0] and Google[1] are both pushing for a clear definition of an “agent” vs. an “agentic workflow”

tl;dr from Anthropic:

> Workflows are systems where LLMs and tools are orchestrated through predefined code paths.

> Agents, on the other hand, are systems where LLMs dynamically direct their own processes and tool usage, maintaining control over how they accomplish tasks.

Most “agents” today fall into the workflow category.

The foundation model makers are pushing their new models to be better at the second, “pure” agent, approach.

In practice, I’m not sure how effective the “pure” approach will work for most LLM-assisted tasks.

I liken it to a fresh intern who shows up with amnesia every day.

Even if you tell them what they did yesterday, they’re still liable to take a different path for today’s work.

My hunch is that we’ll see an evolution of this terminology, and agents of the future will still have some “guiderails” (note: not necessarily _guard_rails), that makes their behavior more predictable over long horizons.

[0]https://www.anthropic.com/engineering/building-effective-age...

[1]https://www.youtube.com/watch?v=Qd6anWv0mv0
If you’re deporting someone, they have to be in custody. They have to deport her to Canada, not Mexico. They likely deal with many other countries and have to arrange for transportation back to all those countries.

I don’t think anyone would have a problem if she was processed promptly and quickly deported or if the confinement accommodations were nicer. That’s purely a resources problem.
But there's a strong intersection between STEM, policy, and downstream innovation/employment - not to mention any ethical dilemmas along the way.

Not discussing and/or allowing bots to overrun any such discussion and drown out dissent has never in the history of man left to immediately better times in STEM.
I can’t tell if this question is just a statement about the impossibility of the situation or a genuine ask.

We should expect more professional courtesy and human decency for our peers than what typical application processes provide today. It help make candidates identify weaknesses and collectively improve our field.

Perhaps creativity or persistence will help us solve this difficult problem but we won’t get there if we write it off as a fact of life.
> If ripgrep never performs writes, there's never a chance of a mistake in usage or bug in the software clobbering files in bulk.

Yeah that's exactly why it doesn't.

It is true that the `-r/--replace` flag can replace a number of `sed` and `awk` use cases. It has for me at least.
In addition i'd also suggest looking at deep roots of why half the country is cheering it up. They don't want their country to go down the drain. Then why? It was pretty illustrative how MAGA was cheering the stopping of condoms money to Kenya in the Trump's speech. It looked like a caricature example of the government waste. Well, condoms there is one of the most effective ways to slow down HIV spreading. I'd bet MAGA wouldn't want more people there to get HIV. I'd bet MAGA just didn't know it. To me the "[not]know" is the root keyword in all that destruction happening now.
This is all implemented and working, just to be clear, and is being used in production. Everything you mentioned in your comment is covered.

You can also create branches within the sandbox to try different approaches, again with no risk of anything being left behind in your project until it’s ready.

It does use git underneath.

Here are some more details if you’re interested: https://docs.plandex.ai/core-concepts/version-control
My dislike of "octopi" is a funny thing. It makes me feel both educated and snobbish in equal measure.
How do we know what projects are worth funding? Anything that labels itself science? Is sociology science and basic research? Do we fund people instead of projects? How do you get in the group?
That's a privilege that the dominant players in the market can get away with. If you are the #1, everyone will do what they need to to run on your stuff. But the players trying desperately to get programmers (and customers) to pay attention to them need to make things as easy as possible to use.
I've been wondering for a while now if the previous FAA constraints actually helped Starship development because it served as a balance against the worst impulses of SpaceX management.

It will be interesting to see if the lack of governmental oversight ends up hindering the development of Starship.
47% is still substantially lower than housing owned by the rich. On top of that, the housing owned by the lower class tends to be lower value. They probably “own” their house through big mortgages, which is just another form of rent paid to the rich.
Bay Area Lisp and Scheme Users Group
I'm not sure what the right answer is: if HN were to change its policy and focus on the authoritarian assault on the US in all its forms, it would easily crowd out everything else, and draw in a bunch of people interested in only politics.

It's sure hard to ignore. IDK, maybe some enterprising person should start a "hackers for democracy" web site where we can share ideas or something.
PackagePhobia – Find the cost of adding a new dev dependency to your project
But it's not a problem, it's actually a good thing that OP's explanation is more general. One of the main points in the OP paper is that you do not in fact need proxies or simplification. You can derive generalization bounds that do explain this behavior, without needing to rely on optimization dynamics. This exactly responds to the tests set forth in Zhang et al. OP does not "rely on Bayesian ensembles, or other proxies/simplifications". That seems to be a misunderstanding of the paper. It's analyzing the solutions that neural networks
actually reach, which differentiates it from a lot of other work. It also additionally shows how other simple model classes can reproduce the same behavior, and these reproductions do not depend on optimization.

"and that already requires studying the specific optimization algorithm in order to understand why it picks certain hypothesis over others in the space." But the OP paper explains how even "guess and check" can generalize similarly to SGD. It's becoming more well understood that the role of the optimizer may have been historically overstated for understanding DL generalization. It seems to be more about loss landscapes.

Don't get me wrong, these references you're linking are super interesting. But they don't take away from the OP paper which is adding something quite valuable to the discussion.
The start and the end of ramadan (the month) are based entirely on the lunar calendar, and the islamic authorities that your particular branch of the faith sighting the moon by eyeball, but the length of time per day that you're obligated to fast are based on sunrise and sunset, which is obviously solar.
By low-level, it is with respect to the agent interface.

The original purpose is to help people understand how the inner agent framework is internally implemented, like those:

OpenAI Agents: https://github.com/openai/openai-agents-python/blob/48ff99bb...
Pydantic Agents: https://github.com/pydantic/pydantic-ai/blob/4c0f384a0626299...
Langchain: https://github.com/langchain-ai/langchain/blob/4d1d726e61ed5...
LangGraph: https://github.com/langchain-ai/langgraph/blob/24f7d7c4399e2...
I should probably have rephrased it a little, I don't disagree with you at all, was just adding more context on localhost and some of the nuances with it when it comes to browser behavior.
I find LLMs WANT TO ANSWER TOO MUCH. If I give them too little data, they're not curious and they'll try to craft an answer when it's nearly impossible for them to be right.

I'll type and hit enter too early and I get an answer and think "This could never be right because I gave you broken sentences and too little." but there it goes answering away, dead wrong.

I would rather the LLM say "yo I don't know what you're talking I need more" but of course they're not really thinking so they don't do that / likely can't.

The LLM nature to run that word math and string SOMETHING together seems like an very serious footgun. Reminds me of the movie 2010 when they discuss how the HAL 9000 couldn't function correctly because it was told to lie despite its core programming to tell the truth. HAVING to answer seems like a serious impediment for AI. I see similar-ish things on google's gemini AI when I ask a question and it says the answer is "no" but then gives all the reasons the answer is clearly "yes".
Y’all balk at six figures salaries. Most will never see them
My understanding is that anything has to work its way through the lower (appellate) courts until it ultimately reaches the Supreme Court.
> Much too quiet here on HN on this post

This whole topic has been done to death on HN, and this post doesn't contribute much that hasn't already been discussed extensively. Science underpins technology, but we've had 2-3 DOGE-related topics pinned to the front page at a time nonstop since the inauguration and the subject is bleeding incessantly into every other submission on the site.

Rest assured you'll have another 500+ comment rage fest in the near future, probably this week. This one just doesn't have enough going to feed the rage spiral—it's pretty blase compared to the dosage we've worked ourselves up to.
I don't think removing the rule is the play. Could be nice to relax it Fridays or the weekend. TGIF rules.
> on the wrong side of history

I don’t think history is a progression of superior morals or thinking, or that there are ethical “sides” to it.
No no, this was incredibly well thought out.

This is the largest set of employees who know how insecure email is, and so are least likely to send anything remotely related to personal information via that medium, and therefore they will all remain fired and 'the administration' can claim they obviously didn't want to get their jobs back because very few emails were received in response to the request.
I mean, it's the same author but seems like co-authors are different.

How do you know it's the actual implementation?
"Socially backward" and "ideology riddled" describes the US pretty well.

And "far off" in the sense that American culture is intentionally isolationist and separatist, and Americans tend to be aggressively ignorant about the rest of the world.

Most Western democracies are more safe and have a higher standard of living and score better on the Human Freedom Index and other metrics than the US, and have "advanced" features like socialized healthcare and education, which the US does not, so one could argue the US isn't even advanced as Western democracies go. Having one's system of laws based on the vague and archaic prose of a Constitution written for an 18th century pre-industrial agrarian slaveowning society isn't very advanced as far as modern constitutional law is concerned.
Could The USA go down in history as the empire that voluntarily gave up it's dominance. Pretty fascinating.

It's like if Rome had a referendum to just leave the world stage and the majority of voters said, "great idea".

Nearly every other case in history seems to involve some type of military failure. I guess there is a chance that in the future, people might say the USA's information space was invaded and so it fell victim to propaganda. Time will tell.
What else can you expect from a team that includes luminaries such as “Big Balls”?
"Preparatory Refactoring says that you should first refactor to make a change easy, and then make the change. "

Amen. I'll be refactoring something and a coworker will say "Wow you did that fast." and I'll tell them I'm not done... those PRs were just to prepare for the final work.

Sometimes after all my testing I'll even leave the "prepared" changes in production for a bit just to be 100% sure something strange wasn't missed. THEN the real changes can begin.
Impressive for a small model.

Two questions / thoughts:

1. I stumbled for a while looking for the license on your website before finding the Apache 2.0 mark on the Hugging Face model. That's big! Advertising that on your website and the Github repo would be nice. Though what's the business model?

2. Given the LLama 3 backbone, what's the lift to make this runnable in other languages and inference frameworks? (Specifically asking about MLX but Llama.cpp, Ollama, etc)
Speaking of statements open to misinterpretation... sorry, as the other commenter imagined, I meant that refusing entry for either type of statement would not be good, but one would be worse than the other.
You’re right on fees being the main reason. I was incorrect about the chargeback rate. https://www.clearlypayments.com/blog/how-merchants-can-manag...
Well, of course. Loudly and repeatedly accusing other people of things you are guilty off is a pretty good strategy to make low-information people stop giving a shit about what you did.

It also works on people who don't believe in an objective reality, people who can't tell two shades of gray apart, and on people who are just looking for some thread of motivated reasoning to excuse your behavior.
Not OP, but practically all of those lines are from a package-lock.json file (6755 lines) and a changelog (541 lines). It looks like the actual source is 179 lines long.
I appreciate the concept, but there are additional costs that would be great to consider. How frequently do you need to parch the package to address CVEs? How many downstream dependencies does this package have? How often do they make breaking changes?
And those that do reply can be fired for violating infosec policy.
A new construction unit is always going to be priced higher than a similar sized and located unit that is older. This should not be surprising.

The claim that housing supply advocates make about affordability is not that new units will be most affordable than but that older comparable units will become more affordable due to the increased competition. The people who’ve been bidding up the prices on older rental and resale homes will choose the newer housing instead because they are able and more willing to. The older stock becomes more affordable. Time goes on and even newer buildings cause what was once new to become a more affordable option. It should eventually get to a point where nobody would ever choose the older (again, similarly sized and located) units with poor amenities because it’s not worth it compared to newer options that are a better value. And those get replaced with new construction. That’s how a housing market should function.

But instead we have housing that is over 100 years old going for ever increasing prices even without modern renovations. Thats a broken market.
Sure, go back in time and talk to the Abolitionists or those who opposed Civil Rights. It's not gray, that's a big misconception. Dang is completely wrong about censoring and flagging discussion on a fucking coup in America. If the discussion devolves a million times, then let it devolve a million times. It's necessary.

Whatever, it's only month three, not too late.
> If I like the "finding files with auto filtering" part of ripgrep, how can I use it to feed another grep or even another tool?

`rg --files`

Is your mind blown yet?

> is also about portability

Except for Windows.
> draw in a bunch of people interested in only politics.

This is already happening. I'm finding myself visiting the site less and less and enjoying my time here less and less because every single thread is getting hijacked by people who just want to talk politics.

That I largely agree with the general mood is exactly the problem: I don't need HN to work me up into even greater despair, I come here to engage my mind on useful things and talk about complex ideas with interesting people. But the interesting people are increasingly retreating from the nonstop anger cycle that's been feeding this site's engagement this year.
> They have to deport her to Canada, not Mexico.

In theory and past practice, perhaps.

Currently the USofA is comfortable deporting Venezuelans to El Salvador with no trial or other due process.

https://www.bbc.com/news/articles/cz032xjyyzyo