skysight-inc/HackerNews huggingface dataset:
imo if the website doesn't want us there the long term value is anyway not great (maybe exception is SERP apis or sth which live exlusively because google search api is brutally expensive).

> extract data behind login walls

We mean this more from a perspective of companies wanting it, but there is a login wall. For example (actual customer) - "I am a compliance company that has system from 2001 and interacting with it really painful. Let's use Browser Use to use the search bar, download data and report back to me".

I believe in the long run agents will have to pay for the data from website providers, and then the incentives are once again aligned.
With no hot shoe for a flash.
I understand the concept. My main point is that it's probably not a huge advantage to store hashes of the first 1KB, which requires CPU to calculate, over just the raw bytes, which requires storage. There's a tradeoff either way.

I don't think it would be far more efficient to do hash the entire contents though. If you have a million files storing a terabyte of data, the 2 stage comparison would read at most 1GB (1 million * 1KB) of data, and less for smaller files. If you do a comparison of the whole hashed contents, you have to read the entire 1TB. There are a hundred confounding variables, for sure. I don't think you could confidently estimate which would be more efficient without a lot of experimenting.
> Comments is a self-admission you failed to write readable code, and you can fix your failure by refactoring code into self-descriptive member functions

# This is not the way I wanted to do this, but due to bug #12345 in dependency [URL to github ticket] we're forced to work around that.

# TODO FIXME when above is done.

Oh no, I so failed at making self-descriptive code. I'm sorry, I totally should've named the method DoThisAndTHatButAlsoIncludeAnUglyHackBecauseSomeDubfuckUpstreamShippedWithABug.
> We moderate HN less, not more, when YC or a YC startup is part of the story

I believe this because it makes sense to me.

I think a habit of tempered reactions allows the understanding - that criticism is valuable in healthy doses.

Adding this: Having HN's stance plainly said is valuable too.
Is This What We Want?
Yes although that's all we observe from the point of view of the fermi paradox so is very relevant.
It seems CCP is less hate worthy than they were two months ago. Comparing fake democracy with real authoritarian is kinda funny.
It's been a while since I last looked at SwiftUI on mac, Is it really still that bad ?
False advertisement. I played a single match and the AI very very quickly blundered their queen to my bishop, and later a bunch of other pieces. This bot way is worse than Martin (250) form chess.com.

Also, those colors are horrible to see. And it's really hard to see which piece the AI is moving each turn.
Publishing on arXiv is now very difficult. You need someone to endorse you who has an account on arXiv and has three recent publications in the area of research you're trying to submit.

I just went through this and had prominent researchers willing to endorse me but unable to do so because of the now stringent requirements on arXiv.

FYI, I am an independent researcher.
> It's better credentials and experiential basis than most other programming books.

When considering coding advice, I just don't find credentials or the results of a coding experiment matter much, especially if it involves students. I run through the scenarios in my head and pick the option that makes sense given the context and competing priorities.

> I think it is remarkable that the author switched from "modules should be specialized" to "modules should be generalized" (rough paraphrasing, mailed my copy to Brazil and waiting to buy a replacement).

The link I posted has a PDF with the content I think. I guess I don't find the limited example involving a few function signatures compelling (a student assignment to write a basic text editor) or understand why I need to pick whether to trend towards modules being specialized or generalized... you treat it on a case-by-case basis, pick the one that has the most benefits given the context and be open to changing later when it makes sense? Outside of a few rules, it's boring but "it depends" really is the answer to most of these debates. Similar with how long functions should be, writing comments and how to name variables.

> If you know of other books which you merit recommendation and which have a similar or better context for their authorship and exposition, I would be glad to hear of them.

Software Engineering at Google is probably relevant for large projects: https://abseil.io/resources/swe-book

The rest probably best comes from practice, that's how I learned most of what I know here. I'm didn't for example
become a fan of strong static types because of advice based on credentials or experiments, but from experience coding with and without types.
Occam's razor says that you must present a proof that they are not existing in a black hole.
For no lens and no hot shoe? I really don't understand the appeal.
But you need to constantly process them too, not just store them.
> Also that simplicity is king. Complexity is the enemy.

As someone that has managed engineering teams for large projects, I 100% agree. One of the issues with computers IMO is that it has made bad engineering easier. Back when you had to check everything with a slide-rule, you had a real appreciation for the skill and engineering prowess and experience to make things absolutely dead simple.
Security through obscurity is not the same as actual concealment. That DoH is specced to operate over port TCP/443 makes it no more or less efficacious than DoT over TCP/853 with regard to avoiding censorship. I.e., they're both encrypted.

Many LAN operators conclude that the pragmatic impossiblility of blocking DoH is a net-negative for both network security and censorship avoidance.
> I know we didn't set out to do that but I regret it some, nonetheless.

This is not correct. Humans have been selectively breeding animals and plants for thousands of years.

Also dogs, for most of human history, provided services (hunting and security) to humans in exchange for "petship". It's only a very recent phenomena that (many but not all) pet dogs have to provide nothing to humans besides companionship. It is now that the maladaptation in dogs have started to appear because of the one way relationship.
I think metadata studies are pretty useful actually. Broad questions like "what medical conditions does diabetes cause" can be investigated in that way. It's definitely not weird at all. But when people say "weird" I think people mean things that don't have immediate economic use, for example, a literature phd that is on the depiction of black hair in books from countries with black majorities vs books from countries with black minorities.
“A lie can travel halfway around the world while the truth is still putting on its shoes.”
Eh, you could ship it in an envelope to reduce carrier costs.
> This tool simply identifies files that point at literally the same data on disk because they were duplicated in a copy-on-write setting.

You misunderstood the article, as it's basically doing the opposite of what you said.

This tool finds duplicate data that is specifically not duplicated via copy-on-write, and then turns it into a copy-on-write copy.
Looking forward to seeing more Chicory in Bazel, is a great use-case! Thanks for spearheading it!
From Records to Agents: The Overlooked Revolution in Enterprise Software
Part of owning equity in a publicly traded company is for shareholders to accept the decisions of the board (management). Or otherwise engage in a conflict with the board. Even if Joann was a viable business on its own, if most shareholders wanted to accept the price being offered for the business (presumably reflected by the board's votes), then that is all that matters.
The article introducing the library has something about how pairwise comparisons are most reliable (i.e. for each pair of items you ask an LLM which they prefer) but computationally expensive. Doing a single LLM call (rank these items in order) is much less reliable. So they do something in between that gives enough pairwise comparisons to have a more reliable list.

https://news.ycombinator.com/item?id=43175658
When training a puppy (I've trained five +, strictly amature) food is very useful

As an adult it becomes a relationship, and the dog is more responsive to praise and criticism.

That is what is meant IMO by "food motivated"

Feeding time is best, best ever, joy joy, for their entire lives
If the executive decides to not enforce judicial orders since it feels like they are unfairly applied that is basically the total breakdown of the rule of law.

That's what is likely to happen if the courts enjoin without discretion. It's what Jackson did to SCOTUS under Marshall.

Article III allows for congress to simply remove the ability for the lower courts to bind the executive at all. That'd be the biggest legal issue in centuries.
He has his ear for now, but he can just as easily become his scapegoat. He burned his leftist supporters for good; I agree his position isn't a weak one but I think its best to reserve judgement on whether his moves (->right->X->DOGE) were a smart play or his downfall.
> For some reason in software there seems to be an incredibly large space for non-evidence based thinking and belief systems.

The secondary problem is that book authors have become extremely good at inventing pseudo-evidence to support their claims. It most commonly takes the form of “I talked to X companies with Y total number of employees over Z years and therefore I know what works best”.

If you cut out all of the grandstanding, it’s nothing more than “just trust me” but in a world of social proof it sounds like it’s undeniable.
Maybe the implementation could include an option to show the worker's name.
Rich people can hire smart people to do things and take credit for it. It happens all the time.

"He has technical chops"

Not in rockets he doesn't. Or programming.

" If good technical leadership is so cheap, why is SpaceX so far ahead?"

Because of Gwynne Shotwell
Framework (2nd Gen) Event – 2025 Launch Event
Then say ugly. "Shitty" can be ambiguous as you see. Most people would classify buggy code as shitty code.

> Then you've never been around the smartest people. Likely you've been around smarter then average people.

This is essentially using your own belief as proof that your belief is correct. You say I haven't been around the smartest people because I say the smartest people don't do what you claim. You are saying "I'm right therefore you are wrong". Maybe you haven't been around the smartest people.

> Yeah and the smartest people structure the problem in their head in a way normal people can't easily understand. They can hold much more in their head so the structures can be complex.

Complex is easy. Simple is hard. And yes, some things are inherently more complex than others. But the goal is to hold the important things in your head. Offload as much as you can so you can focus on what matters.

> Isn't that my point? Formatting rules are a bunch of pointless minutiae to intelligent people. It doesn't assist them in readability because their intelligence allows them to parse even the shittiest code with complete ease. And I mean aesthetically shitty, not intrinsically shitty.

No. It's not the point you are making.

Also, look at to everything I said. Strict adherence to any one style is not a marker of intelligence. I explicitly said that strict adherence is essentially for people in a wide range of skills. But the best have preferences, but realize that they are more guidelines and readability matters more than the rules.

And the rules should be logical and essentially second nature. Like indenting is completely optional in most languages. But proper indenting allows you to better visualize the flow of the code. Nobody reads/writes minified JavaScript.
Zvi on Grok
Another example I’m reminded of:

David Silver sold his video game company, made a good amount of money and then decided to do a PhD in Alberta in Reinforcement Learning under Rich Sutton way before it was cool to work in RL.

If people have other modern examples, please share them!
On my Macbook Pro M2, having a browser window on one half of the screen, and my IDE on the other, with a file tree viewer pane and another pane for my LLM tools, a terminal pane at the bottom... I've never been more pressed for real estate for my actual code editing pane. Even 80 chars has me scrolling horizontally. Secondary monitors help but not when you frequently work away from your desk.
Wow forgot about these guys. They seemed like a big up and coming player 12 years ago but really fizzled after their limited TAM fizzled.
Not necessarily, workflows just need to be adapted to work with it rather than it working in existing workflows. It's something that happens during each industrial revolution.

Originally electric generators merely replaced steam generators but had no additional productivity gains, this only changed when they changed the rest of the processes around it.
Go back, it's so worth it. I stood under those six massive turbojets and looked up in absolute awe. It's a miracle that they didn't cut it up for scrap and left a really fabulous museum piece when the project ended.
... and I'd heard the variation: Another inmate calls out "36!" which brings out raucous laughter. The new inmate asks why that one got such a great response, to be told "We haven't heard that one before!"
I do agree that people rarely truly care about the principles they claim they adhere to, when it turns against their own interests.

But that is not what is happening here. A principle is not self-motivatingly good just because it exists. The principle that Congress must directly make every law and set every detail of that law is simply a bad principle, at least for a country of the size and complexity of the USA, and given the last 200 years of experience in good and bad governance.

Congress has long understood this, and so they have invested some of their legislative power into various executive agencies, while still maintaining a great degree of control over the broad strokes of what those agencies do.

It's not useful to anyone for Congress to, say, debate and set the exact safe level of every chemical known to man in water that should be enforced: the EPA exists to study this and take the right measures based on the most reasonable scientific knowledge of the day. If the CDC discovers that exposure to teflon above 1 part in 100,000 is likely to cause significant harm, it shouldn't be regulated only once Congress meets in the next session.
Fair. Deleted.
Uncle Bob probably the biggest scammer in Software. What a complete pile of garbage.
So much energy wasted in all these design patterns, SOLID and other OOP bullshit.

Turns out you can just pass immutable data in and get immutable data out. Who would have guessed? The whole 90s - 00s Java OOP garbage still gives me nightmares
What does this have to do with singularities? No one expects any kind of singularity anywhere around or in the moon.
I bought and use Machato [1] [2], how does this compare?

[1] https://news.ycombinator.com/item?id=35471091

[2] https://github.com/MachatoApp/machato
I have a 512GB drive in my MacBook Air M3 with 225GB free. Saving 1GB is 0.5% of my total free space, and it is definitely "below my line." It is a neat tool still in concept.

When I ran it on my home folder with 165GB of data it only found 1.3GB of savings. This isn't that significant to me and it isn't really worth paying for.

BTW I highly recommend the free "disk-inventory-x" utility for MacOS space management.
When it comes to tabulating currency amounts, it makes sense to right-align the numbers. That way, their magnitudes align.

Maybe a monospace font for those numbers too.
Show HN: GoFigr – real-time, figure-centric version control for Jupyter and R
Hi HN! After spending the better part of the last decade working in data science, I realized that figure management is (a) a real issue, (b) poorly supported by existing tools.

Specifically:

1. Data Scientists generate a ton of figures, many of which invariably end up in Slack, emails, and PowerPoint.

2. Being able to trace a figure back to the notebook is a royal pain. Especially if the code has changed.

Even if you use git, it's unrealistic to git commit for every figure, and searching for figures in git history is well, painful.

Which is why I created GoFigr. GoFigr is a Jupyter plugin/R library which automatically adds QR codes to your figures and syncs them with the GoFigr service.

We also store the notebook name and the full source code (IPython history in Python) as it existed when the figure was generated.

Furthermore, we support text search within figures as well as reverse image search, so you can always find the exact revision and reproduce it with ease.

Building this has been a ton of fun. The backend is mostly Python + Django + Postgres + Elastic Search. Frontend is React. I'm super excited to show it to the HN community!
>or perhaps they already would be doing that and this tool helps it?

Yes. I don't think we should ethically encourage the abuse of workers. And that official lens of marketing can and will shape who reaches out, even if the tool can indeed be used ethically. Framing is key.

As a tame example: think of the graphic design and marketing of red bull vs Monster. They have the same basic ingredients and purpose but that simple red bull design vs the in-your-face punk-esque vibe of Monster will change who buys it, how they identify with it, and even alter the perception of how it tastes.
Omakos – Setup your macOS for development
An Integrated Energy System with Waste Tire Pyrolysis and Biogas
shipping SQLite as a WASM module can increase your bundle size significantly, depending on your baseline.

> How is something that requires a JS runtime easier than a single-file compiled binary?

You can compile your JS to bytecode and bundle it with its runtime if you want to, getting a single-file executable. QuickJS and Bun both support this, and I think Node.js these days does as well.

If you expect your user to already have a runtime installed and you're not using QuickJS, you can just give them the script as well.
The rest of the world turned right as well. In actuality, the entire world had a bad four years and voted out whoever was in power, regardless of the reasons or outcome. Also the US left ran an extremely bad candidate and they still had a strong showing; a real candidate might have pulled it off. We can only speculate though.
Sen. Grassley Launches Inquiry into UnitedHealth's Medicare Billing Practices
Gift link: https://www.wsj.com/health/healthcare/sen-grassley-launches-...
What UB's description of how to do TDD does not suggest that there are problems that require a different level of thinking and TDD as he describes, does not account for that.
I solved it in mine. I should write a blog post.
My favorite bit of design from this era went something like this: "ooohhh, we need something that can handle high heat. How about if we made it radioactive?" and so Mag-Thor was born (https://en.wikipedia.org/wiki/Mag-Thor): Magnesium plus Thorium. It's creep resistant up to 350C! And it's only mildly radioactive! That's not a problem, right?

Actually used on the BOMARC and D-21's ramjet engines- which is why you don't originals of their engines on display anywhere.
I'd take that income for side gigs in a heartbeat. Pluse OP said hourly work is not their go-to anyway. Not sure why this deserves such harsh criticism.

The body shops that spam me for data software contract work quote well below that.
It's just going to regurgitate the first few things it sees without applying critical reasoning. These models aren't quite there yet for search reliability.
Publish a Deno lint rule, get a prize
Tell me you have a background in IT without telling me you have a background in IT.
> Note that this law was created specifically because Nixon had gotten into the habit of not spending money as apportioned by Congress if he didn't like the specific programs. So, Congress made laws to specifically not allow Presidents to do this on a whim.

This is a little bit misleading, By the time the Impoundment Control Act was passed, the Nixon Administration had been hit by a flurry of lawsuits on impoundment, lost most of them at the trial level, and given up immediately and released the funds at issue in those cases. (There was one case they continued fighting up to the Supreme Court and lost 9-0 after the ICA passed, but not based on the ICA, just pre-existing law; there was also Supreme Court precedent going back to the 19th Century with the same conclusion -- the President has no authority to impound funds Congress has directed must be spent.)

The ICA was basically an olive branch -- it provides a method in law for the President to temporarily hold appropriated funds and request recission, specifying that the funds had to be released if, in 45 session days, Congress didn't affirmatively act on the recission request; this was an effort to provide a mechanism to address the problems that the unambiguously illegal attempts at impoundment were notionally motivated by. It wasn't to prohibit impoundment -- the existing laws directing expending funds already did that inherently.
Plants evolved animals to spread seeds.
You are one recommendation from Uncle Bob away from becoming part of the next SaFE (Scalable Agile FSomething something) process - good luck :-)

Make a Jira plugin and make your fortune :-)
This is a dream come true. Please do it, for the love of mankind.
I can confirm. My Rat Terrier will absolutely not respond if she gets out. Best I can do is throw tennis balls towards the house so she runs in that general direction, assuming that’s the most interesting thing she’s found to hunt yet.
NTFS supports deduplication but it is only available on Server versions which is very annoying.
It's not that nobody enjoys doing anything just for its own sake—it's the destruction of ways to provide for others, socially. Humans really, really like doing that. The two things may as well be completely different activities, scratching totally different itches. No amount of solo activity will make us feel whole in the same way feeling that our abilities and passions are helpful to and desired by—not just humored by—others we care about will.
Yea, too bad :( Everyone involved with macOS and iOS development seems to be (intentionally or unintentionally) keeping us on the hardware treadmill.
"Its most unique feature is Twitter integration and real-time data access"
> He "only" saved 30%? That's amazing. I really doubt most people are going to get anywhere near that.

You misunderstood my comment. I ran it on my home folder which contains 165GB of data and it found 1.3GB is savings. That isn't significant for me to care about because I currently have 225GB free of my 512GB drive.

BTW I highly recommend the free "disk-inventory-x" utility for MacOS space management.
I did! its 900% over the context window limit :D I will have to do it function by function lets see a decent project for me and claude-3.7
ahaha, that's intriguing!
I think there are still some gaps but we are comparing results(with GraalWasm) on Photon here: https://github.com/shaunsmith/wasm-bench
Should be easy to build a native image and compare!
Is a bred in behavior to hunt vermin domestication or lack of domestication?