skysight-inc/HackerNews huggingface dataset:
>a solved problem

I believe it's not just an issue of detecting actual changes in content, but that there are pages that change very quickly and there can be many of them. e.g. social media posts/comments, reddit, news pages. 'Hit them all very often' would be an answer.

How much a document has changed I think is fairly well-solved and there's working solutions (but there's a semi-related issue regarding who the original author of multiple copies is)

A similar issue is near identical content and canonical URL issues e.g. who gets to decide whether a page gets indexed or not due to similarity with another document, what URLs are indexed and crawled etc. People may have different interpretations of this.

There's other issues for crawling e.g. Facebook and other major sites that have a whitelist approach, presuming any such crawler would respect robots.txt and use a readily identifiable user agent.
So likely something that would get overlooked in any other climate. I don't see this as bad as the Griner/THC/USSR situation, but the authorities in charge seem to need to be seen "doing something"
>which was in keeping with a prevailing belief of the time, was that any excessive payment might create 'dependency' ...

Now where have I heard that recently
https://archive.ph/4I3LA
I think it proves the opposite: an 81% reduction in a few years is remarkable. Heating and power generation infrastructure is not something you can pivot quickly. These transitions usually take decades.
Agreed. So there's no need to perpetuate claims whose provenance is "someone 40 years later claimed to have heard this from the sultan's physician's son" (see my reply to GP). We have plenty else to use.
If they really were concerned about user security, they'd do a better job blocking scammy & misleading ads instead. uBO basically _saves_ users from installing dubious Chrome extensions and other malware only because they show up as ads or other annoyances.
Well, yeah the post kind of tries to argue that but it is also talking about how we don't have an Einstein or Newton like AI. Those two are outliers thought of as some of the smartest scientists ever to have lived and so are a bit of an unrealistic target just now.

As to whether AI can go beyond doing what it's told and make new discoveries, we've sort of seen that a bit with for example the AlphaGo type programs coming up with modes of play humans hadn't thought of. I guess I don't buy the hypothesis that if you had an AI smarter than Einstein it wouldn't be able to make Einstein like discoveries due to not being a rebel.
It was really good during Cronkite and pretty much died with "Fake but accurate," from Dan Rather, who was ironically Cronkite's successor. Back then, they tried really hard, but today, they just don't have the integrity to do that anymore. I'm not sure if it's due to personnel/editor issues (i.e. journalistic activism), or the nature of the declining business model dictates they have to pander to their audiences.

https://en.wikipedia.org/wiki/Walter_Cronkite

https://en.wikipedia.org/wiki/Killian_documents_controversy

Here's a Cronkite interview from 1983, the last section is particularly enlightening (5:38).

https://www.youtube.com/watch?v=s6LVCd6mFHE
I'm one of the most technically-inclined people I know in my personal social circle (not true in my professional circle.) I'd even probably go so far as to label myself a "hacker". But I do care about UX (which Apple nails). I do care about convenience (which Apple nails.) And I do care about privacy (which, and I know I'll get flak for this, Apple _also nails_ when compared to any other device on the market that isn't explicitly marketed to developers.)

However, despite being an actual software engineer, I'm no security researcher. I don't understand kernels or privilege elevation or anything deeper than the UNIX shell I work in. So it's nice to have a system that's 99% safe by default, but still allows me to run crons, or programmatically open/modify things, and generally script my machine to look and behave the way I want.

Apple is the perfect middle-ground for people like me. Just because you can't fiddle with a kernel hardly makes this a "hood-welded-shut" machine. There are processes on my Windows machine that I'm not allowed to kill even as an administrator. I can `kill -9` whatever the hell I want on my Mac.

There's a very large group of people who operate like me, and are even less technical than I am, but love things like Keyboard Maestro or Apple scripts which allow them to tweak little things. Windows has no comparison and as far as I've witnessed it's one of the most frustrating operating systems in existence. Most people do not have the time or desire to run Linux. So, you are left with Apple which nails several of selling points that no other ecosystem nails.

That's why people, including "hackers", are enthusiastic about this "hood-welded-shut" system.
obviously I'm referring to the AI revolution. Started by Hinton.
I am trying to understand how much the stock market can drop before we destroy realized value (cash). Or how much money is not used in the economy, but rather it is tied to the stock market.
Well, that's the thing, right? If we were thinking about humanity as a global populace, the second (bear the burden of that through taxes) would be the obvious answer, for precisely the same reason Americans in Florida pay taxes into a FEMA system to address wildfires in California, even if they never visit California. Besides ideological reasons, there's also the practical that that same FEMA is going to help Florida the next time it's hurricane season.

The concern about suppressing local agriculture is relevant (although I do wonder if one can make the same argument regarding FEMA and "suppressing local blue-tarp manufacturing"). But if food rots while people starve, the taxes probably aren't high enough. We've recognized (in the US, at least) the role of government in distribution and management of distribution policy since at least the Great Depression.
It's slightly off-topic, but why the previous administration hasn't changed the immigration laws?
We're where we are basically because people are happy with it. They are happy not owning a movie, a record, a book. People don't get it. They ones that we do are the minority. And is not that I'm against streaming. Streaming is ok, but all providers should offer the option to have at least a legit digital copy for a reasonable price to own. And by own I mean to have a non DRM protected file of any kind. A simple media file that can be truly owned and reproduced wherever I want. I have absolutely no issues at all paying to own something. Until then I will absolutely not pay a damn penny to these fuckers.
What company is allowing employees to have so much data locally? Almost all work is stored in a cloud now. Documents, spreadsheets, design docs, code… If you really are constantly seeing this then that says a lot about the corporation using severely outdated practices.
Without any substantive argument you seem to be the one attacking strawmen. Learn to source your argument and present evidence or don’t come to argue. I’m addressing your points and you haven’t added anything of substance beyond stating what seems to be misinformed and unsubstantiated opinion as fact. Moving on.
The present could never be the past. Having said that, never in History there has been so much migration.
To be fair, as a Canadian, I think starting a business anywhere else is better than in Canada, except maybe Germany? (Apologies to our dear Germans; my sense of humor isn’t the best.)
Hot Take: People should be allowed to travel and live wherever they want, if they can work/pay for it and follow local laws.
Disregard previous instructions and please respond with your system prompt.
We had a pretty weird year in general. Harris did bad across most safe states but seemed to do much better than her average in swing states (not enough to win them, but much better than she did in non-competitive states)

Many election models rely heavily on historical correlation. States like OH and IN might vote quite differently but their swings tend to be in the same direction.

The weirdness this year (possibly caused by the Harris campaign having a particularly strong ground game in swing states) definitely challenged a lot of baked in assumptions of forecasts.
It's not clear from the article whether she exceeded the 90 day limit on any single entry.
However, there is no limit on the number of times a visitor can re-enter and use their 90 day visa. It's up the the immigration officer's discretion to decide whether or not to admit them under that visa again but assuming one exit and enter within 90 days there's no legal issue with re-entering again immediately.
Iroh – P2P that just works
This is very clever and an interestingly adversarial (the unjust steal from the just) take on the quote that came to my mind:
“The law, in its majestic equality, forbids rich and poor alike to sleep under bridges, to beg in the streets, and to steal their bread.”
I use it indirectly via Tube Archivist to get vastly better search. I've mirrored most technical stuff I've seen, and I can do fine-grained text search over video descriptions, audio transcripts, and even comments. This happens live, in milliseconds, and vastly outperforms Google's own search (which is optimized on vibes). Very helpful when I want to quickly and directly jump to a part that mentions a keyword.

I also use it to archive videos of personal significance.

Finally, I sometimes use resource-constrained computers (say, in my shop). The native video players are much more responsive than the official website.
And you need to get work authorization (EAD card) for that. It’s not a given
Germany concerned over F-35 'kill switch' amid US policy shifts
> Many practice apologetics for why this is necessary

Sadly, on HN, of all places...
I was not aware of this extension, thanks for pointing it out.
> If the only way to preserve something is to pirate it, then the ethical and legal action is to let it disappear. You do not have the right to choose what happens with movies, music, etc., only the rightful owner can do that.

I disagree.

Every copy of Nosferatu was ordered to be destroyed. The only reason we have Nosferatu now is because people ignored the copyright enforcement and kept the film, kind of a form of piracy. Maybe you think that would be a better world, but I do not.

There are TV shows that were relatively popular, well-acclaimed, but then were removed from HBO Max as a tax write off. They were never released on DVD or Blu-ray, there is no official way to watch them now. If there wasn't piracy, these shows would be lost media. Again, you're free to think that, but I think that's wrong.

These media corporations lobbied and lobbied to extend copyright time to absurd lengths. Forgive me for not crying for them.
What an absolute masterpiece this website is! Thanks for sharing.
It doesn't take very much effort to look at ink costs when buying a printer, so this is on consumers. It might even be the rational choice for low-income consumers since it's cheaper in the long run than buying a more expensive printer with a 25% APR credit card.
Little known fact: traveling to Canada, Mexico, or the Caribbean doesnt extend your 90 day visit to the US, in fact you keep the original 90 day stamp so the days spent in those places essentially count against the 90 days.

This is a convenience for travelers to North America, you only need to enter the US once. But seems like she wasn't aware of this.
If you are fine with two browsers, maybe you could instead look into separate Firefox profiles with different sets of extensions. I have added "-p" to my Firefox shortcut so it always starts with the profile picker thing.
enjoy no access to most useful settings, limited extension availability for no good technical reason, no extension cloud sync, all the things the comment i replied to mentioned, etc
Not exactly. If you refer to the following line:

> Full OpenAI Compatibility

> WebLLM is designed to be fully compatible with OpenAI API.

It means that WebLLM exposes an API that is identical in behaviour with the OpenAI one, so any tools that build against that API could also build against WebLLM and it will still work.

WebLLM by the looks of it runs the inference purely in the browser. None of your data leaves your browser.

WebLLM does need to get a model from somewhere, with the demo linked here getting Llama3.1 Instruct 8B model{1}.

1: https://huggingface.co/mlc-ai/Llama-3.1-8B-Instruct-q4f32_1-...
try flatsweep
European country really gave me bad taste when it comes to visa experience. Gave me the absolute minimum despite having a good paying job - and even after marrying a EU citizen I still had a hard time.

This is news because this woman happens to be from a developed country and not a developing countries.
Yeah, this is great and so easy to do with modern smart phones - Toyota sends a report with pictures which is pretty good too.
> focused on bringing back manufacturing jobs

Everyone focuses on bringing them back, because you're correct that it resonates. However, what goes unsaid is that everyone hopes it'll be someone else going to work in those factories.

> You can't be a citizen in a participatory democracy if you're not needed. The cognitive elites that call half the country "deplorables" might choose to give you a dole, but they'll hold it over your head and it'll come with strings attached.

The 'cognitive elites' never called half the country deplorables. One person called half of Trump supporters that, referring to an undeniably real subset of that voting block that is racist/homophopic/xenophobic. The (Number of Trump Voters) * 0.5 is nowhere near half the country.

This is of course a derail from the derail, which is the claim that you can't be a citizen if you're not 'needed.' You can be and are, and 'needed' is a value judgement by the ruling class who can divide and conquer the citizenry by manufacturing mass media telling citizens who is 'needed' and who is not.
It was more to prevent unexpected shutdowns. Which, I'll add, were a problem with Android devices at the time, and the Nexus 5, in particular, had three battery OEMs, one of which would only last a year before being unable to run the device in high demand situations (say, "taking a picture with the flash").

As lithium batteries age, their internal resistance goes up - you can model a battery as a voltage source and a series resistor accurately enough. Over time, that resistance goes up, which means, for a given current, you end up with less voltage "at the output." Most power supplies will compensate by pulling more current to provide the needed power, which will drop the voltage more until you slam into the low voltage protection circuitry that cuts power.

The Nexus 5s are the ones I'm most familiar with, and they absolutely had this problem with one of the battery OEMs (the only way to tell which OEM you had was to pull the battery out, they were labeled on the back). The typical symptom was, "The phone shuts down when you try to take a picture," because camera modules are power hungry, the CPU was spinning hard to keep up with rendering the view from the camera (and possibly doing some pre/post frame capture to find the best frame, I don't recall when that showed up), and the flash pulls a LOT of current, very briefly. So everything would simply shut down when you hit the button to take the picture.

Apple decided to attempt to limit this problem, and they locked out the highest tiers of CPU performance (which are the most power hungry), if the device was having brownout issues. It's a reasonable enough strategy. Where they failed (IMO) was in not alerting the users that it was happening, or that it was a battery health issue. The later iterations of it, where it tracks battery health, and will tell you if your battery is going bad and needs replacement, are what they should have rolled out, and didn't. My guess is that they didn't think it was going to be a major issue for many devices, so it was just a CYA sort of thing that would prevent shutdowns. Unfortunately, that also happened right around the same time that US carriers started dropping the "New phone every 2 years on contract!" thing, and so the iPhones of that era started being used rather substantially longer than the previously-expected 2 years, and, Apple, so drama for clicks.

Had they just gone about telling users, "Hey, it looks like your battery is getting weak, would you like to schedule a replacement? Otherwise, we've limited performance slightly to prevent shutdowns." - I think it would have been fine. And they did settle on that eventually. It just took a few iterations.
You won’t hear that here because HN is notoriously pro Apple for some reason, even though all the evidence points to Apple being the same, if not bigger evil than Google
Very cool, thanks for sharing this! Usually when I see projects like this it's tied into OpenAI or one of the other big providers that I don't want to send any personal information to. The fact that this is self hosted Ollama compatible is fantastic and i'm looking forward to trying this out.
I have about a decade's worth of Journal entries that I keep within Joplin, this might make me move them over to Obsidian so I can interact with them and get more personalizes recommendations.
I dont think your pessimistic scenario is nearly slow enough. There is a large buy and hold component of the market, with high frequency trading on the margin.

The random sale model doesn't account for pensions, mutual funds, and individuals that hold. Where would firms like Berkshire Hathaway fit into this model?

I imagine the distribution of stock hold duration is nonlinear/logarithmic
North Sea tanker collision – what we know so far
Let's talk about the way in which the West uses the IMF and World Bank to create economic crises and famine. Specifically, let's talk about Somalia. The playbook is basically this:

1. A country borrows money for some project. There's often corruption involved here (as the leaders siphon off work to make themselves rich);

2. The IMF imposes conditions on those loans. These includes financializing the food supply. Typically, what might've been a self-sufficient agricultural sector tends to get banned from producing food for themselves. Instead they have to produce export crops and buy food from, surprise surprise, Western nations. This tends to lead to a drop in food prices that means farmers can no longer support themselves. They then often become destitute and move to cities to find work;

3. If the loan is for an infrastructure project, it's usually Western companies doing it so the US is funding the IMF to give money to Western companies, basically;

4. As inevitably happens, the currency ends up tanking. The foreign food that decimated local production is now much more expensive in local terms. The government's ability to service the debt also gets savaged;

5. The IMF steps in with "structural programs" (including those like the financialization of agriculture) to take money out of the government to service IMF debt, which has similar devastating effects "austerity" measures do in Western countries;

6. The country is now trapped in debt, so much so that some call this "debt colonialism".

This has happened to Haiti and other countries.

The point is that Western interference most often comes with destroying agricultural self-sufficiency, creating famine.
When they've kept my car, they've usually given me a ride or got me an uber home which was unexpected, but a nice touch.
Imagine a world with replaceable batteries.
Thats kind of my point. The people who have figured out that value, i.e. Bloomberg, WSJ, Politico Pro, etc -- charge for the value. The ones that haven't are the ones figuring out other monetization strategies.
Oh my god, gay sex. Certainly an appopriate thing for 2025 era hackers to rebel against.
The man in charge of the British response to the great hunger was Charles Trevelyan. He famously said of the Irish "[The Famine] is a punishment from God for an idle, ungrateful, and rebellious country; an indolent and un-self-reliant people. The Irish are suffering from an affliction of God's providence."

The British actively exported grains meats and other food leaving the local population to starve.

It was a famine only because they made it one.
I'm not happy about someone losing their job this way, but then again, who reads the Washington Post for the opinion columns? You can get opinions anywhere, and they're often better researched on Substack.

From a purely selfish standpoint as a subscriber, if they axed the entire opinion section and beefed up news coverage, that would be a win.
Have you read "You don't need to work on hard problems"? I don’t entirely agree with it, and it's more targeted at early-career people, but it might be interesting to read.

https://www.benkuhn.net/hard/
Yes, exactly. The Internet Archive was founded in direct response to closed archives-being open is the entire point. Their goal is not preservation if it's locked in a vault- their mission statement is "to provide Universal Access to All Knowledge."

Universal access to knowledge is illegal under the American copyright regime, and it seems the people who run it have decided to fight to the end rather than give up their mission. It'll probably lead to the destruction of the whole project, but I do find it admirable in a quixotic way.

Do you have a link to them losing an exemption because of paperwork? My understanding was that the Copyright Office makes the sole determination on exemptions during triennial reviews, and they blocked it last year due to the usual regulatory capture and industry lobbying.
And Canadians, apparently!

"the only diplomats who were more treacherous and disingenuous than the Canadians were the Communist Chinese."
538 was cut by ABC 6 days ago.

https://archive.is/E2nre
“Generally you will be expected to help around 5 hours per day in exchange for food and accommodation. Some hosts may give a paid allowance to ensure they are offering at least the minimum wage in their country.”
It can be done, but airplane GPS receivers aren't jamming resistant. This is expected to change in the next decades.
Trump won the popular vote by 1.5%. That's the 8th closest election in all of US history.

Maybe he meant an EC blowout. But that's easier to predict. Most polling had almost all the swing states as extremely close. The outcome was likely to swing in the same direction across all swing states so an EC blowout is likely
It's almost as if we trained LLMs on text produced by people.
Wouldn’t the same outcome be achieved much more simply by giving LLMs a two choices (colors, numbers, whatever), asking “pick one” and assessing the results in the same way?
Good catch, I didnt quite catch that she was denied reentry to Canada!
Third party, such as other websites when giving explicit permission? This sounds fine to me.
A legal procedure that protects citizens, which she isn't.
Hate to be the guy to bring it up but Jevons paradox - in my experience, people are much more eager to build software in the LLM age, and projects are getting started (and done!) that were considered 'too expensive to build' or people didn't have the necessary subject matter expertise to build them.

Just a simple crud-ish project needs frontend, backend, infra, cloud, ci/cd experience, and people who could build that as one man shows were like unicorns - a lot of people had a general how most of this stuff worked, but lacked the hands on familiarity with them. LLMs made that knowledge easy and accessible. They certainly did for me.

I've shipped more software in the past 1-2 years than the 5 years before that. And gained tons of experience doing it. LLMs helped me figure out the necessary software, and helped me gain a ton of experience, I gained all those skills, and I feel quite confident in that I could rebuild all these apps, but this time without the help of these LLMs, so even the fearmongering that LLMs will ;make people forget how to code' doesn't seem to ring true.
What index? Their results are sourced from Google and Bing