skysight-inc/HackerNews huggingface dataset:
Have you considered putting cloudflare or similar CDN with unlimited egress in front of your bucket?

Reading your blogpost I don't fully get how the current signing implementation can halt massive downloads, or the "attacker"(?) would just adapt their methods to get the signed URLs first and then proceed to download what they are after anyway?
Under the noise floor at what distance? If you don't want to be a bright beacon at a mile, then you're not going to have a lot of signal at a hundred miles.
You used to be able to have them put real ink on real paper and deliver multiple pounds of it to your doorstep for less than they want to charge for the bits now. It's like in the 90s banks wanted you to pay extra to use the ATM. It saved them from having the office open and hiring tellers but they wanted to charge you for the "convenience" of using the machine.
Quick feedback – you've used the term "signed URL" over 50 times in the post without once explaining what it is or how it works.
Could this be the New Yorker's problem and not Apple's? I'm not super familiar with how Apple News subscriptions work, but there's probably a way they could let you log in to the New Yorker with your Apple ID or link the accounts somehow.
Some countries provide government funded news that is of reasonable quality, for example abc.net.au/news
Local News Papers were a lot cheaper, plus you got news that no one else was reporting.

In most cases the news was balanced back then. Go to a Library and see for yourself by viewing archives.
Yup - another "Contact Us" for pricing. God forbid if your business grows more than 10 Million ARR and now you owe them undisclosed amount of money.
Recently had 8TB NVMe drive die after power outage. Such a mess.

Can't afford data recovery. It was a backup drive though, so I need to redo the backups.

Thinking about buying more smaller drivers maybe on a couple mini PCs connected to network.
I'll nibble. A lot of the badness of news comes from requiring a profit and where that profit comes from. News is required to be dramatic and sensationalist because that's what attracts attention and gets you those advertising dollar. Certain topics are off limits, because of those advertising dollars.

It's basically the concept of "fuck you money" but applied to organizations. Sure, it doesn't solve every problem, but it might solve some.
Granted. But are we engineers or aren't we? If we won't develop the capacity to reckon with complex thoughts, then what can we even claim to offer over a coding model?

(You also suggest my use of "fluent" begs the wrong question. How so? Not every thought is trivial of expression, or we'd need no words but the commonest ten hundred.)
They can claim that a file is infringing everywhere it exists but they'd often be wrong and I don't think inherently infringing files are a valid way to interpret copyright.

"Better safe than sorry" is certainly, uh, safer. But I don't know if you can really say the DMCA requires it.
Isn't it this one?
https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-405B/...

Fairly heavy run locally of course, but I guess enough people here are fortunate enough to be on gear that can manage it.
BBC is pretty good, as well as NPR.

News companies are mostly collapsing. The only viable way to keep in private hands might be the Guardian model, of a trust established in it's name.

Bozo could certainly afford to do that for the Wash Post, instead they're leading the race to the bottom with firings and more for-profit articles.
> It's so obvious to me that machine learning models are derivative works of their training set.

Okay, but narrative creators watch movies and listen to music and read books too. Many do indeed "file the serial numbers off" other people's work and publish something else, that makes them money and not the original creators. Does one instance of "filing the serial numbers off" by one author mean that no authors anywhere are allowed to write any books as soon as they've read "a bunch" of other books? I get what you are saying, but it's not so obvious what the right policy is. It is very hard to make it consistent when "AI" is substituted with "human," and it's not so obvious if "AI" is a distinct class from human, because it is after all, something that only exists because a programmer somewhere wrote and operated it.
(L)GPL to MIT is a choice many projects made when they decided they cared more about their code being used than about it staying free.

Copyleft licenses were the default choice at some point in time, but then in the '10s most big projects seemed to pick a permissive license, and many switched.
Code Complete seems more forgotten than disliked these days (rarely mentioned, either for or against). Clean Code is the one that, when you mention it, brings out all the negative comments.
Yeah, I remember in the early days, when I installed Spotify it would scan my computer for music and upload everything it found. I imagine this is basically how they bootstrapped
Just have to say this again even if everyone already knows it: If the US Government / EU hadn't threatened Microsoft they would have embedded their browser in Windows and tied it to the OS to the extent where normal people would only use their browser. I don't know if Google could exist in that alternate world, but I suspect Microsoft would have "deprived them of Oxygen" and they would be bought or crushed.

You probably can't stop Google from being the most popular search (or don't want to) but you should be able to stop Google from using the popularity of their product to crush alternative ad tech. Or crush some new tech we don't realize will be important.
I agree it seems pretty unfocused. To be fair I read it quickly so I might be missing something, but I'm struggling to pull a thesis out of this piece.

At the beginning it seems like it's trying to make a point about society becoming better after eliminating superstition, but then it mostly just goes through a history of Faustian bargains in literature before ending with one paragraph that implies that the modern equivalent is EULAs in software.

EDIT: I just realized from the URL that this is supposed to be a book review? I probably didn't notice because the book isn't mentioned in the title or even in the article until four paragraphs in.
ADHD is not a "mental quirk". It's a serious condition that often make people incompatible with modern world. It's like being blind. Everything blind person is doing in his/her life is affected by being blind.
I am also not a lawyer; I have some background and training in IP law as it pertains to engineering.

As far as I can tell, the image you describe and your example sentence are closer than you might think to each other. Mickey Mouse is a copyrighted character, and Disney could certainly claim infringement for both. Whether you have a fair use claim is down to the tenets of fair use, and whether they sue you is down to their estimation of how likely it is it'd be profitable for them to do so.

So what is fair use? https://www.law.cornell.edu/uscode/text/17/107

Put simply, you have to argue about it in court and decide on a case by case basis, but the factors are:

The nature of use, such as for profit vs. non-profit.

The nature of the copyrighted work. Your art might be considere literary criticism. How central to that message is Mickey Mouse?

The amount and substantiality of the copyrighted work appearing in your work. Mickey Mouse is the sole feature, so large.

How likely is it that your Mickey Mouse creation will serve as a substitute for people consuming normal Mickey Mouse content?
As someone doing support and occasional code changes for a pile of vb6 that doesn't sound that bad. If you need a code base to be stable for decades COBOL beats vb6.
I'm always surprised to read how much money companies are willing to spend on things that can be done for essentially nothing.

I had a look at the site - why does this need to run on a major cloud provider at all? Why use VERY expensive cloud storage at 9 cents per gigabyte? Why use very expensive image conversion at $50/month when you can run sharp on a Linux server?

I shouldn't be surprised - the world is all in on very expensive cloud computing.

There's another way though assuming you are running something fairly "normal" (whatever that means) - run your own Linux servers. Serve data from those Linux computers. I use CloudFlare R2 to serve your files - its free. You probably don't need most of your fancy architecture - run a fast server on Ionos or Hetzner or something and stop angsting about budget alerts from Google for things that should be free and runnong on your own computers - simple,. straightforward and without IAM spaghetti and all that garbage.

EDIT: I just had a look at the architecture diagram - this is overarchitected. This is a single server application that almost has no architecture - Caddy as a web server - a local queue - serve images from R2 - should be running on a single machine on a host that charges nothing or trivial amount for data.
Ideally, governments solve problems that are important but that society can't figure out how to solve in other ways. The questions for us are then:

- is it important that voting citizens are informed about various issues?

- is the market (or some other mechanism) currently meeting this need?
I don't understand, why wasn't there a CDN in front of the public GCS bucket resources?
I agree. I scan about 30 websites for news each day.

Do I need to subscrible to all of them?

Just not practical...
Those newspapers made most of their money through ads. Most of what people paid was their attention, not their money.
> For the second approach, called Detector, they use the LLM as a forecaster to predict the next value from a time series. The researchers compare the predicted value to the actual value. A large discrepancy suggests that the real value is likely an anomaly.

Unless there's more to it in the actual paper, this is how just about every anomaly detection technique already works. You fit a model of the distribution of data under normal-enough circumstances, and an observation is an "anomaly" if it seems very improbable (based on your model), or is otherwise extreme if your model isn't explicitly probabilistic.

So yes, this technique would be great if you removed the LLM: it's already the industry standard framework.

There's nothing wrong conceptually with trying to plug in a transformer model here. The problem is the presumption that a "large" pre-trained transformer model can actually work effectively on arbitrary time series.
Thanks! I should have made it more explicit that we would need some family of quantic equations, not just x^5 - x - 1. And looks like from another reply the answer is yes? https://en.wikipedia.org/wiki/Bring_radical#Solution_of_the_...
They've used the UK regulators as a very convenient excuse. But realistically the problem is that Google's DoubleClick has a monopoly on both sides of the ad marketplace. If that wasn't the case, the regulators would not have a problem with Chrome deprecating cookies.

So Google has maneuvered into this position skillfully and then blamed the regulars for not continuing on a pro-privacy path, while conveniently that also makes them the most ad money...
Well, sure...if we're going with "things that have Forth someplace under the hood on which only a tiny fraction of a percent of the users ever wrote a single Forth program", there's more escapees than that. Lot of work to kill a joke tho.
No, because surprise runaway costs are their entire business model.
The only way you can somehow NOT come to this conclusion is by denying that all vehicles, big or small, are dangerous and fooling yourself into thinking that there is some magical size where a multi-ton object going at 60MPH is somehow not a lethal force.
First of all, yes, restaurants would be a bit harder than typical. Second of all, I was thinking more along the lines of gas stations, where the QR codes can be applied in one visit and it could be as simple as having them fill out data and then redirecting them to the correct website. I doubt that gas station employees are regularly checking and ensuring the QR codes are accurate.

And given the fairly muted, simple, design of many websites that require you to enter financial data, and the lack of information on what it should look like, then it would be relatively easy to create a website that mimics the correct website.
Awesome reference, thank you!
This is nitpicky but I don't believe you need 24729 variables to reproduce Kepler's laws which very accurately predict the position of the planets. You basically only need what you need for newtons law of gravity which is masses and locations. Of course the n body problem is more complicated but you still only need masses and locations for all the bodies, plus a computer. What ai could be useful for is finding more efficient and accurate solutions to the many body problem. But tbf, I'm not a many body physicist. So what do I know.
Just had a lot of fun playing for an hour or so, even got to #1 for a while. Thanks for building this :).
I don't know, Uri Berliner's critique of NPR was pretty spot-on, at least from n=1 of this former longtime listener. I found it increasingly difficult to stomach the lopsided coverage that no longer stuck to just the facts, but rather what to think and how to feel about them.
Beauty of cloud :) This could be easily served by a $100/month DO droplet with 0 worries about $.
Just spent 5 minutes following along with the first video. Very clear and friendly instructor
One crucial difference is that you could walk up to a newsstand and buy an issue whenever you felt like it.

Online, there's very other options that don't include a perpetual agreement.
I looked at the video demo and tried the live demo and I still have no idea what it does and what value it brings to the user (why adding a watermark to a video needs an AI?). Also, it's super slow and not responsive.

So many AI startups and I have yet to see one that makes sense for me. But I don't blindly trust any output from any LLM, so that's probably the reason.
Yup. The only mitigation here is that there is a limit to how many different asset URLs they will be able to generate, but if they want to be malicious they can download the same file over and over again and still make you rack up a huge bill.
Probably Kim Dotcom has done wrong, but I don't think he deserves to go to court and or prison in a country he has never resided in.
You might be able to DIY this [1]. You can buy lenticular sheets on Alibaba.

[1] https://web.archive.org/web/20230525193416/http://alumni.med...
i want to pay for reuters but they won't let me. no option to turn off the ads in exchange for payments..
Yes, and I wrote the next two. The joke was about Colin's post --- "these 'right answers' are neither common best practices nor what cryptographic hipsters are advocating". The joke has always been "these should be titled Colin's Right Answers or Thomas' Right Answers [eek]" or whatever.

Nobody has deliberately included bad advice. That's not what I'm saying.
If you want to be depressed, check out the difference 40 years made in the Bronx.
> Manning told the court that, during her interaction with WikiLeaks on IRC and Jabber, she developed a friendship with someone there, believed to be Julian Assange (although neither knew the other's name), which she said made her feel she could be herself

When this came out, everything about Assange was made clear. It's just textbook, take someone who is in a mental health crisis, pretend to be kind, you can do anything to them -- and Assange indeed did. Assange became famous, Chelsea went to prison.

When he decided to skip the materials damaging to Russia and published the materials on Clinton, that's when we knew his affiliation. We didn't need Pussy Riot to tell us -- although they sure did, just in case someone missed the obvious.

These are facts. This is not character assassination.

About him being rapist I was clear is not necessarily true. That might be character assassination indeed.
Funnily enough, The Lion King is a property that has its own controversy of plagiarism of a different animation, Kimba The White Lion. But, I guess if Disney does it it's okay...
Tourists go. That doesn’t mean it’s a good place to live.

The extreme example is of course Venice.
To be fair, rich people could theoretically jump start the process by paying people to open businesses in a town. It just takes startup costs. And if the flywheel gets going, you could see a new "popular" town spring up.

But it's a risk.
I think it's quite natural to ask oneself how far one can go applying the same method that is used for solving the equation x² = 4.
What is going in the UK?

if the need for diversity and tolerance warrants censorship , financial ruin and threat of prison then was it even genuine in the first place?

or was it's politicization simply to serve those that seeks to benefit from this absolutist policy?

such extreme measures only increase hatred and intolerance for the weaponized subject and surely not benefit those that throw support for it.
> the index itself should be something operated by the public rather than privately

I love this but the act of indexing the web is both complex and ever-evolving (not to mention expensive), so the market needs to have natural incentives for the public crawler to continue being good at its job. Google is incentivized to have a great index because it feeds into its competitive advantage. If the index is a shared resource, what incentive does the indexing company have to keep improving it? And what guarantees that the indexing company's strategy doesn't end up being unfair to those affected by their websites getting indexed?

All search companies would have to maintain secondary indices to augment the public one. There's probably some artificial structure needed to make open indexing viable.
Does DO have free bandwidth? If not how exactly does that solve the problem?
I'm not sure what exactly you think is a straw man?

When the OP said "everyone wants to live in the same few places", I didn't interpret that to mean specifically NYC/SF, because that's plainly false. I interpreted it to mean urban vs. rural/undeveloped areas in general.

But the problem is that home builder cartels exist all across the country, and they own a lot of the desirable land around the urban areas. For example, in my own area of Madison, Wisconsin, we have a company Veridian Homes that owns giant tracts of land all around the outskirks of the Madison area. They're the dominant home builder here.
What parents get wrong about raising boys
Honestly, I would just move to R2 and save on egress fees even without the CDN. Runaway egress bills are no fun.

I saved myself thousands $/mo moving to R2.
> Using today's model architectures, the problem of using non-expressly-permitted data for training is insurmountable… So if the artists prevail, image generators are donezo.

This doesn’t follow. Using 2014’s model architectures, image generators were also impossible, but that didn’t prevent progress. The field is moving absurdly rapidly. Suggesting that because we can’t do it one way today, therefore we can’t to it that way tomorrow is like saying that because we couldn’t do it one way yesterday, therefore we can’t do it that way today.

It’s wild to trample people’s livelihoods because researchers haven’t figured out how not to yet, especially when that kind of research is making such quick progress. I’d rather wait a few years and have the best of both worlds.
I absolutely would have donated large sums of money to Firefox development if they had allowed me to do so. Sadly you can only donate to the Mozilla Foundation which does a lot of other stuff. Wikipedia shows that projects can get very stable funding through donations.

Browsers offer incredible value. If there is need people will pony up the money. Many corporations have an business interest in keeping the web free and easily accessible so could serve as potential sponsors. Just like some newer programming language get baking from different companies and manage to stay independent. You just don't want to have one company having total influence.
https://en.wikipedia.org/wiki/Yellow_journalism

https://en.wikipedia.org/wiki/Godi_media

This is nothing new and in fact is a feature of having a for-profit 24 hour news media industry that thrives on advertising revenue and flourishes under emaciated regulation.

https://en.wikipedia.org/wiki/Fairness_doctrine

the repeal of the fairness doctrine in the United States means your television radio and internet news feeds are free to outright fabricate stories with impunity. commercial news means the product is tailored to the consumer, not congruent with the facts.

Treating the news like fresh water and clean air and exposing it to an ultraviolet level of regulation and rigor is the cure. You can still have private news agencies, they just cannot market or sell "snake oil" in the service of the dollar. Another alternative is turning all news into something akin to NPR, or having news "co-ops" that provide the service to their listeners for a fee.
Isn't the faustian bargain a warning against taking money from unscrupulous lenders? The promise of riches, but in the process you lose your freedom (still true for business owners)
How much does it cost to have an ISP let you do that? What are the barriers generally?
Maybe, but making GIL optional (rather than removing it completely) solves both problems.
Slow is smooth, smooth is fast: Navy SEALs' efficiency secret
Agree on the backquotes
Or how about the fact that basically no one uses Windows by choice, they use it because they need to for some app, and because of that Microsoft makes the entire OS constantly harass everyone to try and trick them into signing up for Microsoft services.

Regularly I get an OS update that walks me through "setting up" my "new" PC I've had for 3 years, and it involves dodging dark pattern UIs to not sign up for Office or Xbox Game Pass or set Edge as my default browser. And even if I succeed, they'll probably have taught my computer a new way to try to sell me something.

One update they added their horrible Copilot chatbot as an app to my taskbar, which I promptly unpinned. Then the next update they removed my "show desktop" button - which has been a consistent part of Windows for 15 years - and replaced it with ANOTHER COPILOT BUTTON. I had to look up online how to restore a basic navigation button that was replaced with an ad for their terrible new AI product.
As a European I’m still mad at the regulators for allowing Facebook to buy WhatsApp.
I didn't realize the cars had drivers - I presumed they had long been replaced with self-driving.

Does anybody know why not? Surely the Tesla autopilot software is well capable (the routes are very simple after all). Some regulatory problem holding them back?
> A lot of the badness of news comes from requiring a profit and where that profit comes from.

The same badness will happen in a taxpayer-funded organization. After all, someone is still writing the checks, and coverage will be biased towards that someone. I'd rather there not be an official merger of the government and media that now will have an explicit incentive to paint a pretty picture of the government.

The bias that an independently funded, for-profit media may have towards its funders does not scare me nearly as much as the alternative.