skysight-inc/HackerNews huggingface dataset:
Wow, yes, I would have joined. I dreamed of such a thing but also had a theory why it could never be.

Now, I'm not sure if the theory is true (though the shutdown might prove it true). But this is it: Newspapers and magazines want subscribers much more than they want revenues. Especially, while newspapers certainly seek revenue, another key function for a newspaper is to influence public opinion in the direction prefered by their owners. In the US, most small towns have newspapers owned by the leading families. The paper is valuable to that family if it's being read by the locals and the paper making money is nice but secondary.
Yes, I saw that! Inspired me to look at the original paper.

The video takes a slightly different approach from the paper and uses a retraction on the möbius strip to its boundary as a contradiction.

That particular argument doesn’t generalize as well in higher dimensions (in particular, the symmetric product won't always have a boundary to retract to), so I followed the original paper’s one instead. I'll add a link to that video as well
Im still hoping that Typescript support comes soon!
What's the end game here - what happens when these VC backed companies slurp up all original data and the content creators run out of money and will. What will they slurp then? DEAD INTERNET.
No, the ollama default quantisation is 4 bit
Gravity is just the catalyst for solar fusion. The energy comes from moving the atoms closer to iron in size.
I do more research, one-off ,code and being able to align equals signs or successive lines which do similar things both makes me happy and makes it easier to skim. I think the Linux kernel does it too. Emacs has a way of aligning by common separators (=/, as well as quick regex)

I guess I've never gotten into an actual serious debate with someone over formatting so I don't know what I'm avoiding, but sometimes auto formatted code makes it harder to skim
it took me several hours to get llama.cpp working as a server, it took me 2 minutes to get ollama working.

much like how i got into linux via linux-on-vfat-on-msdos and wouldnt have gotten into linux otherwise, ollama got me into llama.cpp by making me understand what was possible

then again i am Gen X and we are notoriously full of lead poisoning.
> Rubbish, but even if it were true, so what? Who gave the US the right to decide what happens in other nations?

So the US should sit back as the USSR does it?

> Whether or not it had "physical effect"--whatever that is--this was clearly support.

Is it wrong for the US to support on side of a conflict?

> "[The CIA] had ongoing intelligence collection relationships with some plotters"

That's not the same as supporting a coup. It's literally the CIAs job to collect intelligence, no? It's something you can do without impacting the outcome?

> Only the coup plotters know why the conducted a coup and I'm not convinced they've told you.

Read up on the conflict. Allende was refusing to follow the constitution. It's not like Chile was some stable democracy, it was teetering on authoritarianism.

> That definitely automatically grants the U.S. the right to decide the matter.

The US wasn't doing that it. It was monitoring the situation and never got involved. But if it had, would it have been wrong to pick a side?

> That's not a fact. That's a matter of judgement (yours).

It absolutely is a fact. Calling it "overthrowing a democracy" is inaccurate. They were highly unstable governments teetering on chaos. Whether the US got involved or not wasn't going to change that fact.

So again, I raise my original point - the alternative isn't a democracy and stability, it's chaos. The US can stand back and let the USSR fund the opposition and end up with a dictatorship. Is that a better outcome than the US getting involved?
Yes. In terms of popularity (installs/time) psql superseded mysql. Although of course at the tipover point msql still may have beaten psql in terms of total installations, i'm pretty sure even by that metric psql already won.
There's a really bad equilibrium where every country (or at least every country big enough to have BigTech workers in their country) figures out they can globally censor the internet by using the assets and people of those companies as leverage. Then we would have Americans having their internet censored by every foreign power except China and Russia, where BigTech have largely left.

And it would all be done under the color of local law.
I totally agree with you. Like I always say—if things could improve, they would have improved by now. Anything that doesn't immediately change the world is usually a scam, con, or flimflam. Personally, I don't know how basic research works, or how industries get bootstrapped, and I don't care. If it's not easy to do, but someone is trying to do it anyway, I assume a crime must be taking place. The people I view as heroes? Those anonymous figures throughout the history of the world, who looked at huge problems and said: "don't bother". They were right, and you are right.
IT was probably one of the most influential pieces of software for me as a teenager. I can’t put into words how important it was to me as a way to escape a crappy life and just get lost in making music and sharing tracks on my local BBS, chatting to other people like me who I’d go on to meet and become life long friends with.

It will always hold a special place in my heart and I owe Jeffrey so much.
who cares?

the difference between 50ms and 5ms is barely pereceptible.

vscode isn't slow. it's fast. it could be faster, but making it faster would be, ironically, a waste of time.
When would you use it?

Emacs dired works fine on other platforms, which don’t have GNU ls on them, so I’m guessing by default it doesn’t run ls on its own.
I did explain it. She didn't understand before but by the end, with some reinforcing chats with librarians, she understood.

The why: Knowing how to research and assess points of view, axes to grind, etc. is essential for the kinds of college work she was going to be doing. And, it would help her in life.
I'm martian and I learned to use TCP/IP to make requests to IP addresses on Earth internet and interpret any response I get, however I'd like. I have been enjoying myself but recently came across some bruhaha around robot.txt, user agents and blah and apparently I'm not allowed to do whatever I want with the responses I get from my requests. I'm confused: you're willingly responding to my requests with strings of 0s and 1s but somehow you expect me to honor some arbitrary "convention" on what I can do with those 1s and 0s. earthlings are odd.
Everywhere I’ve worked, including Google, many (probably most) people care a lot about the code and the format. Often too much. That was the point rsc was making.
Besides and beyond that, every tree has been duplicate counted about 20 times for global warming mitigation, AND they're all going to burn in fires, AND they're all going to die from beetles, AND they're all going to die from drought, AND they're all going to get cut down for wood or fuel.

Carbon removal is a combination of several different scams on the public.
They should have set the age at 65.
The argument doesn't need to be about political engagement, it's about liberty.

Denying the vote to a thoughtful 16 year old is worse than giving the vote to a 29 year old that takes it for granted. And then same thing applies to a 2 year old, if they can independently mark the ballot...
I see a couple comments comparing llama.cpp and Ollama, and I think both have utility for different purposes. Having used both llama.cpp (which is fantastic) and Ollama, a couple things that I find valuable about Ollama out-of-the-box --

- Automatically loading/unloading models from memory - just running the Ollama server is a relatively small footprint; every time a particular model is called it is loaded into memory, and then unloaded after 5 mins of no further usage. It makes it very convenient to spin up different models for different use-cases without having to worry about memory management or manually shutting down those tools when not in use.

- OpenAI API compatibility - I run Ollama on a headless machine that has better hardware and connect via SSH port forwarding from my laptop, and with a 1 line change I can reroute any scripts on my laptop from GPT to Llama-3 (or anything else).

Overall, at least for tinkering with multiple local models and building small, personal tools, I've found the utility:maintenance ratio of Ollama to be very positive -- thanks to the team for building something so valuable! :)
Yeah if what you are making are videogames.

If you are doing grown up stuff, you use a grown up language.
The Perl world had perltidy (first release in 2002) many years before Go was even a thing. It's funny that Perl, a language notorious for it's "There's More Than One Way To Do It" (TMTOWTDI) philosophy had a tidier so early. Of course, perltidy is _ridiculously_ configurable.

One thing I really love about gofmt is that it has no configuration at all. I think that was a major "innovation" and I'd love to see more languages adopt this approach.
Can a candidate be great if they haven't messed around with projects in a group setting?
Somehow, it always works on the third try.
Sure, but there’s a speed limit to that, and you sort of trust the person holding you implicitly.

Not really applicable to an aircraft hurtling along at 300m/s
You are not.

Perplexity should always respect robots.txt, even for summarization requests. If I say that I don't want Perplexity crawling my site, I mean at all, and I explicitly would not want them "summarizing" my page.

The response from Perplexity to such a request should be "The owner of this page/site does not permit Perplexity to process any data from this site." Period.

LLMs can't summarize in any case: https://ea.rna.nl/2024/05/27/when-chatgpt-summarises-it-actu...
Well, the point of a non-temporal write kind of is that you don't care how fast it is. (Since if it was being read again anytime soon, you'd want it in the cache.)

But yes, it can be an over-optimization.
One answers is that this case isn't actually a bad law. This appears to be blatant organized piracy. What's odious about copyright laws? This also appears to be pretty much the gold standard of due process. It's not like somebody submitting automated DMCA requests on videos with silent audio tracks or something. It's a court order for these specific domains, which would have been carefully curated and has been quite literally litigated.

The other answer is that you really don't want big corporations to be ignoring laws they don't like, because odds are pretty good that your list of bad laws doesn't match theirs. Countries have sovereignty. If a company doesn't want to obey those laws, they should not operate in that country. If the law really were bad, the way you'd actually fix this is by the democratic process. That's up to the voters, not foreign corporations.
You meant search bots and other bots? Internet Archive's bot is a crawler.

They showed no difference between search bots and archive bots. robots.txt was never for SEO alone. Sites exclude print versions so people see more ads and links to other pages. Sites exclude search pages to conserve resources. They said sites exclude large files for costs. And they can't think sites want sensitive areas like administrative pages archived.

Really Internet Archive stopped respecting robots.txt because they wanted to archive what sites didn't want them to archive. Many sites disallowed Internet Archive specifically. Many sites allowed specific bots. Many sites disallowed all bots and meant all bots. And hiding old snapshots when a new domain owner changed robots.txt was a self inflicted problem. robots.txt says what to crawl or not now. They knew all of this.
You’re looking for group equivariance - there is some work in group equivariant neural networks. You might find the very recent paper on Clifford Group-Equivariant networks interesting - it applies to not only Euclidean spacetime transformations but even Minkowskian spacetime.

You might also be interested in implementations for novel view synthesis such as instantngp and other NERF-type models. InstantNGP is actually ludicrously simple relative to most recent neural architectures, imo.

With respect to the reversal problem, I wonder how strongly this would still hold for eg encoder-decoder (eg T5) or “order-free autoregressive” models (eg sigma-GPT from last week)
A good amount of these websites are proxied by Cloudflare, so you're connecting to CF and CF connects to the website.

And many websites use CF, so if you were to block a CF IP, you'd block a whole bunch of websites.
I think that if an attacker can control filenames fully, this is the least of your worries. Otherwise this article could've just as well been titled "why you shouldn't create filenames with newlines", but that makes too much sense.

Has anyone actually found a good use for filenames containing newlines?
Is Your Agency AI-Ready?
Can you elaborate on the validating part?
jokes (not so joking) aside: I'd love for a bot to 100% sit between me and "web browsing" 100% of the time. I only want reader mode content. I don't care for ads. and if you need me to pay - ask for it, in text. put a link and clearly state that for me to get those 0s and 1s I need to pay. it's not hard. physical shops do this. it's 2024, it's fine to put up paywalls. yeah, it may break some biz models, but that's just evolution
I see nothing in this article suggesting that the court order is for a global block, rather than a regional one. Do you have a source for that?
A payment processor generally also charges something simply for usage of service. And, even if they don't (and I'm having trouble thinking of any that don't), you almost always need a full time programmer supporting your monetary transaction flow.

Sure, supporting that overhead doesn't matter if you have a million transactions a month. If, however, you only have a hundred transactions a month, a salary of $120K per year means that you need roughly $100 each in profit in order to support that programmer. A thousand transactions in a month means you need roughly $10 profit each to support that programmer. You need 10K transactions per month before you are at $1 profit per transaction to support your programmer.

How many businesses have ten thousand transactions a month? Not very bloody many. Basically, only the very top 50 out of 250K creators (0.02%!) on Patreon pass that mark. It's REALLY rare.

Sure, when you are at scale things are cheap. However, before then things are very expensive.
Which, IMHO, is the right way to do it.

Overly freezing the context guarantees at this early stage would be highly limiting.

It makes more sense to invest in surrounding privacy infrastructure (PCC) to provide sane guarantees without strictly bounding context.
Great answer! And your blog is great, too!
Does Cloudflare operate different 1.1.1.1s for each country?
You've identified exactly the problem. They'd be blocking thousands of unrelated innocent websites. Also, changing your IP address is really easy.
Have you played some of the pure puzzle video games out there? Many of them involve meta layers and secrets that involve lateral thinking and epiphany to progress in.
The problem comes when that now 70 year old is supposed to foster an urgent and relevant response to problems of the current 30 year old generation. They may be a well respected leader with an impeccable service record, but how can they possibly be effective when they don’t know how to use a smartphone or think cookies refer to the things they in the jar in the kitchen, or think AI is that thing that calls you Dave?
> Has anyone actually found a good use for filenames containing newlines?

Yes - in tests for code that handles filenames, shell or otherwise.
You do need more if you use larger context sizes though. It can really blow up to multiple times the model size even for 128k context.

Edit: Oh I see that calculator you linked shows that too. My information was more trial and error, thanks for the calculator link.
> Would a well constructed chess engine always resign as black?

Depends on what you mean by well-constructed?
Also, the country (france) is ordering the "poisoning", these american companies just comply with local regulations.

Heavily biased article.

Remember that dns/ip systems are decentralized at the national precisely so that countries have sovereignity.

The editorial line would have us believe that france is committing a free speech crime or overturning internet infrastructure, while in actuality they are exherting their national rights.
Yes, DoH prevents that, unless the DoH provider is in on it too, which most of the major ones are now, as this article is about.
I think they're colluding to put a ceiling on wages.

Absolutely. That's standard Uber policy.

Uber (and I suspect Lyft too) has the business model whereby they soak the investors and the not-so-accounting-savvy drivers for as much cash as possible and then the administration officers laugh all the way to the bank with their high wages and bonuses.

Uber's business model is designed to never make a profit. If they do happen to make a profit it means they miscalculated the level of company officers' bonuses that year.
They are semantically different—one is a relative domain name, the other is distinct. I'm not sure how this impacts localstorage or cookies but it might.
Hence my weasel wording of 'typically'.
Seems like a better comparison is to a one-way hash function.

Given a set of vectors resulting from an embedding model, it’s cheap & easy to check if a certain document is similar to the original source, as you just run the embedding on the comparison document and choose your favorite similarity metric.

However it’s very hard to recreate the source itself — as far as I can tell, you’d basically have to run a very expensive form of blind gradient descent: generate multiple texts, run embedding on them, check similarity, pick the closest one, and repeat with that text as the starting point.

Maybe someone can correct me if there exists an efficient way of reconstructing the original text. I would be very interested to know.

Edit: I appear to have just described a super naive and slow implementation of vec2text (see sibling comment). Will have to read that paper in more detail but it looks really cool.
I thought about averaging the scores, which gives you a point inside the circle, and then projecting onto the circle with a ray from the centre, which is continuous everywhere apart from where the average is at the centre (e.g. for two voters this is when they have exactly opposite views).
So if you have a continuous probability distribution on the domain the probability of undecidability has measure zero.
The problem is an ANN or LLM has no physical location or “point of view”, which has led ML practitioners toward the concept of embodiment: where algorithms and agents no longer learn from datasets of images, videos or text curated primarily from the internet - instead they learn through interactions with their environments from an egocentric perception similar to humans.

Curiously I didn’t see any mention of this term in your paper. But you did touch on the contrast between egocentric and allocentric representations, which lies at the heart of the issue.

I think the grand challenge of AGI will be unifying these two to reap the benefits of both while minimizing the dangers of imbalance. A bit like physics wrt gravity and quantum mechanics.

We’ll need allocentric perspective for globally optimal decisions (superorganism), but we’ll also need egocentric reasoning to enable robust autonomy in unique local environments.

Also worth mentioning that multimodal representation learning seems like it essentially achieves the sort of cross modality behavior of grid cells, although physical location (not positional encoding) is not an input in any of the research I’m aware of.
What? The tech ( dns in this case) is as neutral as you can get, these are french courts ordering the block, and the dns technicians are controlled by american corps. Dns just executes the orders of the corp, which in turn obeys the local courts.

Tech is under corp in the chain or command, which in turn is under national law.

Gross lack of extra-technical nuance here.
I don’t understand why they had to format 100k files. You enforce the format with a presubmit and let the code get formatted in the next change.

I have long felt that Google’s strength has always been making a bad architectural choice and then executing on it flawlessly. So many systems are designed in ways that require incredible technical execution to make them workable, and they do it.
Sounds like something that can be applied to the call center operator voice as well.
Today the country has the capacity to make about 40 million vehicles annually — enough to supply half the world.

LOL. I don't remember the US car manufacturers complaining of "over-capacity" in the 1950s when Detroit produced half of the World's motor vehicles.
Over the years more and more people would disagree with this though
Not at the moment, although it is a highly requested feature (specifically fine-tuning). There are a few tools that you can (or will soon be able to) use to fine tune a model and then import the resulting adapter layers into Ollama: MLX [1] on macOS, Unsloth [2] on Windows and Linux

[1] https://github.com/ml-explore/mlx

[2] https://github.com/unslothai/unsloth
Alternative title:

French courts order American DNS providers to block unlicensed sports streaming websites.
Ex: Angular
Looks like a cross between an IME and autocomplete. Although in my case, I think I would prefer a proper IME, or maybe something like dmenu with fuzzy search, to invoke on an "as needed" basis.
Wow, so many Starlink satellites overhead!
> in practice no one clicks through on the tiny (1), (2) links to go to the source

I offer my self as specimen of someone who clicks on those citations ALL the time because thats how I can - most of the time - find download links, and other details faster than asking again
Main reason I started using ollama is because it actually worked. I spent half an hour trying to get huggingface models to run on my GPU with no success. Meanwhile `sudo pacman -S ollama-rocm` seemed to just work out of the box.
> Perplexity should always respect robots.txt, even for summarization requests. If I say that I don't want Perplexity crawling my site, I mean at all

Issuing a single HTTP request is definitionally not crawling, and the robots.txt spec is specifically for crawlers, which this is not.

If you want a specific tool to exclude you from their web request feature you have to talk to them about it. The web was designed to maximize interop between tools, it correctly doesn't have a mechanism for blacklisting specific tools from your site.
Have you heard of modular, mojo, and max?
If you want summaries from my website, go to my website. I want a way to deny any licence to any third-party user agent that will apply machine learning on my content, whether you initiated the request or not.

LLMs — and more importantly the companies that train and operate them — should not be trusted at all, especially for so-called "summarization": https://ea.rna.nl/2024/05/27/when-chatgpt-summarises-it-actu...

While Perplexity may be operating against a particular URL based on a direct request from you, they are acting improperly when they "summarize" a website as they have an implicit (and sometimes explicit if there's a paywall) licence to read and render the content as provided, but not to process and redistribute such content.

There needs to be something stronger than robots.txt, where I can specify the uses permitted by indirect user access (in my case, search indexing would be the only permitted use case; no LLM training, no LLM summarization, no proxying, no "sanitization" by parental proxies, etc.).
We’re actually at or past the peak of co2 from power generation. 2024 is likely lower and we’ll keep going down from there
https://ember-climate.org/insights/research/global-electrici...