skysight-inc/HackerNews huggingface dataset:
The classic Milton Friedman argument is: higher government spending = higher inflation.

Friedman made the argument that productivity (GDP growth per capita) has no effect on inflation, and interest rates just move where you choose to measure 0, hence his famous quote that "inflation is always and everywhere a momentary phenomenon" (paraphrased)
Shame they don't seem to be keeping pace with AMD, even after the Mellanox acquisition.
They bought it with the liabilities, so suggesting Amazon isn’t responsible for those liabilities now is preposterous. The fine here should be some large percentage or all of the revenue Ring made during the time they had bad security practices.
What prevents people (and Apollo) from simply using the same open APIs the the official reddit site/app?

The requests would be all made from a client, so how would they even know it's not their client? Is it illegal? Because I can make any reddit request with a curl, no?

Please educate me.
This made me laugh out loud
The law applies to the training of a neural network; you're not depriving the copyright holder of his intellectual property; if you use a copy of his work, he still owns the copyright independently if you copy it by right-clicking > copying or by overfitting a generative model.
the primary difficulty isn’t supposed to be the os, but the software you’re building. though os difficulties will always come up, depending on workload.

being on linux means you gain intuition debugging locally. whatever you might be debugging.

to sum up my point: linux. never not be running it.

to your point, linux is a better experience now than before. this is for great good, not a cause to search for a more brittle os and distro.

at eod, os isn’t that cool. software is cool.
Surprised no mention of them developing their own chips.
Friedman also always said that wage growth doesn't cause inflation, but inflation causes wage growth.
Won 12 games in a row with no losses. Usually I win in one exchange by asking a question that exploits AI's weaknesses, e.g. about a current event or (especially) profanity.
The collection of copyright works for the explicit purpose of processing them for a for-profit ML model has not been shown to be fair use, and the fact that many are being marketed as for profit products that meaningfully compete with the original works is a strike against them being fair use.
Django Rest Framework + drf-spectacular. It needs a couple tweaks here and there but it's great.

Apparently django-ninja (a different REST framework for Django) also generates an OpenAPI spec but I haven't tried it.
I hope this doesn't constitute "jump[ing] down your throat," but: try going to an actual pride parade and enjoying yourself rather than judging it by the HR-approved G-rated "celebration" in your workplace.
He can make an alternative backend or shut down. Those are his choices. Adapt or perish.
I'm glad you brought this up, as this tendency for people to anthropomorphize a learning algorithm really bothers me. The model training process is a mathematical function. It is not a human engaging in thought processes or forming memories. Attempting to equate the two feels wrong to me, and trying to use the comparison in arguments like this just feels irrelevant and invalid.
The SEC has been asleep at the wheel for the past two decades. We've seen a huge amount of consolidation across many industries, so it's not surprising that prices start going up once single actors practically own a whole market.
yeah. There are countries growing at 7% annually, but they're mostly in Africa. Niger, Rwanda, Congo, etc.

But please for the love of God, don't compare GDP to revenue.
> I asked them if they are a helicopter or plane pilot, and they replied simply: "A very good customer."
Phoenix Program
I guess this makes sense if you don’t use a Second Brain/PARA/Zettelkasten/etc. system, but my entire life is structured around Obsidian (at home) and OneNote (at work).

If you’re just throwing notes into a note-taking app with no way of processing them, I can see how this would be true, but my system is constantly resurfacing old thoughts, and I make conscious choices about what gets archived and preserved.

I read the full article, and it sounds like the author hasn’t heard of these. Confident article. Not deeply researched in my opinion.
Digitalocean Spaces uses Ceph as their backend and it is NOT stable (at least with s3fs), had to migrate away from it and could not do a full-stack on DO (aka "no AWS") and had to swap in Wasabi.
I agree that codegen + docs is actually where most of the value is. The problem I think is in the design. Having an intermediate spec makes all the downstream tooling for codegen + docs need to handle all the complexity. Any information lost (because the spec is in sufficient for whatever use case), you end up with a worst of both worlds situation, your code or docs gen tooling is less direct to use, and now is missing context.

Another way of handling this is getting the server your are interacting with to be able to generate the code directly based on their own internal knowledge of how the APIs are put together. This puts more onus on the library creators to support languages etc, but provides a much better experience and better chance things will 'just work' as there are just less moving parts.

ServiceStack is a .NET library that does this with 'Add ServiceStack Reference'[0] which enables a direct generation of Request and Response DTOs with the APIs for the specific server you are integrating with. IDE integration is straight forward since pulling the generated code is just another web service call. Additional language generation are integrated directly. It had trade offs but I'm yet to see a better dev experience.

[0] https://servicestack.net/add-servicestack-reference

(Disclaimer I work for ServiceStack).
Introducing Lil Artist, an educational and fun learning platform for kids aged 2-7. Our app offers a safe and stress-free learning environment where your child can explore and learn at their own pace. With a collection of interactive games, digital storybooks, math learning, memory games, coloring, logic puzzles, Alphabet tracing and bedtime stories, Lil Artist provides endless fun and educational opportunities for kids. 100% ads free.
Judging from this thread: I bet the Apollo dev could easily secure enough VC to eat reddit's lunch in short order. There would be no shortage of talent willing to take down goliath.
Most HTML is undocumented and unstable, so I’d say it’s far from perfect.
I imagine they're blasé about it precisely because they know these belong to no known actor, so far, they haven't shown any kind of signs of aggression towards anyone.

So, I think, these are viewed more like animals than anything else. Is that the right approach? Maybe? But maybe if anyone tried to touch them, shoot them down or whatever, we don't know what kind of reaction we'd get from them.
Comparing the revenues of tech companies to the gdp of a country, even to give a sense of scale is comparing apples to oranges.

Even if a bit unlikely, I would not be completely surprised if the service industry as a whole produced twice the value its produces today thanks to AI in the next 20/30 years. Not to mention the productivity gains in other sectors.
Any database can be used to extend the memory of LLMs. What a database does is store stuff and lets you search/retrieve stuff. Embeddings are differet form of data that are in many (but not all) cases superior to searching through text.

You do not need a fancy cloud hosted service to use an embeddings database like you do not need one to use a regular databse (although you could).

Check https://github.com/kagisearch/vectordb for a simple implementation of a vector search database that uses local, on-premise open source tools and lets you use an embeddings database in 3 lines of code.
Possible Disruptions Due to the War
Someone cared enough to defeat annoying blocker blockers of sites. If they care just a little bit more, they could replace the web developer's code with their own minimal version. Chances are the site doesn't actually need most of the code it includes anyway.

What I'm talking about already exists by the way. Stuff like nitter, teddit, youtube downloaders. I once wrote one for my school's shitty website.
"Yes obviously that kind of free and unexpectedly diligent labor would be appreciated."

Then perhaps characterizing doing work - including often doing partial replication, independently deriving results, checking code to make sure it's both complete and consistent, etc. as "ruining your career and your advisor will also be mad" is unfair.

"I've sent reviews in detailing what further test or figure might be needed to make a point more persuasive, or noting inconsistencies, and I encourage my students to do the same."

Some of this is replication. "I cannot get from X to Y in your paper without the addition of Z" is, at its essence, a statement that a result cannot be replicated given what has been provided.
Some frustrating with this game comes from the slider resetting when moving too fast. With debug touch points enabled I can see that I never leave the path, but it still resets. This is exasperated on Firefox where rendering seems to be slow resulting in constant resets.
Ask HN: How to Update a Cache?
When it comes to architecting code, normally I've been able to figure out great solutions for a lot of design problems. But somehow, my solution to updating a cache is... not very elegant at all.

Basically, I wrote this function Q.getter() which wraps any function and turns it into a smart getter, which does caching, throttling and queueing as needed. Pardon me but I did it 10 years ago before Promises were standard: https://github.com/EGreg/Q.js

Anyway, the caching part uses Q.Cache, something I built, but my question is very general. So when a reply comes in, I basically have an option to the Q.getter():

"prepare" - optionally used to feed the data sent on the wire to a constructor, so you get back an object

And then inside Q.getter() I stuff this object into the cache.

So far so good, but here is the issue: the cache can often depend on a number of things. For example a cached User Avatar may change when I update a User Icon stream. What I do now is have functions like _updateUserAvatar() every time a stream changes. Then it checks the name of the stream, and updates the cache.

As another example, when a new message comes in for a stream, I reach into the cache and update the stream's messageCount. I do these kinds of updates so I don't have to go fetch the stream again.

Basically every time some information is pushed from the server, or comes as a reply to some request, I mutate the cached objects on the client side as long as they exist, so they match the latest view of the server object.

And sometimes, I maintain several caches, for example when I call Q.Streams.get(p, n, {withMessages: 10)}) or Q.Streams.get(p, n, {withParticipants: 30, withMessages: 20}) vs just Q.Streams.get(p, n); That's because the caches are keyed automatically by Q.getter() to the JSON-encoded parameters passed to the function. So there is no concept that I should be aggregating the cached objects into one data tree or something, like

{stream: {messages: ..., participants: ...} }

This seems messy and has a lot of brittle code, and I was wondering what a better architecture would be. Would I make a generic mechanism that would aggregate objects and not duplicate caches just because the parameters to the function are different? Or is there a completely better way to do this?
In your world how would you consider Sam Altman having no equity in OpenAI? And everyone finding out after it had a viral hit
I don't like the prevailing cynicism of dismissing the content of the message just because some bad/prejudiced/wrong factions are involved in it. It's not the way I learned to do research and answer questions. It's nevertheless an ad hominem to dismiss an issue just because some people out there are trying to co-opt it. There's a psychological explanation for that cynical behavior: internalized oppression. The focus is put on the morality of the people saying a thing, rather than just looking at the thing and deciding, independent of the existence of those groups, the objective, scientific implications.

If it were a perfect society and people discovered deep neural networks, there would be no excuse to blame bad actors for posing the question of whether AGI is an existential problem or not, and what to do about it. Unlike bad groups of people, the question won't go away. In the real world, it is entirely possible to have to consider multiple issues at once, not at the expense of any issue.
I've had access since 2023-05-13. You have to use the Insiders build of VS Code, and a nightly version of the Copilot extension.
A rogue appeals court wrecked the patent system (2012)
Allowed, yes. Doesn't mean it's right or even preventing tyranny. You aren't insulting the people making or passing the laws/rules/etc, you're insulting the people acting on those laws/rules/etc.

There is no overstepping authority if they actually have that authority. That doesn't mean they should have that authority, but they do, and thus they're not overstepping it. They're just using the tools at their disposal to get back at someone who is being an ass.
I think this is an unfair criticism which goes to tone more than intent. It's about getting some regulation back into the room before its too late. Is it really about extinction? No.

Technology mis-application is as old as technology. We saw it with expert systems deployments in the 80s and 90s which codifed systemic bias in medical school admissions. At that time, the "blame chain" was clearly to the experts who codified the admissions policies too accurately (!)

The problem with AI is that it's increasingly being used as a hall pass out from human review. So, the layer of indirection in the applied decision is really strong here. Who do you "blame" when a systems does poor inductive modelling from a fact set, using bad algo and then you take policy decisions? Sure, you made the mistake believing it, but the problem is .. capitalism drives hard to save money, so its de-skilling.

Australia had a pre-AI version of this with something called "robodebt" when Algo decisions on welfare payment fraud were let loose at large. People died (suicide) because of the debt burden, for something which was just plain wrong.

When you wind up with insufficient people willing to take money to fly and then release weapons from a reaper UAV, The obvious solution to a cash-strapped military mind is to let the GPT do it for you.

"extinction" is hyperbole, sure. Thats how you get attention. But the societal effect of misapplied generative knowledge, and models, with strong belief outside a cogniscenti to their correctness is a recipe for disaster.

Keep humans in the loop.

Do you think Sam Altman and Geoff Hinton releasing a manifesto which said "keep humans in the loop" was going to get mindshare? I don't.

BTW I am an AGI skeptic. I think AI is a terrible label for statistics and modelling. None the less, I'm glad they made the statement and signed it, and I am glad regulation is coming.

I am also capable of believing Altman said it, to secure and retain competitive advantage. Just because one or two signees have cynical upsides doesn't invalidate the core concern: This stuff needs regulation.
Wikipedia Entry on Caddyserver Vandalized
It is not the same website.
To me it looks like they work for the parks. Both controlling and a good Twitter advertisement.
How Congress Gets Rich from Insider Trading
I disagree. Notes are not only for ideas - they’re also here to manage complexity and understand things.

I use notes app to quickly remember what would otherwise be forgotten. I use notes apps just to make sense of what’s around me and not to have magical ideas.

I’m essentially a staff engineer, and my scope is very broad. I can pretend I have eidetic memory ( which I don’t have), or be lucid, and use notes as a way to not forget things, and be able to draw à meaningful plan.
Apple patent infringement lawsuit in 3...2...
This is an excellent comment, thank you.
Ugh. I meant `;` is unquote-splicing, which is an operator within a quasiquote. Sorry for my brain fart.
Using Redis VSS in a Large Language Model Chain
One thing I would really like for my notes is some sort of AI or fuzzy thesaurus-aware search, so I can enter a search phrase and get "similar" matches from all my local files, not just "exact" matches like you'd get from grep.

Does such a thing exist in emacs?
> What that doesn't seem to address are multiple people with the same name. So the sender know he's sending an email only John Doe can read, but he still don't know which John Doe it is.

That's not the way I read this. Governikus validates the names match, but they're linking the PGP key with the government ID, which should have some sort of unique identifier. What Governikus ought to be signing is a link between the PGP key and the government card's unique identifier. The name ought to be purely informational, and I wouldn't be surprised if the government has a public service showing the name of a person after supplying the unique ID as a parameter.
$12,000 per 50 million requests according to a post the dev made on Reddit, which he claims translates to $20 million a year.
‘We’re not ready’ to defeat Russian attack on NATO, retired US general says
> ad companies and payment processors [...] cut off payments when their corporate values shift.

"Sir, is it time for us to claim to have corporate values?"

"Not yet, m'boy, we are still swimming in our private ocean of profits!"
North Korea blames ‘unstable’ fuel for failed launch carrying spy satellite
Yes, that too; but a double standard on top of that is double plus ungood disgusting.
Sure and I'll be happy to use it when available assuming I'm still working with JVM applications then. Meanwhile I'll still be stuck with fastutil-style templating for another ten years and it kinda sucks.

(Scala has specialization and value classes and opaque types so that covers a fairly big range but they make interop with Java tricky.)
Those of us that live outside the US really wonder why the debt ceiling dance happens like clockwork without any effort to remove the most obvious of pork barrels.
Works on my Pixel 6a with Firefox.
Another good one posted recently: Rekt Network https://news.ycombinator.com/item?id=35971329
Ah yes, the new prohibition. It's worked swimmingly for everything else so far.
Lol. Contempt for a guy for what? Being successful and occasionally saying stupid things?

I'm sure you've never said anything stupid
You should be used to high difficulty if you're using Firefox on mobile.
Rich kids aren't swinging guns in Lakeview.
The use cases for such random access was from our experiences to maintain large-scale training data, with the needs to debugging model performance against to data, which requires fast slicing and dicing over the dataset, filtering into subset of dataset that satisfy certain distributions, and visualize them on internal debugging UI interactively.

A few of users use random access to do shuffling and training on subsets as well.

Many of them migrated from a system where you can store asset URL in your format of choice (say parquet/tfrecord), to Lance, partially because putting asset (i.e., image, large tensors, lidar point cloud) physically together can lead to better scan perf than loading a lot of small files from S3 or on-prem object store / file systems, due to much less metadata server load over the directory / key&value structures. (i.e. Some of our users see similar issues like this decade old article https://blog.cloudera.com/the-small-files-problem/)

One motivation to design lance is to avoid creating a new copy of training dataset just for one model / training iteration. This is one copy of data for maintenance (update/schema evolution/deletion), analytics & visualization, and training.

For scanning, Lance has been proved slightly faster than Tfrecord and parquet over object store (S3 and GCS). I'd contribute the scan performance just to Rust and tokio async I/O. It is not necessary a better design in scan as we just try to scan "no more data than parquet" when we designed the layouts / encoding algorithms.
Scammers exploited a bug in Gmail to impersonate UPS, Google closed as won’t fix
I suspect OpenAPI advocates would argue you should start with the spec and use it to generate both the client and server. This is already a common pattern in other RPC definition languages such as gRPC. You _could_ write a server to match the gRPC spec, but why would you?
I think we saw a version of this unfold during COVID, when many people didn't want to do some forms of labor any more. The (somewhat) successful resonse was to raise wages.
quit at 2 fingers because, why am i doing this? (i've actually commented before on HN about my dislike of all the sliders in the iOS UI, what an annoyingly difficult specialized skill to have to say up on just to hit what should be very fast and simple radio buttons or checkboxes)
It absolutely is a useful comparison. It's obvious that this software depends on unstable interfaces that will eventually break. I wasn't talking about that, I was talking about the sheer effort it takes to create such things. Such efforts are absolutely in the realm of existence today. Projects like nitter and teddit exist. Teddit is on the frontpage of HN right now no doubt in reaction to this thread. There's probably one for HN too, I just haven't found HN to be hostile enough to search for it.

Honestly I don't really care about "most users". To me they're only relevant as entries in the anonymity set. As long as we have access to such powerful software, I'm happy. I'm not out to save everyone.
The land the nobility or the roman catholic church owned were the 'commons' then.

A server with nothing on it is like a field of weeds. It's just taking up space.
I bookmarked this just in case I need to read it later. :)
That's a good idea. The format itself is self-contained. We need a little bit work to expose our file-level read/write API to public.
> but you don't have an employer/employee contract with that company. It seems like such a precarious position to me.

Your employer can dump you at any time. If you hadn't noticed, there have been mass layoffs in many tech companies this year.
Mississippi Is Offering Lessons for America on Education
Meta threatens to pull news content in California if bill pay publishers passes
Right; we wouldn't want the next generation of one of the most populous nations, that is at a more imminent and grave risk from global warming than most others, to have a science background?

It's like some secret plot perpetrated by an external enemy who aims to eradicate the nation.
And per user it's about $25 a year
Contabo offers quite a lot of RAM for not too much money. I'd recommend putting effort into a good backup system (no fancy multi-AZ stuff that makes other server farms so expensive). The $8.50 tier comes with 8GB of RAM, which should be good enough to host 200 users based on the numbers in the setup guide. If not, the $14 plan should definitely cover you.

Hetzner is also a popular source of cheap servers. You'll see similar prices there, though they're often a bit higher (but with more options).

If you're a real cheapskate, you can try using Oracle's always-free tier. That'll get you 4 ARM cores with about 6GB of RAM each for a total of 24GB if you combine them into one machine. Downside of the free tier: the connection is capped at 50mbps which may become a problem for 200 people.
Remember when all the supermods of reddit shut down their subreddits in protest of Reddit not banning some Coronavirus subreddits?

Imagine holding a companies website hostage you work for free on unless they run their company how you want them to.
FTC?
I’ve been wanting to write a tool that takes in a open api spec and generates zod/io-ts for a while now but I haven’t had the time. That sounds very useful though unfortunate you can’t open it up!