MurphyA/hacker-news huggingface dataset:
by smartmic | 2025-06-06 07:16:33+00:00
I had the same experience. In my humble opinion, it's just not the right tool for the task. I remember setting up my own self-hosted PouchDB to sync my notes with different clients. The tool was called NoteSelf¹. It was such a fragile setup and only worked suboptimally. Currently, I use Emacs Howm². Having notes in plain text files is the most robust and simple setup. I am a big fan of SQLite, but none of my attempts to use it for note storage were as good as a file-based solution.

¹ https://noteself.org/

² https://kaorahi.github.io/howm/
by samwillis | 2025-06-06 07:17:42+00:00
This is something I've explored as part of my work on PGlite. It's possible but needs quite a bit of work, and would come with some limitations until Postgres upstream make some changes.

You will need to use an unrolled main loop similar to what we have in PGlite, using the "single user mode" (you likely don't want to fork sub processes like a normal Postgres). The problems come with then trying to run multiple instances in a single process, Postgres makes heavy use of global vars for state (they can as they fork for each session), these would clash if you had multiple instances. There is work happening to possibly make Postgres multi-threaded, this will solve that problem.

The long term ambition of the PGlite project is to create a libpglite, a low level embedded Postgres with a C api, that will enable all this. We quite far off though - happy to have people join the project to help make it happen!
by jsnell | 2025-06-06 07:18:10+00:00
No, it feels more like the disconnect is that I think they're all compute-limited and you maybe don't? Almost every flop they use to serve a query at a loss is a flop they didn't use for training, research, or for queries that would have given them data to enable better training.

Like, yes, if somebody has 100k H100s and are only able to find a use for 10k of them, they'd better find some scale fast; and if that scale comes from increasing inference workloads by 10x, there's going to be efficiencies to be found. But I don't think anyone has an abundance of compute. If you've instead got 100k H100s but demand for 300k, you need to be making tradeoffs. I think loss-making paid inference is fairly obviously the worst way to allocate the compute, so I don't think anyone is doing it at scale.

> I think deepseek instead just showed they haven't really bothered yet.

I think they've all cared about aggressively optimizing for inference costs, though to varying levels of success. Even if they're still in a phase where they literally do not care about the P&L, cheaper costs are highly likely to also mean higher throughput. Getting more throughput from the same amount of hardware is valuable for all their use cases, so I can't see how it couldn't be a priority, even if the improved margins are just a side effect.

(This does seem like an odd argument for you to make, given you've so far been arguing that of course these companies are selling at a loss to get more scale so that they can get better margins.)

> - You are hyper fixated on tokens, and not that owning a large % of distribution lets them sell other things . Eg, instead of responding to my point 2 here, you are again talking about token margin. Apple doesn't have to make money on transistors when they have a 30% tax on most app spend in the US.

I did not engage with that argument because it seemed like a sidetrack from the topic at hand (which was very specifically the unit economics of inference). Expanding the scope will make convergence less likely, not more.

There's a very good reason all the labs are offering unmonetized consumer products despite losing a bundle on those products, but that reason has nothing at all to do with whether inference when it is being paid for is profitable or not. They're totally different products with different market dynamics. Yes, OpenAI owning the ChatGPT distribution channel is vastly valuable for them long-term, which is why they're prioritizing growth over monetization. That growth is going to be sticky in a way that APIs can't be.

Thanks, good discussion.
by gtsop | 2025-06-06 07:20:20+00:00
Your use case is simplistic so it dismisses actual use cases.

People make money on youtube through ads, you can't do that (as effectively) on your own server. This also ties with the analytics.

Some organisations like the ready-made administration solution. Uploading files through ftp isn't for everyone. Youtube (and hosting platforms) has a nice ui to manage all the content, handles the user authentication etc.

Bandwith.

Backups.

I aggree that for people who don't need all these, and are tech savvy, uploading an mp4 to a server is the way to go.
by consp | 2025-06-06 07:20:31+00:00
> Where "agreement" likely means "you accepted some tos 15 years ago so shut up".

I am not a content creator or business on yt but i am 99.9% certain as soon as you enter your business credentials to make money they pretty much are allowed to do as they please and change the terms without notice (to which you must agree). And because as pointed out into the article, yt is a monopoly in all but name you have to agree to it as there are no viable alternatives.
by znpy | 2025-06-06 07:20:32+00:00
@geerlingguy:

First things first: I'm on your side. But the whole content-creator industry should really start looking for and pushing alternatives to Youtube.

Floatplane from LTT folks looks promising, I wish it got more attention. It seems that only Linus and Luke actually had the balls to come up with a business model and implement the darn thing.

Otherwise you (and other content creators) sooner or later will have to decide between self-censoring and make a living.
by retsibsi | 2025-06-06 07:20:50+00:00
I've seen a lot of bikes (and ridden thousands of kilometres), but when I had reason to draw a bike I felt the need to look up some photos to refresh my memory. I'm pretty sure I would have made some basic structural mistakes without that visual reference.

If you find this inconceivable, IMO you're assuming other people's minds work more similarly to yours than they actually do!

In my case (not aphantasic, but I think my visual imagination is significantly weaker than average), the information just didn't seem to be filed in full detail. The image was weak, as are most of my mental images, and I guess I had never paid that much attention to the concept (i.e. how the parts of the bike fit together as a whole; when I had had to pay attention, it had been to specific things like how the brakes work, how to reattach the chain, etc.), so it was all a bit of a muddle.
by mihaaly | 2025-06-06 07:20:54+00:00
The simulation is an excellent idea! Very good it can be explored so easily, excellent.

I find the usage of it suboptimal. Showing the main information in small and tucked away in corners while the rest of the screen is filled with short time amusing animation or nothing. Things happen automatically after a short period of time, and so far I wasn't able to get to the dasboard (tiny characters, not using the full screen) on will, only by waiting. Not quickly obvious what and when the buttons will do (indication sometime sqeezed into tiny parts of the animation), needs quite a bit of practice, and so can be forgotten later, needing relearn. It is nice having a plethora of funcionality but the core functionality suffers a bit in my view. This is just personal observation. A device like this is a very useful one, but not like this. It is demanding to use for the few most important things.
by AStonesThrow | 2025-06-06 07:23:30+00:00
https://www.rtl-sdr.com/big-list-rtl-sdr-supported-software/

Ctrl-F "linux" = 157 occurrences. This is the amateur radio community we're talking about here!

"Writing your own device drivers" is the new "Climbing on your roof to build an antenna"
by fc417fc802 | 2025-06-06 07:24:03+00:00
By that logic it would be acceptable for the state to regulate all sorts of common culinary techniques. Note that those are regulated in a commercial setting. I'd have no objection to similar regulations pertaining to restaurants that wanted to serve alcohol that was distilled, brewed, or otherwise prepared on site. In that context it's equivalent to the regulations pertaining to the handling of raw meat.

Similarly, perhaps the state ought to regulate the use of refrigerators in a residential setting since various failure modes there can easily land you in the hospital.

Enough people have contracted botulism poisoning by storing chopped garlic under oil in their fridge that the FDA has a warning about it on their website. So I suppose that would also be acceptable to regulate? Or perhaps just cooking oil in general? After all, it's quite flammable and people commonly start house fires when frying things.

While we're at it, perhaps canning things at home ought to require a permit?

The standard that "thing could pose a hazard therefore regulation is acceptable" is far too broad a criteria as it applies to approximately everything that exists and entirely disregards individual freedoms.

> It requires care and craft

A fine whiskey? Sure. The equivalent of vodka? Don't be ridiculous.

> alcohol is not only a drug but a transformed product

It most certainly is not. Distillation concentrates something that is already there.

Alternatively, fried eggs are a transformed product but at that point the term as used is so absurdly broad as to be rendered entirely useless.
by strogonoff | 2025-06-06 07:24:14+00:00
The trick to jump from the “messing about” to the “impressive” perspective lies in big picture view and a few rounds of “why”. Ideally, you do it before you start (when it comes to the innermost whys you may encounter resistance, bad faith answers, or answers you don’t like), but if that ship has sailed you can still do it as a post-mortem.
by babushkaboi | 2025-06-06 07:24:50+00:00
Yeah, and it's not just YouTube's moderation that's messed up. Their whole governance model tilts hard against creators.

I have a creator friend who was telling me that newswire agencies are gaming a loophole in YT’s copyright policy to extort creators. Basically, they threaten takedowns unless the creator pays up. Even when creators argue their use falls under "fair use" for reporting, YT’s 3 strike policy doesn’t care. Three strikes and your channel is dead - no nuance. They let rightsholders file strikes at their will & it’s on the creator (or the courts) to fight it out. Guess who usually blinks first?

Also this looks like a global grift. Came across Asian newswires picking up on this playbook - licensing clips at premium prices under the implicit threat of a strike.

I mean, YT could fix this, but they won’t. they benefit either way. Creators are stuck between losing their life's work and paying up just to stay online.
by ttctciyf | 2025-06-06 07:25:01+00:00
... and now he doesn't

> Elon Musk said on Thursday that his rocket company SpaceX will not decommission its Dragon spacecraft just hours after stating that the company would begin decommissioning

- https://www.reuters.com/science/spacex-will-not-decommission...

"Trump/Musk/J.Random.Blowhard says XYZ" stories are highly ignorable IMO. Reporters should concentrate on what they actually do.
by DidYaWipe | 2025-06-06 07:25:22+00:00
I was going to call out that out as a strawman, knowing that it doesn't meet the classic definition. Let me look up what's it's called when you bury a not-agreed-with assertion in a question that requires the recipient to agree with it...

Ah, so that's the definition of a "loaded question." Thanks for the fallacy!

"Loaded Question: A loaded question contains an assumption that may or may not be true or agreed upon. It's designed to trap the respondent into confirming a premise they might not agree with, regardless of their answer.

Complex Question Fallacy (or plurium interrogationum): This is a logical fallacy where the question presumes the truth of something that may be false or unproven. Answering it directly implies agreement with that presupposition."
by kavalg | 2025-06-06 07:25:29+00:00
The viable alternative is to stop watching all the crappy content you don't need anyway. Their restriction to 3 videos for people with ad blocker was a wake up call for me, helping me realize how much content I consume from youtube that not I only don't have a need for, but is actively occupying a sizable portion of my mind. I am old enough to remember the world without youtube, when you could read a book, talk to people, do sports etc, without staring at the screen mindlessly. A 30 min video might not look like much, but that is the equivalent of a decent stretching workout, drinking a cup of tea while relaxing or a multitude of other activities that will actually help you become happier and healthier.

Thank you youtube for helping me realize how harmful you really are!
by genewitch | 2025-06-06 07:25:47+00:00
> Also, most good widely-adopted consumer products NEVER mention anonymity. Maybe security or privacy, but never anonymity.

i meant anonymous as in "a user can receive a link to a video and watch it without having to log in" as well as "there's a list of content on the homepage to watch" - the same way youtube works if you go via private browsing.

> OK so my thing is that all of this is just too hard. Give me ONE program to run that does everything. [...]

Right, I agree. I'm an infra sort of person so this comes naturally. But i will try to summarize it (fediverse) in a non-geeky way: A non-creator can go on any of the existing servers and get an account if they desire - this allows them to follow the content creators they enjoy, and also helps with discovery of new content. Fediverse.party is a site that will help find a server that isn't mastodon.social. oh and you mentioned apps; those exist, but you need a homeserver. most of them probably default to creating an account on mastodon.social; i guess. You don't need to be on peertube to subscribe to a creator that uses peertube to publish - that's the key, here.

i have a little bit more faith that people can ditch youtube, by navigating this "novel" platform.

Content creators may have to wait for someone who isn't as lazy as i am to promote the "N click hosting platform for your videos" where N is small. If you create content, you might have to pay, there's no real way around that if we want to ditch youtube. There is a benefit to paying, though, and it doesn't have to be a lot, you can probably use a $5 VPS (as the saying goes) to start. If some large content creator wants to move over, they probably can afford to spend more, and it won't hurt them at all. Yes, youtube hosting is free, but it comes with caveats (such as TFA, but also losing access to your account for unknown reasons, and so on). Or they can join a peertube (or whatever) and hope the host remains online.

I know you want "one app" - there's some traction https://docs.joinpeertube.org/#/use-third-party-application

note: we're not content creators but we are a "host" and we pay $300/month for our racked stuff, all-in. That's not out of reach for the likes of someone like Louis Rossman, who really ought be moving off youtube; or AvE, or RedLetterMedia. It's going to take some big creators at least "simulcasting" on some other service for a while before it catches on; i just hope this catching on happens before apple, facebook, amazon (oops twitch), or microsoft start a video hosting platform with their spare disks.

Apparently your memory is better than mine; filecoin allowed one to "rent out" their unused storage. What i was thinking of was some other "proof of capacity" coin, where you didn't need a decent internet connection to mine/hold coins, just disk space. the software itself actually mined by writing hash or whatever to the disk. Copilot mentioned "burstcoin" but i've never heard of that. And filecoin apparently was based on ipfs; so i wonder if it's still going or if someone can reboot it.

it certainly didn't have good marketing campaign...
by TeMPOraL | 2025-06-06 07:27:25+00:00
What's more likely to be a problem, is the request to be concise.

For some reason, this still seems to not be widely known among even technical users: token generation is where the computation/"thinking" in LLMs happen! By forcing it to keep its answers short, you're starving the model for compute, making each token do more work. There's a small, fixed amount of "thinking" LLM can do per token, so the more you squeeze it, the less reliable it gets, until eventually it's not able to "spend" enough tokens to produce a reliable answer at all.

In other words: all those instructions to "be terse", "be concise", "don't be verbose", "just give answer, no explanation" - or even asking for answer first, then explanations - they're all just different ways to dumb down the model.

I wonder if this can explain, at least in part, why there's so much conflicted experiences with LLMs - in every other LLM thread, you'll see someone claim they're getting great results at some tasks, and then someone else saying they're getting disastrously bad results with the same model on the same tasks. Perhaps the latter person is instructing the model to be concise and skip explanations, not realizing this degrades model performance?

(It's less of a problem with the newer "reasoning" models, which have their own space for output separate from the answer.)
by touristtam | 2025-06-06 07:27:27+00:00
> has continuously curbed free speech over the past few decades

mmm do you have example at hand or you are just repeating this in the hope that other with voice the same opinion? The UK has a freedom of expression law: https://www.legislation.gov.uk/ukpga/1998/42/schedule/1/part...

1. Everyone has the right to freedom of expression. This right shall include freedom to hold opinions and to receive and impart information and ideas without interference by public authority and regardless of frontiers. This Article shall not prevent States from requiring the licensing of broadcasting, television or cinema enterprises.

2. The exercise of these freedoms, since it carries with it duties and responsibilities, may be subject to such formalities, conditions, restrictions or penalties as are prescribed by law and are necessary in a democratic society, in the interests of national security, territorial integrity or public safety, for the prevention of disorder or crime, for the protection of health or morals, for the protection of the reputation or rights of others, for preventing the disclosure of information received in confidence, or for maintaining the authority and impartiality of the judiciary.
by bob1029 | 2025-06-06 07:27:37+00:00
You can get pretty far with Lucene primitives. That's the level of abstraction I prefer to work at. Running search in a different process or container means I lose the advantages of tight integration of search/indexer logic with business logic. Keeping indexes on the local disk (just like SQLite) is a really simple deployment model too.

I agree that implementing something like Lucene from scratch would be an uphill battle. Probably not worth the time.
by sp0ck | 2025-06-06 07:27:40+00:00
This is mass problem with almost any topic you want to share. I'm sport shooter, range officer and competition jury. You have no idea what crazy stunts YouTube do for Gun/Sport Shooting related content. YT terms containt some weirdest restriction for things like "shown magazine capacity". Wrong angle on video and your 10 round mag is seen by YouTube as 30 round and your video is gone.

You can show silencer disconnected from firearm, connected to firearm but showing moment you screwing it to end of barrel and your video is banned. There are dozens rules that are so vague that if YT wants he can remove any gun related content.

This is problem YT is not willing to fix because collateral damage costs are peanuts comparing to beeing sued and loose because some real illegal content slip trough filter. I don't expect any improvement here because there is no business justification.
by gmueckl | 2025-06-06 07:28:20+00:00
There is more to serving videos well than meets the eye. Not all browsers support all codecs. Not all devices have sufficient bandwidth to stream the highest quality encoding or the available bandwidth isn't constant. Does the server have enough bandwidth? How much does the hosting service charge for outgoing traffic?

While you can put an mp4 file on a webserver and call it a day, it'll most likely be a pretty bad experience for the users.
by fsflover | 2025-06-06 07:28:38+00:00
This development clearly shows the direction of Android development officially chosen by Google. It doesn't matter when it happened or where. It's just another checkpoint on the way to not owning your device that knows everything about you and has access to practically all your secrets. People saying "Android is still better than Apple" will not be right for long. This "competitor" offers a rare opportunity to support the escape path from the dystopia using free software. Sent from my Librem 5.
by sagarm | 2025-06-06 07:31:09+00:00
It's not whataboutism, because NYPD has limited resources to enforce traffic laws. The way they've chosen to allocate their resources here is ridiculous.

> Running red lights is dangerous, period.

Do you feel the same way about pedestrians crossing without the light? Because if you do, you obviously do not live in a city. Cyclists are far closer to pedestrians than drivers, in the sense that they move relatively slowly, are agile, have less mass and therefore pose a lesser danger, and have an unobstructed field of view.

This demand for cyclists to follow rules designed for drivers -- which drivers also pick and choose from, see previous list of routine violations -- is really your typical strategy of using selective enforcement to punish an outgroup.

> Except most cyclists who run red lights do not do so safely, and I think this is a poor characterization of the issue and risk.

Come on, how many collisions do we actually see? Further, if we accept the premise that the majority of cyclists have a death wish, why would ticketing them change their behavior?

The reality is that drivers hitting and crushing pedestrians and cyclists to death don't even get a ticket. There are no consequences for obscured or deliberately damaged plates; unpaid tickets, including dangerous ones; and for many drivers wealthy enough to drive in Manhattan the cost of tickets are hardly a deterrent. In the exceedingly rare situation where licenses do get taken away, drivers will still drive anyway!

As for dashers engaging in actual unsafe behavior, sure, ticket them. But given the scourge that is Uber and Lyft drivers, I'm not holding my breath.
by avipeltz | 2025-06-06 07:32:14+00:00
Thanks! We've done a good amount of experimenting with cadquery and build123d and actually got it to the point where it can reliably generate compiling code, the problem is the generation quality is still more limited than openscad. We may still release it so that users can export to STEP/BREP formats but we have been going back and forth internally on how to highly to prioritize it. We definitely want to build about the ability to generate multiple parts in parallel and assemblies. Thanks for all this :)