MurphyA/hacker-news huggingface dataset:
by siliconc0w | 2025-11-04 19:28:16+00:00
I had a use-case for a persistent dictionary and decided to over do it a bit and built this in the last few days. It has the option to either use local SSD (via BadgerDB) or S3-alike (via SlateDB). S3 sounds like it might be slow but using Tigris which in-lines small writes with metadata and because Slate batches writes, it's actually pretty reasonable. Not quite SSD but maybe close to spinning disk.

It has secondary indexes and Pydantic support so if you felt so inclined, drop the database and live life without object-relational impedance mismatch. That said, while I'm using this in an application I'm building - it's probably not production-ready quite yet. Let me know what else it might benefit from.
by SilverElfin | 2025-11-04 19:28:19+00:00
I don’t see how Amazon or anyone else can prevent AI agents from acting on someone’s behalf. Can they prevent me from using the keyboard or mouse I like? What about the browser I like? What about screen readers? Isn’t trying to ban use of an AI tool a potential violation of disability law? What if I need help from one of these tools to perform actions on my behalf? Or for that matter, isn’t this an antitrust issue - with companies trying to control everything with unreasonable demands?

Note that the broken patent system is a part of the abuse enablement. Companies like Amazon rack up huge portfolios of mostly frivolous patents for this purpose. They may claim they only use them defensively. But the reality is if you cross them in any way, they can then “defensively” make your life miserable by abusing the law through the broken patent system. For example if a company like Amazon copies your innovative product, you can’t practically go after them, because they hold all sorts of leverage through the patent system.
by zokier | 2025-11-04 19:29:08+00:00
realistically? not much regular joe can do.

advanced users can segregate all their iot crap into separate network which allows keeping an eye on what goes on in there. but you need to know what your normal safe baseline looks like to be able to identify something weird happening.

of course there is lot of fancy tools built around this topic too, stuff like zeek and suricata almost certainly could be used to identify possible compromises. especially in a separate iot network, which should have otherwise fairly regular traffic patterns. but realistically, idk if anyone has been very successful in implementing such detection.
by alexaab | 2025-11-04 19:29:36+00:00
Songscription | Founding Engineer, Mobile App Developer & More | San Francisco, CA

At Songscription, we are building state-of-the-art AI models to automate music transcription, with the vision of enabling any musician to learn any song, on any instrument, at any level.

Apply at https://songscription.ai/careers and/or feel free to shoot me an email at alex (at) songscription.ai if you have any questions or want to learn more.
by orly01 | 2025-11-04 19:29:39+00:00
I don't know much about this, but I understand Project Jupyter is Nonprofit. If I go to "jupyter.org" I see a tab "Community" and another "Governance". If I go to "deepnote.com" I see "Customers" and "Pricing".

Why would people want a standard to be controlled by a private company? I don't think the "Open-Sourcing" of it says enough. How does licensing work with formats or standards?
by idoubtit | 2025-11-04 19:29:43+00:00
Is that really a good article? I thought it was average. It had some big flaws but was probably still informative for readers with no mathematical knowledge in the domain.

For instance, consider the only concrete example in the article: the space of all possible configurations of a double pendulum is a manifold. The author claims it's useful to see it in a manifold, but why? Precisely, why more as a manifold than as a square [O,2π[²?

I also expected more talk about atlases. In simple cases, it's easy to think of a surface as a deformation of a flat shape, so a natural idea is to think of having a map from the plan to the surface. But, even for a simple sphere, most surfaces can't map to a single flat part of the plan, and you need several maps. But how do you handle the parts where the maps overlap? What Riemmann did was defining properties on this relationship between manifold points and maps (which can be countless).

BTW, I know just enough about relativity to deny that "space-time [is] a four-dimensional manifold", at least a Riemmannian manifold. IIRC, the usual term is Minkowski-spacetime.
by buellerbueller | 2025-11-04 19:30:09+00:00
Why do so many supposedly smart humans think that we can make an artificial mind that is capable of AGI (or even something close to it), but from a completely detached evolutionary history and biological needs, and somehow force it to "align" to our human/biological/societal priorities?

Have none of these people ever had or been a teenager? At least teens have some overlapping biological requirements with non-teens that will force some amount of alignment.
by zijin1994 | 2025-11-04 19:30:12+00:00
Location: Kamloops, BC, CA

Remote: Yes

Willing to relocate: No

Technologies: JS/TypeScript, React, Next.js, Node.js, Express, SQL, Postgres, Mongodb, DynamoDB, AWS(SDKs mostly), Nginx, OpenAI api ...

Résumé/CV: https://drive.google.com/file/d/168nwYf5vxAQGMHySVlobdAERr50...

Email: zijin@ualberta.ca

Hello there, I am a full-stack developer based in BC, Canada, with experience in tools like JavaScript/TS, React, Node.js, Express, and Postgres, and I am also comfortable working with AWS. I recently developed Rabbitory, an open-source RabbitMQ deployment/management platform(https://rabbitory.github.io/). I am also an open source contributor of Firefox(https://phabricator.services.mozilla.com/p/zijin/).
by aj_hackman | 2025-11-04 19:30:40+00:00
Thank you for your thoughtful reply, and I shall pray for you in turn. I'm used to people turning towards the Catholic church as they become more legalistic and hard of heart, so your answer caught me by surprise. I also believe in a God that may have a different answer for each one of us, and so I feel that the answer for me at this time might be something like a small men's Bible study group. Christ be with you always.
by kccqzy | 2025-11-04 19:31:19+00:00
But doesn't marimo force certain workflows that jupyter does not? For example its website states that "Notebooks are executed in a deterministic order, with no hidden state — delete a cell and marimo deletes its variables while updating affected cells." This appeals to people doing traditional software development work in notebooks, but it breaks workflows where people use notebooks as notebooks, where state is entirely separate from the in-notebook presentation of cells. Do people using notebooks these days hate this fundamental feature of notebooks? It's the key reason why notebooks aren't just a transcript of a REPL session!
by simonw | 2025-11-04 19:31:25+00:00
Way to undermine an interesting product launch through poorly chosen language:

> Let’s be frank the single‑player notebook has felt outdated for a while now. We’re open‑sourcing its successor. Jupyter belongs in the hall of great ideas — alongside “Hello, world.” and “View Source.”

If you're trying to reach out to the Python community this is not the way to do it. Completely unnecessary hostile language there! Have some respect.

My advice to Deepnote is to scrap this launch announcement (ideally with an apology) and try again. They've built something genuinely useful and interesting but it's going go get a lot less attention than it deserves if they introduce the open source version to the world like this.
by vaibhavdubey97 | 2025-11-04 19:31:43+00:00
We have a data enricher feature (still in a beta mode) which uses LLMs to generate labels for your data. For cleaning and feature engineering, we use agents that automatically handle it for you once you've connected your data and defined your ML problem.

P.S. Thanks for the feedback on the video! We'll update it to show the cleaning and labelling process :)
by IAmBroom | 2025-11-04 19:31:45+00:00
I confirmed it varies trivially. That means it effectively doesn't vary.

Your statement about resolution being infinite is laughably wrong. I assume you don't even understand what "infinite" means.

You wrote two sentences that are both wrong.

Also, your understanding of resolution is lacking. Our eyes aren't uniformly covered at all. The MP amount you claim is "virtual", for want of a better word. It's like taking an SD (480p) video for one second, combining it with AI, and extrapolating a 500MP single photo. It's very like that, in practice.
by phantasmish | 2025-11-04 19:32:29+00:00
It's what I've used for years and it's entirely fine for me.

For a long time I installed iterm2 because "that's what you do" but one day I realized I was suffering a little wasted disk space, slightly slower start-up, and slightly worse input latency, for... no reason, because I didn't do anything with it that Terminal.app couldn't do.

25 years on unixy operating systems. Spend tons of time in the terminal.
by j4_james | 2025-11-04 19:32:29+00:00
Agreed. The only thing that VS-15 is supposed to do is give the emoji a "text presentation", which the spec suggests as "black & white". And every example they show of a text presentation is exactly the same width as the emoji presentation.

Changing a character's width from wide to narrow after it has already been output is fraught with problems for a terminal. Imagine trying to write a "narrow" text presentation emoji in the bottom right corner of the screen. You'd think it should fit, but the emoji is received before the VS-15 selector, and that doesn't fit, so the terminal is forced to wrap the text, triggering a scroll of the entire page. By the time the VS-15 arrives, there's no way to undo all of that.

And for another example, try using IRM (insert replace mode) to insert a text presentation emoji in the middle of some existing text. If it was really narrow, you'd expect it to insert enough space for just one character, but it actually inserts two spaces, only occupying one of them, and then leaving an unexpected gap. And the more of these "narrow" characters you insert, the bigger the gap becomes.

VS-16 changing a text presentation character from narrow to wide doesn't share these problems. And that behaviour is supported by the spec text, which says that emoji should generally have a square aspect ratio. And at one time the East Asian Width spec specifically mentioned VS-16 making narrow characters wide (but said nothing about VS-15 making wide characters narrow).
by marcellodb | 2025-11-04 19:32:48+00:00
Great question, this is super important. The agents in the platform have the ability to do some degree of cleaning on your data when building a model (for example, imputing missing values). However, major improvements to data quality are generally not possible without an understanding of the data domain (i.e. business context), so you'll get better results if you "help" the platform by providing data in a reasonably clean state, answering the agent's follow-up questions in the chat, etc. By doing so you can give the agent better context and help it understand your data better, in which case it will also be more capable of dealing with things like missing values, misnamed columns etc.

This also highlights the important role of the user as a (potentially non-technical) domain expert. Hope that makes sense!
by raldu | 2025-11-04 19:33:29+00:00
So, “Let’s build carbon-titanium-foldable bicycles instead of bloated modern cars, and still get from A to B?”

How many mainstream online platform users care about the difference in KB in their experience, anyway?

The sites in the list are hobbyist clubs with a technical point of view, which wouldn’t make sense for a mass media outlet with millions of daily traffic, and real interdepartmental complexity and compliance issues to deal with.
by stonogo | 2025-11-04 19:33:56+00:00
There is almost no real information here, not even the name of the engineer. The pictures are credited to "true north yachts", and searching for this reveals a patreon that talks a lot about sovereignty and also youtube growth hacking. There's a patreon (called truenortharchive, not sure what it's archiving) and there doesn't appear to be any substantial information about this actual boat.

All available information seems to be in this youtube video: https://www.youtube.com/watch?v=bX5EraBZ0As

There are a couple of shots of the plywood construction, but no hard information. At one point he shows the camera the power control interface, and at another he shows the outboard motor, both of which seem to be off-the-shelf at https://www.epropulsion.com/
by mmooss | 2025-11-04 19:34:02+00:00
That becomes circular: if it's a genocide then deniers shouldn't be given much weight. It also doesn't address the other core issue: How does Wikipedia handle controversial issues?

I think Wales is full of it - he's giving orders in an official capacity and threatening them with action if they don't comply, and he's brazenly lying about it - a demonstration of power and a threat. Still, I think your comment is more inflammatory than helpful because it doesn't address the core issues, it just throws a rock.
by ceejayoz | 2025-11-04 19:34:43+00:00
> Where: Low Earth Orbit.

Challenging!

> Scale: Lots of small satellites.

So we're getting cheaper by ditching economies of scale?

There's a reason datacenters are ever-larger giant warehouses.

> Much like number of bridges you build around the world does not directly affect the amount of traffic on any individual one.

But there are places you don't build bridges. Because it's impractical.
by frankmatranga | 2025-11-04 19:34:51+00:00
I have November off before I start a new job in December and am finally taking time to start a developer blog! It's always been a dream of mine. I started with a simple problem I've come across in a few codebases, automating soft deleting in Prisma ORM. Looking for critiques of form and content. I am inspired by the dev blogs I see posted on HN all the time.

It was more difficult than I expected to structure this simple article and I enjoyed the process. It forced me to read my sources and fact-check myself and even realize a few improvements I could make to the code as I was writing it.
by bigyabai | 2025-11-04 19:35:12+00:00
This is not about patent or copyright. Amazon has sent them a C&D, and can legally choose to terminate Perplexity's access to their services if they desire, the same way they can block scrapers.

Now, maybe that is monopoly abuse. But monopoly abuse isn't taken seriously in America, so Perplexity's options are limited.
by welfare | 2025-11-04 19:35:19+00:00
As an engineering challenge, I love it.

Other than that, I would've understood this notion better in the 90's when we were all on dialups. Maybe my perception is skewed growing up and seeing in real-time a picture loading on a website?

Now, even with outdated hardware on an ok connection, even larger sites like WAPO (3MB) loads what I feel like instantly (within 5-10 seconds). If it loaded in 2 seconds or 1 second, I really don't know how that would impact my life in any way.

As long as a site isn't sluggish while you browse around.
by zahlman | 2025-11-04 19:35:21+00:00
> If he was truly shorting it into collapse, then I'd say he's misguided here.

He's not shorting this time. He has put options. This is a "short position" i.e. one that behaves inversely to the stock price, but his downside is limited (at the expense that he pays the full downside up front, and can lose money even if the stock goes down, if it doesn't go down by enough).

TFA says the options are on "roughly 1 million NVDA shares worth $187 million", implying NVDA was around $187 at the time of acquisition. That more or less tracks with the September 26 close, and this was apparently disclosed in a September 30 filing. NVDA is currently above $200. Similarly, he would have options on PLTR bought when that was also somewhere around $182 (roughly matching the September 30 close); even with today's crash, the stock is hovering around $190 as I write this.

So depending on the duration of the options there's a pretty decent chance he's going to lose money, and depending on the strike price it might well be the entire premium. As far as I can tell, neither of these is disclosed in the filing.
by naasking | 2025-11-04 19:35:32+00:00
> Do not confuse the mathematical description of physical processes as the world being made of math.

Again, this doesn't apply to information. A simulation of a computation really is equivalent to that computation.

> One is simple math that runs on electrified sand, and one is an unknown process that developed independently across a billion years.

Right, so you admit that it's an unknown process, which means you literally cannot conclude that it is different to what LLMs are doing.

> There are a billion trivial proofs that make the rounds as memes, like one R in strawberry, or being unable to count, etc.

No, none of these are definitive proofs that they are not thinking. LLM "perceptions" are tokens, the strawberry question is basically asking it to figure out something that's below it's perceptual range. This has literally nothing to do with whether the way it processes information is or is not thinking.
by layer8 | 2025-11-04 19:36:10+00:00
That’s certainly not the assumption here. The appeal is, as I said, that the systems would be more predictable and tractable, instead of being a tarpit of complexity. It would be easier to reason about them, and about their runtime characteristics. Side-channel attacks wouldn’t be a thing, or at least not as much. Nowadays it’s rather difficult to reason about the runtime characteristics of code on modern CPUs, about what exactly will be going on behind the scenes. More often than not, you have to resort to testing how specific scenarios will behave, rather than being able to predict the general case.
by estimator7292 | 2025-11-04 19:36:12+00:00
It's solved for low power cooling.

We do not have a solution for getting rid of megawatts or gigawatts of heat in space.

What the sibling comment is pointing out is that you cannot simply scale up any and every technology to any problem scale. If you want to get rid of megawatts of heat with our current technology, you need to ship up several tons of radiators and then build massive kilometer-scale radiation panels. The only way to dump heat in space is to let a hot object radiate infrared light into the void. This is an incredibly slow and inefficient process, which is directly controlled by the surface area of your radiator.

The amount of radiators you need for a scheme like this is entirely out of the question.
by tim333 | 2025-11-04 19:36:23+00:00
The Armenian genocide killed approx 1 million out of 1.5 million Armenians in Turkey in an attempt to wipe them out which is kind of where the term genocide originated. I don't think the Armenians attacked the Turks or took hostages or anything like that.

In Gaza maybe 3% of the population has been killed, partly as a side effect to fighting back against Hamas after they attacked and took hostages.

I guess it depends how you define the terms. Maybe we need some new term for trying to wipe out a people as opposed to causing casualties in war against people who attacked you?
by sixhobbits | 2025-11-04 19:36:23+00:00
Haha I've asked LLMs to avoid fluff in a prompt and gotten exactly a heading like that one wkth "(no fluff)" before.

Otherwise I've followed DeepNote since they started. I agree with other comments that it's icky to announce yourself as a successor to someone else's project, but always nice to have more options for open source
by e38383 | 2025-11-04 19:36:49+00:00
Location: Mannheim, Germany

Remote: Yes (hybrid/onsite ok)

Willing to relocate: No

Technologies: AI, IT-Security, Data Privacy, GDPR, SOC2, ISO27001, project/product management, Mail (dovecot, postfix, …), simple web stuff (with Cursor, Lovable – not only "vibe"/AI), Linux, …

CV: https://uweschwarz.eu/

Email: mail@uweschwarz.eu

I've been in the enterprise sector for over 20 years, seen everything, started as Linux guy, now project lead, also started with AI. I'm doing mainly contracting within the EU, but I'm open for everything.
by rootlyhq | 2025-11-04 19:37:08+00:00
Rootly | AI-native on-call & incident response (Slack/Teams) | Remote (US/Canada/Europe)

We help engineering teams resolve incidents faster—from first alert to retrospective—used by 1000+ customers like NVIDIA, Glean, Mistral, Figma, LinkedIn, Dropbox, Replit, Grammarly, Cisco and many more.

Hiring

* Senior Software Engineer (Backend/Rails)

* Senior Site Reliability Engineer

* Security Engineer

* QA Engineer

* Senior Solutions Engineer

* Staff Product Designer

* Product Marketing Manager

* Enterprise Account Executive

* Developer Relations & Community Manager

* Product Engineer Co-op

Why Rootly: A passionate team building modern incident tooling that teams actually love; real adoption at scale; lots of ownership and impact. See roles + details: https://rootly.com/careers
by westurner | 2025-11-04 19:37:27+00:00
ScholarlyArticle: "Video‐rate tunable colour electronic paper with human resolution" (2025) https://www.nature.com/articles/s41586-025-09642-3

NewsArticle: "Colour e-paper screen offers high-res video with low energy use" (2025) https://www.newscientist.com/article/2500981-colour-e-paper-...
by Macha | 2025-11-04 19:37:56+00:00
Rust came first, so people who didn't like Rust flocked to Zig as an alternative, and were keen to promote it as an alternative to Rust by criticising Rust, as wider usage would provide them more of an ecosystem to use in their own Zig programs.

People who were happy with Rust didn't have same need to criticise Zig in online spaces as Rust is the established player in the C alternatives space. (Though Rust is on the other side when compared to C once you expand the space to "all low level programming languages").

Also for people who don't care about the space at all, Rust has had years of exposure to promote fatigue, while Zig hasn't (yet).
by maxglute | 2025-11-04 19:38:02+00:00
There are studies of AIS disabling events, highest proportion of ships/time. IIRC, avg worst is Spain, ~15% obscure. Then US, ~8%, then TW ~5% then PRC slightly less. US gets pass since US fishing happens in North West Atlantic - US has big EEZ. Not much info on SKR/JP (other biggest DWF) except they tend to fish where PRC fishes and do all your slave labour that other DWF does, so hard to believe they don't do AIS shenanigans. IIRC worse (by type) absolute was JP for tuna longliner. There's other consideration that DWF has global players interacting, i.e. JP doesn't do destructive trawling, but they run big transhipment reefers (fridge boat) to support to fish longer.

MSM will focus almost exclusively PRC. It's spiked narrative. TLDR, go track "research" on PRC DWF since ~2020 when the champaign started. The estimate of PRC DWF by west aligned research... laundered by western news went from something like 3000 to 6000 (reasonable), to 10000 to 18000... in 5 years. Meanwhile PRC wild catch increased from 12m tons to 15m tons, i.e. PRC somehow built ~30000 new fishing ships in 5 years, 950% increase... only to fish 25% more. It's all stupid all the time.
by overfeed | 2025-11-04 19:38:12+00:00
> that means it's lagging and I should load up RAM today, or this is indeed US-specific. But I don't know what's true.

This is a global issue that is most severe in the US due to its share of hyperscalers and their, uh, scale. You may not feel the effects yet, but it is matter of time until someone notices your market has a RAM glut, while 30-55% of their orders aren't being fulfilled.

In all likelihood, the supply channels to your locality have a low turnover rate, and DRAM has a long shelf-life. If the high prices stay high for long, it's going to impact prices when your retailers try to restock. If the price shock ends soon, your retailer may not even notice it. Whether you ought to buy or not depends on your outlook on how things will shake out