MurphyA/hacker-news huggingface dataset:
by Aduttya | 2026-02-11 16:20:31+00:00
I’m building an AI search optimization product and wanted to apply the same principles internally: fix content architecture before launch instead of correcting problems after users — or AI systems — struggle to understand it.

To do this, I created a Python CLI tool that analyzes semantic structure using vector embeddings. It parses markdown files, generates embeddings (all-mpnet-base-v2 or OpenAI), computes cosine similarity, runs k-means clustering, detects redundancy and semantic gaps, and produces visualizations like heatmaps, dendrograms, and UMAP projections. The stack includes Python 3.12, sentence-transformers, scikit-learn, UMAP, and Plotly, with embedding caching for speed.

Analysis Overview:
The site contains 25 pages (~12.9k words) across features, concepts, use cases, and resources. No stub pages were found.

Topic coherence (measured via average similarity between sections) ranged from 0.73 to 0.93, with most pages between 0.78–0.88. Lower coherence wasn’t necessarily bad — the Proof Engine page scored lower because it intentionally covers many subtopics.

Semantic redundancy showed only one pair above 0.85 similarity, both intentional cross-link sections. Earlier, I removed two index pages with 85%+ similarity to parent pages, flattening navigation from three layers to two.

No semantic gaps were detected; all pages were well connected. Hub analysis confirmed that Home, Learn, and the AEO Playbook act as central nodes, matching the intended architecture of concepts → applications → tools.

Heatmap clustering revealed:

* Concept pages: 0.65–0.80 similarity
* Feature pages: 0.45–0.65 similarity
* Use cases: 0.70–0.79 similarity

Embeddings were chosen over keyword analysis because they capture meaning rather than wording, detecting paraphrased overlap and relationships relevant to AI retrieval systems.

Limitations include model sensitivity, arbitrary cluster counts, and coherence scores that don’t fully account for intentional structure. Planned improvements include entity coverage analysis, competitor comparisons, and query-simulation testing.

The entire process took under a minute but prevented structural issues that could cause discoverability problems later. Running semantic analysis pre-launch helped validate architecture, reduce duplication, and ensure content works for both humans and AI retrieval systems.
by throwway120385 | 2026-02-11 16:20:32+00:00
Microwave frequencies like 2.4 or 5 GHz just passively allow you to do this. You'd have to adopt frequencies that are useless for radar.

I mean you could even jam a microwave oven door open, turn it on, and then measure how much energy loss there was through certain paths. That's essentially all beamforming in Wifi requires -- a really sophisticated way of measuring paths that cause energy loss, and a really sophisticated antenna design that allows you to direct the signal through paths that don't cause energy loss. The first problem is what's facilitating surveillance because humans cause signal loss because our bodies are mostly water, and 2.4 GHz radio waves happen to get absorbed really well by water. This causes measurable signal loss on those paths and the beamforming antennae use that information to route around your body. But they could also just log that information and know where you are relative to the WAP.
by jmount | 2026-02-11 16:20:52+00:00
Just so I know that I took the time to say it.

The "singularity is going to be exponential" fantasy is based on assuming change simply becoming proportional to recent advances. Hence the exponential shape. Even conceding "chartism" one would need to at least propose some imaginary mechanism that goes reciprocal to pretend that sort of curve is coming.
by torginus | 2026-02-11 16:20:55+00:00
I welcome the competition, but my two cents is that BYD or any other Chinese brand doesn't seem to be offering anything outside of the typicial price-performance calculus of existing brands.

I welcome competition, as it benefits everyone, even people who don't want to buy Chinese. It will also encourge building factories for EV components in Europe, which mean other suppliers might benefit from lower prices, and some of the savings will end up at the customer.

As for why your coworkers decided to go for non-Tesla EVs, you have to ask them, and ask them again a few years from now if it was worth it. In their defense, Tesla makes a very particular kind of car (in 2 slight variations), which many people might want to move away from.

Maybe they want a petrol range extender, maybe they want a more traditional SUV, or something smaller/bigger than Tesla.
by wffurr | 2026-02-11 16:20:58+00:00
Just before the Superbowl, the Boston Globe had an article full of interviews with New Englanders who have moved to California. One claimed to still be a New Englander but didn't miss the weather, "I haven't slipped on ice in 30 years". I had to think, are they really New Englanders if they can't handle the weather? I think that's a big part of it. Having some Patriots and Dunkin Donuts swag doesn't cut it IMO.
by srcreigh | 2026-02-11 16:21:09+00:00
Various cheating to get their conclusions (from the paper):

> To allow for an unobstructed gait recording, participants were instructed not to wear any baggy clothes, skirts, dresses or heeled shoes.

> Due to technical unreliabiltities, not all recordings resulted in usable data. For our experiments, we use 170 and 161 participants for CSI and BFI, respectively. [out of 197]

I wish they had explained what the technical unreliabilities were.
by mahrain | 2026-02-11 16:21:49+00:00
Verizon has a security feature built around this, https://www.xfinity.com/hub/smart-home/wifi-motion

Philips WiZ bulbs: https://www.wizconnected.com/en-us/explore-wiz/spacesense

Alarm.com also supports such sensors: https://poweredbyalarm.com/eventresources/wp-content/uploads...
by georgeck | 2026-02-11 16:21:56+00:00
Thanks for the feedback. The system prompt for the web app is optimized to balance between too short a summary vs not long enough. The browser extension, on the other hand, allows you to customize the system prompt to make the result exactly the way you want.

Another option is to look at the Bluesky feed [0]. This bot looks at top stories in HN and creates a very short summary. It only does around 20 posts a day. That could be limiting too.

[0] - https://bsky.app/profile/hncompanion.com
by wheybags | 2026-02-11 16:22:00+00:00
I'm not super familiar with the jpeg format, but iirc h.264 uses 16x16 blocks, so if jpeg is the same then padding of 16px on all sides would presumably block all possible information leakage?

Except the size of the blocked section ofc. E.g If you know it's a person's name, from a fixed list of people, well "Huckleberry" and "Tom" are very different lengths.
by gleipnircode | 2026-02-11 16:22:15+00:00
Anthropic has been actively cracking down on this exact pattern. They've publicly stated they're "taking appropriate action" against account sharing and reselling, introduced weekly rate limits to combat it, and have been banning accounts that trigger abuse filters.

Their ToS explicitly prohibit reselling. Sellers risk permanent bans, buyers risk losing access overnight. Clever hack, but the runway seems very short.
by coldpie | 2026-02-11 16:22:27+00:00
I try these things a couple times a month. They're always underwhelming. Earlier this week I had the thing work tells me to use (claude code sonnet 4? something like that) generate some unit tests for a new function I wrote. I had a number of objections about the utility of the test cases it chose to write, but the largest problem was that it assigned the expected value to a test case struct field and then... didn't actually validate the retrieved value against it. If you didn't review the code, you wouldn't know that the test it wrote did literally nothing of value.

Another time I asked it to rename a struct field across a the whole codebase. It missed 2 instances. A simple sed & grep command would've taken me 15 seconds to write and do the job correctly and cost $~0.00 compute, but I was curious to see if the AI could do it. Nope.

Trillions of dollars for this? Sigh... try again next week, I guess.
by tracker1 | 2026-02-11 16:23:44+00:00
I need to just break down and find an old version of that... from before the Jasc sellout. IIRC, it ran via Wine without issue too.

I try to use Pinta/Paint.Net, but it's not quite as good as I remember psp being. I don't even hate the newer MS Paint... thought I'm only on windows for my work environment and even then.

Aside: I've been using my personal computer more, so I can work on a limited surface with docker and ai agent, then just bring in the components I'm working on when ready. My work environment is really locked down, no wsl, no docker... and it's like working in 2002 to some extent... It's literally easier for me to create stand-alone projects, work on a given feature in complete isolation... AI agent mostly to boilerplate the environment and most of the automated sanity tests, then I can focus on just what I'm working on.
by swat535 | 2026-02-11 16:23:56+00:00
Everyone thinks that their inquiries are urgent, top priority. That's not always the case, it maybe urgent to you, but not to the other person.

If something is critical, you can communicate via other means: phone calls, SMS, slack, etc.. and even then, there's no guarantee you will get a response.

In business context, I lean the other way, tend to give all parties as much leg room as possible.

I think The Eisenhower Method is a great fit for prioritization.
by welanes | 2026-02-11 16:24:13+00:00
Made a quick tool so you can check if your extensions are on the list: https://extensioncheck.val.run

1. Go to chrome://extensions and toggle Developer mode on (so IDs are visible)

2. Select all text on the page with your mouse and copy

3. Paste it into the tool

It parses the IDs and warns you if any are among the 287 spyware extensions.
by alexpotato | 2026-02-11 16:24:27+00:00
Not sure how many people are aware that the newer Alexa devices have "presence detection" that uses ultrasound so they can detect when people are nearby. [0]

Heck, even Ecobee remote temperature sensors can do this.

Reminds me of the story about how the Google Nest smoke detector had a microphone in it. [1]

0 - https://www.amazon.com/b?node=23435461011&tag=googhydr-20&hv...

1- https://www.reddit.com/r/privacy/comments/asmusq/google_says...
by ThrowawayR2 | 2026-02-11 16:24:28+00:00
Feynman had the vanishingly rare combination of being at world-shaking (literally) historical events like the Manhattan Project and the Trinity test that ordinary people can relate to¹, actual scientific contribution enough to merit a Nobel Prize in Physics, and being an engaging storyteller and educator. I don't think it's all that surprising that his recognizability very high.

¹ Ordinary people can relate to a giant industrial project and a huge boom. They cannot relate to some person sitting in a room writing arcane symbols and muttering to themselves until one day they yell "Heureka! Ich hab es gefunden!" or whatever the proper German is and rush off to publish a paper.
by Tharre | 2026-02-11 16:25:22+00:00
There are a bit too many IPs to list but from my logs they're always of the form 74.7.2XX.* for GPTBot, matching OpenAIs published ip ranges[0].

So yes, they are definitely running scrapers that are this badly written.

Also old scraper bots trying to disguise themselves as GPTBot seems wholly unproductive, they're try to immitate users, not bots.

[0] https://openai.com/gptbot.json
by yieldcrv | 2026-02-11 16:25:40+00:00
> I burn up the entire context window for 30 pages of text

We analyze 200 page contracts no problem

I think you're doing it wrong or in an antiquated way (until context window sizes improve)

Are you doing this programmatically at all or are you doing something closer to dropping a contract into a chat window?

We use a main agent to classify the pages and we build subagents that are familiar with page classifications and are fed page ranges. They all have their own full context window and prompts
Ask HN: Do freelancers manually scan social media for leads?
by KrishnaTorque | 2026-02-11 16:26:05+00:00
I’ve noticed many freelancers and small agencies manually search X, LinkedIn, Reddit, etc. to find people publicly posting that they need a developer, designer, or marketer.
It feels inefficient and noisy.
I’m exploring building a tool that automatically surfaces live hiring posts across social platforms, extracts publicly available contact information (when available), and drafts a personalized outreach email.
Before building further, I’m trying to understand:
Do you currently search social media for leads?
How do you decide which posts are worth reaching out to?
Would something like this be useful, or is manual search “good enough”?
Appreciate any honest feedback.
by BeetleB | 2026-02-11 16:26:28+00:00
If you pay for the whole year, GLM4.7 is only $7/mo for the first year. And until a few days ago, they had a fantastic deal that ran for almost 2 months where it was less than $3/mo for the first year. I grabbed it, and have been using it exclusively for personal coding since. It's good enough for me.

The other claimed benefit is a higher quota of tokens.
by falcor84 | 2026-02-11 16:26:31+00:00
I tried to go about it in a bit of a roundabout way, as a followup question in a longer conversation and was able to get this in the thought process before it froze:

> Step 2: Analyze the Request
The user is asking about the events in Tiananmen Square (Beijing, China) in 1989. This refers to the Tiananmen Square protests and subsequent massacre.

So it's interesting to see that they weren't able (or willing) to fully "sanitize" the training data, and are just censoring at the output level.
by greggoB | 2026-02-11 16:26:33+00:00
> You gotta do your own research, I'm afraid.

So again, how do you propose one actually does this? Via crowdsourcing on FB? AI-generated news gathering? Consulting with a medium? Like what is your actual, concrete solution for how to obtain and distribute events and occurrences?

Journalism may be as imperfect as the humans who do it, but it's at least a concrete, operating means of informing the general public, with an ideally healthy array of outlets having overlapping coverage of the same events. Within this framework, "do your own research" would be called "reading broadly".

> ... And no, none of that was because people believed the "all the entities are wildly rotten and corrupt" "meme". It wasn't ever that they just didn't trust the system enough.

I have been around long enough to know that the meme does fit for some non-negligible section of the population. It's not to say that the system hasn't given a lot of people good reason for doubt, but a lot of people were already primed to throw the baby out with the bathwater and declare everything a conspiracy.
by KempyKolibri | 2026-02-11 16:26:34+00:00
This is what regulation already does (quite effectively too, at least over here in the UK). We already know that harmful substances aren’t likely to be present in our foods thanks to regulatory checks.

Then we’d be left with checks for substances at levels lower than regulations are concerned with, but I’m not sure why we’d care about that.

Fish has mercury present in it, but increased consumption seems to be associated with positive health outcomes. If the device said “danger, mercury”, what are we replacing it with? Red meat? Sausage? The current evidence would suggest that would be a retrograde step.
by jsheard | 2026-02-11 16:26:41+00:00
> The cheapest new mac mini is $600 on Apple's US store.

And you're only getting 16GB at that base spec. It's $1000 for 32GB, or $2000 for 64GB plus the requisite SOC upgrade.

> And it has a 128-bit memory interface using LPDDR5X/7500, nothing exotic.

Yeah, 128-bit is table stakes and AMD is making 256-bit SOCs as well now. Apple's higher end Max/Ultra chips are the ones which stand out with their 512 and 1024-bit interfaces. Those have no direct competition.
by lern_too_spel | 2026-02-11 16:26:56+00:00
> The job posting touts the VR environment that will be used to "drive requirements", not vehicles!

No, it says it will bring the user into the vehicle. They are driving requirements for building this telepoerating system. The role description couldn't be more clear.

> What company would hire a highly-skilled and credentialed engineer to be a drone pilot?

They're hiring an engineer to build the VR driving system, not to operate it.

> But why even attempt to implement FSD or top-level autonomy, if your operators are doing the driving anyway?

Obviously, they would like to remove the need for the teleoperators, just like Waymo would like to remove the need for its driver assistants, but Tesla is nowhere near being able to do that.

> This would never scale.

You know it. I know it. This is just to fool Cathie Wood into believing that robotaxi works for long enough until they can get Optimus working. Then if they're behind on Optimus, they'll presumably have backup teleoperators for those in small deployments (just like they're doing with robotaxi now) until they can get the next big thing working or until SpaceX buys out Tesla.
by djcapelis | 2026-02-11 16:26:58+00:00
> In what world is public opinion not universally against the cartels? It's hard to take you seriously after that.

I think you’re getting tripped up by some specific wording and managing to miss the point the poster was making. The point should be taken seriously even if imprecisely articulated. While most folks are against the cartels, there’s a much wider range of belief on how much they warrant government or military intervention and to what degree we should be spending various resources on them. The historical state of play was(is?) that cartels are criminal organizations which are generally a policing matter that has escalated to specialized policing agencies and multinational networks of policing agencies. The marked escalation of the military into this is a more recent piece that is somewhat more controversial. One doesn’t have to be “in favor of the cartel” to ask questions about whether our military should be bombing boats or invading countries to ostensibly neutralize organizations that historically have been subject to policing operations.

To go back to the parallel… the public wasn’t in favor of Al Qaeda before 9/11 either, but there was a huge difference in the level of response the public was in favor of after. It turned from an intelligence monitoring level of response into an active military invasion of multiple countries.
by dangus | 2026-02-11 16:27:04+00:00
Why does everyone in this thread keep talking about bucket crabs like they’re in some kind of groupthink cult? I don’t know what the fuck anyone means by bucket crabs.

Living in space is essentially like living in the ocean with all the same environments challenges. We don’t do that and never have because it doesn’t really make logical sense, we have better options available. It lends the question of “why do that?”

Why? Why do we want to live in space colonies? To what end?

This planet will be habitable for tens of thousands of years at the bare minimum if we take care of it, certainly moreso than the vacuum of space.
by Rygian | 2026-02-11 16:27:09+00:00
While assuming absolutely zero bad will on your part, I would nevertheless find it fair if you were legally on the hook for whatever happened after the sale, unless you could prove that you provided reasonable means for the users of your extension to perform their due diligence on the new owner of the extension.

This is of course easy to say in hindsight, and is absolutely a requirement that should be enforced by the extension appstore, not by individual contributors such as yourself.
by JumpinJack_Cash | 2026-02-11 16:27:15+00:00
60 oz energy drink = 5-6 fat lines perhaps more

The most dense energy drinks have 350-400 of caffeine in a can these days and on top of that there's the taurine etc.

60 oz is 4 cans, do your math. 4 * 400 = 1600mg of caffeine alone

> > potential for generally destroying someone’s life is, while not at the same level, definitely in the same ballpark as crack, heroin, and meth.

That's more of the result of the enviornment and the associated people who frequent such circles and not the stimulant per se.
by weirdsweatsuit | 2026-02-11 16:27:21+00:00
Representative Veronica Escobar, an El Paso Democrat, said in a news conference that the explanation citing Mexican drones crossing the border as the reason for the closure was “not the information that we in Congress have been told.”

She said that there was no current or past threat to the area. “There’s no threat. There was not a threat, which is why the F.A.A. lifted this restriction so quickly,” she said. “The information coming from the administration does not add up.”

“There have been drone incursions from Mexico going back to as long as drones existed. So this is nothing new” (NYT)
by sponaugle | 2026-02-11 16:27:23+00:00
This is a VERY controlled environment - and they used 20 passes of each person walking with direct knowledge of each person to train for identity. They did no tests with multiple people walking at the same time, or with any other external moving distortion effects (doors opening, etc) . This is very far from actual 'identification' of people in real public settings - and no doubt the cell phone everyone is carrying with them offers many orders of magnitude better opportunity. In a real crowded environment this would be nearly worthless.

The devices that reported BFI information were also stationary, and there were no extra devices transmitting information that would be conflicting.

A single camera would be much more effective.
by senko | 2026-02-11 16:27:25+00:00
File system access is not one of OpenClaw's biggest security issues. If that were so, running it in a VM or another computer (I hear Mac Minis are popular!) would solve it.

If you need it to do anything useful[0], you have to connect it to your data and give it action capabilities. All the dragons are there.

If you play it careful and don't expose your data, comm channels, etc., then it's much like the other AI assistants out there.[1]

---

[0] for your definition of useful

[1] I do appreciate the self-modification and heartbeat aspects, and don't want to downplay how technically impressive it is. The comment is purely from POV of an end-user product.
by staticassertion | 2026-02-11 16:27:27+00:00
It is, of course. What they mean, I assume, is that it would reach a tipping point where intervention would be more broadly supported. Virtually everyone is willing to say "that's bad" with regards to something happening somewhere, it is far less agreed upon that the US should intervene in that bad thing. An effective tipping point is probably something on the order of "we feel attacked".
by joe_mamba | 2026-02-11 16:27:39+00:00
>newer Alexa devices have "presence detection"

Not even the biggest privacy issue of using Alexa devices. I think listening you 24/7 is a bigger potential issue.

Not sure if Alexa has this, but cheap mm-wave wideband multi-GHz sensors(or radars more accurately) now enable more finely grained human presence detection and also human fall detection[1] with the right algos, so you can for example detect if grandma in the nursing home fell down and didn't get back up, but in a privacy focused way that doesn't resort to microphones or cameras. Neat.

>Reminds me of the story about how the Google Nest smoke detector had a microphone in it.

Vapes have microphones in them to detect when you're sucking and light up the heating element. Cheap electronics have enabled a new world of crazy.

[1] https://www.seeedstudio.com/MR60FDA2-60GHz-mmWave-Sensor-Fal...