MurphyA/hacker-news huggingface dataset:
by doronp | 2026-02-15 16:40:49+00:00
AgentShield is an open-source benchmark suite that tests commercial AI agent security products (Lakera Guard, LLM Guard, ProtectAI, etc.) against the same corpus under the same conditions. 537 test cases across 8 categories: prompt injection, jailbreak, data exfiltration, tool abuse, over-refusal, multi-agent security, latency, and provenance/audit.
Scoring uses a weighted geometric mean across attack categories with a standalone over-refusal penalty — blocking legitimate requests costs you points. Latency is scored inversely (sub-50ms p95 = 100, over 1s = 5).
Some findings from the first run:

Composite scores range from ~39 to ~98. The spread is larger than I expected.
Tool abuse detection is weak across the board. Several providers that catch >95% of prompt injections miss most unauthorized tool calls.
Over-refusal is under-tested in the industry. One provider flags 37% of benign requests.
Provenance verification (can the tool tell a real approval chain from a fabricated one?) is nearly absent outside provenance-native approaches.

Disclosure: I built and maintain this benchmark. I also run https://agentguard.co/, which is one of the tested providers. AG is included in results, tested via a commit-reveal protocol with Ed25519 signatures (code in src/protocol/) rather than the standard open adapter path. I know "vendor runs own benchmark" raises eyebrows — that's why the entire corpus, scoring code, and methodology are open source under Apache 2.0. Run it yourself, verify the results, file issues if something seems off.
The test corpus, adapters, and scoring are designed to be extended. PRs for new provider adapters, novel attack test cases, and methodology improvements are welcome.
Repo: https://github.com/doronp/agentshield-benchmark
Leaderboard: https://doronp.github.io/agentshield-benchmark/
by dotancohen | 2026-02-15 16:41:24+00:00
You don't have to install executables downloaded from an unknown GitHub account named marler8997. You can download that script and read it just like any other shell script.

Just like those complaining about curl|sh on Linux, you are confusing install instructions with source code availability. Just download the script and read it if you want. The curl|sh workflow is no more dangerous that downloading an executable off the internet, which is very common (if stupid) and attracts no vitriol. In no way does it imply that you can not actually download and read the script - something that actually can't be done with downloaded executables.
by iamnothere | 2026-02-15 16:41:48+00:00
I will add this: the number of ways in which humans can harm one another is immeasurable, and every law comes with an associated cost. At the bare minimum the cost is enforcement plus the harm imposed by occasional false accusations and convictions. But bad laws can also dampen legitimate economic activity, making social problems worse.

As a society plunges into dysfunction due to economic stress, the number of people harming one another increases. If the society responds using more laws, and fails to correct the source of the dysfunction, it will eventually collapse under the weight of those laws as enforcement becomes uneven and politically driven. (This is the failure mode of legalist and bureaucratic states.) Alternatively, if the society responds with a more arbitrary case-by-case system of punishment, it will collapse into mob rule or dictatorship, so lack of structured law isn’t a solution either.

The only real solution is to fix the root problems facing the society. Antitrust helps with this because it can “unstick” parasitic incumbents who are preventing the market from dynamically responding to real economic conditions.
by byproxy | 2026-02-15 16:42:01+00:00
This is exactly what I’ve done for my Google settings after feeling more and more upset with what the Youtube homepage was showing me. Not so much in that it was necessarily contrary to what I may have wanted to watch, but more-so me thinking “My god.. is this what I’ve become?”

I now much prefer to open Youtube (quasi)tabula rasa. I still have subscriptions set up so I can follow “vetted” accounts, but for other things I now rely on that intentionality.

The one minor bummer is that Youtube won’t remember your spot in a video, say if you’re watching in your phone and want to continue on your desktop (or vice-versa). Not the biggest hassle to manually check the time and sync it up, though.
by infinitewars | 2026-02-15 16:42:30+00:00
The natural range of the Pecan is somewhat limited, so unless you're in southern Illinois or by the river, it might not be its preferred habitat.

https://en.wikipedia.org/wiki/Pecan#/media/File:Carya_illino...

They're actually considered a fast growing tree when in the right place--1 to 2 ft per year at first.
by gaigalas | 2026-02-15 16:42:42+00:00
Windows Native is fine. People in that space are comfortable with it.

What needs to be fixed is the valley between unix and windows development for cross-os/many-compiler builds, so one that does both can work seamlessly.

It's not an easy problem and there are lots of faux solutions that seem to fix it all but don't (in builds, the devil is in edge cases).
by arter45 | 2026-02-15 16:44:30+00:00
What do you mean? IANAL, but Claude doesn't just "wake up" (whatever that means) and decide to reverse engineering/hack stuff, so if this is a CFAA violation the person who prompted Claude is indeed responsible. At best, one could argue that the company producing Claude is partially responsible because it didn't prevent people from using it to reverse engineer stuff, but there's no way Claude is "responsible for all of the hacking", regardless of how many times the blog posts says "Claude did X".
by injidup | 2026-02-15 16:45:32+00:00
Fuck vibe coding. If you want a system that actually stays stable, use OpenSpec (or something like it) to build a closed-loop rig where your requirements drive the code and the code proves it met the requirements.
In one weekend, I built a system that processes OpenSpec requirements into IMGUI automatic testing scripts. It captures screenshots, compiles them into a report, and assigns each image a prompt—essentially a requirement snippet—that tells a multimodal LLM exactly what to look for. Claude is incredible at stitching these types of tools together. Once you have that closed loop, you can let an agent loose on features and just let the code it writes converge on the spec.
The golden rule: If you don't like the results, change the spec. Don't shortcut or "vibe code" a bug away. This keeps the guardrails on. For every feature you add, you have to think about how to validate it automatically. Even a basic smoke test that raises a flag for human review is better than nothing.
Think about the workflow: capture screenshots of all your app workflows and commit them to Git as a baseline. On the next commit, run fast smoke tests. If the images match, you’re good. If they differ, the LLM analyzes the diff against the requirements and proposes a fix for either the code or the spec. Rigs like this used to take teams years to build; now you can build them in a few days with a coding assistant. It’s simple, it’s stable, and it actually scales.
by anonymous908213 | 2026-02-15 16:45:49+00:00
> I'm not going to argue over principles, as that's not law,

> The Supreme Court declined to extend the third-party doctrine to tracking one's location via cell-phone metadata in Carpenter v. U.S., 585 U.S. 296 (2018), so it's not absolute.

In other words, principles are law -- in the US, whatever the principles of 9 judges at a given time, because they are the final arbiter of what anything written down by Congress means. "Third-party doctrine" is not law as written by Congress, it is something the Supreme Court made up out of thin air according to their principles. And these principles are not binding; a later panel of judges is free to throw out the rulings of older judges if they decide their principles differ, as famously happened to Roe v. Wade among other cases.
by Havoc | 2026-02-15 16:45:59+00:00
That's some fox news grade reporting alright.

Whether the market as a whole is structured around direct "ownership" of share or via a central well established custody system - it's functionally identical risk. You're counting on rule of law. And not just you - everyone. If it works it works, or it doesn't in which case the global financial system crashes and we've all got bigger problems. Also custody <> ownership.

Nor can any of this seize retirement savings:

>may seize securities used as collateral in lending arrangements with broker-dealers.

i.e. no different from bank seizing your house if your mortgage arrangement blows up.

There is nothing to see here
by kube-system | 2026-02-15 16:46:11+00:00
A radiology report is written by a radiologist which is a doctor. The findings in a radiology report may be clinically relevant or they may not be. Very often, the findings of the radiologist are not conclusive enough to diagnose or rule out a diagnosis.

Of course, doctors know this, and that’s why they normally use these scans to aid in the diagnosis of a specific condition… not in search of one, which is what this article is about.
by linsomniac | 2026-02-15 16:46:51+00:00
>perfection cannot be achieved

That's not what I get out of the comment you are replying to.

In the case being discussed here, one of code matching the tax code, perfection is likely possible; perfection is defined by the tax code. The SME on this should be writing the tests that demonstrate adhering with the tax code. Once they do that, then it doesn't matter if they, or the AI, or a one shot consultant write it, as far as correctness goes.

If the resulting AI code has subtle bugs in it that pass the test, the SME likely didn't understand the corner cases of this part of the tax code as well as they thought, and quite possibly could have run into the same bugs.

That's what I get out of what you are replying to.
by delta_p_delta_x | 2026-02-15 16:46:57+00:00
> MSYS2 CLANG64

I get your point. Although my point is that there is actually zero need for MSYS at all for this, even as a developer, and especially not with the 'CLANG64' environment. These binaries themselves are built to run in the MSYS2 environment This is how I cross-compile from Windows... to Windows with LLVM-MinGW[1]:

> (gci Env:PATH).Value.Split(';') | sort
> clang-21.exe --version
clang version 21.1.2 (https://github.com/llvm/llvm-project.git b708aea0bc7127adf4ec643660699c8bcdde1273)
Target: x86_64-w64-windows-gnu
Thread model: posix
InstalledDir: C:/Users/dpdx/AppData/Local/Microsoft/WinGet/Packages/MartinStorsjo.LLVM-MinGW.UCRT_Microsoft.Winget.Source_8wekyb3d8bbwe/llvm-mingw-20250924-ucrt-x86_64/bin
Configuration file: C:/Users/dpdx/AppData/Local/Microsoft/WinGet/Packages/MartinStorsjo.LLVM-MinGW.UCRT_Microsoft.Winget.Source_8wekyb3d8bbwe/llvm-mingw-20250924-ucrt-x86_64/bin/x86_64-w64-windows-gnu.cfg

[1]: https://github.com/mstorsjo/llvm-mingw
by u1hcw9nx | 2026-02-15 16:47:35+00:00
This article is a good example why CNN is second tier.

They don’t mention the interest rate, nor do the journalist know how explain how it can be a good investment even if the company disappears at some point over the next 100 years. That bond easily pays off its principal in 20 years, even when accounting for the inflation.

Reuters did a better story
https://www.reuters.com/business/alphabet-sells-bonds-worth-...
by tasuki | 2026-02-15 16:47:41+00:00
> This article was written by AI btw

Unless you had an AI write the article, you can't possibly know that. I'm sick of this being randomly thrown around: it's basically mentioned for every article posted. Sometimes the author chimes in to say that no, they wrote it themselves. Other times sure, the article was written by AI. I don't know, and you don't know either.
by jaen | 2026-02-15 16:47:53+00:00
I'm very curious about what you consider a real "design" then?!

The Windows NT kernel had a better design than most contemporary and succeeding operating systems (including the various Unixes, Linux, BSD, plan9 etc.).

Modern kernel designs like Google's Fuchsia have more in common with NT than POSIX/Unix/Linux.

In particular, the NT object manager approach subsumes the Unix "everything is a file, well, not quite, oh... uhh.. let us slowly fix that by adding stuff like signalfd, memfd, pidfd etc. ahh hmm, these still do not exactly fit into a FS mold... ah crap, still missing a proper ptrace FS analogue" design approach that eg. Linux has taken in the last two decades.

It also had powerful primitives like eg. APCs that could be used to build higher-level kernel features elegantly.
by easton | 2026-02-15 16:48:03+00:00
Having been the person that used to support those packages, it’s not that simple. You need to pass what workloads you need installed too, and if it’s a project you’re not familiar with god help you.

I used to just install the desktop development one and then work through the build errors until I got it to work, was somewhat painful. (Yes, .vsconfig makes this easier but it still didn’t catch everything when last I was into Windows dev).
by wrsmith108 | 2026-02-15 16:48:04+00:00
I kept solving the same problems in Claude Code: Write commit messages this way. Review code against these standards. Run the pre-commit checklist. Every new session, I'd re-explain the same context. Skills fix this ... when composed well and referenced in claude.md. A skill is a markdown file with YAML frontmatter that you drop into ~/.claude/skills/. Claude loads it automatically. Skillsmith is the registry and tooling for finding, installing, and managing them.

Example: we have a governance skill that triggers on "code review" or "before I merge." It has our TypeScript strict mode policy, the 500-line file limit, testing requirements, commit format that smoke out issues early and save a boat load of tokens. It enforces all of them and fixes violations in place. No more "would you like me to fix these?" prompts. Include with Ralph Wiggum loops for big speed and cost wins.

Skillsmith exposes MCP tools that Claude calls during conversation:

- search to find skills by keyword, category, or trust tier
- skill_recommend for suggestions based on your project context
- skill_compare for side-by-side comparison
- install_skill with automatic security scanning
- skill_publish to share your own

Add to your Claude Code settings and you're running:
{"mcpServers": {"skillsmith": {"command": "npx", "args": ["-y", "@skillsmith/mcp-server"]}}}

On the technical side: search runs ONNX semantic embeddings (all-MiniLM-L6-v2, ~50ms/query) merged with FTS5/BM25 ranking. The security scanner checks 8 pattern categories on install: prompt injection, data exfiltration, privilege escalation, SSRF, path traversal, and others. Skills get trust tiers (verified, community, experimental) and anything above a risk threshold is quarantined.

TypeScript monorepo with three packages: @skillsmith/core, @skillsmith/mcp-server,
@skillsmith/cli. SQLite for local storage, Supabase for the hosted registry. Published on the official MCP registry.

Limitations: the total skill catalog on GitHub is still new. We're early days and many publicly available skills are immature. ONNX needs glibc so Alpine doesn't work, but there's a WASM fallback for the MCP server. Skillsmith has been built by and for Claude Code for now, but Cursor and Codex users are giving good feedback (Cursor will translate to a cursor.rules file for you). License is Elastic License 2.0, which is source-available, not OSI open source. The Live Services crawls GitHub every hour, updating for new skills, and new versions of skills, running them through security, quarantine, and indexing. The API calls from your machine pull the latest vector db down. No data from your machine goes up other than what's in the query ("find me end to end testing skills").

Free tier is 1,000 API calls/month. Also works offline with the local database.

GitHub: https://github.com/smith-horn/skillsmith
Website: https://skillsmith.app
by neoCrimeLabs | 2026-02-15 16:48:13+00:00
Agreed.

That said for some I can foresee Meta being hard or harder to disconnect from because of their percieved level of personal social needs.

I left facebook and many of my friendships faded away.

Awkward bumping into people conversations would happen such as: "We missed you at my birthday party!", "I didn't know about it, else I would have been there!" "We posted it to facebook..." "I deleted my facebook account 2 years ago."

My personal philosophy was maybe they were not real friends to begin with. After all in the now 5 years since deletion, not one has reached out to ask if I'm even still alive. I've reached out to a couple people, with little to no reply. None the less, it was a hard transition.

For others', that might be an impossible task.
by ksec | 2026-02-15 16:48:40+00:00
You are describing in cases where small businesses have little headcount and cant shrink any further.

But in a much bigger picture AI is akin to what Excel did to a building of people doing accounting and bookkeeping. Except at the time there were plenty of opportunities for those people doing different thing in the market. Something that economists constantly burp about.

I dont see this now. For whatever reason the economy has so much more bullshit job than those days, despite computer and technology we have far more administration hurdle and employees than before. And 70% of those will go away in the next 5 years. We automated those needless complexity. It isn't clear to me in a world today where many jobs are specialised, there is enough time and room for them to relearn the skills required for other job opportunities, if there are that many to fill the ones who were laid off.
by raw_anon_1111 | 2026-02-15 16:48:45+00:00
How do you have a free press that is funded by the government and can report on government corruption and overreach? You keep failing to address that in the last six months the government did take funding from NPR and PBS because they were “too woke”. The government has been threatening to take funding from PBS since the 1960s.

The structural problem is the government. The structure of the government as stated in the Constitution is that the rural Bible thumping, racist part of America structurally has more power because of 2 Senators per state and to a lesser extent the electoral college. Until that’s not the case, the government will always be statistically more likely to be antagonistic to people who look like me.

I’ve worked for 30 years and the last decade+ in roles that put me in the rooms of decision makers. First as a tech lead at product companies and then as a customer facing consultant.

I never wondered whether I was going to be treated differently by corporate America - and I never have either as interviewee or dealing with CxO, directors, etc. The tools of the government on the other hand …

The public servants - the people with the legal right to take my property, liberty and life - those are the problem. You see what the full force of a corrupt government can do to its enemies with the meritless prosecution of Trump’s enemies and that almost half of the people still support.

You realize slavery was built into the constitution right? That whole 3/5ths of a person thing. Also the same government endorsed “separate but equal” in a Supreme Court case that had my again still living parents growing up in less well funded schools and drinking from separates water fountains.

I mentioned that until a couple of years ago, I lived in what was the most affluent county in the state. That county was Forsyth County GA and just so you don’t think I’m making this up just to argue.

https://news.ycombinator.com/item?id=46954232

While the outskirts of this county have diversified as far as not being rural. It’s still mostly White and conservative (my step son was one of only four Black students in his entire public high school). More of the Bush/Romney type of classic conservative than populist. What I didn’t mention was this was Forsyth County only 25-35 years ago.

https://m.youtube.com/watch?v=dlzwh2Wh1fw

It was a “sundown town”.

Those people haven’t gone anywhere - we had White friends that lived in the older parts of Forsyth County and even they told us to make sure we call if we get lost coming to their house and don’t walk up to the wrong house by mistake.

FWIW: we didn’t move because we had any problems living there. We sold the house for twice what we had it built for eight years earlier and downsized after my younger (step)son graduated and moved to state tax free, warmer Florida once I pivoted into consulting where it’s relatively easy to find companies that allow remote work.
by dhbradshaw | 2026-02-15 16:49:24+00:00
I really like this passage:

>It is always the case that there are benefits available from relinquishing core civil liberties: allowing infringements on free speech may reduce false claims and hateful ideas; allowing searches and seizures without warrants will likely help the police catch more criminals, and do so more quickly; giving up privacy may, in fact, enhance security.

> But the core premise of the West generally, and the U.S. in particular, is that those trade-offs are never worthwhile. Americans still all learn and are taught to admire the iconic (if not apocryphal) 1775 words of Patrick Henry, which came to define the core ethos of the Revolutionary War and American Founding: “Give me liberty or give me death.” It is hard to express in more definitive terms on which side of that liberty-versus-security trade-off the U.S. was intended to fall.
by dawnerd | 2026-02-15 16:49:31+00:00
It’s insane actually how fast to re-request the same pages, even 404s. They’re so desperate for data they’re really hurting smaller hosts. One of our clients site became unusable when one of the ai bots started spamming the Wordpress search for terms that I’m guessing users were searching for but were unrelated to the sites content. Instead of building a search index they’re just hammering sites directly. So annoying.
Show HN: Alive-analysis – Git-tracked analysis notes for AI agents
by with_geun | 2026-02-15 16:49:45+00:00
Hi HN — I built alive-analysis, an open-source workflow kit that turns AI coding agents into structured data analysis partners.

Problem: AI-assisted analyses are often throwaway chats. A month later, you can’t trace why you reached a conclusion.

Solution: It enforces a 5-stage loop (ASK → LOOK → INVESTIGATE → VOICE → EVOLVE) with checklists, and saves analyses as Git-tracked markdown files.
Quick mode: 1 file. Full mode: 5 files.

Works in Claude Code and Cursor.

I’d love feedback on:

1. Does the ALIVE loop match how you do investigations / experiment reviews?

2. Which checklist items feel missing or unnecessary?

3. What would make this usable in a team setting?
by devinplatt | 2026-02-15 16:50:02+00:00
It's so interesting to read these comments because this this is literally my job (to help Workspace teams integrate Gemini faster)

Some thoughts:

- Hardware constraints are real, even at Google.

- Features are often released for enterprise users first, before being released for the general public.

- I only started my current role last year.

- 2 years ago is forever ago in AI and things are changing a lot. For example, with older model generations people used to do a lot more fine-tuning (slow) vs. prompt engineering (fast). The implication is that things that are easier to do today might have been hard to do not that long ago. The rapid changes also create churn for internal platforms and dev tooling.

- Google is less yolo and cares about safety, prompt injection, etc. so some time goes into that

- Typical big company bureaucracy also applies, but TBH there's a lot of pressure to deliver Gemini related stuff so I think there's less of that