MurphyA/hacker-news huggingface dataset:
by aliyanishfaq | 2025-05-12 19:23:19+00:00
lol, should've cleaned the code more, but it's still safe. ParaAI was also built by me. It is connected to models hosted on Azure and has more prompt/iterative checks for styling so so that was the fastest way for me to implement instead of copying code.

Appreciate the note tho! would you want it to directly send request to model provider APIs?
by kaycebasques | 2025-05-12 19:23:25+00:00
Thanks for the feedback. I've been reading the research papers behind how these models are created e.g. Gecko [1] and NV-Embed [2] and Gemini Embedding [3] so I'm starting to grok what you're getting at and will find a way to make the post more accurate on this front

[1] https://arxiv.org/abs/2403.20327

[2] https://arxiv.org/abs/2405.17428

[3] https://arxiv.org/abs/2503.07891
by josh_carterPDX | 2025-05-12 19:25:08+00:00
While I agree with some of the statements made in the article, I don't think everything is doom and gloom. There is still a place for early-stage VC for founders looking to scale.

While I agree that AI is making it easier to launch things, there are so many other ancillary things that require human capital that AI still hasn't solved for, and I don't see that changing in the next 10-15 years. Call me a boomer, but there are a lot of companies that need to grow, and VC funding is a great solution for them.

I will say, however, seeing larger funds change to evergreen funds or even to a more PE model should make everyone pay attention. Adapt or die, right?
by coffeeboy | 2025-05-12 19:25:16+00:00
Very nice! I'm personally looking into bot account detection for my own service and have come up with very similar heuristics (albeit simpler ones since I'm doing this at scale) so I will provide some additional ones that I have discovered:

1. Fork to stars ratio. I've noticed that several of the "bot" repos have the same number of forks as stars (or rather, most ratios are above 0.5). Typically a project doesn't have nearly as many forks as stars.

2. Fake repo owners clone real projects and push them directly to their account (not fork) and impersonate the real project to try and make their account look real.

Example bot account with both strategies employed: https://github.com/algariis
by toast0 | 2025-05-12 19:25:26+00:00
(in the US) Mechanical licenses are compulsory; you don't need permission, you can just follow the forms and pay the fees set by the Copyright Royalty Board (appointed by the Librarian of Congress). You can ask the rightsholder to negotiate a lower fee, but there's no need for consent of the rightsholder if you notify as required (within 30 days of recording and before distribution) and pay the set fees.
by mritchie712 | 2025-05-12 19:25:41+00:00
> they're saving over 60% off of their BigQuery bill

how big is their data?

A lot of BigQuery users would be surprised to find they don't need BigQuery.

This[0] post (written by founding engineer of BigQuery) has a bit of hyperbole, but this part is inline with my experience:

> A couple of years ago I did an analysis of BigQuery queries, looking at customers spending more than $1000 / year. 90% of queries processed less than 100 MB of data. I sliced this a number of different ways to make sure it wasn’t just a couple of customers who ran a ton of queries skewing the results. I also cut out metadata-only queries, which are a small subset of queries in BigQuery that don’t need to read any data at all. You have to go pretty high on the percentile range until you get into the gigabytes, and there are very few queries that run in the terabyte range.

We're[1] built on duckdb and I couldn't be happier about it. Insanely easy to get started with, runs locally and client-side in WASM, great language features.

0 - https://motherduck.com/blog/big-data-is-dead/

1 - https://www.definite.app/
by AustinDev | 2025-05-12 19:26:27+00:00
You're correct actually the libraries are private donations then they later get transitioned to NARA which is federally funded.

I was getting those mixed up with the foundations such as Clinton Foundation, Bush Foundation, Obama Foundation. The Clinton Foundation has the most controversy surrounding it with $2b raised with > $20m coming from foreign governments.

This whole putting a Jet into a Presidential Library is unprecedented and bizarre.
by winwang | 2025-05-12 19:26:48+00:00
I was about to comment that Gluten is only targeting CPU vectorization, but then I found this (very cool!): https://github.com/apache/incubator-gluten/issues/9098

I'm not very familiar with Gluten, but I'll still comment on the CPU side though, assuming that one of Gluten's goals is to use the full vector processing (SIMD) potential of the CPU. In that case, we'd still be memory(-bandwidth)-bound, not to mention the significantly lower FLOPs of the CPU itself. If we vectorize Spark (or any MPP) for efficient compute, perhaps we should run it on hardware optimized for vectorized, super-parallel, high-throughput compute.

Also, there's nothing which says we can't use Gluten to have even more CPU+GPU utilization!
by scoofy | 2025-05-12 19:27:38+00:00
The second sentence in the Wikipedia entry:

>Specifically, an industry is a natural monopoly if the total cost of one firm, producing the total output, is lower than the total cost of two or more firms producing the entire production.

The industry of operating a network connecting independent taxi service providers to taxi service clients is the natural monopoly, simple because the cost to operate the service is wildly scalable, and become more useful as more people use them, as all network-based industries are.
by yamazakiwi | 2025-05-12 19:28:10+00:00
You’ve successfully contributed 20 pts to your institutional privilege score; Impressive! You're just one step away from your next badge:

"Class Immobility" (95% of users unlock this without trying!)

How to unlock: Be denied access to an accredited education. Work twice as hard for half the recognition. Watch opportunities pass you by while gatekeepers congratulate themselves!
by andoando | 2025-05-12 19:28:20+00:00
Implementing state isnt very difficult.

I think youre thinking of a very static use case again. Link to page number doesnt make too much sense when the data changes (and do you really want to refresh the whole page just to change the table data?), but yes thats easy to implement to.

It would just look something like let pageNum = params.page

<Table defaultPage={pageNum}/>

Now think about if you need to implement a more complex table in an admin UI that lets you filter / sort, delete/add rows, etc. Thats where reactivity is really really nice. All you have to do is something like items = items.filter(i -> i.name.startsWith(input)) and youre done.
by psunavy03 | 2025-05-12 19:29:47+00:00
Australian SASR already had a major scandal. There's been open reporting in the past about some bad actors over the years in USSOCOM. It'd be interesting for someone to do some serious psych research on how many of these people were psychopaths who slipped through the cracks as opposed to people who broke bad after several combat deployments.

The general public never payed much attention to GWOT as it was, but one of the consequences of it was that the special operations forces as a community were "rode hard and put away wet" as they say for 20+ years. Take someone, put them through a grueling selection process to become "the best of the best," which can cultivate a corresponding ego. Then pound the hell out of them over a full career with combat deployment after combat deployment, raid after raid.

It doesn't excuse what happened by any means, but is there legitimately a limit that needs to be known about how much violence someone can take before they give in to the beast within? Military aviators have crew rest limitations because it was discovered that beyond a certain level of fatigue, you are literally killing people. The experience of Vietnam POWs forced changes to military training for being taken captive, because they found out that if you torture anyone enough, they will eventually break.

So is the solution here that the SOF communities are attracting too many psychopaths and screening needs to be changed, or is it that people were being broken by war, which is a totally different problem?
by DrakeDeaton | 2025-05-12 19:29:59+00:00
Part of the thinking behind the Barbican's somewhat hidden entrances to the estate and tts maze-like layout was that they would reduce foot traffic, and it totally worked. Not many people use the public estate high-walks as a shortcut to get across the City. This has a wonderful effect wherein you're surrounded by the hustle and bustle of the City, while being just a touch insulated from it.

I lived there for the better part of a year and it completely changed my perspective on living in London. More city-life should be like the Barbican.
by AStonesThrow | 2025-05-12 19:30:10+00:00
I don't know about yearning, but if the balance has shifted in recent decades, we all need to think about the ramifications of women being forced into the workplace.

- More men fending for themselves without a wife or homemaker to prepare meals, clean, shop, care for children at home. Are boys being prepared for this adult reality?

- More women needing to stand on their own two feet, rather than relying on a male protector, breadwinner, supporter at home. Must a woman also fend for herself in the workplace, while she's cooking, cleaning, and raising children at home? That seems inhuman to me.

- In the face of rising addictions and mental illness, divorce is an easy-out and welfare is your safety net, rather than family. So an abused, divorced woman imperils herself and may wind up on the streets. Any man who can't hold down a job and a household is likewise imperiled. At least he doesn't need to worry about child care?

- If women do not yearn for the kitchens then men are certainly displaced from careers and jobs that were once available to them. Can you imagine unemployment literally doubling? If you go from zero women needing to work, to all women needing to work, does this not affect men's status? Must we send women into combat, into coal mines, and onto oil rigs?
by ChrisMarshallNY | 2025-05-12 19:30:28+00:00
I’m not getting into angels and pinheads, but modern ML has the ability to perform “fuzzy analysis,” and interpret results in a far more flexible manner, than ever before.

They may not be able to match an MIT Ph.D, at analyzing experimental feedback, but they can probably match a lot of research assistants.

It’s like having a billion RAs, all running experiments, and triaging the results. I understand that is how they have made such good progress on medicines, with AI.

> “I have not failed. I've just found 10,000 ways that won't work.”

-Attributed to Thomas Edison
by thezoq2 | 2025-05-12 19:30:51+00:00
Spade author here!

My probably controversial opinion on output code quality is that if you have to see the generated Verilog, I've done something wrong since there is probably a compiler bug if you need to go down to that level.

Of course, you could just be looking at output from tools like timing reports, and then as someone else commented out, it is a bit of a tooling issue. Spade does emit (* src = *) attributes which yosys and friends accept to show the original Spade source instead of Verilog, but it is still kind of leaky in some cases
by catlikesshrimp | 2025-05-12 19:31:04+00:00
Non US Call centers can't handle cancellations. If they can't convince you to postpone, they have to transfer you to some US Call center specifically for Retention or something like that.

The transfer process impacts the metrics of the agent. You know, like call length, customer survey, customer callbacks, etc

Well transfers are also a metric. That specific agent might prefer a "callback" over a "transfer" that month.

W/e Your best strategy is to open the call with: "hi, I want to cancel my service" And don't give details about any problem, you just want to cancel. Period.

If the agen't "can't transfer" ask for a supervisor. Could be 5 - 15 more minutes but at least you don't have to call again.

If you ask for "an American" or "someone who can speak english", depending on the call center company, you can get a call drop, a soft retention, a transfer to the agent beside, or a transfer to a call center in the US. YMMV

my two cents
by enaaem | 2025-05-12 19:31:07+00:00
I would argue that it has little to do with war itself but the rather to environment where we can use collective effort to solve strategic goals.

There is a idea that collective action is always inferior to private action, but I would argue there is a subset of problems with outsized effects where solving the problem is far more important than solving the problem as efficient as possible. This is particular for problems where the effects are large and impossible for markets to price in all the effects.

One example is war fighting itself where winning is far more important than being cheap. Although efficiently matters, it only matters in the context of increasing your changes of winning. How would you price in the destruction of a city? How are you going to collect the money if you manage to save it?
by beloch | 2025-05-12 19:31:25+00:00
Soldiers are not trained to do police work, yet that's what many are asked to do. An informant provides a tip that someone is manufacturing IED's, so soldiers are sent to investigate. They're not trained for that. Worse yet, they're the targets of the crime they're investigating. Police are not typically asked to investigate an attempt on their own lives for good reason.

Even with appropriate training and when investigating crimes that do not target themselves, police are often guilty of abuses. In an occupation, the sheer numbers involved would guarantee abuses even if it were police operating under ideal conditions.

It is usually not feasible to conduct military operations with a huge force of trained police officers. However, even with people of the wrong background investigating without detachment, there should be an expectation for a culture of conscientiousness. That's the truly shocking thing about this article. Soldiers were put into a situation where things were expected to go wrong, but the attitude from command was to let it go wrong gleefully and to help cover it up afterwards. There was a complete surrender to inhumanity, on the part of command, before the conflict even started. That's what is truly reprehensible. Perhaps we must forgive people for doing bad things in the moment and under duress, but there should be no forgiveness for those who do it happily, daily, and without complaint.

This was a failure of command even more than it was a failure of the soldiers who committed crimes.
by gnat | 2025-05-12 19:32:22+00:00
Computers and the Internet started with academics. Distributed systems were theoretical before they were practical. The first sites of the Internet were universities and the first non-academic site was a milestone. Harvard and Dartmouth and MIT all contributed to computer design and programming advances. UNIX is a product of a quasi-academic research lab.

The Center of Gravity shifted in the late 90s/early 2000s, I reckon. Real world needed distributed systems, and neural networks, and crypto math, and hardware design, and …

There’s still a place for academic research but it’s a much different place in the Gilded CPU Age. It’s the god of the non-commercial gaps: for a while there if it seemed like it’d make money, someone .com giant with gigabucks of free cash had someone on it. Why work for a university if gigabucks.com is hiring?

Not saying USENIX didn’t have factions. I just question the word “capture” about academics, who invented all this stuff before there was money in it. It feels like retiring the Annual Technical Conference is the final step in Usenix’s capture by industry.
by winwang | 2025-05-12 19:32:42+00:00
I'm not sure about the rest of your comment, but we would likely still want GPUs even with highly multicore CPUs. Case in point: the upper-range Threadripper series.

It makes sense to have two specialized systems: a low-latency system, and a high-throughput system, as it's a real tradeoff. Most people/apps need low-latency.

As for throughput and efficiency... turns out that shaving off lots of circuitry allows you to power less circuitry! GPUs have a lot of sharing going on and not a lot of "smarts". That doesn't even touch on their integrated throughput optimized DRAM (VRAM/HBM). So... not quite. We'd still be gaming on GPUs :)
by J0nL | 2025-05-12 19:33:01+00:00
Being denied satisfaction is the important part but yeah, there are countless circumstances that can result in it. Having to waste all your time fighting for limited resources because a handful of individuals are hoarding them is by far the most common.

In the US the so called "free market" was intended to be a way for people to achieve financial independence in spite of any persecution. Unfortunately regulatory capture has made it exceedingly difficult.
by jgilias | 2025-05-12 19:33:20+00:00
Curious, what are the practical concerns? The place looks fantastic to me!

I really miss more bold architectural and city planning experiments. Like, I get it, if it’s a flop, it’s a pretty expensive one. But still, it feels like the design-space there is just really under-explored.

Maybe there’s some AI-driven simulation way to explore the design-space and arrive at viable solutions before committing too much funds.

One can dream.
by thezoq2 | 2025-05-12 19:33:34+00:00
Spade author here!

That is a good point, sadly I'm not experienced enough with verification to know what is actually needed for verification from a language design perspective which is why I just offload to cocotb. There are a few interesting HDLs that do focus more on verification, ReWire, PDVL, Silver Oak, and Kôika are the ones I know about if you're interested in looking into them

Also, nitpick but amaranth does have its own simulator as far as I know
by archagon | 2025-05-12 19:34:18+00:00
It's not that complicated: little guy taking stuff from big corp (then) vs. big corp taking stuff from little guy (now). Similar to the recent debates over permissive open source licenses and corporate exploitation.

As for the zeitgeist, I'm not sure anything has materially changed. Recently, creators have been very upset over Silicon Valley AI companies ingesting their output. Is this really reflective of "general internet sentiment"? Would those same people have supported abolition of copyright in the past? I doubt it.
by VonTum | 2025-05-12 19:34:42+00:00
> As one HDL theory expert once told me "Too many high level HDLs try to abstract out time, when what they really need to do is expose time."

Exactly! It's astounding how often the documentation of some vendor component has in the documentation: "data_out is valid 2 cycles after read_enable is asserted", and NOTHING in the actual module definition makes a mention of this. There's so much dumb and error-prone mental arithmetic designers have to do to synchronize such latencies.

Spade does make a nod at this, with its pipelining notation. The issue I have with it is that it takes a too simplistic approach to said port timings. In a Spade pipeline you separate "pipeline stages" by adding a "reg;" statement on its own line. (It's an approach shared by another language called TL-Verilog.). A consequence of this style is that all inputs arrive at the sime time (say cycle 0), and all results are produced at a second time (say cycle 5). This is irrespective of if an input is actually only ever needed in a final addition in cycle 4. It'll insert the 4 extra registers regardless. Likewise, it leads to unnatural expression of subpipelines, where syntactically you can already see a value, but can only _access_ it 3 pipeline stages later.

With SUS, I have a solution to this: Latency Counting. (Intro here: https://m.youtube.com/watch?v=jJvtZvcimyM&t=937). A similar philosophy is also followed by Filament, though they go a step further with adding validity intervals too.

The gist of Latency Counting is that Instead of explicitly marking and naming "Pipeline stages", you annotate a statement to say that it "takes one cycle", and through exploring the dependency graph between your wires, it assigns a unique "absolute latency" to every wire, and places registers accordingly. (And now it can even infer submodule parameters based on this pipelining, in a bid to do HLS-style design in an RTL language).
by pixl97 | 2025-05-12 19:34:43+00:00
While previous is an over reactions, the wild west free for all we have is also a problem.

At the end of the day the masses will finally get tired of the fuckery of programmers doing whatever they want and start putting laws in place, and the laws will be passed by the stupidest people among us.

Programmers now should start looking into standards of professional behaviors before they are forced on them by law.
by DavideNL | 2025-05-12 19:34:45+00:00
2 other factors other than physical activity and stress that seem to impact insuline sensitivity:

1. Temperature (room / outside)

2. How well you’re hydrated

Regarding the *time* it takes for eaten Carbs/glucose to enter the bloodstream, it seems that simply standing/being postural often slows down digestion, while sitting/laying down (think of a couch potato watching tv) seems to increase digestion speed.
by MisterBastahrd | 2025-05-12 19:34:45+00:00
Yup. He said that in the Bible. But he also fed people on the Sabbath because there were people needing to be fed, not because the recognition of the Sabbath day was abolished, but because the ridiculous legalistically dogmatic adherence to the Law was harming people. Just like today, where we've got ICE agents rushing parents and leaving their children alone in the backs of their vehicles. Also, his fulfillment was about being the sacrifice that sinners couldn't make for themselves, not about ignoring Old Testament laws.
by ryao | 2025-05-12 19:35:13+00:00
The two being equal in efficiency is true in a best case scenario, but that ignores real world effects such as inverter losses. I wonder which would be superior in a real world test.

That said, in my home, I use net metered photovoltaic panels with a Rheem heat pump for domestic hot water. This was not done because I considered it to be a better solution, but because it was the only solution available to me from local installers.
by thezoq2 | 2025-05-12 19:35:15+00:00
Clash was the HDL that I used before starting Spade. I'm not a huge fan of haskell and wanted a few more hardware specific features which is why I didn't stick with it.

That said, Clash is great and I know quite a few people at QBay. They don't seem to be slowing down any time soon!
by ceejayoz | 2025-05-12 19:35:32+00:00
And OpenAI is definitely thinking about this on their end:

https://www.axios.com/2024/12/03/openai-ads-chatgpt

> OpenAI CFO Sarah Friar told the Financial Times that OpenAI is weighing the inclusion of ads in its products but wants to be "thoughtful about when and where we implement them."
by Gracana | 2025-05-12 19:36:18+00:00
I wonder if it was unable to read your report, and just answered as if role-playing?

I gave it a pdf of an engine manual recently and asked some questions, which it answered reasonably. It even pulled a schematic out for me, though it was the wrong one (it gave me a schematic for the CDI ignition variant that we first talked about, rather than the DSAI one we settled on later.)
by winwang | 2025-05-12 19:36:46+00:00
They have >1PB of data to ETL, with some queries hitting 450TB of pure shuffle.

It's very true that most users don't need something like BigQuery or Snowflake. That's why some startups have come up to save Snowflake cost by "simply" putting a postgres instance in front of it!

In fact, I just advised someone recently to simply use Postgres instead of BigQuery since they had <1TB and their queries weren't super intensive.