MurphyA/hacker-news huggingface dataset:
by virgilp | 2025-05-21 10:36:32+00:00
I managed to get Perplexity to hallucinate, which was rather hard :) - but this is not a question that acts as a very good "template".

The question is "Is this JWT token valid or is it expired/ not valid yet? eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzdWIiOiIxMjM0NTY3ODkwIiwibmFtZSI6IkpvaG4gRG9lIiwiaWF0IjoxNzQ3ODIzNDc1LCJleHAiOjE3NDc4MjM0Nzh9.4PsZBVIRPEEQr1kmQUGejASUw0OgV1lcRot4PUFgAF0"

The answer was in some ways way better than I expected, but it got it wrong when comparing the current date/time with the "exp" datetime. Got the expiration date confidently wrong:

```

iat (issued at): 1747823475 (Unix time) exp (expiration): 1747823478 (Unix time)

Token Validity Check

The current date and time is May 21, 2025, 1:32 PM EEST, which is Unix time 1747817520. The token's exp value is 1747823478, which is May 21, 2025, 3:11:18 PM EEST.

Conclusion:

The token is not expired; it will expire on May 21, 2025, at 3:11:18 PM EEST. The token is already valid (the iat is in the past, and the current time is before exp).

Therefore, the JWT token is currently valid and not expired or not-yet-valid.

```
by lhecker | 2025-05-21 10:36:38+00:00
Back then (a year ago?) I simply included the Windows.h header into a Zig file. Is that not possible anymore? It worked great back then for me IIRC!

Overall, I liked the build system. What I found annoying is that I had to manually search for the Windows SDK path in build.zig just so I can addIncludePath it. I needed that so I can add ICU as a dependency.

The only thing that bothered me apart from that was that producing LTO'd, stripped release builds while retaining debug symbols in a separate file was seemingly impossible. This was extra bad for Windows, where conventionally debug information is always kept in a separate file (a PDB). That just didn't work and it'd be great if that was fixed since back then (or in the near term).
by weatherlite | 2025-05-21 10:37:34+00:00
> Well, right, how does one become a senior engineer in a world where no one needs to hire a junior?

You don't. Unless the person is super brilliant I just don't think the industry needs many more new people, there are enough for the next 1-2 decades and after that humans will probably not be needed at all.

People should go where the demand is - medicine, education, policing or whatever it may be.
by Gud | 2025-05-21 10:38:04+00:00
To be honest, and maybe I’m using LLMs wrong, but are they really _replacing_ juniors?

I use ChatGPT occasionally, as a teacher.

I feed it a query and typically it responds with the correct result.

Wouldn’t this be empowering junior developers and make them more productive?

I use ChatGPT in the same way to learn German.
by skohan | 2025-05-21 10:39:00+00:00
I always felt unwrap is preferable for diagnosing issues, which makes it useful in tests. A failed unwrap will point you directly to the line of code which panics, which is much simpler than trying to trace an issue through many layers of Results.

If you use `assert` in tests, I don't understand why you wouldn't also prefer unwrap in this context.

I think it's also perfectly reasonable to use in a context like binary you run locally for private consumption, or for instance a serverless function which allows you to pinpoint the source of errors more easily in the logs.

It's not a good fit for cases where you do expect cases where the unwrap will fail, but it's a great fit for cases where you believe the unwrap should always succeed, as it allows you to pinpoint the cases where it fails.
by sim7c00 | 2025-05-21 10:39:17+00:00
"Since launching in 2023, SynthID has watermarked over 10 billion images, videos, audio files and texts, helping identify them as AI-generated and reduce the chances of misinformation and misattribution. Outputs generated by Veo 3, Imagen 4 and Lyria 2 will continue to have SynthID watermarks.

Today, we’re launching SynthID Detector, a verification portal to help people identify AI-generated content. Upload a piece of content and the SynthID Detector will identify if either the entire file or just a part of it has SynthID in it.

With all our generative AI models, we aim to unleash human creativity and enable artists and creators to bring their ideas to life faster and more easily than ever before."

From the page linked in the post....

So there's different ways to detect AI generated content (videos/images atleast). (https://www.nature.com/articles/s41586-024-08025-4 <-- paper on synthID / watermarking and detecting it with LLMs)
by bogtog | 2025-05-21 10:39:23+00:00
> The largest model we tested has 405 billion parameters, but others, such as DeepSeek, have gone much further, with over 600 billion parameters.

Very quickly skimming, I have some trouble taking this post seriously when it omits that the larger DeepSeek one is a mixture-of-experts that will only use 12.5% (iirc) of its components for each token.

The best summary of text energy use I've seen is this (seemingly more rigorous, although its estimates are consistent with the final numbers made by the present post): epoch.ai/gradient-updates/how-much-energy-does-chatgpt-use

Estimates for a given response widely for a "typical" query (0.3 Wh; 1080 joules) and a maximal-context query (40 Wh; 144k joules). Assuming most uses don't come close to maximizing the context, the energy use of text seems very small compared to the benefits. That being said, the energy use for video generation seems substantial

I would be interested in seeing the numbers corresponding to how LLMs are typically used for code generation
by ZeroGravitas | 2025-05-21 10:39:32+00:00
They're not actually unpopular.

They've been implemented all over the world, because they're effective. They cover 31% of emissions in developed nations.

To whatever degree you could say they are unpopular, they're unpopular in regions where the government doing stuff about climate change (or just "the government doing stuff") is unpopular, which makes it odd to single out putting a price on carbon specifically

See where they are used here: https://carbonpricingdashboard.worldbank.org/
by DonHopkins | 2025-05-21 10:39:45+00:00
Did you ever play around with the Matrox Digisuite SDK for DirectX for real time video processing, that had a visual data flow programming language interface for its video processing nodes that would execute inside the gpu?

https://video.matrox.com/en/about/history-of-innovation

>1996: Matrox launches the Matrox Genesis Series vision processor, and with its highly pipelined, parallel-processing architecture, establishes a new performance industry standard.

>The company also introduces Matrox DigiSuite, the first affordable all-digital system for real-time, non-linear editing. The award-winning DigiSuite breaks new ground in offering a full set of professional-quality editing and effects capabilities. DigiSuite becomes the world's best-selling professional video editing card.
by rurban | 2025-05-21 10:41:02+00:00
Some decades I typed a doctoral thesis of this Kokoschka doll obsession. 300 pages of insanity. And now I'm living just a few hundred meters from Kokoschka's home in Dresden. He was a maniac.

There's also this interesting story about him as arts teacher in an experimental Viennese school, led by a Jewish woman.
by alkonaut | 2025-05-21 10:42:37+00:00
> LINQ syntax is just sugar and probably a design mistake

I find that the term "LINQ" these days tend to mean the extensions on IEnumerable/IQueryable, and not the special query syntax. Whatever the term meant when it was launched is now forgotten. Almost no one uses the special query syntax, but everyone uses the enumerable/queryable extension methods like Select() etc, and calls it "Linq".
by avidphantasm | 2025-05-21 10:43:50+00:00
Thank you for elucidating the fact that US “borrows” in its own currency and so as long as we have monetary sovereignty (which we do to a great degree due to USD being the global reserve currency) we have no deficit problems (as long as we keep inflation in check).

I implore everyone reading this thread to read up on Modern Monetary Theory (MMT). Stephanie Kelton’s “The Deficit Myth” is a good place to start. Until more people have a better understanding for how the system works, they’ll continue to be confused and easily led astray by politicians who don’t have the best interests of most people in mind, but instead wish to rob us blind in a vain attempt to eliminate trade/budget deficits.

(Note: I’m very much for restoring domestic manufacturing as much as possible, including the use of highly targeted tariffs, industrial policy, R&D, workforce development, etc. but this is not what the current administration is doing, not even close).
by ts17631 | 2025-05-21 10:44:25+00:00
Thanks a lot for zod and really looking forward to trying out the new version! Also as a primary Go developer this issue just has been really interesting to read about. Go avoids this issue by just not having peer dependencies and relying on the compiler to not bundle unused code - or just live with huge binaries when it doesn't work out :-)

I am still curious about the `zod4` idea though. Any thoughts on adding an `__api_version` type of property to distinguish on to all of zod's public types? Perhaps it's prohibitive code-size wise but wondering if it's possible somehow. Then downstream libraries could differentiate by doing the property check.

Just wanted to share the idea but the current state seems ok too.
by rakinar2 | 2025-05-21 10:44:44+00:00
So basically Spy.pet v2? Hmm.

I do see how this might be useful for certain use cases, but I don't like the fact that someone is scraping my messages without my consent. You might tell me oh well I could just opt-out: but what about those who don't even know about this thing?

I can already see Discord coming after this. Good luck fighting the legal battle with them.
by alkonaut | 2025-05-21 10:45:55+00:00
It means that if you find a performance problem, and you could hand-code that performance problem away (e.g. use some for-loops and preallocated buffers etc instead of wrestling enumerables, adding to lists) then you may find it useful, because you can keep the code cleaner.

This is to the Queryable/Enumerable extensions what ValueTask is to Task, or ref struct to struct etc. If you are the type of developer that sees great benefit switching from Task to ValueTask then you will probably find this useful too.
by skissane | 2025-05-21 10:45:58+00:00
IBM z/OS is officially a Unix-a very weird Unix which uses EBCDIC-but it passed the test suite (an old but still valid version, which makes it somewhat outdated) and IBM paid the fee to The Open Group, so officially it is a Unix. (Although somewhat outdated, they recently added a partial emulation of the Linux namespace syscalls-clone/unshare/etc-in order to port K8S to z/OS; but that’s not part of the Unix standard.)

If Microsoft had wanted, Windows could have officially been Unix too-they could have licensed the test suite, run it under their POSIX/SFU/SUA subsystem, fixed the failures, paid the fee-and then Windows would be a Unix. They never did-not (as far as I’m aware) for any technical reason, simply because as a matter of business strategy, they decided not to invest in this.
by kingkongjaffa | 2025-05-21 10:46:30+00:00
> Personally, I believe as engineers our focus should be on the product. The profits are the domain of the business people.

This is the dumbest idea in tech. Please don’t listen to this advice. If you’re just starting your career I’m begging you not to laser focus on coding widgets better for the sake of it.

Care about your customers and what problem they are trying to solve and be involved in figuring out how to make solving those problems a profitable endeavour.

All code is throwaway, all code is worthless, solving real needs, wants and pain points for customers is the real source of value.
by sim7c00 | 2025-05-21 10:46:44+00:00
presumed datasets: 1. its petabytes of data in the public/listed/free tier videos. 2. there's paywalled videos. 3. there's private/unlisted videos.

google will have access to all of these. competitors will have to do tons of network interactions with google to pull in only the first set. (which google could detect and block depending on how these competitors go about it)
by dr_dshiv | 2025-05-21 10:47:01+00:00
It is also additional value creation.

It also leads to automation and efficiency, even if it isn’t a fully linear path.

AI isnt a waste. We can’t let environmental consciousness get in the way of rather natural human development. Especially CO2. (I have different opinions about biodiversity because of the irreversible loss. I also believe that we have the technology to pause and reverse climate change — but don’t pursue it because of degrowth ideologies)
by rndmio | 2025-05-21 10:47:23+00:00
You might, just as ages ago when people were complaining about juniors c+ping stack overflow answers you might have said you used them to learn from. LLMs are a turbo charged version of the same problem, only now rather than copying a code fragment from stack overflow you can have an LLM spit out a working solution. There is no need to understand what you're doing to be productive, and if you don't understand it you have no model or reasoning to apply in the future to other problems, maybe AI will save you there too for a while, but eventually it won't and you'll find you've built your career on sand.

Or maybe I'm wrong and we're all headed for a future of being prompt engineers.
by pjmlp | 2025-05-21 10:47:24+00:00
Now try to contribute to OpenGroup.

You mean free pdfs like C and C++ drafts?

https://www.open-std.org/jtc1/sc22/wg14/www/docs/n3220.pdf

https://isocpp.org/files/papers/N4860.pdf

Maybe like Ada,

http://ada-auth.org/standards/ada2y.html

Or Fortran,

https://j3-fortran.org/doc/year/23/23-007r1.pdf

Apparently there is a little more than a table of contents, when people actually know where to look.
by Fraterkes | 2025-05-21 10:48:18+00:00
The current AI-boom has been aroung for ~3 years. Implying that effeciency gains in AI will be like Moore's law (ie they will accrue at around the same high rate for decades) based on data from that time frame is pretty unresponsible in my opinion. Also, Altman is not in any way an expert in any of this and has an obvious financial interest in making this technology palatable. There's no good reason to cite his writing in these kinds of discussions.
by zfountas | 2025-05-21 10:48:40+00:00
Hi MacsHeadroom, first author here. Thanks for the great questions about compute/memory trade-offs.

The quick take: To give you an example of processing speed, with a 7B model on an NVIDIA V100, EM-LLM processes (or generates) about 326 tokens/sec with a 51.2K context window (which is quite competitive for these old GPUs).

More broadly, EM-LLM is designed to make ultra-long contexts (memory-prohibitive for standard O(n^2) attention) computationally tractable. The Appendix C of our paper https://openreview.net/pdf?id=BI2int5SAC details how: significantly better attention scaling, efficient O(nm) memory formation, and large KV cache management via CPU/disk offloading. While there's a slight per-chunk overhead compared to the simplest retrieval methods initially, the crucial part is our ability to handle sequences at scales infeasible for full-context models. For instance, we're successfully using 8B models with 10M token contexts on a single GPU without prohibitive delays.

Regarding RAG in particular, EM-LLM often shows significant gains on tasks needing deep understanding of a single, long, coherent context. A key reason is that EM-LLM allows each layer to retrieve and integrate relevant information from different "episodes" of the context independently, offering more nuance than a typical single RAG step, for similar overall resource use.
by mxuribe | 2025-05-21 10:48:44+00:00
Interesting! Both my partner and i felt that Leonardo DiCaprio (while we consider him a pretty good actor in general) didn't quite fit that "timeless" label for the Gatsby role....while we felt that both Carey Mulligan and Tobey Maguire did indeed feel right at home in such roles...at least to our eyes. Also, while we do love the original film with Robert Redford, we did also really like the modern (and quite different!) take of the Gatsby film created by Baz Lurhman. :-)
by TeMPOraL | 2025-05-21 10:48:57+00:00
Just moments ago, I managed to turn a photo of a person into a short clip of them dancing, in half-decent quality, fully locally, on a mid-range gaming GPU (RTX 4070 Ti, 12GB VRAM). I almost run out of RAM (32GB), but it worked, worked well, and took only couple of minutes.

Half a year ago, that was sort of possible for some genius really bent on making it happen. A year ago, that was unthinkable. Today, it's a matter of drag&dropping a workflow to a fresh ComfyUI install and downloading a couple dozen GB of img2vid models.

The returns on R&D are not diminishing, the progress is just not happening everywhere evenly and at the same time.
by incognito124 | 2025-05-21 10:49:04+00:00
Thanks for sharing the name of that problem! I've encountered it before while optimizing batched LLM inference. The whole batch would last until all queries in a batch were done, and by changing the batch size, you'd trade off per-query-speed (better in a larger batch) with overall performance (worse with a larger batch).

Nowadays I think this is solved in an entirely different way, though.
by dgb23 | 2025-05-21 10:50:13+00:00
Point 1 sounds interesting but I can't comment on it, because I don't remember ever having encountered it.

Point 2:

One of the most important techniques as a self-taught programmer is to develop an instinct for "foundational solution that wants to get out" so to speak. So you search for the name of the type of problem you're looking at or for the approach you half-way discovered. You don't have a tutor or professor who will tell you where you are, so you need to figure that out yourself, often by assuming that someone else already put a label on the map.

On the other hand, self-taught does not mean "you don't have theory". From my experience getting the raw knowledge is the easy part. There are a lot of excellent resources out there, from book recommendations/compilations to freely available lectures and so on.

The thing that I always missed or were generally harder to come by are far more precious than that: guidance and feedback from teachers/mentors, interaction with peers who are in the same boat and most importantly time.
by jajko | 2025-05-21 10:50:19+00:00
US fast food slowly spreading like a cancer to cater to lowest social layers ain't something to be proud of. Their products are of much lower quality and taste. Basically spreading obesity, diabetes and cancer further by attacking lowest reward cycles in minds that have lowest control mechanisms.

Its like being proud in pushing PFOAs or BPAs on whole world. Nobody goes around and celebrates Thomas Midgley Jr. or inventor of fentanyl, do we.

Also, this year any US product is much more avoided on purpose, that goes also for pop culture. I specifically avoid them unless they are top of the market by big margin for given money. orange man achieved what many couldn't do in their whole careers - wake up Europe from its cozy naive and stupid sleep.
by naikrovek | 2025-05-21 10:50:58+00:00
Astoria and WSA are different things. Sort of. WSL and WSA both use the approach that was proven by Astoria. That approach was possible since the NT kernel was created, but no one within Microsoft had ever used that feature outside of tiny pieces of experimentation prior to Astoria. Dave Cutler built in subsystem support from the beginning, and the Windows NT kernel itself is a subsystem of the root kernel, if I am remembering a video from Dave Plummer correctly.

Anyway, Astoria was an internal product which management ultimately killed, and some of the technology behind it later became WSL and much later, WSA. WSA's inital supported OS was Windows 11.

Microsoft being Microsoft, they artificially handicapped WSA at the outset by limiting the Android apps it could run to the Amazon App Store, because that's obviously the most popular Android app store where most apps are published. [rolls eyes] I don't think sideloading was possible. [rolls eyes again]

I don't work for Microsoft and I never have; I learned all of this from watching Windows Weekly back when it was happening, and from a few videos by Dave Plummer on YouTube.
by oblio | 2025-05-21 10:51:39+00:00
> It's much easier to 100x $1k than to 10x $1m.

That's kind of goes against the conventional wisdom, which largely feels true in my experience, that "the rich get richer". Countries are a bit different, but China looks poised to avoid the middle income trap up to a point, and even if they don't, their "middle income" is a lot more likely to fall somewhere near the Japanese levels, which would make the Chinese economy massively bigger than the US one, by 2050.
by lynx97 | 2025-05-21 10:51:47+00:00
Believe me, the common man doesn't need the ultrawealthy to dislike arbitrary cost increases. Carbon taxes are incredibly unpopular. As is common sense and/or planning for a future 20 years ahead. Humans are, on average, selfish beings. All this climate change activism is NOT the norm, and does NOT resonate with most common people. Talk to some outside of your activist bubble, and you will learn a thing or two about humans.
by jdietrich | 2025-05-21 10:51:49+00:00
You can't go wrong with a Yamaha Pacifica, although you'll pay closer to €250 - the build quality is consistently excellent and the 112J is extremely versatile. Harley Benton (Thomann's house brand) offer a very wide range of guitars at under €200 with shockingly good specifications, but the quality control is a bit more patchy, so I'd suggest getting a guitar-playing friend to look it over or paying a local guitar store for a setup.

If you're just practising at home, the Positive Grid Spark 40 is an astounding bargain at under €250. It sounds great out of the box with a simple interface, but connect the app and you've got near-endless tonal options and tons of really useful practice features. It also does double-duty as a good Bluetooth speaker. Spend a little over €250 on something like the Fender Mustang LT50 or the Boss Katana 50 and you've got a versatile modelling amp that'll just about keep up with a drummer in a rehearsal room.
by metalman | 2025-05-21 10:52:00+00:00
amazing how successfull the "deficit" narative is for the country that somehow gets the largest share of the worlds real comodities and goods shipped to it's shores in exchange for some "currency" pulled strait from the iether! and as someone said, If I owe a thousand dollars, it's my problem, but if I owe 5 million, it's the bank's problem, so I think it is a good idea for me to run a bit of a personal "deficit", you know just to do my part, and be a good citizen, hard as it is to take all that stuff, someone has to do it, but realy it's not fair, no not fair to get all the stuff and hand out IOU's for some stuff that I just have to mark up a bit, no not fair, all the time and trouble marking my stuff up, in fact I think I need to be compensated for marking my stuff up
by fipar | 2025-05-21 10:52:08+00:00
We should be grateful for the people that get a new guitar every month since I bet they keep that industry alive. I don’t think it would survive on professional musicians alone, though I could be wrong. We would certainly have professional luthiers, but I’m not sure about production lines…

In any case, your comment on a 200 Euro guitar reminded me of this: https://en.m.wikipedia.org/wiki/$100_Guitar_Project

And to confirm your “and above all playing” part, a couple of years ago I updated my 90s epiphone s-type (“Gibson’s Strat”, ha!) with ‘68 Strat pickups (reissue, obviously, I’m neither rich nor that crazy) and I told a friend “I now sound just like the guy that tunes Mark Knopfler’s guitar” :)