MurphyA/hacker-news huggingface dataset:
by Philpax | 2025-05-02 17:18:41+00:00
Yeah, it's a bit confusing at first to navigate. Luckily, they offer XML dumps that aren't too bad to work with:

1. Go to https://dumps.wikimedia.org/enwiki/latest/ (or a date of your choice in /enwiki)

2. Download https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-page... and https://dumps.wikimedia.org/enwiki/latest/enwiki-latest-page.... The first file is a bz2-multistream-compressed dump of a XML containing all of English Wikipedia's text, while the second file is an index to make it easier to find specific articles.

3. You can either:

a. unpack the first file b. use the second file to locate specific articles within the first file; it maps page title -> file offset for the relevant bz2 stream c. use a streaming decoder to process the entire Wiki without ever decompressing it wholly

4. Once you have the XML, getting at the actual text isn't too difficult; you should use a streaming XML decoder to avoid as much allocation as possible when processing this much data.

The XML contains pages like this:

<page> <title>AccessibleComputing</title> <ns>0</ns> <id>10</id> <redirect title="Computer accessibility" /> <revision> <id>1219062925</id> <parentid>1219062840</parentid> <timestamp>2024-04-15T14:38:04Z</timestamp> <contributor> <username>Asparagusus</username> <id>43603280</id> </contributor> <comment>Restored revision 1002250816 by [[Special:Contributions/Elli|Elli]] ([[User talk:Elli|talk]]): Unexplained redirect breaking</comment> <origin>1219062925</origin> <model>wikitext</model> <format>text/x-wiki</format> <text bytes="111" sha1="kmysdltgexdwkv2xsml3j44jb56dxvn" xml:space="preserve">#REDIRECT [[Computer accessibility]] {{rcat shell| {{R from move}} {{R from CamelCase}} {{R unprintworthy}} }}</text> <sha1>kmysdltgexdwkv2xsml3j44jb56dxvn</sha1> </revision> </page>

so all you need to do is get at the `text`.
by karmakaze | 2025-05-02 17:19:01+00:00
> According to reports, the woman asked ChatGPT to interpret the coffee grounds left in her cup — in a lighthearted attempt to mimic traditional fortune-telling. The AI responded, supposedly describing a young woman with the initial “E,” claiming the husband had strong feelings for her and that the relationship would soon become a reality.

ChatGPT is not to blame, they could have gone to a coffee-grounds (human) reader and done the same. If someone can show that human coffee-grounds readers are better than ChatGPT, then there might be a case.
by throwaway743 | 2025-05-02 17:19:51+00:00
Could you just get away with modifying something small, uploading the update, then revert the change, and reupload?

Either way, it's nonsense that they force this, especially for those who made an app however long ago and just uploaded and forgot about, or that version was the only one they intended to make. It's crazy how much Google gets away with bullying us.
by rconti | 2025-05-02 17:19:52+00:00
I very clearly remember my very first version of Slackware -- pre 3.0.0 (which I actually bought on cd for a few bucks). I don't remember that first version, just that I downloaded the floppy disk sets over zmodem at 14.4kbps (thankfully saving to hard disk, not to floppy).

That first version of Slackware I used had the Linux kernel 1.2.8; IIRC that series went to 1.2.13 before going through the a.out->ELF transition.

Anyway, original point, that Slackware distro of 1.2.8 had a bug where every single time I had to reinstall the bootloader for a newly-compiled Linux kernel (which I had to do regularly), LILO was broken and hung at the `LI` prompt... those who were there may remember, the number of letters of LILO: that were output gave a sign to the source of the error.

But every single time, I had to rescue boot, and try to remember what I had to fix to make LILO work again.
by dragonwriter | 2025-05-02 17:20:13+00:00
> Although I know the church has a lot of money, I can't imagine they dedicate a particularly large budget to the observatory compared to, say, a huge research university or a specialized scientific research project.

The VO has about the same share of the State of Vatican City's budget as NASA does of the US budget (but the Vatican Advanced Technology Telescope has a separate foundation, largely funded by private donations, that funded its construction and funds its ongoing maintenance, without going through the general Vatican City budget.)
by chunkmonke99 | 2025-05-02 17:20:26+00:00
Yeah I agree! I use GPTs (Gemini 2 series and o3 etc.) and they are excellent! But even they sometimes don't quite get the nuance of things or subtly misses the point! There are certain "meta-cognitive" limitations ... I would never bet against the AGI industry and I can only assume that these issues will eventually be solved after we build planets of computronium and force every word and thought any human ever utters to be recorded and trained on. But for now there remain some limitations.
by fjfaase | 2025-05-02 17:20:48+00:00
I did not read any mentioning of testing non-verbal IQ. Many math skills also depend on verbal IQ. Verbal IQ correlates strongly with academic performance and probably also with learning new programming languages. I personally have a much stronger non-verbal IQ than a verbal IQ. Often when I think about algorithms, it is all about abstract blocks moving around even before I have written a single line of code. I usually see multiple solutions in my head and often find myself being stuck because I cannot make a choice. I always takes some effort to code the solutions and weed out stupid bugs due to spelling errors mixing up varisbles, but then things work correctly.
by ivape | 2025-05-02 17:21:01+00:00
What do you mean by math? Abstractions or calculations? The effort it takes me to do long division in my head matches the effort it takes me to follow some obtuse spaghetti code. See, I can get good and fast at long division in my head, but I may never understand the fundamental theorem of calculus. Some people are really good at mucking around garbage code (they have no choice, they get paid to), but what part of programming did they get good at? Obviously, some part of it, but nothing to write home about. Whenever I sense that I'm just getting practice at doing the equivalent of mental long division at work, that's when I always seek a new job. No amount of money is worth falling behind like that.
by jghn | 2025-05-02 17:21:12+00:00
> CICO ignores the effects

It doesn't though, at the end of the day there's an objective amount of CI and an objective amount of CO. Further, CO isn't just "activities", for instance you burn calories merely by existing. Things you're describing will impact CI and CO, but at the end of the day if one had the ability to fully and 100% accurately measure CI & CO it'd be apparent that the math works.

But this is why "it's just CICO" is at best a tricky phrase. Because the hard part is in the nuance you describe.
8+ unique business ideas and 2 implementations and yet no investment offers?
by vitarnixofntrnt | 2025-05-02 17:21:21+00:00
I have:

1. Optical illusion internet captcha idea.

2. Some ICE engine cylinders smaller and deactivate larger ones for fuel efficiency, then activate all for power idea.

3. Magnetic suspension in semi trucks which wouldn’t add much weight to an already 12+ ton semi truck so that handling is improved and winds don’t blow the truck around idea.

4. Braking system that uses a massive amount of electricity to engage brakes electromagnetically, would have to design to not cause nearby electronics to power off idea.

5. A 6 Lines of Verilog Code 64-Bit Addressing BitBitJump CPU for a security focused, bug-free CPU under European Union Public License Version 1.2 or GPLv2 Only, not idea, actually implemented in Verilog. EUPLv1.2 Toolchain in development.

6. A FPGA Architecture that can get logic blocks to disable themselves individually or get neighboring logic blocks to disable themselves to work despite silicon defects. Under European Union Public License Version 1.2 or GPLv3 or later, not idea, actually implemented in Verilog. EUPLv1.2 Toolchain in development.

7. A gym that has a lot of long pool lanes with slightly cold water which starts shallow but becomes deeper, so that one can burn body fat pacing back and forth however deep they want to go.

8. Track cars drifting and wearing out their tires less with water being squirted out of water jets under the tires.

* Etc. (I’ll keep posting them on my ScaleUpstream Page by making new blog posts, it usually takes me around two weeks to come up with a new business idea.)

I keep being told that my ideas are not ready, that I need others to invest in me first before they consider investing in me (network effect), etc.

Not that they owe me anything, but it would be great if I could achieve my dream “job” of inventor that I picked in high school at some point.
by hshdhdhj4444 | 2025-05-02 17:21:22+00:00
So you don’t think it’s useful to learn that there are people who will indeed use ChatGPT as they would an Ouija board, or seance, or a fortune teller?

Because that is certainly news to me and is extremely counterintuitive, considering that the whole idea behind those other things is that they are infused with mystical spirits whereas even the makers of ChatGPT don’t suggest that.

Alternatively instead of mysticism, it may be the belief in the technology being scientifically accurate that including in its ability to scientifically accurately predict the future that may be driving this decision making.

If the latter that raises many questions around us technologists who are working on or with these technologies to do a better job of explaining to the users what the limitations of these technologies are.
by alabastervlog | 2025-05-02 17:21:48+00:00
25-year career as a programmer here.

I can count the times I've ever applied math past approximately high school algebra 1, on one hand. Period, in private life, in hobbies, at work. I'm not sure I've ever used any "college level" math, for anything at all.

I've, and other programmers I've known, gotten excited on the very few occasions anything even slightly mathematically-tricky came up, precisely because it almost never happens.
by butz | 2025-05-02 17:21:59+00:00
Very sad state of affairs on Play Store. Independent app developers are clearly not welcome there. I already pulled all my hobby apps from Play Store, just to sleep soundly at night without thinking how to pass yet another app review after update, when policies keep getting more ridiculous each time. To the point where one update finally was pushed to the store, and another got the same issue again. The biggest question is, how does one closes their Google Play Developer Account? There is no button in admin for that.
by pwm | 2025-05-02 17:22:21+00:00
Artificial | Full-time | Remote (Europe) | London | https://artificial.io/careers/

We are building the specialty (re)insurance landscape of the future. Our technology is revolutionising how brokers and carriers operate in complex markets.

Site Reliability Engineer: https://artificiallabsltd.teamtailor.com/jobs/5882832-site-r... (Fully remote)

Design Engineer: https://artificiallabsltd.teamtailor.com/jobs/5728149-design... (Fully remote)

Solutions Engineer: https://artificiallabsltd.teamtailor.com/jobs/5441617-soluti... (Hybrid Onsite)
by karmakaze | 2025-05-02 17:22:28+00:00
The other thing I don't like about this framing is the implicit false dichotomy. The best programmers I've met often have strong language and math skills.

Poetry is the art of giving different names to the same thing. Mathematics is the art of giving the same name to different things. (Henri Poincaré)

It's basically being good at "naming things", in particular abstractions.
by qwerty456127 | 2025-05-02 17:22:43+00:00
This depends on whether you want to exchange data with other computers using even removable media, let alone the Internet. Also whether you want to use Unicode. In case you only want to hand-type, edit and print a plain English paper right away by dumping plaintext/PostScript/PCL to LPT you probably are fine with any computer you can find. It's just nobody is using standalone computers anymore, almost every modern computer is a network device.
by alephnerd | 2025-05-02 17:23:01+00:00
> How different would you say rural JK/HP/LA/UK is?

Rural UK is much poorer than rural HP and JK.

The administrative structure of UK is very top heavy (everything is decided in Dehradun), and Dehradun+Haridwar have caused tourism and real estate induced Dutch Disease to arise. JK and HP also have a tourism economy, but also have a strong industrial base (pharma in HP, heavy industry in JK) plus more investment in higher value rural industries like food processing and fruit cultivation.

HP and JK also have a bottom up political culture with panchayats in a district coalescing into District Planning Committee that includes state civil service cadre and the MLA, so local governance is much more responsive, and has the resources and capacity to invest in infra like cold storage or make the case for an MNC to invest in manufacturing.

Basically, if local government and administration is actually given priority beyond haphazard panchayats, it makes it easier to attract build industries and a semi-industrial rural economy.

> Kerala, CG and Odisha have better rural administration than MH, TL or KA because of the absence of heavyweight cities.

Political culture is also more top-down in states like MH/TG/KA, where the CM office tends to have inordinate control over local planning and panchayat+local government funding is minimal

Even if their administrations had some interest in rural economic development (which in those states they don't), they wouldn't even have the bandwidth because there are too many districts. This is why local government needs to be invested in by states, but locals are the ones who know best about their needs and capabilities.
by snovv_crash | 2025-05-02 17:23:13+00:00
Some people can do macro tracking, others don't have the discipline for it. For those people, shifting to foods with a higher satiety to calorie ratio is a better strategy, or intermittent fasting, or cutting out a food group. As you said, what matters is CICO, not how you achieve it.

I like to compare it to programming. If you tell a C++ developer that their software should have good uptime, your advice here is the equivalent of saying "don't have memory leaks, null pointer dereferces or use-after-free". Yes, all true, but everyone know that. What we need are behaviour patterns like RAII, an extensive test suite, running those tests in valgrind/ASAN, etc. that actually help in a forward looking perspective achieve this goal of not making those mistakes which lead to poor performance.
by yesterdayjones | 2025-05-02 17:23:20+00:00
AGPL: Uselessly open-source. Anyone who wants to make money with it, even if it's just one of many components in your tech stack, would have to open-source everything. This drives people to adopt the paid versions of the same software over the open-source version, and that's no doubt the point. Adopting the AGPL is a cold, calculated move.
by Nevermark | 2025-05-02 17:24:03+00:00
We don't need an end to capitalism.

Just an end to capitalism that perversely carves out an exception to normal reciprocal arrangements for using other people's property, for one of the most important categories of property: universally owned property. I.e. the environment.

Today, the value of our joint inherited environment has no systematic representation. The default is, do your damage until it is significant enough, and some white knight politicians, finally try to limit the damage with one-off narrow per-case idiosyncratic limits.

No wonder protecting the environment is near impossible. Legally and politically, our systems are tilted far into the direction of non-protection. Ignoring the literal reality of joint inheritance, and ignoring the tremendous value being mismanaged.

The default should be: reciprocal agreements in the form of cap and trade for all public asset impact. Most especially the environment. Exactly as it is required for impact anyone wants to have on another owners private property.

Then the legal and political default would be to protect the value of joint assets, and maximize the value back to the public of their use.

Then all the wonderful magic of capitalism, for optimizing the value of resources, would work for the environment.

This even creates an avenue for some universal income. We all should be paid for use of the non-human created, jointly inherited asset: the environment.

Instead of the default being endless over pollution of CO2, plastics, etc., the default would be all entities pay for what they use, and pay even more for what they use that requires fund for offsetting the damage. Suddenly capitalism and the environment work.

And we all get and dividend, reflecting our jointly inherited asset, on its use.

Value which will go up for everyone as the economy grows, without any form of wealth redistribution.

The numbers of top tier problems this would contribute solutions or partial solutions to, is considerable.
Ask HN: If AI is good, why can't Gmail stop the following blatant spammer?
by selfhoster | 2025-05-02 17:24:11+00:00
I get one or two of these a day at my selfhosted account. It's McAfee (which is funny, I'm Ubuntu Desktop), Norton something, Microsoft Office, etc. They always come in from random Gmail accounts. I've individually reported dozens of these the past year or two to Google, using their web form, that their abuse email response requires to be used.

Does Google not care people use their account system to spam people at other domains? If their AI is good, seems like they could filter these before they get sent, perhaps even detect abuse patterns of the abusers?

These all have a very similar format. I don't use SpamAssassin but I may have to go back to using it, to see if it can reject these emails.

-----snippet---------------

Dear Customer [redacted, my name],

We’ve received your payment of USD 357.25. Thank you for choosing Microsoft Office.

Your order has been processed successfully, and we’ve begun debiting the amount. It will be posted to your account within 24 hours.

To cancel your reservation, contact our support team at [redacted, likely the spammer's phone No.].

Please remember: Once placed, reservations are final and cannot be edited. We’re here to help with any concerns.

Subscription Details: Product Code: 7610634-460 Product/Service: InsightScan Security Services Email on File: [redacted, my email] Total Amount: USD 357.25

Best Regards, Microsoft Office Billing Team [redacted, likely the spammer's phone No.]

-----end snippet---------------
Show HN: AI code review now available on Azure DevOps
by edvaldodfreitas | 2025-05-02 17:24:32+00:00
Hey everyone,

Just wanted to share a quick update we just launched at Kodus.

For those who don’t know it yet, Kodus is a code review agent that runs directly in your team’s Git workflow (GitHub, GitLab, Bitbucket… and now Azure DevOps as well). It helps maintain code quality and consistency by analyzing each PR based on your team’s own rules and repository standards.

Support for Azure had been a common request — so if your team uses it, you can now plug Kodus right into your workflow and give it a try.

Docs: https://docs.kodus.io/how_to_use/en/overview Repo: https://github.com/kodustech/kodus-ai

We’re constantly improving the tool, so any feedback, suggestions, or criticism would be super helpful!
by scripturial | 2025-05-02 17:24:52+00:00
> There is no such thing as a "language brain" or a "math brain"

Tell that to the people who designed the study, the people that approved the study, and the people that funded the study.

At the end of the day, the study set out certain criteria for assessing certain skill types/competencies and divided the people by those well defined criteria. I think it’s pretty hard to argue against the idea that people might have at least some level of aptitude for different types of activity and skill.
by buffalobuffalo | 2025-05-02 17:24:54+00:00
Yeah, the brain is a sparse MoE. There is a lot of overlap in the hardware of the "language brain" and the "math brain". That being said, I can discuss software concepts in a foreign language, but struggle with basic arithmetic in anything but English. So while the hardware might be the same, the virtualization layer that sits on top might have some kind of compartmentalization.
by oriel | 2025-05-02 17:25:06+00:00
I did something like this, in a much more limited form, when putting together my personal site a few weeks ago. https://1ps0.info/

I had a friend try to run 'sudo shutdown -r now'. It inspired a much more thorough approach to the terminal functionality, but I didnt want to rabbit hole too far.

As it stands, initially it was a cyberpunk theme but i wanted a vscode-like professional theme as default, so you can toggle between them through cli. Lots of fun to be had with eastereggs.
by jcynix | 2025-05-02 17:25:13+00:00
If your wife isn't happy to see you fencing (which I can understand) you might want to take a look at archery instead? And add this book (which impressed me during my teenage years) to your reading list:

Zen in the Art of Archery - Wikipedia https://en.m.wikipedia.org/wiki/Zen_in_the_Art_of_Archery
by janalsncm | 2025-05-02 17:25:17+00:00
> language ability and problem solving skills

First red flag is here. The title rewrote this to be language only. That problem solving skills are relevant is pretty obvious, but language less so.

I’ve been programming for most of my life and I don’t consider myself a very good speaker. My language skills are passable. And learning new languages? Forget it. So I’m skeptical. Let’s look at the study.

First of all, “math” becomes “numeracy”. But I think programming is probably closer to algebra, but even then it’s less strict and easier to debug.

> Assessed using a Rasch-Based Nuemracy Scale which was created by evaluating 18 numeracy questions across multiple measures and determining the 8 most predictive items.

Also, the whole thing is 5 years old now.
by dserban | 2025-05-02 17:26:45+00:00
I'm not sure if I should be applying but before I do, I'm wondering what kind of novel or interesting data driven algorithms you refer to here. Are you referring to like adaptive query planners based on runtime statistics? Real-time detection of query latency spikes? Automated creation of secondary indexes based on usage patterns? Statistical smarts to decide what to cache and when? These would be sort of runofthemill for any modern database product, can you clarify if you are looking for any of these?
by invalidroot | 2025-05-02 17:27:22+00:00
Nice writeup! This is the second post I've seen in the genre of "I've had a secret, personal benchmark for LLMs where the 'solution' requires questioning the premises, and o4-mini-high beats it." The first post I saw was about a chessboard and the prompt "mate in one:" https://x.com/KelseyTuoc/status/1912945346126417940

(Edited to remove direct spoiler for the MU-puzzle, in case people want to try it.)
by PaulHoule | 2025-05-02 17:27:24+00:00
It's like how Triplebyte paid off half of the tech bloggers to write blog posts with the title "hiring is broken" until Triplebyte went out of business. (Spammed too much? Nobody wants to work with them anymore?) Or whoever it was that was splogging about how you shouldn't use JSON Web Tokens.

Trouble with "billing is edge case hell" is that if you code up your own billing solution you can 100% make it behave the way you want it to behave even if it is "hell". Buy some solution from a fly by night vendor who splogs and you might find the answer is "you can't get here from there" unless you code it up yourself or find a more reliable vendor.