skysight-inc/HackerNews huggingface dataset:
I think it's very easy to disagree with!

If Zuckerberg had his way, mobile device OSes would let Meta ingest microphone and GPS data 24/7 (just like much of the general public already thinks they do because of the effectiveness of the other sorts of tracking they are able to do).

There are certainly legit innovations that haven't shipped because gatekeepers don't allow them. But there've been lots of harmful "innovations" blocked, too.
Praising is good. Gratitude is a bit much. They got this big by selling user generated content and private info to the highest bidder. Often through questionable means.

Also, the underdog always touts Open Source and standards, so it’s good to remain skeptical when/if tables turn.
> Does annotating `main` with no_panic do the trick?

I've never tried that, so maybe :-)

> How much does that tend to affect compile times, do you know?

IME, not very much -- there might be a small amount of overhead, but the "trick" behind the check is to fail the linker with a symbol error if the panic code is inserted into a function. So the compiler itself should be roughly as fast, and the error path in the linker is really the only thing that should change too much.
IMO in 20 years we’ll be discussing new classes of problems arising from the abstraction methodologies inherent in languages like Rust, Swift etc.
Your analogy is flawed. This isn't testing someone's house. This is buying the locks that are on people's houses and testing them in your own location. Which people should absolutely be doing.
Was a really fun article to read/podcast to listen to.

Favorite fact is that 127 is the DEL because for hole punching it removes all the info. I love those little nuggets of history
Yeah, 12th gen is probably still available.
> $1mil in stock for 4 years

Those are just golden handcuffs! How many of the hired employees get to complete the vesting period?
FTC launches probe into 'surveillance pricing'
Political machines did deliver tangible benefits to their constituents through what could be described as vote buying. In Daley's Chicago, if you there was a pothole on your street or your cousin who was new to the country needed a job, you could go to your alderman who would solve the problem for you. In return you were supposed to vote for the party and get everyone you knew to vote for the party.

This worked as long as the machine was unquestioned and there were contractors willing to play ball to finance the whole thing. Now as a series of court decisions limiting the spoils system and incompetent successors have weakened the system, the mayor's approval rating is half of what it once was and overall confidence in the city is much lower. And the city's finances are about as bad as they can get today. So I wouldn't call it socialism and I wouldn't even say that it's worse than the alternatives.
"You make a good point but those are also just limitations of the technology (or at least our current understanding of it)"

Yeah, that is my point. Things that don't have source code can't be open source.

"Maybe an analogy would help. A family spent generations breeding the perfect apple tree and they decided to “open source” it. What would open sourcing look like?"

I think we need to be weary of dilemmas without solutions here. For example, let's think about another analogy: I was in a car accident last week. How can I open source my car accident?

I don't think all, or even most things, are actually "open sourcable". ML models could be open sourced, but it would require a lot of work to interpret the models and generate the source code from them.
> ... adult/gambling ...

Interested. Tell me more.
That's a really informed comment from both sides of the exact fence.

>there's either failure or a big payout that dwarfs the FAANG salary.

Tech or not I think it usually doesn't dwarf anything but if it comes close, a little bit low or high, that's a huge milestone above failure.

In that case it might allow you to maintain readiness for an incredible bonanza which might be within reach only from beyond that point, and that can be what dwarfs the "big payout".

IOW depending on the situation, occasional big payouts that really just even things out may not be very life-changing even if they are big, but it can give you more rolls of the dice at things that can't be approached any other way.
because it is extremely challenging to capture the additional value that is being produced by better weather forecasts and generally the forecasts we have right now are pretty good.

private capital is absolutely the driving force for the vast majority of innovations since the beginning of the 20th century. public capital may be involved, but it is dwarfed by private capital markets.
> If anything, allocate compute to citizens.

If something like this were to become a reality, I could see something like "CitizenCloud" where once you prove that you are a US Citizen (or green card holder or some other requirement), you can then be allocated a number of credits every month for running workloads on the "CitizenCloud". Everyone would get a baseline amount, from there if you can prove you are a researcher or own a business related to AI then you can get more credits.
I miss the cultural era that was enthusiastic about economic growth. Most stories I see on HN, and other places, now react with reflexive condemnation of any kind of human industry. I worry about where this zeitgeist will lead us.
AI moderators too would be an enormous boon if they could get that right.
I appreciate the article because it has useful information that might help people, but it doesn't feel like it's in the spirit of "ShowHN" [1] because the link is only something to read. There's nothing for HN'ers to "play with."

Usually a regular submission is the best way to show HN an article or other resource. Thanks again.

[1] https://news.ycombinator.com/showhn.html
I added a few items, to those bingo cards. They are now nearly complete :)

- CEO mentions "nation-state actors"
- Someone's Zoom background is amusing
- Someone holds up a "Buy Bitcoin" sign
- "We take this very seriously"
- "working with our partners in industry"
- "remediate"
- "Security is our top priority"
- "Our customer's security is our top priority"
- Congressman mispronounces "CrowdStrike"
- Congressman twice mispronounces "CrowdStrike"
- Different Congressman mispronounces "CrowdStrike"
- Different Congressman mispronounces "CrowdStrike". Twice
- Reference to SolarWinds hack
- Reference to McAfee incident
- "Critical infrastructure" is emphasized
- Technical glitch during the hearing
- "Critical infrastructure" down during the hearing
- "Zero-day vulnerability" mentioned
- "Zero-day vulnerability" exploited during hearing
- "Zero-day vulnerability" exploited *at* hearing
- Mention of recent ransomware attacks
- "Cyber hygiene"
- Senator says "back in my day..."
- CEO says "back in my McAfee days..."
- CEO smiles awkwardly
- "Collaboration with federal agencies"
- "Collaboration with federal agencies and partners in industry"
- Phone rings on live stream
- Phone rings on live stream and is exploited
- "Layered security approach"
- Reference to a previous attack
- New reference to McAfee incident
- Reference to McAffee incident and how "it would not have affected Crowdstrike Falcon users" by CEO
- Wi-Fi connection issues
- "Bad actors"
- Wi-Fi connection issue due to "Bad actors"
- "Multi-factor authentication"
- Kurtz corrects a technical detail
- Kurtz wrongly corrects a technical detail
- Kurtz twice wrongly corrects a technical detail
- "Cybersecurity workforce shortage"
- Senator asks unrelated question
- Kurtz gives unrelated answer
- Kurtz unknowingly gives unrelated answer
- Kurtz unknowingly gives unrelated answer which happens to be right
- "Threat landscape"
- Mention of a fictional hacker movie
- CEO avoids direct answer

Bonus Square: CEO drinks water
Free Space: Any participant says "cyber"
Bonus Point: Someone mentions Edward Snowden
Extra Credit: "We need more funding for cybersecurity"
Postgres looks eventually consistent (from the client)
Many yes/no attributes: table design study
Sure, if you have a H100 cluster. If you quant it to int4 you might get away with using only 4 H100 GPUs!
I wouldn't call it enormous. Some datacenters run dry cooling. A large datacenter (100MW) that uses evaporative cooling probably uses ~1000 acre-ft/yr, on par with a medium farm.
letsencrypt is the nonprofit community-focused infrastruture that we imagined the internet would consist of 20 years ago. I love you letsencrypt.
Correct me if I'm wrong, my impression is that 3.1 is a better fine-tuned variant of base 3.0 with extensive use of synthetic data.
It's in the <7B club, but Phi has always had a good dose of synthetic data https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
The biggest painpoints for me are discovery, and access. It can be really difficult to find papers on the topic I am researching, and often getting access to the papers I find is hard.
Ireland's energy isn't particularly green, compared to nearby countries.

The UK, Netherlands, Belgium, France, Spain and Portugal all have lower carbon emissions from CO₂.

https://app.electricitymaps.com/zone/IE (set to "Yearly" view).

Ireland only stopped burning peat for electricity last year!
Do sharks not have any way to metabolize or pass these things? Usually bioaccumulation refers to things that STAY in an organism. For example, vitamin c does not bioaccumulate. Microplastics do.
It is notable, but it's not alone. Mistral NeMo just released last week with a 128k context window:

https://news.ycombinator.com/item?id=40996058
> the kind of job where you need security clearance and a full background check

That's like saying "a tech job". Most jobs that require those things pay poorly. Big defense contractors like Northrop Grumman, Raytheon, etc. pay worse than most tech companies. I have over a dozen friends in defense (I used to work for a defense contractor) and none earn comparably to big tech. It's not a matter of clearance, to be clear - most of those dozen have TS/SCI and had to go through a full polygraph.

Unless you meant working directly for the government, not a contractor. That would put you on the GS payscale, which does not have carveouts for SWEs, meaning it won't pay as well as any private developer role.
The "open source" part sounds nice, though we all know there's nothing particularly open about the models (or their weights). The barriers to entry remain the same - huge upfront investments to train your own, and steep ongoing costs for "inference".

Is the vision here to treat LLM-based AI as a "public good", akin to a utility provider in a civilized country (taxpayer funded, govt maintained, non-for-profit)?

I think we could arguably call this "open source" when all the infra blueprints, scripts and configs are freely available for anyone to try and duplicate the state-of-the-art (resource and grokking requirements nonwithstanding)
Foldable iPhone is coming in 2026 with top-down fold design
What is the real motivation for RTO?
- risk averseness of management
- need for control/power over employees
- push some folks out without needing a layoff
- management knows that RTO is better for companies despite lack of public data
- external force from real estate owners/ city governments
If pygamelib interests you, you might also be interested in Pyxel:

https://github.com/kitao/pyxel
There's no need for this.

Buy name-brand storage from reputable sellers.

Of course the fantastically cheap stuff on Alibaba is fake. You don't even have to check.
If you have the ram for it.

Ollama will offload as many layers as it can to the gpu then the rest will run on the cpu/ram.
Feels a bit like you are splitting hair for the pleasure of semantic arguments to be honest.
Yes there are no source in ML, so if we want to be pedantic it shouldn't be called open source. But what really matters in the open source movement is that we are able to take a program built by someone and modify it to do whatever we want with it, without having to ask someone for permission or get scrutinized or have to pay someone.

The same applies here, you can take those models and modify them to do whatever you want (provided you know how to train ML models), without having to ask for permission, get scrutinized or pay someone.

I personally think using the term open source is fine, as it conveys the intent correctly, even if, yes, weights are not sources you can read with your eyes.
Sounds great. Except that as a company, you can now only deliver services to this government. No products, since you will lose your competitive advantage. This is a big disadvantage for for instance startups that target this market.
strange: on MacOS 14.5 I get output for `man ascii` but `ascii` goes "command not found"
I don't think the EU has any expectations that Meta makes any money. That's for Meta to figure out. The EU is regulating the market and protecting European Citizens's rights, which is part of its mandate.
Other languages may handle it differently, but having to manage threads is not a small compromise for going colorless. You're now forced to deal with thread creation, thread pooling, complexities of nested threads, crashes within child or descendant threads, risks of shared state, more difficult unit testing, etc.
Exactly. Furthermore, the fine article mentions 21% going to datacenters (of which, which fraction might be off-shoreable anyway?), and 18% to homes.

Okay, that leaves 61% going to what?

Which other industry uses have been going up or down? Then compounded by "If we already had lots of wind and lots of solar, it wouldn’t be a problem", which, as far as datacenters go probably misses the need for storage.

What this is seems more of a meme article, linking presumably evil datacenters, with climate change, with "policy of low corporate taxation."
Open source "AI" is a proxy for democratising and making (much) more widely useful the goodies of high performance computing (HPC).

The HPC domain (data and compute intensive applications that typically need vector, parallel or other such architectures) have been around for the longest time, but confined to academic / government tasks.

LLM's with their famous "matrix multiply" at their very core are basically demolishing an ossified frontier where a few commercial entities (Intel, Microsoft, Apple, Google, Samsung etc) have defined for decades what computing looks like for most people.

Assuming that the genie is out of the bottle, the question is: what is the shape of end-user devices that are optimally designed to use compute intensive open source algorithms? The "AI PC" is already a marketing gimmick, but could it be that Linux desktops and smartphones will suddenly be "ΑΙ natives"?

For sure its a transformational period and the landscape T+10 yrs could be drastically different...
Ok but why is there a tomato?
> No one is going to come after you for not changing the oil on your truck

Several parties will come after you for not changing the oil on your semi-truck that is being used professionally for freight,
starting with your driver, your insurance company, and the US Department of Transportation (DOT), specifically the Federal Motor Carrier Safety Administration (FMCSA), with whom you have m have to provide maintenance records. Trucking is a highly regulated industry, and after Crowdstrike, software engineering is only going to get more regulated, not less.
RAG architecture for SaaS – Learnings from building an AI code assistant
> The above are all things that could (and sould!) be done to reduce the chances of a misbehavior happening, but we must accept that the code bug was just the specific trigger this time around and a different trigger could have had similarly nefarious consequences. The root cause behind the outage lies in the process to get the configuration change shipped to the world.

> Now, SRE 101 (or DevOps or whatever you want to call it) says that configuration changes must be staged for slow and controlled deployment, and validated at every step. Those changes should first be validated in a very small scale before being pushed to the world later on, and every push should be incremental.

Unfortunately, the article is sort of burying the lede until half-way through until it makes some decent points.

We should be using safer languages, but also 1) how is it possible that CrowdStrike can push a content update globally to all clients with no option for their customers to delay it for testing and 2) why doesn't CrowdStrike have internal testing before deployment?
>> moving these emissions out of Ireland so Ireland can reach it's targets doesn't help if those emissions mearly happen elsewhere

They aren't being moved out. This is basic market forces, negotiation between provider and consumer. Ireland would be perfectly happy to host these datacenters should they be carbon neutral, perhaps by constructing their own green energy support system. The datacenters don't want to do that. They want cheap electricity. They want to be simple electricity consumers and thereby outsource any emissions issues to the local grid. Ireland has chosen not to take on that burden. If another country is willing, then so be it. Nobody should engage in a race-to-the-bottom on emissions. If these datacenters want to be in Ireland, they are free to foot the bill.
Great example of how LLMs are eliminating/simplifying giant swathes of complex tech.

I would love to use this in a project if it could also caption embedded images to produce something for RAG...
I changed my Facebook country (to Canada), using also a VPN to Canada, but that didn't help. That used to work before somehow.
My 6 years with Rust – low-level retrospective
Overall government doing anything is a bad idea. There are cases however where government is the only entity that can do certain things. These are things that involve military, law enforcement etc. Outside of this we should rely on private industry and for-profit industry as much as possible.
I miss that era too. But the shift isn’t purely cultural: it’s an acknowledgement of the underlying reality that climate change is getting to be real bad. I worry about where a growth-at-all-costs mindset has lead us at least as much.
There's several second and nth-order effects that seem crucial to our understanding.

Every seller has a buyer. Who would be buying these liquidated stocks?

What would the estimated new equilibrium be? What would be the effects of this equilibrium compared to the current state? Can we estimate the pros and cons?

Conversely, holding the belief that stock prices are crucial to our betterment, wouldn't that imply that we would be better off if stock prices were higher due to more wealthy people owning stock and fewer non-wealthy people owning stocks? At face value that doesn't sound right, so I must be getting something wrong.
The corporations that funded this fraud got what they wanted (at that point in time, when the FCC sided with them in policy) and were not punished with even so much as a fine.

It's a very interesting example, to me: the telecom companies set up an arms-length arrangement with the criming entities, the "social media consultants", such that if the fraud were caught (and it was), the people who benefited from the crime, and intended for the crime to happen, could plausibly plead ignorance. US law apparently has no good solution to this type of "wink-and-nod" white-collar crime.
I think that is a fundamental Gap between different people talking about this. The most upvoted response to this article was an argument that this isn't a real test of Ubi because 12K a year is a trivial amount and not enough to see results. Also keep in mind that this 12K was in addition to existing welfare programs, and most Ubi proponents argue that it would replace welfare
Henry Ford did something similar with a beautiful English cottage from the early 1600s.

> In 1929, Henry purchased the property for $5,000 and immediately hired a team of local builders to restore the structures to more accurately reflect the era in which they were built. Upon completion, the workers dismantled them stone by stone, numbering each one individually and packing them in gravel sacks that were transported to the United States via train and boat.

https://victoriamag.com/touch-england-cotswold-cottage/
Nuclear being illegal in Ireland doesn't help.
It works the same as industrial capacity for things like planes or artillery shells. Once you ramp up production you can produce lots very quickly, the US produced 70,000 between 1945 and 1990, averaging 30 per week with a peak rate around 54 per week; but building out the factories to ramp up takes a long time - for the first 10 years the US averaged 6 per week. Most of the US's nuclear production capacity was dismantled. With WW2 levels of hustle and disregard for safety, we could probably build new facilities in around a year or two. These efforts would be pulling resources from attempts to ramp up production of other wartime necessities. Also you don't just need to build the nukes, you also need to build adequate delivery systems, which are all advanced aerospace manufacturing.

If you eliminate your arsenal and then decide later you want it back, you're giving adversaries a lot of time to beat you to the punch, all the while advertising that you are pursuing nuclear as opposed to conventional weapons to fight your war.
Well done!

It's really nice to have expandable details and links for each entry.
> If you are turned down for a job

If you don’t take a job that would pay more you are also hurting your income opportunities. Turning a job down because of some hypothetical problem at some future date isn’t rational imo.

If you genuinely believe certain industries would hurt your future job prospects, you need to quantify the risk. And I have a hard time believing the particular industry would matter at all to an employer. If you can build CRUD apps for a gambling company you can build CRUD apps for a pediatric cancer charity.
Governments ought to incentivize efficient datacenter workloads, the same way they're incentivizing heat pumps over resistive heat. If they can give people tax credits for having efficient homes, they can give maintainers of large-scale software something in exchange for optimizing that software. I bet some very large percentage of data center electricity usage is directly attributable to absolute bloat, like VMs that could be containers, build pipelines that chug away endlessly producing nearly identical build artifacts every time, dumb polling that could utilize a smarter message queue push, neural nets that could be if statements, etc. -- where is the "LEED Gold" of software?
If anyone has an interest in Irish mythology and data centers, I'd highly recommend a listen of the Blindboy podcast's hot take on it:

https://podcasts.apple.com/gb/podcast/rivers-lakes-and-data-...
Maybe a stretch - but this reminds me of blood sugar regulation for people with type 1 diabetes.

Too low is dangerous because you lose rational thought, and the ability to maintain consciousness or self-recover. However, despite not having the immediate dangers of being low, having high blood sugar over time is the condition which causes long-term organ damage.
Ireland live electrical generation https://www.eirgrid.ie/grid/real-time-system-information
That's the kind of work that can come out of academia and open source communities when societies provide the resources required.
Cocaine Sharknado II: Shart Week
> When I modify source code, I might make a change, check what that does, change the same functionality again, check the new change, etc... up to maybe a couple dozen times.

You can modify individual neurons if you are so inclined. That's what Anthropic have done with the Claude family of models [1]. You cannot do that using any closed model. So "Open Weights" looks very much like "Open Source".

Techniques for introspection of weights are very primitive, but i do think new techniques will be developed, or even new architectures which will make it much easier.

[1] https://www.anthropic.com/news/mapping-mind-language-model