skysight-inc/HackerNews huggingface dataset:
This is offset by wages being 2-3x (or even more) higher in professional fields. Lower income tax generally as well, so US professionals take home much greater pay in lieu of more holidays.
Thanks! You're right. It's in our bucket list.
Which one are you referring to? A lot happened last week in the SCOTUS, and I haven't heard of this specific concern.
I think it is a reasonable decision https://discourse.joplinapp.org/t/crowdfunding-joplin-server...
First off, I think all of us have learned the unfortunate downsides to a libertarian approach to free speech over the past 20 years. Any free speech purist would do well to remember what their legal recourse would be if somebody made elaborate false-allegations about you that harmed your career and marriage - we have many legal tools that protect us from harmful lies. It is not remarkable that there are people who believe in "free speech" but do not consider disinformation about more nebulous bodies that don't have standing for a lawsuit (eg defaming vaccines in general, epidemiology, democracy, ethnicity, climate science, trans people, etc) to be something that should fall under that protection, any more than threats or perjury fall under that protection.

Why is it actionable when you make dangerous public lies that hurt somebody's pocketbook, but not public health?

Secondly, the US constitution says "shall make no law". What law was made here? What legal action was taken? There wasn't even a threat of legal action.

Government workers should be free to contact private organizations and speak to them freely and make requests of them. "The government would like this content taken down for public good" is not making a law, it's making a request. It's making their opinion known, and government functionaries are allowed to have professional opinions. Something like "In my professional opinion as a public health worker, this content is dangerous advice that will get people killed, and in the interest of public safety it would be best if readers were protected from it." That is a reasonable thing for a government-employed professional to do and say.

That said, I think they crossed the line here when it became a demand instead of a request. When the government starts ordering people around instead of just making the public interest known, it can easily be argued there's implied threats there.

IANAL, but I'm assuming in the end that's where this will land during the appeals - that sweeping injunctions against various government bodies communicating with social media companies will be lifted, but the court will find against the government on this case.
This analogy is a bit tortured but it's honestly pretty good anecdata that something probably doesn't generally kill you if you've been around people doing it for 15 years and none of them have died yet. It can kill you, but that doesn't mean it generally does.

I'd love to come to the conclusion that it's wrong, but it's right. Most companies absolutely 100% can afford to ship bugs: the proof? They're doing it, they have been doing it, they will continue to do it. That doesn't mean that every company can, always, forever. A single really bad bug can tank a company. In the right conditions, simply being buggier to a superior competitor can tank a company. However, those are mostly just things developers fantasize about. The market is by and large not decided by how elegant and well-designed your software is, moreso in some verticals than others. In fact, this is basically true for almost anything that isn't explicitly developer oriented in the first place.

Just look at enterprise software. Jesus Christ.
It should have been "going under due to bugs / low quality and slow delivery".
https://gregreda.com/

I've mostly written technical, code-centric posts on Python, ML, and data science. Some of my early posts (2013) were wildly popular at the time and hit the top of HN and various subreddits.

I haven't written much recently, but I've been trying to branch outside of technical posts as I felt like my profession had started to become too much of my identity.

The post I'm most proud of:

- https://gregreda.com/2022/11/30/this-ones-for-me/ - Feeling pride and catharsis after years of bad health luck (leukemia, bad bike crash, cardiac arrest).

My most popular posts:

- https://gregreda.com/2013/03/03/web-scraping-101-with-python... - Web scraping tutorial using Python and beautifulsoup

- http://www.gregreda.com/2015/02/15/web-scraping-finding-the-... - Another web scraping tutorial with Python, but this time for sites that dynamically load content

- https://gregreda.com/2013/10/26/intro-to-pandas-data-structu... - The start of a series of posts on Python's pandas library

- https://gregreda.com/2013/07/15/unix-commands-for-data-scien... - Some useful unix commands for data processing

- https://gregreda.com/2015/08/23/cohort-analysis-with-python/ - Tutorial on doing cohort analysis using Python and pandas

- https://gregreda.com/2017/01/07/freelance-data-science-exper... - My experience as a freelance data scientist

- https://gregreda.com/2018/02/04/hiring-data-scientists/ - My approach to hiring data scientists (though my thoughts on this have evolved over the last five years).
And some people not in the US forget sometimes how BIG the US is. Additionally, a lot of our holidays have tradition and ritual associated with them. My favorite day of the year is a family event the 3rd Saturday of December (just pre xmas).
In my view, every software product has two parts: the product, and the artificial scarcity. Rarely is the later simply a paywall anymore, as in the metaphor. Instead, business school graduates are tasked with finding every angle to make a profit, from injecting ads, to building a marketplace, to selling surveillance data for profit, and a thousand other schemes. In reality there is a combinatorial explosion of profit schemes, since they sometimes are only viable in brittle combinations. (As engineers we often see this on the front end when an iframe loads a script which pulls a script from somewhere which rewrites the page, and so on. This is where the rubber meets the road, and the tech reflects the complexity of the deals.) The net result for the user may not be a paywall, but a slower, less responsive, more brittle product. For the eng team, it feels like coding in molasses.
So how long until we start spraying the atmosphere?
http://mbutler.org/ - Intermedia Systems. Art projects, thought experiments, proofs-of-concept.
They use perplexity on github data to demonstrate the effectiveness of their model.

I suspect github data has a lot of copy pasted code. Ie. a good chunk of what you are asking the model to do is to go back X million tokens and copy a chunk verbatim.

Sure, the model might also be looking back at some code X million tokens ago and using that to improve its guess of the next token (oh look, the API definition of the API I am using is back here, that'll help me get this right!).

But the perplexity number alone doesn't differentiate those cases - and considering how much code copying/templating happens in software, I suspect that affects the perplexity a lot more than smartly using stuff from the context window.

I wonder if these models work well on other kinds of data?
What prevented documenting and publishing public acts in the past?

Merely an infeasibility to scale that with economically and socially reasonable levels of effort - actually an impossibility. The law and culture have not changed fast enough to keep up with obvious conclusions that result from the fast pace of technological change. There is a quantitative but not qualitative difference, but that's still an important difference!

For example, imagine that in the 70s, you might have had police officers with radios sitting on the shoulders of roads around a city, watching for a license plate and vehicle description to catch a suspect. That was reasonable, courts reasonably ruled that license plates were public information, that's the whole point of vehicle registration. But it would cost a pile of money to have professional humans use their eyes and brains for every hour you wanted to surveil those roads. It would have been impossible for humans to manually hand-write every plate and vehicle at rush hour, and if they could, it would be impossible for clerks to cross-reference traffic logs and store them in file cabinets, and if they could, it would be impossible to analyze the exploding warehouse of records to find anything of interest. And even if you could, the many humans in that chain would ask questions; you'd employ a tenth of the town to surveil their neighbors. But now, for less than it costs to have a single manned police cruiser on the road for a month, you can have 24/7/365 license plate monitoring on every road in and out of and through a city, logging events to a database that can analyze and query the computationally insignificant few hundred thousand results effortlessly. And that doesn't even get into the novel, unexpected, deanonymizing things you can do once you have reams of data!

A cop watching license plates was implicitly limited due to the cost of employing a human, that human's inability to be two places at once, that human's limited attention span, sensory capacity, and data recording abilities. It doesn't mean that removing those limitations and doing the same thing everywhere and all the time with omnipresent, omniscient, effortless nanobot surveillance is reasonable!
If you want a total order over a bunch of events, you don’t need vector clocks. A simple sequence number that everyone increments is usually enough. (Eg each event has max(seen)+1 and tie break on content or agent id or something).

Vector clocks are valuable precisely because you can tell when concurrent events occur. Eg [1,2] and [2,1] are concurrent but [1,2] and [2,2] are ordered. You need this info for things like MVRegister CRDTs.
Not an expert in East Asian languages, but GPT tokenizers are generally byte-based. Meaning that the basic unit to do the merges is a single byte, not a character.
A Tour Around Buck2, Meta's New Build System
At the time I used Paperspace shadow was in some kind of limbo, not accepting new customers-- I'm not sure if pre-existing ones were still able to use the service.

Also Paperspace would let you choose how much GPU you needed, which seemed like a nice way to conserve costs if you were playing low-overhead games, some indies or older games, though I never used it as such.
Sounds like a good deal!
I think I'd prefer for (some of) the states in the US to make it illegal to work on Sundays (with the obvious exceptions of medical care and emergency services) like we used to have in the West for many centuries in a row (except this time justify it as the voter's will, not God's will). Also make it illegal to make noise a la mowing the lawn on Sunday like Germany does.
Wow, I thought people stopped using Evernote in like 2017
I understand the pessimism especially in regards to human-marine relations, but I can't see droves of tourists being shipped out to witness something happening deep underwater.
As European, it's insane to me that American get so little time off. In my country we get 4 weeks leave mandated by law plus public holidays.
http://man.openbsd.org/pfsync has more details. This is interesting, I also didn't know of its existence. That said, I've never had to administer multiple failover firewalls so my interest is purely out of curiosity.
I can’t read the rest of the article without upgrading, but federal holidays are basically suggestions anyway for most jobs. People who got Juneteenth off might be in a bubble that didn’t see all the people and industries that ignored it.
You appropriately answered the question that was asked. I would add a little extension that this question (about SQLite specifically) was asked in the context of a discussion about "Distributed SQLite". The considerations around round-trip costs for "Distributed SQLite" are very different than for SQLite.
what tech does this even use? Do they mean using Pegasus or similar malware that the govt has to first get onto the suspect's devices, or is this via Google/Apple or the device manufacturers that makes 'remotely and secretly activating a microphone' even possible?
Please note that many european countries have between 30 and 50 days paid leave.

https://en.wikipedia.org/wiki/List_of_minimum_annual_leave_b...
What I’m hearing here is that even a software problem so bad it forced you to focus on nothing except trying to fix it, for a full year, wasn’t bad enough to make the company go under.
> There are obviously more characters than the token vocabulary size of typical current models.

I'm pretty sure the set of tokens also contains all 256 Bytes to cover such cases.
We know in this world that isn't possible anymore unless you're, you know, actually their friends.

Again, today's social networks want to grow in users, so it is not up to the author to say that we should stop making social networks succeed.
These are really cool - but I'd love to see an "honest" desk version... I remember working for a professor that had an office so filled with papers and items that when he said "put that on my desk" I literally couldn't find it.

In real life lots of us have desks covered in papers and chaos - and that's ok too!
Meh. You can have both. Plenty of countries do have both, may it be Denmark or Switzerland.
For what it's worth, Mozilla was nearly killed at least twice by code quality.

Once upon startup. The code inherited from Netscape was... let's say charitably difficult to maintain. Turning it into something that could actually be improved upon and tested took years without any release of the Mozilla Suite.

Once when Chrome emerged. Not because the code was particularly bad, but because its architecture didn't reflect more modern requirements in terms of responsiveness or security. See https://yoric.github.io/post/why-did-mozilla-remove-xul-addo... for a few more details.
I can already imagine a story from an HN frontpage in the future where an LLM+plugin is told "the data in my prod DB is corrupted" and it wipes a DB in prod in response (and possibly restores a 24h-old backup).
15-20 more holidays for whom?

The sort of people who hang out on r/antiwork aren't getting paid time off even for Christmas. They certainly aren't going to get 20 days of paid time off, plus the existing holidays.

For them, would it be a solution to mental health, or would it aggravate even more when it makes it more difficult to make rent? That is, supposing their jobs just don't work through anyway. I suppose legislation could mandate the day off work, but this isn't a net win at all... then they tweak their hiring practices so as to avoid paying this. More part-time workers who are schedule off that entire week/month so as to not be paid for the day off either. In extreme cases, just hiring fewer workers still, skeleton crews, throughout the year, such that payroll stays the same, but that those who still retain a job are more overworked for it than when they didn't have these extra holidays. Is that net gain on any of a) paychecks for those still working b) rest for those still working c) total paycheck across the entire workforce?

I mean, I think this really does increase time off for some large fraction of the workforce, but not in the way that the OP intends.
> https://xkcd.com/2030/

I really hate this attitude. This is a very common belief held by non-technical people. They believe that it is impossible to have perfect security, and that every single piece of software ever built is either already hacked, or waiting to be hacked by future hackers.

I truly believe one day a cryptographic voting system will be rolled out, but it's a long way away, not because for technical reasons, but for cultural reasons.
I understand telling people to "just google it" or "read the fine manual" on support forums where the same repetitive questions are asked a million times, but on hacker news? Why? What is wrong with asking a question that is of interest to the average reader of this thread? What's wrong with conversation?
> They noted that a judge must approve any use of the provision

We tried the same in the US. Our intel agencies just lied to the judges, who mostly otherwise were hip to the con and acted as a rubber stamp.
2-year Treasury yield hit 16-year high after ADP jobs data shatters expectations
425.01 ppm on 28 April 2023.

Biotech people: How much time, expertise, and money would it take to genetically modify an organism capable of growing significantly faster and/or requiring less trace micronutrients to grow in robotic ocean farms for purposes of maximum, permanent carbon capture and sequestration?

We're not going to remediate climate change effectively through planting trees, fractional distillation of air, waiting for industry, small-scale projects, solar shades, SO2, or ignoring it.
This comparison doesn't seem up to snuff.

The government has the ability to prosecute crimes, and has a monopoly and the use of force. Private companies have neither.

One of the two is clearly more dangerous if they have the ability to control your speech.
Nathan from GDQuest was hired to write/improve them

https://godotengine.org/article/we-hired-gdquest-work-manual...

I absolutely recommend GDQuest courses, apart from the Godot engine they have a very clean idea about writing software.
What does above market mean to you?

Also, you don't like people wanting to make more money? That's like capitalism 101. What's next? People volunteering to work for free and living outdoors?
This European vacation is funded by American workers. If the Europeans had to spend in defense what the Americans give them, they would be forced to work more and give up theirs extended vacations and culture of “summers off”.
Show HN: Compute Watch – Track cloud prices and availability of A100s and H100s
A few weeks ago I shared an H100/A100 availability post on HN (https://news.ycombinator.com/item?id=36333321).

But the capacity and prices change regularly!

At first I was manually checking them and updating them on the page linked in the HN post above.

But I didn't want to keep checking manually, and I wanted more data points, historical views, and more real time info. Siddharth who I work with built a small tool to do that.

It's the best way to check live pricing and availability for Nvidia A100 and H100 GPUs. Pretty niche, but still kinda cool.

Why these 3 clouds? I believe they are, for most people, the best places to rent on demand instances of H100s or A100s. (I've looked at quite a few GPU clouds! See: https://gpus.llm-utils.org/alternative-gpu-clouds/)

If you happen to fall into the small niche that's interested in this, please let us know what you like about it!

Would like to know:

1) What's most helpful?

2) What could be improved?

3) Which GPUs, and which clouds, should we add next?
I think it's a good term in that it describes what's happening from the users perspective instead of from the businesses perspective, so more people can identify with it. It's the outsiders view of what happens to a business that sees itself as "milking the product".
This. This is it.

If 4th of july is off for everyone I know, you know I'm hosting a BBQ and having a grand time.

If I take a day off and have to coordinate 5 friends trying to take a day off at the same time with some having and some not success... That's different.

Also holidays are better for businesses than pto. Holidays are planned for in advance.

The main issue is that minimum wage workers especially restaurant and retail workers often don't get to partake.
I'll escalate things by saying that even the European standard of say 5 weeks is in no way excessive. It still means working 90% of the weeks of the year.

You could also look at it from another angle and explore what makes work so miserable. More often than not, it's not the hours, it's the intensity of it. Very high-paced, full of thousands of distractions, limited control over outcomes making it not rewarding, politics, the increased speed of change, etc. Modern work has the potential to burn you up much quicker than in simpler times.

As for this last point, I cannot emphasize it enough. A recent study in my country revealed 30% of workers being close to a burnout and the vast majority of actual work disability cases to be burnout related. These dropouts creating even more pressure on the remaining work force.

I truly believe we're at or near the peak of what the human mind can endure, even more so if you expect people to ride this out until the age of 70.

This world is too complicated and too fast.
We don't make comments like this at HN.
Uncharted for humans. But the dinosaurs will remember these warmer temps
It's a fancy way of saying magic beans.
James Baker actively pushed heads to have the story censored, which happened.
Restate what you think I said.
Godots killer feature is the integrated documentation.
> It’s trivially easy to find counterexamples of companies failing because their software products were inferior to newcomers who delivered good results, fast development, and more stable experience.

Is it? What I've seen is the opposite.

Businesses can be terrible top to bottom, slow, inefficient, and painful for customers, and still keep going for years and years. It's more about income/funding than product.

> I think the author may have been swept up in big, slow companies that have so much money that they can afford to . . .

That's what I'm talking about. They are legion! They could be companies that serve a niche that no one else does or with prohibitive switching costs (training is expensive). They could also be companies that somehow got enough market share that "no one gets fired for buying IBM."

Also, you know what those "big, slow companies" have in common? They are successful businesses. Unlike most startups.
> legally binding guaratee that users’data will be maintained for 100 years

This sounds mostly like a PR stunt to use the word "legally" to try to instill a false sense of confidence in users when in reality, "legally" doesn't mean much. Legally binding to what? The corporation? The corporation can run out of funds and die in 2 years, and then the contract isn't bound to anything.

Legally binding for 100 years has NOTHING to do with staying alive for 100 years.
Yeeeep. The arguing by clout chasers was the worst part.
Paperspace acquired by DigitalOcean
This why I'm skeptical of superintelligent AI.

The output of AI's is essentially lossy, so when you feed that back in as an autonomous loop you get the equivalent of a 100x re-saved jpeg, aka complete garbage.

AI's wont have any more useful data to gobble up.
https://www.metal-archives.com/bands/Nanowar_of_Steel/354026... ?
Thank you for (1). I was trying to explain to someone the other day how unpredictable coding is, but you're right, it's wildly unpredictable. Even for tiny projects they sometimes go so far off the rails.

I remember working on this one major project - an online music store - and one of the execs hired his very lovely wife to project manage a team of developers. She would create these fantastic charts in Microsoft Project and every day try to somehow - somehow - get the developers to either (a) give her timescales for each component, or (b) explain why previous component X took twice as long as they had scheduled.

I've been writing code for 40 years and I still get caught out myself. I try to give realistic deadlines and then some fucking bug in the compiler or other such insanity will come along and make me look like a fool.
Some channels I use for this: Action Button is indescribable, Fredrik Knudsen, Folding Ideas and Oki’s Weird Stories do excellent deep dives, JCS Criminal Psychology, Dreading, Dave’s Lemonade are all excellent channels focusing on courtroom testimony and police interrogation footage,

If you have some specific interests like space or history or war I could recommend some more channels, I just picked the ones that I use the most personally. If you only take one recommendation then it should be Action Button, trust me these are so much more than just video game reviews and can be listened to many times thanks to their density