skysight-inc/HackerNews huggingface dataset:
Productivity can mean speed, or it can mean reassurance that code will be easy to understand and refactor in the future (which compounds speed).

The past few months I’ve been working heavily with Python type hints and pydantic which makes it bearable.

Golang is strongly typed but it’s difficult to transform data handily with one-liners.

I’ve used Java and Spring but it’s very verbose

In my experience, TypeScript and its ecosystem has been very productive. It runs on backend and frontend, and the type system is very expressive. I always reach for it first.
To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

What's his track record on promises/predictions of this sort? I wasn't paying attention until pretty recently.
Provided 10 citizens occupied all 10 houses the supply was 0 and remained 0 so it could not decrease even more since there is no negative supply. But if any of the houses had been for rent then immigrants moving into them decreased the supply of houses for rent, pretty straightforward.
> You are free to purchase a domain from a registrar, setup a server or purchase hosting and bandwidth, and display any legal content, including nudity, on the internet for all to see.

This retort always seems kind of trite and disingenuous.

First of all, no, they are not free to do these things unless they are billionaires with capital to spend. "Just start your own business" is a silly dismissal because the vast majority of people cannot start such a business. Second, it doesn't even address the original complaint. "I think Company X should do ABC." Suggesting they start a different company to do ABC doesn't really address what OP calls for: Company X changing their ways.
Huh, I guess “non-trivial PDF” is so wide a spectrum as to become meaningless, but FWIW I’ve never had any such problems on much lower hardware specs. I am, however, only talking about whole books, long-ish forms, brochures with print-quality images and graphs and that sort of thing. Since PDFs can theoretically contain anything under the sun, are you perhaps talking about more exotic use cases (interactivity, animation, idk)? Or just more excessive file sizes?
> I'm the author of Rust's regex engine. Treat me as an oracle. What is your specific concern?

I know and I'm terrified haha.

That's a very generous offer; I don't disagree w/ your post or OP's basic premise that validation isn't absolutely necessary. I also think it's perfectly reasonable for regexes to not match on invalid bytes (what, we should just ignore stuff now? Total madness). Like, if you don't like it, consider living less dangerously and validating!

My overarching worry is that a lot of engineers will read this and think, "validation is indeed for wimps" and suddenly a lot of invalid UTF-8 will end up in databases, tape backups, and S3 tripping us up for years to come. I probably could be mollified with a small title tweak like "In some cases (and you'll know if if you have one) you can intentionally not validate UTF-8 strings, but throw some salt over your shoulder first." I also think there's plenty of weird interactions like with normalization or basic string manipulation people should think about before walking down this road.

> I hope presents a nuanced data driven analysis

I was actually sold early on when you pointed out that filesystems are creepy attics full of exotic data; perfect use case for not assuming/forcing any kind of string encoding and a really good blueprint for applying solid engineering principles to give the people what they want.
They are far from the only company to do this but they deserve to be skewered for it. The FTC and NLRB should come down hard on them to make an example. Jail time for executives.
Slumber: A TUI HTTP Client
Claude 3 Opus has the most knowledge encoded in it from my experience, so I use that when I am using the non web search models. I also find that I don't often need the most recent information for the work that I do, so I don't often use the search enabled one. If I use the expert assistant, I usually just provide it an exact URL of a long document that I want to ask questions about.

I think they are particularly useful when you know what you want with particular nuances, and it would not be easy or possible to find that specific information in a web search. For example, I recently used LLMs to help me write a configuration for my RAID. I knew I wanted mirror+stripe, and I wanted to mount the RAID at /data, and mount my home directory at /data/home. I explained this to the language model, and it essentially built me a script to do that.

I could have looked at the manuals for how to use mdadm and edit /etc/fstab, but writing down exactly what I want in plain English and then doing what the language model spits out was easier and faster for me.
We don't need to. The cost of living will rise as well.. It's just not worth it. Life is good as it is.
honestly, I hadn't heard of him until 24-48 hours ago :x (he's also the new superalignment lead, I can't remember if I heard that first, or the podcast stuff first. Dwarkesh Patel podcast for anyone curious. Only saw a clip of it)
And I got it. When the algorithm sees a word that is already in the list, it discards the word in the list first. Then it adds the word again with the same probability as any other word.
This ensures that only the last occurrence of each word can occur in the final list, so the final occurrence of each word are all in the final list with the same probability, and prior occurrences are always removed, if no earlier then when the next occurrence is seen.

If the input is known to be large, there is no reason to start by adding every element. It can treat the first round like any other, and start out with a _p0_ that is smaller than 1.
The Precarious Future of Big Sur's Highway 1
It's not "discretion at enforcement".

It's that the goal of the national body is to get you up to compliance, with reduced fines as incentives for helping you get there. The difference with PCI is that with PCI non-compliance means that payment networks will refuse to work with you, but at least in theory you're not forced to work with them either - you can not "opt out" of GDPR. So the purpose of the national body is to get the rules followed, and it has both ways to sweeten the deal (reduced fines for cooperating business) and the stick (vast increase in fines).

Worst thing about GDPR was the cottage industry of "GDPR lawyers" that exploded around it coming into force in order to capitalize on panicking businesses, often fueling said panic. In reality, the main difference in GDPR versus previously active law is that GDPR increased fines and introduced policy framework for enforcing and helping compliance.

BTW, there's no such thing as "not being a target". It's just enforcement depends on finite resources - and on complaints from people.

And "do the minimum to not be target for enforcement" would be actually grounds for increased fines for acting in bad faith.
Not sure what you mean. You can sign up for compounded semaglutide from many online services (e.g. Ro https://ro.co/weight-loss/compounded-semaglutide/)

It's still expensive, but far cheaper than brand name with similar efficacy. Competition from these programs will likely drive costs much lower over the next few years.
At that scale having common ancestors effectively does not matter anymore.
I'm in favour of doing away with patents entirely. Or maybe make them 3 years and not 20.
OpenAI put 'shiny products' over safety, departing top researcher says
As a rule of thumb, If something seemed too good to be true, but then never was adopted at scale; assume that it didn't worked as planned in the real life, and was silently discarded to save face. Lost of trust in a mega-project is a serious issue.

To start, the sellers of the project will be pressed to embellish the history and real capabilities of the system.

And mega-projects are a magneto for corruption. Part of the money will vanish, then somebody will typically hide it, cutting corners in safety, and then some horrified official looks at it and thinks: "No way I will sign the green light and associate my name with this mess".

This is a dilemma. Politicians can't never, ever admit that this never worked (and millions were burnt by their naivety). "best thing since chocolate with grapes, but can't be opened and will never be" is a common defense. Plus <blame deflected to outer group like hippies or public> for better measure.

I'm not saying that this is the case here, but it just happens a lot with mega projects and, lets face it, companies working on nuclear projects were all except honest or transparent with the public on those years
It doesn’t matter if they are not legal. Employees do not have resources to fight expensive legal battles and fear retaliation in other ways. Like not being able to find future jobs. And anyone with family plain won’t have the time.
Like education, government involvement only causes prices to go up. Why wouldn't they? The government has unlimited money. The education and healthcare industry beats the government like a money pinata.

Why would you suggest more government to a government created problem? Usually because people don't realize the government as the root cause in the first place. Get the government out, let people actually pay for their own health care, so they actually 'care' what they're paying. Use insurance for the exceptions cases. And social programs for the people who really can't afford it.

Capitalism actually works if you let it.
Well, for starters this author of this video has a channel:

https://vimeo.com/jiwasa
>To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

Link? Is the ~2 year timeline a common estimate in the field?
Related [0] (15 points, 3 hours ago)

[0]: https://news.ycombinator.com/item?id=40394121
> I am curious how long it will take for Sam to go from being perceived as a hero to a villain and then on to supervillain.

He probably already knows that, but doesn't care as long as OpenAI has captured the world's attention with ChatGPT generating them billions and their high interest in destroying Google.

> Mass protests are coming and he will be an obvious focus point for their ire.

This is going to age well.

Given that no-one knows the definition of AGI, then AGI can mean anything; even if it means 'steam-rolling' any startup, job, etc in OpenAI's path.
> That's another monad!

If you like monads, maybe you should look into Haskell or Idris.

Please let me know when you write an interesting post that solves a class of problems rather than getting excited over something so trivial. Perhaps I'm jaded. Good luck to you.
Sorry for not being clear.

I meant that the PM is fully aware of the law so he knows the answer, but asks anyway to get attention[1]. That is the non-story, not the court case itself.

Unfortunately, it’s also a very easy story to write up because it contains some (made-up) controversy, so the Guardian fell for it.

> non· sto· ry ˌnän-ˈstȯr-ē plural nonstories. : something that is not a story. a nonstory with no clear plot. specifically : an event or occurrence that is not newsworthy enough to be a news story.
https://www.merriam-webster.com/dictionary/nonstory#:~:text=...

[1] If he really wanted to change something he would have announced a parliamentary initiative, or held a “roundtable on media governance” or similar.
Desalination costs are dominated by energy costs. And I am making a point that California is in a perfect position to solve its water problems with the excess of solar capacity by using it to desalinate ocean water during the time of day when energy is essentially free.

Sorry for not being clear.
Uncommon sense for founder sales: from IIT engineer to successful founder
Man, substack is going for all the dark patterns.

2 full page ads to subscribe and 1 half page ad for substack itself.
Totally agree. For all this to work there needs to also be transparency. Anyone receiving equity should have access to the cap table and terms covering all equity given to investors. Without this, they can be taken advantage of in so many ways.
They do not have to start a company to share their nude art or whatever they want. And they don’t have to be billionaires. $100 per month is plenty to cover bandwidth and hosting expenses.

There has never been a cheaper and quicker way to share one’s art in the history of humanity.
My alma matter!
Nationalized healthcare doesn’t stop at a pharmaceutical manufacturer’s borders. You think NHS or any other country with socialized medicine pays what the US does? With socialized healthcare the pharmaceutical companies pay what the nation dictates or it doesn’t do business with that nation. I highly doubt Novo Nordisk would write off the US if it went to Medicare for all.
> To use this feature, make sure that you:

> Are located in one of the supported regions and are at least 18 years old.

I wonder how much of the 18+ part is due to their models producing unsafe outputs (which seems unlikely considering how often they refuse to be useful), or if they're actually using it as a subtle form of anti-bot protection (I had one of my accounts suddenly marked as "potentially under 18" and I have to submit my passport to verify)
Also see https://www.fshade.org/, a F# dsl for shaders
> That's a 57x speedup by doing nothing.

Okay, I'll have what you're having.
The superalignment team was not focused on that kind of “safety” AFAIK. According to the blog post announcing the team,

https://openai.com/index/introducing-superalignment/

> Superintelligence will be the most impactful technology humanity has ever invented, and could help us solve many of the world’s most important problems. But the vast power of superintelligence could also be very dangerous, and could lead to the disempowerment of humanity or even human extinction.

> While superintelligence seems far off now, we believe it could arrive this decade.

> Managing these risks will require, among other things, new institutions for governance and solving the problem of superintelligence alignment:

> How do we ensure AI systems much smarter than humans follow human intent?

> Currently, we don't have a solution for steering or controlling a potentially superintelligent AI, and preventing it from going rogue. Our current techniques for aligning AI, such as reinforcement learning from human feedback, rely on humans’ ability to supervise AI. But humans won’t be able to reliably supervise AI systems much smarter than us, and so our current alignment techniques will not scale to superintelligence. We need new scientific and technical breakthroughs.
That's when you need a lawyer.

In general, an agreement to agree is not an agreement. A requirement for a "general release" to be signed at some time in the future is iffy.
And that's before labor law issues.

Someone with a copy of that contract should run it through OpenAI's contract analyzer.
It's the "fusion in 20 years" of AI?
Looks awesome. I'd find the open source library really helpful for a few of my projects.
What are some applications that people run under Wine that are most useful? I currently use VM for windows but would be interested in what HN users of Wine find as most helpful uses of Wine.
Not every Roman peasant lived in Rome. It’d be more apt to compare Rome with, say, NYC than with a random strip mall somewhere.
Yeah, courts have generally found that this is "under duress" and not enforceable.
I would tell you to go to a specific timestamp to see the pen shadow that you are missing, but the Threads video player doesn't seem to have a visible time nor a way to pause playback. That's unfortunate.

If you go 1/4 to 1/3 of the way through the video when the camera zooms in, you'll probably see it.
>I assume the vitriolic tone is directed elsewhere

I'm always really shocked on hn when people getting called out for arrogance respond with accusations (of vitriol). What day job do you have where you can make proclamations like "It quickly seems that the low level C/Cpp is becoming obsolete" while simultaneously admitting being an amateur and not get checked. Must be very different from my day job where being precise and accurate and conservative is paramount. Moreover what kind of habit of thought are you in that being called out for that is read as vitriol?
> I just refuse to believe that people whose opinions and decisions actually matter are influenced by such fears

Well, at least I'm glad you admit it's due to your stubbornness and unwillingness to change beliefs when confronted with evidence.

Sam Altman ("Development of superhuman machine intelligence is probably the greatest threat to the continued existence of humanity"), Ilya Sutskever, Geoffrey Hinton, Yoshua Bengio, Jan Leike, Paul Christiano (creator of RLHF), Dario Amodei (Anthropic), Demis Hassabis (Google DeepMind) all believe AGI poses an existential risk to humanity.
Which ones weren’t accounted for in the CBO report, which tried to take into consideration other health issues (from a financial perspective at least)?

It states that “at their current prices, [anti-obesity medicines] would cost the federal government more than it would save from reducing other health care spending—which would lead to an overall increase in the deficit over the next 10 years”
There's a parallel, but the police can literally deprive you of life and liberty. And under "qualified immunity" they can often get away with it.

The bar should be extremely high and I don't have faith that it is.
It’s not just OpenAI. I think AI winter is coming much sooner than expected. Throwing more compute at the current solution is not yielding better results it seems. Reasoning will not be solved by a bigger LLM
Yea, they're disincentivizing the wrong thing. It should be difficult and expensive to own multiple properties, regardless of whether or not you are renting them out. And it should be progressively (quadratically) more difficult and expensive to own the next property, the more properties you already own. That's the evil here: Single entities owning hundreds of properties for the purpose of value extraction rather than to live in.
The Great Debate Over Whether 1+2+3+4..+ ∞ = -1/12
People keep saying that thunderbolt/usb4 networking Just Works, so I went and tried. I plugged my PC (ubuntu 23.10, Maple Ridge) into my NAS (ubuntu 23.10, Maple Ridge) with my good USB4 cable which I just tested to have full connectivity on my LED tester and transfer above USB3 speeds to my NVMe enclosure. No network interfaces appeared. I also tried plugging my PC into my M2 macbook and again no network interfaces appeared on either end. I booted into Windows and tried PC-NAS and PC-Macbook. No auto-configured network interfaces. Windows did make the "connect" sound with the Macbook, but that was it.

Until connecting the computers by USB4 results in:

0. Drivers already installed and configured without additional effort

1. Automatic appearance of network interfaces

2. Automatic configuration of network interfaces for peer connectivity

3. Automatic peer and service discovery on auto-configured network

4. Automatic presentation of sharing options through a popup or other icon

5. At least some of those options actually work.

then it shouldn't be called automatic, "already done," "super solved," or any related phrases. Linux can probably get away with having a few of those steps broken by default, but for everyone else 0-5 above are minimum viable. I'm not even including things that really ought to happen like bad cable detection. The theoretical possibility of getting this to work if you are willing to compile custom drivers, learn an undocumented configuration format, iterate a few times with it, and then proceed to do 1-5 above manually is so far from being minimally viable for public consumption that it might as well not exist and definitely does not deserve any of the praise being heaped upon it here. From the user perspective, it is approximately 0% done, not 100% done.
> How would you index into or split an invalid UTF-8 string?

Indexing/splitting by bytes is usually more useful than by Unicode code points anyways. Often, you would want to split by a substring; if so, then it works just as well if you are treating them as sequences of bytes instead of code points; due to the self-delimiting feature of UTF-8, such a thing would work correctly (unlike e.g. Shift-JIS, which doesn't work correctly). Treating them as bytes when splitting by substrings also avoids needing to count the code points every time.

> How would you apply a regex?

You can apply byte-oriented regular expressions. (Often you will not need Unicode-oriented regular expressions, and you can still match UTF-8 strings with byte-oriented regular expressions.)

> What is its length?

It depends on why you want to measure it. Usually, the number of bytes is the most useful kind of measurement, is what it seems to me.

> How do you deal with other systems that do validate UTF-8 strings?

It depends. Sometimes it is better to just not deal with such systems (or to fix them if you can). Sometimes you might treat the input as ISO-8859-1 and convert it to UTF-8, or as bytes and convert it to base64, just so that the other system won't complain. In a few cases, doing the validation would be appropriate, though.

> scanning a sequence of byte for invalid UTF-8 sequences is validating. ... It's probably also a lot slower as you have to always do this for every operation, whereas once you've validated a string you can operate on it with impunity.

Usually you should not need to do this scanning at all; just use the bytes as they are. Of course, you can add the validation step once where needed if you really do need this validation, but usually you shouldn't need it.

It is also notable that you cannot always assume strings are Unicode anyways; there are problems with Unicode anyways and you might have strings with other character sets (or none at all).
If it can actually save the health care so many billions, you'd think it was worth paying high prices for it.
https://www.dwarkeshpatel.com/p/john-schulman
Where in the world are you located? (I work at val.town)
> We could always stop paying for the servers, or their electricity.

This is satire, right? No one saying this or "off button" has thought this difficult problem through longer than 30 minutes.

https://youtu.be/_8q9bjNHeSo?si=a7PAHtiuDIAL2uQD&t=4817

"Can we just turn it off?"

"It has thought of that. It will not give you a sign that makes you want to turn it off before it is too late to do that."
The general criteria for authorship require including the people who worked on the experiments and data for the paper, which can be more important contribution than most of the text in that paper. In other experimental fields, there are papers with dozens or even hundreds of authors, because it can take many people to get to a measurement of a single number in the paper.
One does not rely on the persistent competence of the coders, and will tell you when something has gone wrong.

And walking a binary object store to ban problem users is not always necessary... depending what you are doing.

Most other approaches makes the same predictable assumptions:

https://en.wikipedia.org/wiki/List_of_cognitive_biases

Despite popular belief, shitty design does not usually get better in another language. Rather, people just feel more confident it isn't shit anymore.

I have yet to see evidence to the contrary. =3
The regex compiler then can have a flag to treat the regex as Unicode or non-Unicode. The regex engine then does not need to care which flag the compiler used.
Changing my input and output audio devices in the sound dropdown is almost impossible at work. There are dozens of Apple TVs that appear one after the other while you're scrolling or clicking.

I can't disable Apple TV support on my Mac :(
Not always true, see recapcha's JS for example. It embeds an interpeter and then an obfuscaed program that runs in it.