skysight-inc/HackerNews huggingface dataset:
Yes this is what I do, and I wouldn't have dedupe for all datasets, for instance in this case he wanted dedupe on his games, so I would just enable it for that dataset.

But I do run disk-wide compression with no problems and have done so on all my datasets for many years now, and it's been a tremendous space saver. Especially on machines where I have a lot of VMs/containers, it's not unusual for me to have a compression ratio of 2 on these with good old lz4, it will be interesting to see what damage zstd will do once I start experimenting with that.
The Open Book: Project Reboot
#2 is simply not a fact. Wikipedia has a page on extraterritorial jurisdiction. There's a list[1] of specific laws passed around the world that grant extraterritorial jurisdiction. How can you say there is no precedent?

[1] https://en.wikipedia.org/wiki/Extraterritorial_jurisdiction#...
What's the specific agenda here?
Understanding SurrealQL and how it is different from PostgreSQL
PostgreSQL has been around for a while now and is the go-to choice for applications that need reliability, performance and scalability. But as more complex apps need to be built, the limitations of traditional SQL databases are showing. One of the main issues developers come up against with Postgres is writing complex joins. It's even tricky for experienced SQL programmers. SurrealQL, SurrealDB's own query language is trying to solve this problem.
This same technique - WITH RECURSIVE - is also supported by SQLite.

I ported the example in this tutorial to SQLite here - now you can play with it in Datasette Lite: https://lite.datasette.io/?sql=https%3A%2F%2Fgist.githubuser...

Amusingly I ported the sample PostgreSQL code using the new ChatGPT "Browsing" alpha, with the following prompt:

> Read this tutorial and then output equivalent create table and insert statements for SQLite https://www.dylanpaulus.com/posts/postgres-is-a-graph-databa...
The technology for designer babies is here; polygenic embryo selection could do it right now, people just aren't going all the way for various reasons (concern about regulation).
"The system is only failing black and hispanic students. "

Black students of African heritage, unless the group is very specifically selected (Nigerian-Americans come to mind, with their extremely high average education levels), tend to come out on the bottom in all racially mixed societies in the world. Even the Finnish educational system, touted as one of the best in the world, struggles to educate Somali immigrants to Finnish levels.

The very opposite tends to be true about East Asians and Ashkenazi Jewish students. I am not aware of a single educational system worldwide where either of those groups would be considered under-achieving and needing government or private help.

The standard American answer is that the root cause is systemic racism. I don't believe that; the phenomenon is too widespread and there are other ethnicities that face vicious open racism in their countries, while being extremely successful. Some of the most successful groups in the world are actually direct survivors of genocidal campaigns or lost wars; all that murder didn't break them.
This product is probably the answer to my Ask HN four years ago: https://news.ycombinator.com/item?id=17738724
That has to be an astroturfer that posted that comment.
Slot hour? It's been a year or two since I worked with bigquery but I enjoyed that you only paid for data read.

It was such a simple way to think about it.
I think you have a misunderstanding of the system.

Sealed indictments are not new. All indictments are sealed after the Grand Jury returns a True Bill. Indictments must be unsealed before an arrest warrant is issued.

While the indictments haven’t yet been unsealed, Trump also hasn’t been arrested, nor has an arrest warrant been issued.

Finally, an arraignment (the first Court appearance where you are formally notified of the charges) will never happen with a sealed indictment.

The 6A protects you from being tried on secret charges.

However, when being arrested the police *are not* required to notify you for the reason for your arrest.

So, nothing novel is happening in this instance related to the sealed indictment. The thing that’s unusual here is the case is so high profile we know about it after the Grand Jury returned an indictment but before it was unsealed.
They aren't standalone executables, they need to be distributed along with the lib folder that includes the racket runtime.
Same here. I've done a few little projects with ChatGPT4 in my back pocket. I've been able to give more aggressive timelines, more features -- and I've been able to hit those goals with ease. Probably the first time in my life I've been able to over promise AND over deliver.

Also, the final product (with documentation) has been complete and pretty amazing.
This is known as the orthogonality thesis -- goals are orthogonal to intelligence. Intelligence is the ability to plan and act to achieve your goals, whatever they are. A stupid person can have a goal of helping others, and so can the smartest person on earth -- it's just that one is better. Likewise, a stupid person can have a goal of becoming wealthy, and so can a smart person. The smart person is Jeff Bezos or Bill Gates.

There are very smart people who put all their intelligence into collecting stamps, or making art, or acquiring heroin, or getting laid, or killing people with their bare hands or doing whatever they want to do. They want to do it because they want to. The goal is not smart or stupid, it just is. It may be different from your goal, and hard to understand. Now consider that an AI is not even human. Is it that much of a stretch to imagine that it has a goal as alien, or more, than the weirdest human goal you can think of?

*edit - as in this video: https://www.youtube.com/watch?v=hEUO6pjwFOo
It's quite likely they had no idea.
Easy to imagine a scenario where there is a company owning the building, one owning the cameras and maintenance, one owning the data/recording, all wrapped up in management partners mergers shells etc.
According to Wikipedia on the MiG-25: "The airspeed indicator was redlined at Mach 2.8, with typical intercept speeds near Mach 2.5 in order to extend the service life of the engines.[28] A MiG-25 was tracked flying over the Sinai Peninsula at Mach 3.2 in the early 1970s, but the flight led to the engines being damaged beyond repair.[34]"

Both citations are for Barron, John. MiG Pilot: The Final Escape of Lt. Belenko. New York: McGraw-Hill, 1980. ISBN 0-380-53868-7.

https://en.wikipedia.org/wiki/Mikoyan-Gurevich_MiG-25#cite_n...
Tesla is also switching to 48V for the accessories.
Maybe they were unfashionable but that's not why they died at all.

Flash died because the iPhone killed it because Adobe refused to work with Apple to make it more secure and more power-efficient. Ultimately it was Adobe's own-goal.

And Visual Basic was similarly a self-inflicted death, when Microsoft decided to make VB.NET incompatible with the previous VB6. But what was bad for Microsoft was good for the internet, as HTML+JS ultimately replaced VB6 for enterprise apps.

FoxPro I don't know about, though. Never approached Flash/VB in terms of popularity.

Flash videos and apps got easily replaced, and animations with HTML/CSS/JS, and those bite-sized Flash games basically got replaced with mobile gaming as apps.
The security council was always kind of a dubious proposition. The UN isn't a government, and it lacks the "monopoly on the legitimate use of force". At best it could send peacekeepers in to much, much smaller countries, but even then results were mixed at best.

The UN is far more effective at humanitarian efforts, and at providing a central place for conducting negotiations. Its security council receives a lot of attention because it sounds the most like the part that wants the UN to be a world government to enforce an end to war. It has never been that, and distracts from the things that the UN actually does very well -- a lot of jaw-jaw that has prevented a lot of war-war.
They might as well be in terms of political power. In a democracy a group or interest should have power according to their number. That's not how it works in practice though.
Right wing political partisans and their petro head sub-cult are really at war with logic and reality.

1) Electricity is a universal and unlimited form of energy that can be generated in many different ways. Petro supply is limited and declining.

2) Electric cars are mechanically simpler and easier/cheaper to build and maintain and operate. The battery is the major expense and costs are declining rapidly. New technology can and will make them cheaper than ICE cars In the very near future.

3) The economics are undeniable and will easily overwhelm the most ardent petro-head. If death doesn't overwhelm them first, there will be an EV in their future.
Do New Yorkers, people actually like the new "We [heart] NY" logo?? The original is iconic. If it ain't broke...
Therac 25 is so serious that jokes are one of the very few ways to discuss it at all, eh?
Gotta hand it to them for not closing bugs after 2 months of inactivity as is the norm for large OS projects.
Doubt it, that’d be better than any other car. I think they’re using a very optimistic testing cycle, like the European one. The EPA’s testing cycle is much more conservative and closer to real world usage.
https://nimble.directory/ for a package directory for the package manager `nimble`
Why do you want hello world, at all? Yes, the nearly-null program is 50MB; also, yes, a fairly nontrivial program is ... 60MB? The core for a computer algebra system is 100MB?

You're paying a higher initial capital cost for lower per-unit costs.
They don't ban sale of videogames/movies based on age rating mechanism, they restrict the sales. These words are not the same and not to be used interchangeably.
Show HN: cataclysm v0.1 – the final Python module?
cataclysm is an over-the-top experiment to take more of the human out of coding.

Any function you give it, it generates and executes. No need to think about what you need, it'll make it for you.

I haven't taught it to use itself yet if a module isn't installed, but that's next on the agenda once GPT4 isn't so slow.

Video intro here: https://www.youtube.com/watch?v=ZK8fUuQDgZ4

Some random examples when using global cataclysm:

>>> uhoh = first_prime_with_3_digits()
>>> print(uhoh)
101

>>> scary_words = get_italicized_phrases_wikipedia(page="Global catastrophic risk", only_lowercase_words=True, min_length=6)
>>> print(scary_words[:5])
['existential risks', 'existential catastrophe[16]', 'global', 'terminal', 'permanent,']

Fun experiment: I fed it some of the 'tests' for other simple Python based modules and it was pretty good at implementing what was needed to succeed at them by replacing their module name with `doom.`. Obviously lots it can't do, but it's already surprisingly reliable.

You'll need a GPT4 API key-- it works with ChatGPT 3.5 turbo but that code is a little less reliable (and it can't generate as lengthy code).

It has two modes-- the ridiculous 'global' cataclysm mode for use in notebooks/interpreter that lets you hand-wave any function name and it'll cook it up for you. This is a bit scary (a typo turns into random code execution), so the second mode is just to use 'doom.' in front of any function name and it'll generate/cache its best guess for the right code given where it's called in the call stack (and its name/types/parameter names/etc).

A bit extreme, but a small concept to help us adjust to the impending cataclysm ahead of us. :)
It’s not just BigQuery. Pricing for cloud services is increasing across every provider. Azure increased prices in the EU recently https://news.microsoft.com/europe/2023/01/05/consistent-glob...

For AWS, one of the people behind https://ec2instances.info showed that the price/performance ratio for newer instances is rising, https://github.com/patmyron/cloud/#compute--memory-unit-pric... meaning cloud users are paying more for less.
For what it's worth, the on-screen keyboard is kind of awful. You can also type using the two thumb touchpads, so I guess you could do it with that, but it sounds like an exercise in frustration unless you're using an external keyboard of some sort.
I was mainly referring to those FTT tokens, but the problem with a meme stock (or similar) is that those buying and selling it are fickle and it's a bubble, it's a liquidity issue in the future not now. Due to the memetic popularity _today_ you can buy and sell very easily. Whether you can do that tomorrow is a different question. If Musk goes on a selling spree, how long will it take until the bottom is hit?

If someone owned thousands of very rare collectible beanie babies in the late 90s, on paper worth hundreds of millions, do they actually have hundreds of millions of dollars? Sure they could find one buyer, ten buyers, but thousands of buyers? What can such a bubble handle?

People hate Musk, I get it, but the guy is not the wealthiest in the world. He's sitting on a pile of rare collectible beanie babies.
Considering GCP is still a distant 3rd, I would have thought they'd aim to get more market share 1st :(

BigQuery was 1 of the main reasons anyone would use GCP.
What is the best alternative for BigQuery? What is the most economical? Once you are hooked, it is really hard to imagine going to e.g Redshift
Maintenance is already perceived as one hell of a cost center.

I'd have enough money if to train my own foundation model if somebody gave me a nickel for every time somebody underestimated the time to rebuild an existing e-business system by orders of magnitude because they were ignorant of all the "requirements" that were satisfied by the existing system that were undocumented.

The most expensive maintenance problem comes when you've accumulated a lot of data that is incorrectly structured and may or may not be possible to migrate to a new, correct, structure.

Fred Brooks in No Silver Bullet pointed out that software development involves multiple phases, say 5 of them (requirements gathering, design, coding, testing, deployment) and that even if you could reduce the time involved in one of those to zero there is no "revolution".

The corollary to that is that the opportunities from ChatGPT come out of identifying the things that ChatGPT does poorly. For instance it might be just as important to turn code back into requirements as to turn requirements int code. There was a post the other day about a "simple" problem in CSS that turned out to be hard because of the deep understanding required

https://news.ycombinator.com/item?id=35361628

the ratio is much worse between spending 3 minutes to make a partial solution with ChatGPT and 3 hours to really solve the problem as opposed to 30 minutes to make a partial solution manually and 3 hours to really solve it. That is all the more reason to clean house at the lower levels, either make a style sheet language that is not so fraught or maybe make one that's designed so that chatbots can write good code for it.

There has been hype over "no code" and "low code" tools for the longest time and people have been chasing that revolution for a long time and it's astonishing how many innovations have been forgotten (like the 1990s CASE tools that could turn code into diagrams and back again and leave formatting intact.) Real progress involves solving all the problem that is ahead of us instead of cherry picking the parts of the problem we want to solve and thinking wishfully that will be sufficient.
I got to use this internally when I was at Datadog. It really is a great flow / experience for collaboration. Congrats to the team on the launch / shipping. (And yes, make Linux please!)
Or rather, you see Zapier 1/100 inverse opportunity as custom built integrations are basically going to be free since LLMs can autogenerate them. You have no need for middle men.
Have had similar experiences. I found two HTTP servers running on my TV and I wanted to see what was going on in them.

Dirbuster wasn't packaged for Debian (that I could find). I wasn't too keen on trying to build from source or anything like that. A few months ago that would have been that.

But with GPT I just asked it to write a POSIX-compliant C port of dirbuster. Less than 10 minutes later I was scanning my TV for routes.

https://sharegpt.com/c/stLFWA1
Show HN: Actio, a (young) Node.js framework that makes microservices invisible
The Economist article someone mirrored farther down has the clearest trace of the payments I can find: https://archive.is/0rJIh

Michael Cohen paid Stormy Daniels. The Trump organization reimbursed Michael Cohen. The candidate Trump never declared the payment on his campaigning behalf.

Do you have any links on the specific laws that preclude candidate-directed corporate payments? Haven't seen specific laws in the reporting thus far, although I expect when the charges come out it'll be all over.
I'm not trying to be negative, but there is a rather large gap between ChatGPT and what Vicuna is showing in its online demo.

Here's an example I just had:

Q: What should I do for my wife today?

A: There are many things you can

End of transaction.
> I started using it on 6.06

4.10 here. The first ever release, and every single one since then.

BTW, I have not seen any trace of what @selivanovp called "horrendous releases like 11.04 and 11.10". I ran both. They do not stand out in my memory in any way.

> (I think 2008 is when they moved to the April/October schedule).

Nope, that has always been the case.

4.10, 5.04, 5.10...

The first ever LTS was "Dapper Drake", version 6.06, and it was 2 months late. That is the only release there's ever been of Ubuntu that wasn't either .04 or .10 as far as I can recall over 19 years of using it.

And it was their first try at an LTS release, so I can forgive them.
There are researches working on the specific problem of AI safety, and I consider them to be the experts of this field, regardless of the fact that probably no university is currently offering a master's degree specifically on AI safety. Whether one or more of these researchers are in favor of the ban, I don't know.
This may be in the $10^7 category now, but is there any reason to believe it will never be $10^3?

Oddly the most pressing concern is “increased productivity”.
> There’s a very good chance that their new jobs

The linked blog post reads like the other 43.3% don't seem to have found any new jobs at all (if I'm reading it right). ("There could of course still be many that have found new jobs, which they might not yet update their profiles - a common practice on LinkedIn").
Those paper log books were commonly referred to as "comic books" referencing the (lack of) tight coherence the data entered there had with reality.
I know a few photographers and they have plenty of work and make nice money. The pictures that they take can't be compared with someone taking a picture with a smartphone.

Both wedding photography and family/portraits.
Alpaca on 13B Llama is enough to convince me that it on 65B Llama would match GPT 3.5 for most tasks.

Perplexity AI's app is definitely better than GPT 3.5 for many things although it isn't clear how they are doing everything there.
Ask HN: How do you deal with a super hero team leader?
Got on a new company, great spirit and business but the team manager likes to be the super hero for the business: he blocks all team communication with other teams, only he knows what to do next and only what he does or his solutions are correct.

Sometimes we have a roadmap and processes but he is the first one to not follow them (he approves his own PRs and sometimes develop in production ).

The consequences are obvious regarding and overall the team is demotivated.

I've been trying to go around by having conversations with him suggesting new approaches to stuff just for him to present them as his ideas on the next week. I don't really mind that but it's managing him that is completely draining me.

Any suggestions on how to approach this? I do love the company and the business teams but this is not sustainable for the next months.
> What I really love is the unbounded optimism of the AI. How many colleagues could you ask "Can you write me a PoC for a horizontally scalable, probabilistic database in Rust, using Raft-based consensus?" that would then just think for a second and go "Certainly! Let's start by ..."

I agree about the unbounded optimism. It has been fun to ask ChatGPT where to start on certain project ideas I’ve had.

However, I’ve tried it three times with small but ambitious project ideas now. Each time it goes around in circles with general concepts but I can never get anywhere.

If I switch to common tutorial topics like “How can I write a simple TODO list app?” it performs surprisingly well.

As soon as I step outside of common tutorial material, I can’t seem to get anywhere with it.
Richard B and Bill G don't have the generational change techutzpa of Elon M and Jeff B.
I work in the medical device field. Funny you should say that because just yesterday I was looking at some really crappy (but still safe, mind you!) code and wondering how I'd feel if I were being wheeled into the OR, knowing "how the sausage is made."
I checked out the archive and came across https://simon.datasette.cloud/data/chatgpt_public_messages?_...

I’m wondering if the archive missed something or what this random statement from the system is about. It seems to be telling itself who it is and setting a restriction on what it knows. I know if it’s not trained on data past a certain point, it cant know it, but still i wonder if you could intercept that and change the cutoff date (if even possible), would that have any effect on anything. But then again, I am probably reading to much into it because it seems to be coming from system.

2023-03-26 04:10:49 - [system] : You are ChatGPT, a large language model trained by OpenAI. Knowledge cutoff: 2021-09 Current date: 2023-03-25
I've noticed it as well. The most recent example I can think was with gitlab webhooks. I need to manage (create/delete/edit) a lot of web hooks across a lot of different projects. I normally would have probably just started doing it by hand in the web ui, but instead I had some python code from gpt to automate it in a few minutes.
chatgpt via Azure is certificable though?

What a win for Microsoft if they can expose openAI as a usable solution...
That's good, but is that what's used in "used car-batteries with degraded capacity"?
At small scales, yes. But at more than that it's much cheaper to use dedicated slot reservations.
> They will do ANYTHING to stop him out of fear, anger, arrogance etc

ANYTHING, eh? Please tell me, what did they do? Trump won an election (thanks to the mechanics of the Electoral College), he served as president, he passed laws (some of which the courts overturned, as happens with most presidents), he handed out pardons (some wise, some not), and then he lost an election.

What is this "ANYTHING" that has been done to stop him?
The Deep Roots of an Italian Song That Sounds Like English–But Is Just Nonsense
When I called Oracle to inquire about a license and they set up a 1 hour meeting with 5 people in it I knew it would not be cheap. I was right.
> Trade shows, E3 in particular, was where studios gave you a taste, a preview, an announcement, got you excited

All of this has moved to The Game Awards now, probably because companies don't necessarily need to actually pay to attend. PAX is also still a thing.

> But maybe that's just me getting old.

Probably - all of the eyeballs are on twitter/youtube/facebook now and they can pay to shove themselves into your feed. Companies get more bank for their buck spending their millions of advertising budget on those platforms rather than spending that money on a day or two at a tradeshow.
When you run out of resources on an elastic cloud: "here's a bill for 2-5x what you thought it would be, good luck paying it!"

When you run out of resources on metal: "your application is slowing down, becoming unresponsive, and falling over, good luck getting it back up!"