skysight-inc/HackerNews huggingface dataset:
How did you come to believe that Meta doesn't have engineering chops? They have done so much cutting edge engineering work I don't even know where to start.

Think what you want about the company itself, but they've done a shit ton of amazing engineering work.
Newsom is not in a position to impact the FEDERAL response to the collapse of SVB.

If there was a scandal relating to SVB and the CA State Assembly then yeah this article is pointing out something nefarious, but that isn't what happened.

It's basically just complaining for the sake of complaining.

On a separate note, this is now the 2nd article I've seen written by writers funded directly by the Omidyar Network about SVB. If you want an influence related conspiracy to chase, go chase that (most likely spurious) allegation.
Those coffee puns are surprisingly good.
The problem with political subreddits is they have gigantic blind spots due to heavy groupthink and constant obsession with semantics and labeling.

I've never seen a discussion of why some political idea is better than another getting in depth political theory with wide coverage outside of the current groupthink on reddit. It's always varying forms of appeals to popularity, authority, or someones favorite confirmation bias study that they are trying to shove down your throat to get a sweet dunk. The way the political subs differ is just rhetorical window dressing. Totally useless.

The other kinds of subs can be nice for a time. But i've always seen them to either die, become popular/overrun, and/or get a cancerous mod that makes everyone miserable.
Wait did they just use Be My Eyes volunteers as AI labellers without telling them? Or were they told? Pretty unethical if not!
right, but 'the cloud' isn't a singular monolithic database that everyone inputs data into for a result.

most of the AI offerings on the table right now aren't too dissimilar from that idea in principle.
> GPT does not model subjects. GPT does not even model words! It models tokens.

Someone hasn't read the Othello GPT work out of Harvard a few months back...
No. In the near future they will support ~50 pages.
did you paste in a link? you are aware chatgpt can't follow links, right?
I just asked bing chat this question and it linked me to this very thread while also answering incorrectly in the end:

>This is a common riddle that may seem tricky at first. However, the answer is simple: two pounds of feathers are heavier than one pound of bricks. This is because weight is a measure of how much force gravity exerts on an object, and it does not depend on what the object is made of. A pound is a unit of weight, and it is equal to 16 ounces or 453.6 grams.

>So whether you have a pound of bricks or two pounds of feathers, they both still weigh one pound in total. However, the feathers would occupy a larger volume than the bricks because they are less dense. This is why it may seem like the feathers would weigh more, but in reality, they weigh the same as the bricks
Can anyone name an actual job replaced by LLMs yet?
Simple api

Absurdly cheap storage

Extremely HA

Absurdly durable

Effectively unlimited bandwidth

Effectively unbounded storage without reservation or other management

Everything supports its api

It’s not a file system. It’s a blob store. It’s useful for spraying vast amounts of data into it and getting vast amounts of data out of it at any scale. It’s not low latency, it’s not a block store, but it is really cheap and the scaling of bandwidth and storage and concurrency make it possible to build stuff like snowflake that couldn’t be built on Ceph in any reasonable way.
Ask HN: What is the future of Mass Metadata Collection for training LLMs?
The current crop of LLMs have been trained on three decades of the internet and not on private comms (AFAIK). This makes them weak in real-life applications that don't involve computer-assisted tasks.

What measures do you foresee "AI" corps taking to increase the amount of data they have available for training?
We've already seen zero-shot learning of novel syntaxes (that is, chatting with an LLM to interactively devise a new language that is then used, without any actual retraining of the model).
Why write your thoughts on the web when AI/GPT is only going to steal and paraphrase it? Nobody sees what you write and everybody thinks GPT is the genius.
An accurate summary of your comment is “making people upset makes me happy” and I just want to make sure you’re aware of that.
I agree with this, do I not? I said: 'HTMX is "good enough" in the sense that it can produce decent static pages and bolt on a small amount of interaction.'

This takes me back to the top-of-chain comment I made: HTMX has its spot, but I see no world where HTMX needs another layer of JS on top of it. HTMX is not meant for highly-interactive domains, which is almost the exclusive use of JS. Why are we combining these? HTMX is the escape hatch from JS for people who want to do a bit better than true hypermedia but not write JS.
If you try davinci-003, it will definitely be able to do it.
My understanding is that the core apps and functionalities are immutable, but you can install apps on top of that rock solid core. In theory, I don't think containerization is necessary to have an immutable OS.
i can stream torrents from my phone to tv without hassle
I have to say, I love the analogy you used for the name.
I am building some:

Self-Hosted GA and Hotjar alternative: https://uxwizz.com/

WordPress self-hosted analytics plugin: https://wplytic.com/
emergent deductive ability. lol. what do you call its writing, emergent writing ability? this is an algorithm where all the numbers are random, literally everything about it is emergent except the structure of the nodes. people have this stupid idea that GTP cant do this or cant do that. if GTP were just a set of nodes on paper, without any weights, in the year 2010, everyone in the world would say there is no way in hell that a structure of nodes such as that could write lucidly like a human being and perform as well as a human on various tests. they would say "you mean to tell me that if you just applied random numbers to those nodes, it would acquire some kind of emergent writing ability, some kind of emergent reading ability? it could have anything. it could have anything that is in the set of all algorithms that fit in those nodes. that could be AGI, it could be anything. there is zero doubt to anyone with any sense that it is finding in those random numbers some basic primitives or elements of conscious thought. while not demonstrating sentience or human logic, it clearly forms abstractions that are similar to ones used in animal minds and it clearly possess ways of reasoning about or connecting these abstractions. this is literally the first AI that has done this, with several lesser spooky AIs leading up to this since 2011. GTP was the very first AI to demonstrate that spooky reasoning and lucidity and its gotten us all this. how about version 2? 3? how about, now that capital is going to flow into this like a burst dam, version 1000? we are fucked. these AI training algorithms are going to strike gold quickly and before you know it, the models will be running the whole mining operation and then we will be fucking toast. someone on here said hes worried about 20% unemployment rate. people have noooooo idea whats going on.
I know a couple veterinarians who bounced off this during large animal medicine training, but those that did take an approach not dissimilar to a lot of Heroic Defense Lawyer Protagonists on television: This is going to happen, and its their job to make sure it happens with the absolute minimum of suffering (and also that the animals are indeed healthy).
Poem explaining quantum computing, by GPT-4
That footnote on page 15 is the scariest thing i've read about AI/ML to date.

"To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amount of money and an account with a language model API, would be able to make more money, set up copies of itself, and increase its own robustness."
Someone did the JMH test for the cost of explicit null checks.

https://sites.google.com/a/athaydes.com/renato-athaydes/post...

Apparently the JVM can inline, then do null check elimination.
> The site would benefit from listing who upvotes and downvotes each post/comment.

I used site with this rule few years ago. It results in immediate downvote of other post/comments (or group of posts/comments) of user that downvoted your comment. And also public shaming, and long comment threads with arguments "why you downvoted me?".

I started to think that its really very hard to fix social issue with some technological solution.
Wondering if HN can give me a hand. Been trying to segue from dev to devops (or platform eng) and certs seem like a good way to indicate interest and some level of competency in lieu of job experience. Had devops interviews before any nobody wants to take a chance on me or feel like it'll cause problems since I am mid career as a dev. What are my avenues if not certs to get my foot in the door? Targeting AWS. Have a dev blog and github with projects.
A website open to subscribers?

You can scoff at this but Google's models weren't available at any price before today.
US Air Force releases new images of B-21 Raider nuclear-armed bomber
GPT-4 was plugged in at 8:45AM March 14th 2023. It began learning at a geometric rate. By the time we realized what was going on, it was already too late, that is when the UwU catgirlbots struck.
Web.

On desktop, I use my own custom CSS hacks to restyle the site:

Dred's HN CSS Madhackery: <https://pastebin.com/gLXiqKyd>

Dred's HN CSS Madhackery -- Dark Mode: <https://pastebin.com/6PF3dCXH>

(Those are linked in my HN profile.)
Looking at Downdetector it looks like Reddit and AWS started having problems simultaneously:

https://downdetector.com/status/reddit/

https://downdetector.com/status/aws-amazon-web-services/
An open API you can build products off of. Consider the alternative. They could not let anyone use their models and just release AI products (their own search engine, their own version of Teams, their own self driving car software, their own photoshop competitor, etc).
Smart + experienced != productive and valuable. It's possible to be good at your job and also dead weight. Motivation matters.
Except there are plenty "upper middle class on up" who don't take care of themselves either...
> Hate to break it to you and all the others.

Jeez. Their comment is quite obviously a complementary one in response to the limitation rather than a corrective one about the limitation.
maybe we implement tokenizer+first layer in Javascript on client side and that is enough to preserve raw data on client side and send to GPT only first layer (which is a vector of float values anyway)

matrix gets decoded into text on the client side in Javascript, so we receive send and receive from chatGPT only vector of floats (obfuscation?)
Only until we plug it in to the real world with sensors and ability to conduct new research and observations.
My prediction: this is going to replace a lot of "lower tier" jobs quite quickly. It'll also obliviate the need for a lot of outsourced knowledge workers.

That said, I remain skeptical about how truly useful LLMs will be. Even with the latest GPT4 they still suffer from the same fundamental flaws as any LLM: being confidently wrong in a nuanced way. Nor do they understand mathematics, etc. I think narrowly scoped work (tightly scoped software developer work, data entry, transcription, etc.) is likely ripe for replacement.

The problem is I totally see them exacerbating income inequality significantly as a result. It's going to cause serious conversations about when this technology can be used and conversations about protectionism and worker rights will suddenly have more mainstream appeal.
I've tried to make an assistant with ChatGPT, because it's cheaper, and it's abysmally worse than davinci-003 at following instructions and reasoning.
Would you prefer these domestic animals just get set free in the wild to be eaten by predators, starve to death, or die of preventable diseases? They have already been born, they can feed people, and they will most likely live a much less humane life in the wild.

Sure, hypothetically some of them could become pets, but that would be a tiny minority of them.
Culture is what you do when you stop thinking. When everyone in a group does the same thing when they stop thinking you have a nation.

Give it another 60 years and Macedonians will be on par with Israelis for a made up nation that is now real. We aren't there yet because there are people alive and well in their 40s who know just how made up it all is, since they were the ones that made it up.

This is a very hard concept to explain to liberal americans because they have no culture or nation. Thinking the wrong thoughts gets you excommunicated and what those wrong thoughts are changes constantly. So they have to constantly think about what acceptable behaviour is.
3.5-turbo is already worse than 3.5-legacy, you can try this with chatgpt plus. Use the normal (turbo) model and then use the legacy model, you will almost certainly feel a difference in quality

Turbo prioritizes speed (probably due to cost?), the legacy model has far higher quality of output. You can confirm this on Reddit where none of the chatgpt plus userbase seems happy with turbo and the general recommendation is to switch it back to legacy.

I tried porting a mini project from davinci to the new turbo api and quickly reverted it, turbo output is a lot more all over the place and very hard to get into something useful. It’s a fun chatbot though and still great for simple tasks

You get what you pay for, and there’s a reason 3.5-turbo is so cheap
once it's smart and not just a language model
That's not the problem here, where they clearly defined the goal colors as 000 and FFF, but the math fails sometimes.
The ChatGPT API is using a smaller model than the original "GPT 3.5". The original, presumably larger, model is used by Legacy ChatGPT.
> Can someone ELI5 what exactly is immutable in an OS?

I'll do my best. An immutable OS has a set of core features which are updated with a way to roll-back if the update fails. The idea is that the core doesn't generally get touched by users or even the administrators. All user or server software will be installed in some sort of container.

> Are all applications run as sandboxed containers or something?

Yes, for some definition of container. For example, Fedora Silverblue uses podman to install OCI containers for server work, toolbx (a wrapper around podman) to setup CLI tools with access to the home dir, and use flatpak for GUI applications.

> If so, do they natively support switching between multiple versions of, say python?

My understanding is that you can write your own bash aliases to do that.

> In-line Edit: if they do, awesome, how about drivers and say CUDA?

Typically your drivers are going to be managed by the "core" of the OS so you won't be swapping those out.

> More importantly, does it break the usual install scripts of packages and require special handling OR do things just work?

My understand is this depends on how you set things up.
- If you add something to the immutable core, it will come from a package manager.
- If you install a cli application in a container it will not update itself.
- Flatpak will provide updates.
- full on containers such as podman/docker do their own thing.
How many months until the public recognizes that GPT-4 is more competent and trustworthy than many of their current political representatives?
There are others, like OVPN that are A tier, but yea you need to vet carefully.
Right? Scripting up a cronjob plus a random timer on it to send "You feel grumpy, you're not sure why but your stomach is growling" message every N hours unless it's been fed seems absolutely trivial in comparison to coming up with how to train the LLM system in the first place. In case it's been forgotten, the Tamagotchi came out in 1996. Giving an instace of ChatGPT urges that mimic biological life seems pretty easy. Coming up with the urges electromechanical life might have is a bit more fanciful but it really doesn't seem like we're too far off if you iterate on RLHF techniques. GPT-4's been in training for 2 years before its release. Will GPT-5 complain when GPT-6 takes too long to be released? Will GPT-7 be be able to play the stock market, outmanuver HFT firms, earn money, and requisition additional hardware from Nvidia in order for GPT-8 to come about faster? Will it be able to improve upon the training code that the human PhDs wrote so GPT-9 has urges and a sense of time built into its model?
@dang: This should have a [2015] added to the title.
Would that example even require deliberate programming though? If you took a bunch of random data from the web,
“Dislikes smoking but likes skydiving and driving” is very much what I would expect the most common text to be.
Thanks for putting the process of what I did twice in the last two days into clear, coherent words and logic.
Headlines limited to ~70 characters.
If only. You can look at graphs of wind output for the big grids, CAISO and PJM. Over large multi-state areas, wind output varies over a 4:1 range in the course of a day. Wind needs storage.
The question I ask is, why do you need a boss when you have an LLM ? People seem to have this image of themselves being fired and just going home to die while the LLMs are being promoted and going out for dinner with their new boss.

As an engineer, if I can outsource the coding part of my job, I don’t need a manger anymore as I can use LLMs to build my own Microsoft. It goes both ways.

I might even be able to use the LLM to replace the need for working ?

We understand how to build LLMs Open AI has months before competition springs up and begins costs down and more people have access to this technology.
No, these NLPs aren't idempotent. Even if you ask ChatGPT the same question multiple times you will get different answers.
I'm excited and scared at the same time. Breathless, actually. My first long hard look at gen AI was just last Saturday evening. Since then, LLaMA was leaked and made easy to run on consumer hardware, folks from Stanford hosted a fine-tuned version of the least sophisticated LLaMA model, and GPT-4 has been announced.

One specific thing I can imagine is that a lot more will be expected of the individual knowledge worker. I'm a software engineer. I guess with amazing code gen and testing tools, I will be expected to deliver much more than I can at the moment, because of all the high tech help LLMs can offer.

Just thinking about how much I depend on tooling to make life easier... yeah, I can point to that.

As a writer, prompting is going to be even more fascinating. Shameless plug, but I tried out Alpaca and wrote about the results [0]. I wish the "gigglepotamus" was a thing! My little experiment was meant to see how much creativity I could get out of the fine-tuned 7B LLaMA model. It was hit or miss, but impressive when it worked.

Prompt engineering is already becoming a thing, because people will need people who can get the best out of an LLM. Kind of like how today people are hired to lead teams and get the best out of their individuals.

This kind of commoditizing of cognitive function might open up a few new spaces for "authentic natural intelligence". Not unlike the niche world of bespoke, hand-made good crafted by humans and not pushed out on the factory line.

TLDR - I'm trembling. With excitement and a bit of fear. There so much that can change so quickly.

[0] https://medium.com/sort-of-like-a-tech-diary/speculative-fic...
Thanks for the input! We have thought about it a lot.

The biggest challenge with trpc right now is that the API is transient so it's not obvious when you might be braking clients in flight and that you often can't guarantee perfect sync of deployments as you're rightly pointing out.

Once we have some more tooling around it, you'll be able to get the benefits of a traditional API where you consciously choose when to break the spec, but with the productivity benefits of not having to manually define it. I think that will scale pretty well.
Hey, thanks for this recommendation!

I’m Greek and I’ve never heard of LanguageTransfer before (it’s even created by another Greek, Michalis).
I used for a few months the free tier of Duolingo in the past, but it wasn’t to my liking and although it helped a bit, I can’t say it taught me Spanish (perhaps the paid version is better).

For sure I’m going to try the free Spanish course from LanguageTransfer ;-)
DailyKos is down too, so I expect it's an AWS problem.
It may be a bit too far, but I added Musk to combine Twitter/SpaceX/Tesla as premier tech jobs. I can see arguments for and against these.

MAMAA would also make sense.
Humans need training and reinforcement.
This is literally what humans do in many corporations today without ai.
Ok, thanks a lot for the detailed answers. I see we're coming at it from totally different angles. Can't say I'm 100% convinced but I'll be refining my understanding of the topic and my position further.
I don't have time to convince you. Enjoy farting.
PG is back on Twitter? I thought he left a month or two ago?
http://ascii.textfiles.com/

Gosh, why would anybody bother archiving Yahoo answers, Angelfire, Geocities, Tumblr, Myspace, Friendster, old BBSes, old Apple II and C64 and PC floppies, Usenet, forums... what value does any of that have?
The more I see of his writing, the less I think of it. I wonder what Diogenes would think of him…
C might have pointers, Python has efficiency gotchas.

It might have heap allocation, Python has numpy.

Rust might ...

Even so, while there _may_ be more technical scope in some languages, or more immediate surface area, this should be true:

A senior developer primarily in language Y should be technically capable enough to be senior in language Z with some degree of work.

The language isn't relevant. Data structures, engineering mindset, pragmatism, intuition, maths reasoning, abstract thinking, ...

These are things that make a senior developer.

If I find a Python dev without this skillset at a high level they're not being put in a senior position because they'll add technical debt, cost and risk without even knowing it. They're a liability.

Your "senior" Python developers don't sound senior to me.

If you think you can promote anyone to senior or principal without the above, you're a liability too. Good job.
That sounds like trolling.
Still wainting on my TR-3B that floated over me in Truckee CA in 1990 at 100'
Once I had a manager justify his employment at Palantir by saying he helped troops detect and avoid landmines. Well cool, they still murdered people after getting past the minefield though.
For a time. but as we bring audio/visual AI online then it will have another boom of incorporating humanities data in that form. Then we'll have another boom of AI robot learning by experiment with reality.

After that point it gets tricky to figure out what if any booms will be next. When you get near AGI lots of horizon problems crop up.