skysight-inc/HackerNews huggingface dataset:
We wrote our own LFS API server (which is actually not very hard, about 100 lines of python was enough and it performs at scale) so we can directly leverage azure blob storage. If you don't walk this path and enable LFS in github or something like that the costs are obscene, yes. For us it's dirt cheap.

If I check out head of my repo and don't filter anything, it's a couple GBs.

Inside the azure blob storage container that backs our LFS API server, there's probably terabytes of data. It's really very very much.

We don't have any performance problems. One API instance can handle it. Of course we did make sure to implement it well... It's Uvicorn/Starlette, all IO is async and all CPU "intensive" work like JSON (de)serialization runs in a background threadpool.
Some quick thoughts:

1. Given the availability of both LLAMA and training techniques like LORA, we're well past the stage where people should be able to get away with "prove this wouldn't work" arguments. Anyone with a hundred dollars or so to spare could fine-tune LLAMA using the methods you're talking about and prove that this technique does work. But nobody across the entire Internet has provided that proof. In other words, talk is cheap.

2. From a functionality perspective, separating context isn't a perfect solution because LLMs are called to process text within user context, so it's not as simple as just saying "don't process anything between these lines." You generally do want to process the stuff between those lines and that opens you up to vulnerabilities. Let's say you can separate system prompts and user prompts. You're still vulnerable to data poisoning, you're still vulnerable to redefining words, etc...

3. People sometimes compare LLMs to humans. I don't like the comparison, but lets roll with it for a second. If your point of view is that these things can exhibit human-level performance, then you have to ask: given that humans themselves can't be trained to fully avoid phishing attacks and malicious instructions, what's special about an LLM that would make it more capable than a human being at separating context?

4. But there's a growing body of evidence that RHLF training can not result in 100% guarantees about output at all. We don't really have any examples of RHLF training that's resulted in a behavior that the LLM can't be broken out of. So why assume that this specific RHLF technique would have different performance than all of the other RHLF tuning we've done?

In your linked comment, you say:

> Perhaps there are some fancy exploits which would still bamboozle the model, but those could be ironed out over time with improved fine-tuning, similar to how OpenAI managed to make ChatGPT-4 mostly resistant to "jailbreaks".

But GPT-4 is not mostly resistant to jailbreaking. It's still pretty vulnerable. We don't have any evidence that RHLF tuning is good enough to actually restrict a model for security purposes.

5. Finally, let's say that you're right. That would be a very good thing. But it wouldn't change anything about the present. Even if you're right and you can tune a model to avoid prompt injection, none of the current models people are building on top of are tuned in that way. So they're still vulnerable and this is still a pretty big deal. We're still in a world where none of the current models have defenses against this, and yet we're building applications on top of them that are dangerous.

So I don't think people pointing out that problem are over-exaggerating. All of the current models are vulnerable.

----

But ultimately, I go back to #1. Everyone on the Internet has access to LLAMA now. We're no longer in a world where only OpenAI can try things. Is it weird to you that nobody has plunked down a couple hundred dollars and demonstrated a working example of the defense you propose?
It applies always. But I don't see contractual consent as the highest moral virtue.
And then lost them again during the gap between Vista's launch and SSDs becoming ubiquitous...
FOX and CNN are at least held to a higher standard. We need to apply those same standards to the internet.

If they tell an outrageous lie on CNN they can be sued.
Aren't most supercomputers clusters of racked machines?
TBH, Reddit has been pretty addictive for me. Currently working on breaking that addiction.
Good write up, I appreciate the humility about what it is and isn’t. Cheers!
> groupby by two columns is not very common, so DataFrames.jl decided to leave it out from precompilation. For this reason when you run groupby(flights, [:origin, :dest]) native code for such a scenario is not cached. This is indeed a hard design decision for package maintainers. You could add more and more precompilation statements to improve the coverage of cached native code, but it also costs as it would impact: package installation time and package load time.

How feasible is it to let the users provide their own precompilation code? If I know that two-column groupbys are important to me (or some other operation that takes tens of seconds), it would be nice to be able to pay the one time precompilation cost for them to have much better TTFX later.
Good summary and test cases. Not too surprised to see the result – I feel most commentators have preferred ChatGPT to Bard. In fact, on Bard's initial launch, I remember a lot of discussion expressing surprise that Google was as far behind as it seemed. Maybe there is more hype for Bard in other circles than mine?
No. We agree on their right to exist. We don’t support their apartheid. It’s a policy failure to treat countries as monoliths.
I consider all the manual curation effectively a form of RLHF that can be imposed automatically later on. We saw how much this can improve a raw LLM by looking at the output of ChatGPT. Otherwise, the criticism of LLMs being just glorified autocomplete machines isn't that far from reality. In other words, it is just an expected requirement for LLMs to be effective.

You are probably right that lysozyme is an easy target and may have large sequence variety between homologs so saying "very different" for 30-40% is not correct. But that is only in the context of biology and protein structure and function. This is an LLM trained on primary sequences only. It doesn't know anything about the folds or domains or functional sites (unless I am wrong and those are part of the metadata fed to it during training). Yet it did learn enough to generalize to the point that even with only 30-40% identity, it still produces soluble proteins with the same function. I am sure you know that at 40% differences, one protein can be in an entirely different superfamily from another. So it is still an impressively low identity score.

Also, I think it is more appropriate to compare the amino acids to things like the alphabets than vocabs. Domains would probably be an equivalent to LLaMa vocab.
> surely I don't need to explain to you what effect laying off a bunch of workers might have on share price?

Surely you do, because sometimes the stock goes up if the workers weren't needed in the first place, sometimes it goes down because it shows the company is flailing, and sometimes it does nothing because it's business as usual.

You're operating under an illusion that execs have control over how the market will respond.

> Sorry, I'm missing the part of this where you answered the question.

And I'm missing the part where anything I wrote gave you the excuse to be rude. Please be civil, this is HN.
Routing Patterns for Manageable Phoenix Channels
Oh that's great. Curious what the model sizes are but then to be fair gpt4 isn't publicly saying that either.

Side smaller complaint - whats the point in these wait-lists if they never tell me when stuff actually launched.
How do you know other animals are not self-aware? Is self-awareness a criteria for not being killed and eaten? Is it not pain and suffering that really matters?
You can install Android yourself. Most people will use Android "distros" like https://lineageos.org/. Or of course you can go the "Android from scratch" route.

But yes, the biggest issue is drivers. Many phones have proprietary drivers that are required for the hardware to fully function.
It's not intentional in the sense that they're trying to do that to her, but their algorithm likely determined that showing a video in that cohort leads to increased use of their app.
And you... permit this to continue? Intentionally?
So did “fintech” just mean “shitty bank” all along, same way that crypto was just shitty penny stocks.
This is the original reporting that Business Insider rewrote:

https://www.nytimes.com/2023/05/12/technology/tiktok-bytedan...
It's not the road surface, it's the city blocks with not a single window that isn't boarded up, and a third of the houses have trees growing inside.

As for the schools, they already get a ton of funds: https://foxbaltimore.com/news/project-baltimore/update-balti...

But more money won't fix systemic incompetence, corruption (https://www.justice.gov/usao-md/pr/former-baltimore-mayor-ca...), and misguided policies.
Git does do compression on repos, but the fact that versioning repositories with (huge) data is still an open problem suggests that it is not the kind that fixes it. I might be mistaken, are you aware of any interesting compression methods applied to version control?
I have no love for Russia or China, but to be frank, as someone who comes from a "shithole country", I also have no love for the US. The US has a long history of being exploitative and by flexing it's oppressive military muscle, without anyone calling it out.

In a fight between China/Russia and the US, I support the fight.
Which governments should Twitter obey, then?
Why did the executive have customer's phone number?
Urbit, a network older and weirder than Bitcoin, finally turns towards growth
Yeah, totally agree. The American system seems to have, despite its amazing innovations and advances, that we all benefit from sooner or later, the worst of both worlds: neither an efficient market-driven approach not a particularly socialised one either. And that's despite the US government spending more per head than I think any other country on healthcare.

The ties between government, big pharma, insurance companies and hospital systems must be so entrenched that it's very difficult to see a way out.
A human blink takes about 0.1s.
And spends roughly 75 years alive.

Blink/s/min/hr/day/years=
0.1/60/60/24/365/75 = ~4*e-11
ratio of blinks to years alive

Age of universe is 14Byears

14,000,000,000 * 4*e-11 = 0.59 years.

A cosmic blink is about 7months
One of many reasons why shadowbanning is bad and outdated practice.
No no no. You're confused.

There is no algorithm acting independently. The responsibile agent(s) is(are) a person(people).
Check out other anvaka's projects, there are gems: https://news.ycombinator.com/from?site=anvaka.github.io
Isn't the repair work that of the RNA ligases, whose particular versions for humans are first mentioned here?

> "In order to fulfill their diverse functions in the cell, RNAs often need to be chemically modified after their creation or repaired after damage," explains Andreas Marx, professor of organic and cellular chemistry at the University of Konstanz.

> One chemical reaction that plays a role here is the three-step linking (ligation) of two RNA strands at their respective opposite ends. This reaction is triggered by specialized enzymes called RNA ligases and is present in all forms of life, from viruses to fungi and plants. In vertebrates, including humans, such RNA ligases had yet to be identified.

> An interdisciplinary research team from Konstanz has now discovered the first human RNA ligase of this type, the protein C12orf29."
Twitter imposed content restrictions for Turkey
It is interesting how the definition of a supercomputer changes over time.

Compared to decades ago now everyone carries a supercomputer.
don't you have like extra heap allocation per call with code that macro expands to?
Gonna have to agree that at the very least, the immune system is way up there! After reading Philipp Dettmer's book "Immune" (recommended), I couldn't help but think, "Wow, the API and protocols that this thing has..."
If you're providing financial services in a heaivily regulated industry, it's not that big of a leap. The company has a pending application for a UK banking license for the past 28 months; the turnaround time for that in the UK is 12 months. Yet even now, they have filed their accounts several months late, and without a clean bill of health from the auditor.

The CFO of all people should have advised withdrawal of their application until internal controls were sorted. That they're resigning instead doesn't bode well.

From the FT, their UK operations chief departed as well: https://www.ft.com/content/f27f6b80-d32d-4913-991d-c512f6e90...
You are the author so can change the title?

You can’t have the cake and eat it too
> I'm not even allowed to use it _at my own risk_

Obvious hyperbole, but:

There is no such thing as "at your own risk" in the EU. It's a Nanny State. Brussels knows best what's good for you.
Totally get it. I still visit sites like reddit (or HN) where you can browse and scroll interesting things.

Think the bigger challenge for anyone who quits these sites is what to fill the time we spend scrolling with? We’ve all spent many years conditioned to simply open these apps to fill any time or moment of boredom, with low effort. Ive had to take up a number of interests, mostly physical, to keep busy and happy.
i.e. Japan where even if something is true there needs to be an actual public interest in my publishing of it.

[1] > Under Article 230-1 of the Criminal Code of Japan:

> “(1) A person who defames another by alleging facts in public shall, regardless of whether such facts are true or false, be punished by imprisonment with or without work for not more than three (3) years or a fine of not more than 500,000 yen.”

Personally I like the UK model where the speaker is on the hook for knowing what they say is true. It shouldn't be too much to ask people to avoid making an unfounded claim ...

[1]: https://kellywarnerlaw.com/japan-defamation-laws
Personally I just buy Brother now, though they are starting to do some of the tricks.

Least evil option?
Let's go back to 2009. Am I hiring for a social media position? Does the experienced person have 2 years of experience in marketing or in social media?

We've all seen this flip before and I think its disingenuous to pretend it doesn't apply here because its "low skill". this leads to us being okay with someone making less than the minimum wage and pushes downward on labor's ability to attempt to make the playing field livable, not level, just livable in a way that we could be proud of as a nation rather than embarrassed of.
I have never heard anyone call Sage "modern software" before : - )
I avoid TypeScript because I already feel the tidal forces on me emanating from Redmond. We are currently working on an education app in C# and it’s simple and delightful to do it and our front end is so easy to do. I also kind of like Typescript too, but as the author here points out, then you’re married to this tooling and … all of these autogenerated files.

So for me I guess I’m saying the threshold is lower just because I already feel like I need to keep some diversity in our codebase.
Yes, but it's pretty small compared to men. I'm ignoring the much smaller case for the moment.
Now we have spinners that twirl while we wait for graphics to transmit from another continent.
literally all I want is the best llm
This is really neat! Are there any insights you gleaned from doing this that were unexpected?
Fwiw once upon a time .com was the file extension that predates .exe
English is widely spoken because it was the colonial language enforced at the highest levels of society. This is still true today and is currently a primary plank in the political platform of US conservatives.

https://en.wikipedia.org/wiki/English-only_movement

There are libraries of books written solely on this subject. Your bizarre hypothesis ignores this and instead points to slavery and trade. More to the point, there are new articles on how English was enforced on subjugated people published on an almost weekly basis. Last week, the article I read on this topic was about how indigenous orphans were prohibited from using their native language and forced to use only English. But let’s talk about glowing myths about trade and slavery instead which have literally nothing to do with it.
Scroll wheel works for me.
Similar (but a far more limited implementation):

“Write a Git Client from Scratch in 25 Minutes”

https://youtu.be/xvzo_nV9PjU
Tangent: TRS-80 Model III was advertised at $8,326.63 in 2023 dollars! (page 36)
Bard's also not available in Canada yet! I feel a bit like a broken record. But it's something a bit shocking and I believe needs to be addressed. Why not google? What's the real answer?
One approach you could try now is creating StartUp packages: https://julialang.github.io/PrecompileTools.jl/stable/#Tutor...
That’s a result of occupying a certain canopy layer. Any other plant that occupies that canopy layer can do the same.
By what measure of complexity, and what definition of “object”?

Arguably the totality of all lifeforms on earth, which are all physically connected to each other by their common genealogical graph (and by Earth as their environment), is more complex, because it contains all the brains.
Permit? Your wife? It's not a kid you can revoke internet access from.
Privy Reviews
Privy is a free and open public forum that brings creators and audiences together. Built on trust and transparency, Privy provides a safe space for subscribers to share their experiences about content creators while also discovering new ones. Privy is a free and open review platform that lets users review their favourite digital creators from Twitch, Youtube, TikTok, Patreon, Soundcloud, and more! Find new and exciting digital creators to follow and subscribe to. Join Privy and start asking your already established fanbase for reviews to confirm your popularity to brands and other collaborations. Advertising your online reputation and credibility will help market your already amazing content to even more people. Sign up for free today!
IDK anything about music theory but I wonder, if you're having trouble finding a good at abstraction to express theory, perhaps the theory is at fault.

I mean, at a high level, theory is the abstraction isn't it?
i use them day to day last week for various matters. That includes work, leisure, life. ChatGPT's $20 is a good deal, 1 month ago Bard was a junk right now it can be ok for many reasons, I'd rate it as free GPT-3.5
In other words, cognitive dissonance.

https://en.wikipedia.org/wiki/Cognitive_dissonance
too strong consumer rights like in the eu
Modern FPGA Architecture (2021)
That is really interesting and begs the question of how frequently you have changes in your data that lead to new commits. I am assuming here that you don't dedupe anything, that is, you throw the entire files into Azure with each version, since it's cheap enough for your purposes. Also, how frequently do you move head, even without committing anything new, perhaps to use another branch?
> It's not intentional in the sense that they're trying to do that to her,

Do you know this for certain?
If the rules that govern intelligence are simple (and intuition tells me they are), then the immune system is certainly a complicated and prickly beast.

https://en.wikipedia.org/wiki/V(D)J_recombination is wild.

My money is on the immune system being more complicated.
No no no. You're confused.

I didn't absolve the creator of guilt, I just said that it's unlikely they're intentionally trying to make her sad. They're just trying to increase engagement - at any cost.
The article seemed to imply the customer had been texting complaints directly to the executive, not that the executive just cold texted a customer a weird threat.
Change is the constant
The link you mention is in the first sentence and refers to "all but ruled out most of the worst-case scenarios". [0]

The second sentence, about "a good chance that we can hold warming below the 2 degree level" links to a different tweet, with different data [1].

I don't think there's any risk of "civilization ending" below 4 or 5 degrees.

In the future, before calling someone "relentlessly stupid", you probably should check whether you've understood correctly what they're saying. But this is the sort of emotionally charged rhetoric that happens when people are primed for the apocalypse! That's why doomerism is a problem! It's cathartic, but not helpful.

[0] https://twitter.com/hausfath/status/1425504599167827968
[1] https://twitter.com/hausfath/status/1465330361077018634
GPT-4 doesn't do great at math, but it can ace the bar exam and do plenty of far more complex things. However, individual skills or knowledge aren't the same as intelligence. You can be intelligent and still not know something until told/shown, or not know how do do something until you've tried and practiced.

The whole discussion is about intelligence. I was replying to OP. MY definition of intelligence is degree of ability to apply prior experience to correctly predict future outcomes. However my definition isn't particularly relevant here since you seem to want to side with OP and say that GPT-4 isn't intelligent - so it's YOUR definition of intelligence that would be needed support your position.

BTW, I'm not sure why you think GPT-4 couldn't code a Transformer (i.e. a GPT-3/4 type model). Yesterday I was talking to GPT-4 about difference in scaling strategy between GPT-2 and GPT-3 and detailed operation of decoder-only Transformers, and it appears very capable, and it can certainly code. Again, a specific skill like being able to code isn't necessary to be called intelligent, but if that's your litmus test then GPT-4 passes.
If I can fully erase it, that's what I'll do. Disabling it is a comprise from a weakened position.
I'm pretty sure "tiktok is specifically trying to make people sad" and "tiktok does not really care if they hurt people as long as they increase engagement" are two separate concepts.
Try reading the Bible again after watching Jordan Peterson's the Biblical series. You'll thank me later.
I don’t know. But that gets into the broader design pattern of engineering a microclimate, whether that is changing local humidity and temperature levels.

Perhaps, the structure itself can also provide some other functions. The pylons, for example, can double as a way for deep root watering.
I don't know that the diagram is correct.

Where it indicates "scheme" - that is actually protocol to be used.
> when it's generally understood that ".com" and ".edu" are domains

.com is also a file extension. It describes an executable format that predates the web.
Did you mean Pegatron?
First Came the Sports Betting Boom. Now Comes the Backlash
eev.ee wrote some great articles about doom, and made one of my favourite doom maps
"Like all proprietary AI software, I'm sure this app will generate battle plans without explaining why they make sense or what intel they were based on."

AI does what you tell it to do. As you likely know, a NN model never outputs definitive results, we clamp/truncate them to make it so. In areas of life and death you can choose to keep this information and lay it out as part of the way for an AI to establish the reasons behind its decisions and its level of certainty.

You're describing poor practices that come out of likely poor understanding of tech, poor training, maybe perverse economic incentives for Palantir to present its technology in a more assertive way than it should, but we're simply guessing.

AI is what we make it to be, literally.
That's wild, and a bit disappointing to hear. My spam protection has been top-notch. Perhaps because it's a custom domain with very little traffic. Also I mask everything with 1Password which has been nothing but good too.
Complexity is a bit subjective. Society is ostensibly more complex than us, because it includes us. Of course, so far society is more often less than the sum of our parts, than the other way around. Growth is hard.