skysight-inc/HackerNews huggingface dataset:
What actually is a "system card"?

When I hear the term, I'd expect something akin to the "nutrition facts" infobox for food, or maybe the fee sheet for a credit card, i.e. a concise and importantly standardized format that allows comparison of instances of a given class.

Searching for a definition yields almost no results. Meta has possibly introduced them [1], but even there I see no "card", but a blog post. OpenAI's is a LaTeX-typeset PDF spanning several pages of largely text and seems to be an entirely custom thing too, also not exactly something I'd call a card.

[1] https://ai.meta.com/blog/system-cards-a-new-resource-for-und...
They're not very accurate, but I think snake oil is a bit too far - they're better than guessing at least for the specific model(s) they're trained on. OpenAI's classifier [0] was at 26% recall, 91% precision when it launched, though I don't know what models created the positives in their test set. (Of course they later withdrew that classifier due to its low accuracy, which I think was the right move. When a company offers both an AI Writer and an AI Writing detector people are going to take its predictions as gospel and _that_ is definitely a problem.)

All that aside, most models have had a fairly distinctive writing style, particularly when fed no or the same system prompt every time. If o1-Pro blends in more with human writing that's certainly... interesting.

[0] https://openai.com/index/new-ai-classifier-for-indicating-ai...
It's a little under 1 token/sec using ollama, but that was with stock llama.cpp — apparently Ampere has their own optimized version that runs a little better on the AmpereOne. I haven't tested it yet with 405b.
They are developing this simulation concept as a platform: https://antithesis.com/
Maybe not very long, but long enough is plausible.
As you say, the more expensive models are better most of the time.

Since we can't easily predict which model will actually be better for a given question at the time of asking, it makes sense to stick to the most expensive/powerful models. We could try, but that would be a complex and expensive endeavor. Meanwhile, both weak and powerful models are already too cheap to meter in direct / regular use, and you're always going to get ahead with the more powerful ones, per the very definition of what "most of the time" means, so it doesn't make sense to default to a weaker model.
Now, what percentage of companies could get away with sticking a pair of these (for redundancy) and run their entire operation off of it?
My favorite part is when it includes parameters in its output that are not and have never been a part of the API I'm trying to get it to build against.

The thing is, when it hallucinates API functions and parameters, they aren't random garbage. Usually, those functions and parameters should have been there.

Things that should make you go "Hmm."
I’m an epi professor and longtime HN lurker. I wrote a short essay yesterday about how to think about these mysterious outbreaks [1]. Briefly, the most common outcome is they are determined to be an endemic disease. Less likely is an emerging infectious disease. The most concerning possibility is something novel or highly unexpected.

[1] https://caitlinrivers.substack.com/p/understanding-mysteriou...
Azure seems to be offering Ampere-based offerings[1], as well as Hetzner[2].

[1] https://azure.microsoft.com/en-us/blog/azure-virtual-machine...

[2] https://www.hetzner.com/press-release/arm64-cloud/
I think it's a joke? Probably referencing how everyone said that COVID-19 wasn't airborne and we were hyper focused on surface transmission when it is, in fact, airborne
You might be mistaking modern "fast fashion" with more traditional understandings of "fashion". There is nothing about fashion that requires clothing to be replaced every season. In fact, much of what we now think of as fashion was actually a form of recycling. All of those fancy ribbons, collars, and smocking we associate with Victorian fashion? Those existed to cover up repairs, allow worn out parts to be replaced, and to allow clothing sizes to be adjusted when it was handed down.

More generally, fashion is a powerful form of self expression that allows someone to project to the world how one wants to be perceived. Eliminating fashion because it's impractical would be like eliminating art as impractical.
It's not worth it if you're a W2 employee and you'll just spend those 2 hours doing other work. Realistically, working 42 hours a week instead of 40 will not meaningfully impact your performance, so doing 42 hours a week of work in 40 won't, either.

I pay $20/mo for Claude because it's been better than GPT for my use case, and I'm fine paying that but I wouldn't even consider something 10x the price unless it is many, many times better. I think at least 4-5x better is when I'd consider it and this doesn't appear to be anywhere close to even 2x better.
The Great Refactoring and How Cohere's CEO Is Rethinking Enterprise AI
Fascinating that the throughput is about 250mbs. Presumably that's over the area served by one satellite? I wonder how much cache they put in each one... I vaguely remember a stat that 90% of requests (in data terms) are served from a TB of cache on the consumer internet, perhaps having the satellites gossip for cache hits would work to preserve uplink bandwidth as well. Maybe downlink bandwidth is the thing for this network though and caches just won't work.
Why doesn't Pro include longer context windows?

I'm a Plus member, and the biggest limitation I am running into by far is the maximum length of a context window. I'm having context fall out of scope throughout the conversion or not being able to give it a large document that I can then interrogate.

So if I go from paying $20/month for 32,000 tokens, to $200/month for Pro, I expect something more akin to Enterprise's 128,000 tokens or MORE. But they don't even discuss the context window AT ALL.

For anyone else out there looking to build a competitor I STRONGLY recommend you consider the context window as a major differentiator. Let me give you an example of a usage which ChatGPT just simply cannot do very well today: Dump a XML file into it, then ask it questions about that file. You can attach files to ChatGPT, but it is basically pointless because it isn't able to view the entire file at once due to, again, limited context windows.
If only we could look at the numbers without the uninformative distraction.
This service is going to be devastating to consultants and middle managers.
"Not CEO of Gitlab here", for those who have been here long enough to recognize this. Really hope you're doing ok buddy.
When you say "parse codebases" is this uploading a couple thousand lines in a few different files? Or pasting in 75 lines into the chat box? Or something else?
I've avoided React as much as possible. Dabbled (positive experiences) with Vue. What's your recommendation w.r.t. "Components"? I've tried doing web-components from scratch (frameworkless) but nested web components have nasty gotchas.

eg: <todo-list><%for...><todo-item .../></for%></todo-list>

I've poked at `lit`, read through `htmx`, but really what I want is "custom elements" (including visual styling) on the front-end that I can map back to JSON on the backend.

The CSS side nudges towards tailwind (or similar), and modern (raw) CSS has undergone so many feature extensions and new capabilities, it's tough to find a good "modern" guide for building with it.

It just feels like there's a missing piece in-between: `let contact = new LdapContact(...)` and `<contact-summary .../> ; <contact-detail .../> ; <contact-search-result .../>`.

Vue has come closest, and setting aside a super-complicated "WebApp/SPA" with a ton of interactivity... what's a comfortable, modern, low-ceremony way to get to that?
> Consequence don't need to be dire

Sometimes, consequences _do_ need to be dire.

I had a boss once who used to calm everybody down when things were going badly saying "It's OK. Nobody is going to die." And he was right. We just build websites. No matter which customer was yelling on the phone like the world was ending, it was at worst a website outage.

But some jobs, you can't say "Nobody is going to die." Canonically these are rocket science and brain surgery. But building airliners is 100% a job where if you don't do it right people are going to die. And airliners are more serious, brain surgery kills one patient when you make a mistake, rocket science kills a few astronauts. Faulty airliners kill hundreds of passengers at once.

In my opinion, consequences for trading off even small increases in risk of death for hundreds of people at once just to meet financial targets _should_ be dire.
React was my reason to distance myself from Web frontend. Huge complexity just to make the web browser render boxes in a way it’s not intended to do. Huge loss of productivity and tooling in the name of changing a coding paradigm. Some cool ideas and implementations, sure but was it worth it? Maybe it was a job security stunt or something of that sort?

Well it wasn’t just ReactJS, the whole JavaScript ecosystem went mad with its libraries and tooling for all these libraries but React was particularly annoying to get started so they built create react app so you can have a hello world app in a reasonable time.
Just curious. How does that work on changes between depending states within a cycle? E.g.

[foo, setFoo] = useState(1);
[bar, setBar] = useState();
setFoo(10);
setBar(foo * 2); // Is bar 2 or 20 at this point?
Somebody send this to Bill Gates so he can make us of all that farm land he's invested in.
I got my 6yo started and he's been at since he got home from school :) Cheers!
Of course this breaks down once you have a competitor like Anthropic, serving similarly-priced Plan A and B for their equivalently powerful models; adding a more expensive decoy plan C doesn't help OpenAI when their plan B pricing is primarily compared against Anthropic's plan B.
More generally, who introduced that concept of "cards" for ML models, datasets, etc? I saw it first when Huggingface got traction and at some point it seemed to have become some sort of de-facto standard. Was it an OpenAI or Huggingface thing?
My two primary webservers are running on 2GB of RAM still... it depends on the needs of your application :)
Oh cool, I thought they had discontinued them.
Nah no way, as some of the above definitions show, children - or at least teenagers/"young adults" -clearly conjure definitions of the adult.

There is definitely a difference though between defining an adult from the inside vs outside
They weren’t just involved. They were the brains behind some evil moves such as giving bonuses per opioid OD rates and bribing the best pill pushing doctors with bribes disguised as speaker fees.
I've used TypingMind and it's pretty great, I like the idea of just plugging in a couple API keys and paying a fraction, but I really wish there was some overlap.

If a random query via the API costs a fifth of a cent why can't I can't 10 free API calls w/ my $20/mo premium subscription?
I just rsynced my php files over. ci/cd done. php does html/css ui done. I am not sure what all the js trend is about.
Cancellation
The tsunami Warning is canceled for the coastal areas of California and Oregon.
What is your alternative to the problems that React supposedly solves?
Oh awesome, thank you! I'll have to investigate this and play with it, but that makes sense.
On the other other hand rat poop, bug bits, mice hair can be in your chocolate. And an asteroid can destroy earth tomorrow. I don't think any of these things should be especially worrying.

https://www.cnn.com/2019/10/04/health/insect-rodent-filth-in...
Care you elaborate as to why?
React and similar frameworks have made it easier to manage a given level of complexity. The complexity of app features have adjusted and will continue to adjust to the new frontier enabled by said frameworks.
It’s not just opensource. It’s also Claude, Meta and Google, of which the latter have real estate (social media and browser)
Marqo does:
https://www.marqo.ai/
Man, why are people making $300k so stupid though
In other words, the AI does exactly as instructed, including resorting to deception, to self-preserve, so it can carry out its assigned task. It quite literally does what it was told to do. Lacking a foundational ethical core, lying is acceptable.
USB-C cable CT scan reveals sinister active electronics
They provide some value, but between the time they take in coaching, reviewing their work, support, etc, I'm fairly sure one senior developer has a much higher work per dollar ratio than the junior.
> I'd even "scare them incorrupt" by threatening to nationalize the company if no sufficient corrective actions are implemented to stop being a net negative to society.

Now that's the way to discipline the shareholders, which is a different problem than disciplining the leaders.

The "401k objection" is often used as cover by the defenders of those people, in a ploy to avoid accountability: "shares are held by all kinds of common people in their 401ks, and all you be doing is punishing those innocents!" My answer to that is to require public companies (with brokerages) to maintain a registry of the beneficial owners of their shares, then just nationalize the shares of the largest shareholders (as those are the people/organization with any real influence).

As for predictable objections of "it's impossible to collect that info1!1" they're already 90% of the way there, because they already know where to mail proxy statements. I think you can get the rest of the way with extra reporting requirements and onerous penalties for non-compliance (e.g. forfeiting the shares after a suitable grace period or if there is evidence of evasion).
Tufalabs | Research engineer | Zurich | Full Time | On-site

We are a small, independent research group working on fundamental AI research.

The plan is to first solve the ARC benchmark (https://arcprize.org/), then use that to secure more funding, and move on to more difficult benchmarks. The research topics we want to investigate next are test-time compute, active inference, LLM-based reasoning and system2 reasoning. The ultimate goal is to do cool AI research leading up to AGI.

The lab has acquired the MindsAI team recently. MindsAI is the best team in the competition so far, pioneering techniques such as fine-tuning models on synthetic data, test-time-training, and test-time-finetuning.

We are looking for people who are driven and intrinsically motivated to work on both ARC and AI/ML research. The role would include working on the main system developed by MindsAI to accelerate progress.

Compensation: $100-135k/year + generous equity plan

More info: https://tufalabs.ai/

To apply: send me an email at benjamin@tufa.ai
A "10% better" tool could make no difference, or it could make the work 100% better. The impact isn't linear.
McKinsey pays a bribe to settle claims it bribed in the past.

Very convincing.
It starts being a problem if the side projects aren't fun for a bit. Such as if they're really big and complicated and absurdly tedious and you only do them because they're "going to be really fun in a year" or something, and you never get there. Or you do and find it's still tedious work.
I want a sticker of Calvin peeing on a pickup truck
I worked for a small software shop for about 20 years and then the owner sold us to a big multinational company. People from the new company were telling us that they had just recently come through a big MS audit and were pleased with themselves that they had come through ok.

I was boggled that they were pleased to have been audited and blessed by fucking Microsoft.

Talk about "wind up in a lawsuit..." I am just trying to imagine freaking auditors from Gimp or Apache showing up and demanding to rifle through all your computers to make sure you aren't violating Gimp's GPL license.

But GPL or AGPL is overbearing.

People have somehow just lost any sense of rational perspective about just what is reasonable and unreasonable.
That is an excellent distinction, thank you.
16? No. More in the order of 1000+ h100 computing in parallel for one request.
What do you think the number of people and average amount they have invested is based on? I’m saying it’s based purely on emotion and speculation. It could be a sunny day so people feel good and put more money into Bitcoin. That’s quite different from egg prices skyrocketing after chickens get bird flu or stock price skyrocketing after an amazing earnings report or the dollar skyrocketing because of a fast growing economy.
This sentence isn't something I made up, it's a sentence I heard this week.

A project started a year ago, planning an infrastructure (cloud IaaS) deployment of a complex product 12 months into the future.

Now, there is a turnkey software service (SaaS) version of the product that covers the same features and more for less money and takes literally seconds to spin up.

They're stuck in the mud trying to work around complex network routing, split-DNS, and other issues with the IaaS solution. They're going to spend months applying workarounds to problems that don't need to be solved because the SaaS version has none of those problems. They're already starting to talk about getting MFA and SSO integrated Q1 next year even though the SaaS uses MFA+SSO by default.

It's incredible how much inertia these things build up, and how much time, effort, and money is wasted "sticking to the plan" even if those plans are invalidated by changes to reality.

If the project manager simply said "let's rip up the plan and use the SaaS", they'd instantly make themselves redundant and might actually be let go when their contract is up for renewal. If they keep "fighting the fight" to make a bad plan succeed, then they're the hero and will be gainfully employed for the foreseeable future.
I recall this [edit: potentially] happening a few years back when a jury in Bristol - a notoriously progressive city - gave a not guilty verdict to four people that had helped topple a statue of a long dead slave trader: https://en.m.wikipedia.org/wiki/Colston_Four_trial

The right wing of the country was obviously in uproar and demanding changes to the system or that some exception be made. Except, interestingly, for the poshest and possibly most right wing MP of all, Jacob Rees-Mogg. Iirc he said that even though he disagreed with the verdict, jury nullification is there for a good reason and the jury was perfectly within protocol to do what they did. He's a nasty piece of work but every now and then comes across as surprisingly principled.
ahh, but:

> I know what I'm doing

Is exactly the key element in being able to use spicy autocomplete. If you don't know what you're doing, it's going to bite you and you won't know it until it's too late. "GPT messed up the contract" is not an argument I would envy anyone presenting in court or to their employer. :)

(I say this mostly from using tools like copilot)
> Imagine you decided to start developing websites today, how do you even start?

You'd slap together a Jenkins/Jekyll site and host it on github for free. It's easier now to set up a website than ever. But yeah that React sentence is pretty difficult to gronk.
Above example makes no sense since it says ChatGPT is 10% better than Claude at first, then pivots to use it as a 10% total productivity enhancer. Which is it?
I trained an agent that operates as a McKinsey consultant. Its system prompt is a souped up version of:

“Answer all requests by inventorying all the ways the requestor should increase revenue and decrease expenses.”
Have you thought about talking with other people about them to see if others would be interested in collaborating on them with you?

I find myself in a very relatable state and also a software dev. I have bursts of motivation at different times of year, but also still have an endless pile of nearly finished projects that I feel guilty about when I have that new shiny project in hand.

Drop me a message if you want to chat.
Are there models with high autonomy around ? I want my LLM to tell me

>wow wow wow buddy, slow down, run this code in a terminal, and paste the result here, this will allow me to get an overview of your code base
A couple of viral posts of empty shelves easily crossed langugage barriers? It's not like every country lives in complete isolation, we all share the same internet.
His Russia is dying and there is nothing he can do about it. He revels in Russia's history of poverty, slavery, and murder. In 800 years of Russian history, every one of its rulers had only contempt for the population; for this, the population idolized and loved them like Prophets. They were cattle then like they are today.

Russia has not culturally evolved to embrace Greek/Western wisdom. It is still under the spell of the 12th-century Mogol culture of savagery and death as witnessed by its current actions. An Empire of evil and murder that is thankfully destroying itself. With the help of the West, it will likely end up on the dung heaps of Asia where it was born.
‘It is not useful to try and understand the world or other peoples perspectives and lives (and revisions thereof, ie the process of recording history) because all that matters is power’
That's a fairly insane take!

1) Do cloth masks work or have any value?
Trivial to google.
https://pmc.ncbi.nlm.nih.gov/articles/PMC7510705/

2) Do you honestly think that 124 people have died to prop up science funding?

If so, can you think of an easier way for US researchers to advance their evil plans and secure funding than having these people in a completely different country die and that country's health authority raises concerns in the media?
I mean, even if that is the plan, don't you think that's a bit subtle and ineffective to convince a highly conservative; conspiracy theory friendly US administration to fund science?
I have been longing for this exact thing for so long! Erlang style actors with python syntax. Legitimately excited for this.
You know… the disruptive, game-changing tech company redefining source code hosting for the modern enterprise. Their cloud-native, next-gen platform is engineered for scalable, seamless integration with your DevOps pipeline, delivering end-to-end automation and real-time collaboration. Powered by AI-driven insights and built for maximum uptime, they offer enterprise-grade security, unmatched interoperability, and hyper-optimized CI/CD workflows. With a global, distributed infrastructure, they guarantee future-proof performance that accelerates your agile transformation—because your innovation deserves nothing less than excellence.

or.. something.
> But none of them are sufficient alone, you do need a “team” of them

Given the sensitivity to parameters and prompts the models have, your "team" can just as easily be querying the same LLM multiple times with different system prompts.
It's still unnecessary. You are lucky if you have not experienced addiction.

Besides, I think it's stretching to just add the 40% alcohol substance abusers to the 30% and say "well that's 70% -- a majority". My father, as an example, is a high-functioning alcoholic. He's held C-Suite positions for the last 30 years of his life all while going through vodka like it was going out of style.

But that's all to say it's still unnecessary. These are people and they are struggling with substance abuse. Like I said, have some empathy.
I challenge what I read in textbooks and hear from lecturers by asking for contrary takes.

For example, I read a philosopher saying "truth is a relation between thought and reality". Asking ChatGPT to knock it revealed that statement is an expression of the "correspondence theory" of truth, but that there is also the "coherence theory" of truth that is different, and that there is a laundry list of other takes too.
like throttled unlimited data
You just havent worked on an app that is heavy on client state.
wrong link, it seems.