skysight-inc/HackerNews huggingface dataset:
Honestly, I swear to god, been working 12 hours a day with these for a year now, llama.cpp, Claude, OpenAI, Mistral, Gemini:

The long context window isn't worth much and is currently creating more problems than it's worth for the bigs, with their "unlimited" use pricing models.

Let's take Claude 3's web UI as an example. We build it, and go the obvious route: we simply use as much of the context as possible, given chat history.

Well, now once you're 50-100K tokens in, the initial prefill takes forever, O(10 seconds). Now we have to display a warning whenever that is the case.

Now we're generating an extreme amount of load on GPUs for prefill, and it's extremely unlikely it's helpful. Writing code? Previous messages are likely to be ones that needed revisions. The input cost is ~$0.02 / 1000 tokens and it's not arbitrary/free, prefill is expensive and on the GPU.

Less expensive than inference, but not that much. So now we're burning ~$2 worth of GPU time for the 100K conversation. And all of the bigs use a pricing model of a flat fee per month.

Now, even our _paid_ customers have to take message limits on all our models. (this is true, Anthropic quietly introduced them end of last week)

Functionally:

Output limit is 4096 tokens, so tasks that are a map function (ex. reword Moby Dick in Zoomer), need the input split into 4096 tokens anyway.

The only use cases I've seen thus far that _legitimately_ benefit are needle in a haystack stuff, video with Gemini, or cases with huuuuuge inputs and small outputs, like, put 6.5 Harry Potter books into Gemini and get a Mermaid diagram out connecting characters.
I wish we could implement this internally via chargebacks. The teams that refuse to upgrade their stuff should be forced to pay for the externalities they cause.
Exterior handles provide leverage to free up iced doors. Does the app do that?
Meta has the massive advantage of not needing to sell the AI. The primary purpose of Llama is to make Facebook, Instagram, Whatsapp, Quest etc. better (well, "better" from the perspective of the company). It is basically an internal tool. So just like React, Cassandra, PyTorch, GraphQL, HHVM and all of their other open source work they benefit from sharing it with the rest of the world. There is very little incremental cost, and they get to generate massive goodwill and attract talent because of it.
Virgil's reachability analysis also applies to initialized objects and their fields. I.e. it will only include the reachable parts of the heap and will remove fields that are never accessed from objects. This analysis happens on the entire program at once.
Verbal lie detection using Large Language Models
Main discussion:[0](191 points, 46 comments)

[0]: https://news.ycombinator.com/item?id=40077533
this space moves impossibly fast...

are all open models still just derivatives of llama?
Through my insurance company (Blue Cross and Blue Shield) I have access to a program they call "ConditionCare" at no extra cost. It's customized support and care plans for asthma, diabetes, COPD, heart disease, and high blood pressure. it includes:
- Support from a variety of health experts, including nurses, pharmacists, exercise physiologists and dietitians
- Health screenings at no extra cost
- Access to educational guides, newsletters and tools
- Answers to your health questions, 24/7

Outside of ConditionCare,, they also have monthly webinars (sleeping better, starting a walking program. etc)
also don’t love the sidebar taking up like 1/4 of the screen on mobile lol
Penny, a Next.js v14 example project
I started coding with an Action Replay cartridge. Press a button and you get dumped into a new context where can fully inspect the machine and running program, and can modify any of it.

That's easier it was later on Windows (which for 15 years was how 99% of people used computers) and anything after.
Mixing market economics and human morbidity and mortality is always sort of a macabre humor. I believe the most profitable (aka the best) customer of a private insurer would be someone who pays premiums all their life and then drops dead of a heart attack.
I don’t think the core model was crazy, you just have to actually deliver value. They didn’t and I’m glad they’re being punished for it.

So many people like to do fake work instead of real work, including people who scoff at fake work.
> my chickens are visually processing far more than I possibly can

This is what I'm responding to. I don't know how to reconcile your two sentences, but no problem.
C&P error.
Wrong link.
To be fair this is llama 2 70b, but I’m not sure why they choose to use this because it’s quite trashy
Do you know of any direct drive motors?

One of the cheapest low-gear-ratios I found was the RMD series: (which is 1:6 or 1:10 gear ratio).

https://ozrobotics.com/shop/myactuator-rmd-x4-16-micro-motor...
We still haven't seen the boom in utility tokens yet. We've seen the boom in Bitcoin, L1s, and L2s. But there are a lot of developers exploring product/market fit for DApps.
'Human-induced' climate change behind deadly Sahel heat wave: Study
Russia is not considered bad right now because in the past it was bad. It’s considered bad right now because of invading neighboring countries and that it is also Europe’s last true colonial empire. Germany was bad. Now not so much.
Eh, the "tech people" who've been laid off range everything from graphic designers to project managers to marketing, sales, HR etc, almost none of whom have any skill overlap with the engineers, mathematicians and scientists building AI.

There are a small number of CS-degree holding software engineers or statistical expert data scientists who can pivot into AI with a fairly direct application of their existing education and experience, but the vast majority of people who were laid off from "tech companies" do not have that background.
Median _household_ income in California was right around $91k a few years ago.

https://www.census.gov/quickfacts/fact/table/CA/INC110222#IN...

After taxes and payroll deductions from your average paycheck you barely get $5,500 to take home...
An 11-Year-Old Girl's Fossil Find Is the Largest Known Ocean Reptile
Yeah I'm really wondering what OP's income is like now
O by Cirque du Soleil has underwater lifts not sure about other shows
to be fair I don’t see the research itself favoring evolution over creationism in any sense, which is notable because of course the poster mentioned atheism, it’s just that we have a desire and tendency to take research and turn it into a story, when really all the research we don’t have is so strikingly vast that it makes it kind of silly to craft an ongoing story based on such tiny amounts of data, but it’s human nature and fun, but leaning into it too much forgets that one new discovery can toss the entire story, science just isn’t meant for building confident origin narratives for that reason, it’s a very tiny scoped view of things on purpose, by the very nature of the scientific method

example: based on our limited understanding all we can seem to confirm so far is that there was a sort of “big bang” but that doesn’t mean a “big bang” is all there was, not by a long shot
What is screen time doing to children?
The kind of house going for $5500/mo mortgage in SoCal will be in a very affluent town like Irvine, where most households will be dual income white collar.

The article itself references Torrance, CA which has gentrified from working class Latino American and Asian American to upper middle class Asian American
Sorry, little green men: Alien life might be purple
What sort of life experiences have made you come to this conclusion?

Has nobody ever told you "come on, it'll be fun" and proven to be right by subsequent events?
yeah the 6k is wild for sure, if you are looking to not use formlabs resin why would you buy a formlabs printer though?

The biggest advantage of formlabs in my mind is the ecosystem, the resins just work out of the box and you do not have to try and fine tune things. If I wanted to use Loctite or some other resin company (price per L is comparable) I would just buy a anycubic printer.

I do get where you are coming from though, I am not a drm fan but I am just curious why you would not just go with a different printer.
2024 World Press Photo Contest global winners announced
> I believe until very recently there was so much fibre laid during the dot com boom, that we didn't really need to lay much more.

My understanding is that there was a one-two punch of the dot com boom laying a huge amount of fiber followed by wave division multiplexing shortly afterwards massively increasing the capacity of existing fiber that resulted in an oversupply that lasted a decade or more.
They explain that they will be releasing longer context lengths in the future.

It’s better to make your RAG system work well on small context first anyway.
Dittofeed v0.13.1: Webhooks and Admin API
Hey HN, we just released Dittofeed v0.13.1! Dittofeed is an open-source, MIT-licensed alternative to customer engagement platforms like Customer.io and Braze. This release introduces several features that really expand how you can use Dittofeed:

- *New Webhook Channel*: This channel lets you make API requests directly from user journeys. It's useful for:

1. Use cases include sending Slack messages, triggering native mobile push notifications.

2. Sending messages with your internal APIs.

3. Integrating messaging channels that Dittofeed doesn't yet support natively.

- *Admin API*: The Admin API allows you to programmatically manage your Dittofeed workspace. This release includes endpoints for managing users, searching user events, and more.

- *Improved Template Publishing UX*: Our template editor now allows you to visually compare your drafts against published templates, simplifying the publication process and ensuring you don’t lose track of your changes.

For a more detailed breakdown of what’s included in v0.13.1, check out our blog post:

https://dittofeed.com/blog/release-0-13-1

And for those self-hosting Dittofeed, make sure to consult our latest upgrade guide:

https://docs.dittofeed.com/deployment/self-hosted/upgrade-guide/v0-13-0

We'd really appreciate it if you visited and starred our repo to help support the project:

https://github.com/dittofeed/dittofeed

Thanks all!
that's very exciting. are you quoting same benchmark comparisons?
> That sounds right for how long they're with an employer, but if I move companies I'm probably going with the same insurance carrier under the new company's plan.

At least middle sized companies seem to change insurers commonly enough that both my wife and I have had our employers change said insurers in the middle of our employment.
That's a different company's model, so while it may have been obvious it is not relevant to whether Claude 3 has been nerfed or not is it?
Sort of. The Stabilization Act of 1942 (act of Congress) authorized FDR's Executive Order 9328 [0], which was a price/wage stabilization Order meant to keep the economy stable during WWII.

Because companies could no longer compete via wages, they began competing with fringe benefits -- health insurance being chief among them. It's been that way ever since.

[0] https://en.wikipedia.org/wiki/Stabilization_Act_of_1942
On an average, the cost averages out.
There is zero science to back that up, natural selection ≠ evolution.
Here's the industry's claim. Of course, given the nature of the industry, it's probably misleading at best and intended to alter your thinking to align better with their interests.

https://www.ana.net/content/show/id/37679
And parents have phones with TikTok. What is your point? How is it relevant here?
What AI Means for Training Lawyers
It still say it is using llama2 if you ask it
Good!

I was involved deeply in tech career volunteering several years back when this was called Lambda school.

Writing was on the wall about Lambda even then based on student feedback from a 100+ student multi year sample size in the orgs I helped.

Consistently students raised: ISAs coming to much larger payments than advertised. Constantly changing curriculum. The classic one for bootcamps - blind leading the blind with former students teaching the always changing curriculum, and juicing graduation employment stats. If I recall I even broke out the ol’ discounted cash flow math with students to actually sort out what the rate lambda was getting on these ISAs, and ya it was payday loans basically.

But, we saw justification after illogical justification about this setup. Former students employed by lambda getting aggressive. otherwise pretty well-meaning groups who had vendorized tech career support partnering with Lambda, despite seeing the same feedback as I did bc the company leads were in the same groups as I was.

Takeaways from all this if you or people you care about are trying to use these conduits to build a tech career and are evaluating options like Lambda vs a degree and so on:

- market can stay illogical, and same with its supporters, longer than when good, clear as day data about fraudulent (or more politely “very obscure and novel pedagogy approaches”) practices surfaces to counteract that narrative.

- people and orgs who have staked their future on that illogical/fraudulent market will roast their reputations in face of that evidence for much longer than you think or respect

- the feedback that matters should be the primary sources: the students that since 2019 or so started pointing out all these practices in bulk.

It is now 5 years later and who knows how many students who shredded their career goals by depending on schools like this.
Last week, I made the explicit decision to circle through paid subscriptions of various providers every few months, instead of sticking to just ChatGPT.

Glad to see Meta.ai on the list, in addition to Claude, Gemini, Mistral and Perplexity.
I can't express how good Dwarkesh's podcast is in general.
In Irvine the average is 10k a month. 5500 is more I.E
Right from the start, the tone of the presentation struck a wrong kind of chord with me. "The world's most important infrastructure"? Dear author, try living without electricity or fresh water for a few days, then I'll ask you again...
Project Management Management?
The EV market is basically (1) Tesla, (2) a bunch of Chinese auto makers (BYD and ten others you’ve never heard of), (3) and every other well-known legacy auto maker.

BYD is giving Tesla some healthy competition.

Tesla is working on a $25k auto right now that should be available in 2026.

There isn’t much hope for legacy auto in the EV space. They’re too far behind and their costs for production are too high to remain profitable.

The Chinese auto makers have announced plans to open factories in Mexico which would give them easier access to North America under the USMCA.
Traditionally the guideline was that housing costs (rent, utilities, etc) shouldn't be above 30% of gross income. $66K / $300K is only 22%. So, I wouldn't call it insane.
Peter Schweizer's great book Blood Money goes into the current state of the art with TikTok (and a bunch of other stuff).
I’m not sure about that. I think our baseline for suffering just shifts. So you can shield a person in a bubble of happiness, still some minor inconvenience might cause that person to break down if they’re not used to experiencing it.

The same way, people who have suffered a lot in the past might be now more happy than you are, maybe you’re objectively better but you might not perceive it that way, which is what matters in the end.
Yes, could be. Not sure how or even if anyone could prove it, though.
Fair enough, interesting, and plausible! I looked at the first link and saw it as more of a capabilities demo, but didn't dig into the Google one. I'm mostly just encouraging thoughtful reflection on tool choice by raising questions, not making a case against. Very cool.
Yeah. I see (or notice) more and more use of "from" where "starting" might have been clearer. I have also seen this usage in old texts, so it's not purely new.

I used to think this usage of "from" had to originate from another dialect than my own native one, but now I'm not sure at all. It can seem awkward and slightly jolting to me still, but I have worked at being more accepting of it.

The "From...until..." hopefully makes it clearer in TFA, though your initial reading could still be interpreted.
What makes houses so expensive?

Is it the land or the house itself?

I live in a city of 2 million in Europe. With a car, it takes 20 minutes from the center to places where absolutely nobody lives.

If it is cheap to build a house - why not do it there?

If it is expensive to build a house - could it be optimized, 3d-printed, automated in some way?
> Testing cannot be used to prove that a flaw doesn't exist, only that it does.

FWIW, I wrote a similar blog post about a different encryption bug that really seemed like it should have been found by fuzzing, and had 100% coverage.

https://googleprojectzero.blogspot.com/2021/12/this-shouldnt...

Not that I disagree with you, just a practical example.
> Neglected to include comparisons against GPT-4-Turbo or Claude Opus, so I guess it's far from being a frontier model

Yeah, almost like comparing a 70b model with a 1.8 trillion parameter model doesn't make any sense when you have a 400b model pending release.
This is a limitation/downside/flaw of "VA" LCD panels. OLED panels will not experience this, and neither will several other LCD technologies.
You're right, that's a good point. It is possible to make a model dumber via quantization.

But even F16 -> llama.cpp Q4 (3.8 bits) has negligible perplexity loss.

Theoratically, a leading AI lab could quantize absurdly poorly after the initial release where they know they're going to have huge usage.

Theoratically, they could be lying even though they said nothing changed.

At that point, I don't think there's anything to talk about. I agree both of those things are theoratically possible. But it would be very unusual, 2 colossal screwups, then active lying, with many observers not leaking a word.
I'd bet very good money that they wouldn't say that, no
I still play Halo 2 on PC all the time, multiplayer included. There's an active community thanks to Project Cartographer: https://halo2.online/home/
I don’t where the author got the idea that clinicians aren’t advocating low carb diets for diabetes patients. Every clinician I have ever had has recommended a low carb diet to help with diabetes.
I agree, the self imposed doctor shortage have caused God Doctors that think they have every diagnosis.

We need more doctors, but the cartel limits it.
"There was a time when battles could be won and lost with the mere push of a button, and these mobile dolls are the absolute root of that detestable and hateful spirit. When war is dehumanized both victory and defeat become miserable, and God no longer lends a helping hand." - Treize Khushrenada

Not UC, I know, but it's the first thing that came to mind when I saw this thread.
Mostly the former. Plenty of examples of burned out husks selling for over a million
Philosophically, I don’t think a company’s desire to optimize marking should come at the cost of people’s privacy.

I get why they want it, but don’t agree that it’s important enough to give up our privacy.
The part about making it easier for beginning programmers probably refers to JEP 436 [0] which allows you to leave out some of the tedious boilerplate around the entrypoint for simple programs, just like in Python (well, there is still some extra boilerplate compared to Python). It has nothing to do with the vector API.

The article confuses these two things because it's AI-generated word salad and plagiarized the phrase from somewhere else.

(Also, why does the article include a "ref" parameter in its links? Does openjdk.org have some sort of affiliate program?)

[0] https://openjdk.org/jeps/463
Any kind of intelligence gathering is a natural consequence of size. For companies, it starts at the startup stage with researching target market / competition / existing solutions in search of a PMF.

Later on companies do more extensive research before launching product lines. At this stage people doing research are still pretty close to the product being launched.

As companies get larger, product launch costs and separation between execs and people who do work grows. At this point there is extensive review before execs write the big checks. A lot of times it's outside consulting.

At Amazons scale and their quarterly KPI pushing it's not that much of a stretch that they will have a dedicated org which scours internet for any and all intelligence techniques that would give them an edge.
>
Naturally, the buyers often didn't want them either and it could become a point of contention between the parties!

Where is the problem?

After the sale has been done, you invite some strong friends (either one of them has a big van or pickup truck, or you rent one for half a day), and together you bring the devices to get rid of to the junkyard. After that, you empty crates of beer together.
That doesn't seem that different from the drugs. People lose the weight, and then half of them go on to gain some back.
“Weighted random text generator generates random text that doesn’t make logical sense” maybe. Seems to be both accurate and better describes what’s actually going on. The AI can’t claim or hallucinate anything because that requires it to have core beliefs and senses that can be fooled by incorrect inputs.
You'd think for all the lip-service given to how employees are their most valuable resource they would at least consider re-training. Some developers (myself included) have zero interest in LLM-hype train and would gladly take a severance package, but others would certainly want to up-skill and they already know the culture and company. Seems much cheaper than fire/hire.
>, you may be benefitting from an implicit subsidy by younger employees without dependents.

And they in reverse benefit from me paying a higher tax bracket because of my higher income. This is one of those tradeoffs we all make in a society.

We'd all be better off at the end of the day if healthcare was separated out from work and we'd just pay it out of taxes directly, like every other reasonable country out there.
Medicare still isn't. There's a two-year (!!) negotiation process for ten (10) drugs (!!) that takes effect in 2026. A disgusting way to run a health system.
Some things Halo 2 had off the top of my head that aren't related to gameplay:

- Matchmaking. Almost all games at the time made you manually join lobbies, and now we take matchmaking for granted.

- Persistent party. You'd invite your friends to your party and then start the match-making process. During the whole process you could chat with your friends, and when the game ended, you were still a party and could talk to each other.

- Chat. Everyone had an Xbox Live headset which came with the service. So everyone was a participant of party chat, in-game team chat, and even "proximity chat" with the enemy. With Halo 2's chat systems + Xbox Live headset ubiquity, it was a highly social game.

- Split screen online. All of the above worked with playing with a friend in split screen. Your friend could come over and you could start Team Slayer matchmaking in split screen which was awesome—the game would have to find two more teammates—, and your guest could even chat. Something that could never be done on PC really.

These dominated the old "look for and join the server" model of past FPS and, frankly, I could never go back to that.

Gameplay wise, Halo 1 had most of the innovations that Halo 2 capitalized on but Halo 2 moved to the pure shield-is-your-health-bar system and removed health packs. After each battle you didn't have this scramble for a health pack just to get ready for the next confrontation, so the pacing was better than arena shooters imo.

Finally, Halo 2 didn't need to be the global first on each bullet point to be innovative. But it was probably the first game to have all these in one package. There was a lot of UX polish in setting this standard which you can tell because most games don't reach it even today.