skysight-inc/HackerNews huggingface dataset:
I've bumped into a few of these. I use https://openrouter.ai as a model abstraction, but not as a router. https://withmartian.com does the same thing but with a more enterprise feel. Also https://www.braintrustdata.com/ though it's less clear how committed they are to that feature.

That said, while I've really enjoyed the LLM abstraction (making it easy for me to test different models without changing my code), I haven't felt any desire for a router. I _do_ have some prompts that I send to gpt-3.5-turbo, and could potentially use other models, but it's kind of niche.

In part this is because I try to do as much in a single prompt as I can, meaning I want to use a model that's able to handle the hardest parts of the prompt and then the easy parts come along with. As a result there's not many "easy" prompts. The easy prompts are usually text fixup and routing.

My "routing" prompts are at a different level of abstraction, usually routing some input or activity to one of several prompts (each of which has its own context, and the sum of all contexts across those prompts is too large, hence the routing). I don't know if there's some meaningful crossover between these two routing concepts.

Another issue I have with LLM portability is the use of tools/functions/structured output. Opus and Gemini Pro 1.5 have kind of implemented this OK, but until recently GPT was the only halfway decent implementation of this. This seems to be an "advanced" feature, yet it's also a feature I use even more with smaller prompts, as those small prompts are often inside some larger algorithm and I don't want the fuss of text parsing and exceptions from ad hoc output.

But in the end I'm not price sensitive in my work, so I always come back to the newest GPT model. If I make a switch to Opus it definitely won't be to save money! And I'm probably not going to want to fiddle, but instead make a thoughtful choice and switch the default model in my code.
I am not sure how much really is done via inferencing, if at all. Just the way how "Tesla Vision" behaves in a parking garage does simply not look like what I would expect to come out of inferencing. It looks very, very, very much like a pretty bad heuristic. Just look what it makes out of blind spots, the parts the cameras can't see. There is absolutely nothing like "according to my model, there should be X on this spot". The same goes for their distancing sensing in these situations. "Oh, there is a pipe on that wall, which likely has difference distance to me than the wall. I might not wanna crash into that" is trivial on a level that nobody would even use that as a Captcha these days. A model that does not "know" what the third dimension is?

Do you know of any reverse engineering that proves that there really is running anything in regards of inferencing on the NPUs?

Also, just as you said - there are tons of corner cases in the real world, especially once you aren't on a 10-lane US highway which has been designed for monster trucks driven by 16 year olds (no offence) but one of the roundabouts of hell in Paris.

Where would the training data been coming from?

So, I have my doubts.

During summer, there is a red flower growing near the entrance of my parking garage. It constantly is seen as a red light, and the entrance of my garage is often mistaken for a huge truck suddenly magically appearing. Again: Nobody would use a Captcha these days: "Is this a red flower or a traffic light?".

Again, smells like heuristic. "Amount of red pixels in a certain form and spot".
Antisemites (really, any hate group) are indefatigable. :-(
For whatever it's worth (not much), Sam Altman did say they would do that

> if any former employee who signed one of those old agreements is worried about it, they can contact me and we'll fix that too. very sorry about this.

https://x.com/sama/status/1791936857594581428
Used cars come with their own costs. A new car will probably last you 20 years, a 10 year old car will need to be replaced in another 10. A new car will have negligible upkeep in the first 5 years, a used car will have upkeep in the first 5 year of your ownership. At some point, repairs on older cars are more expensive as certain parts become obsolete and become harder to find. Newer cars offer better fuel economy, a 10 year old car will make you spend more on fuel. Over a longer period of time (say 20 years), the cost of using new car vs old car kind of converges. You keep a new car for longer, while you’re forced to change the older cars.

Unless you’re going for cars >5 years old or cars with a big mileage, used cars will also be very expensive.
IMO, Clojure is superficially/syntactically much more elegant and beautiful than Common Lisp or Scheme. I find this really helps you focus on what matters most.
It's puzzling to me that third-party apps doing the same thing were shared on HN just months ago and highly upvoted (500 points, for a submission about an app‽), but now Microsoft does it and the frantic media backlash takes over. It's a textbook moral panic. Amplified by media cynicism about tech, and by Windows's awful brand perception.
That's not what decentralized means though. This whole comment thread is unclear on whether decentralization or encryption is what's desired.
When was this document written? Today Portugal has nearly the same level of drug-addiction problems as they had in the early 2000s when they legalized all drugs.

https://knowledge.wharton.upenn.edu/article/is-portugals-dru...
Agreed, I always need to scroll to see video description content and comments which I would rather be able to see while still watching the video.

While, instinctively, the previews below the video feel odd because they've been to the right for so long. Logically, I can see the improvement they are going for here and would welcome it.
The 4D chess game there is cartel B is undercutting cartel A. Cartel A gets wind of this and gets pissed. they get some of their guys to put fentanyl in their bricks, but instead of marketing it as coming from cartel A, they mark it with the cartel B stamp. voila, fentanyl-laced cocaine
This makes sense. “Treatment works” is not an argument for treatment, it may in fact not work very well. Nonetheless we must focus solely on prohibition because treatment either does or does not work to an acceptable degree and criminalization obviously increases the amount and/or efficacy of treatment
By the societal benefit model, yes. By the more libertarian model yes because of bodily autonomy. Either way yes. Trying to protect them from themselves is worse from virtually any angle and especially the humanitarian one.
To some degree, yes. But, theres a low value to cost ratio in that exact UX.

Take a single character in the game, and enable that character the depth and nuance of a true experience between a Zen Master / Inquiry facilitator, powered by AI. IXCoach.com can do a phenomenal job powering this, so literally the only code needed for an MPV is the mod + character api.

Then, the cost benefit ratio is 400x, and in a day of coding you have taken a game that is mostly pure entertainment, and provided a means for depth, nuance and personal development that literally leads the market.

I pinged the executive producer of CD Project Red on this, it's viable.

https://www.linkedin.com/in/danhernberg/
Hence "or read key input". And:

> Key input handling is kind of a mess, and this is where I really recommend using a terminfo library if at all possible. This also avoids the whole backspace/delete key confusion (less of an issue today than it used to be, but still exists).

Of course lots of applications don't use backspace or delete; sometimes you just want the ability to select between 3 items with j/k and arrow keys, or something like that. And if this is something just for yourself or a limited audience then it's fine to just read that from stdin and not worry too much.
At the time, no. There wasn't any checking. And while it looks like a lot, it wasn't insanely expensive to unwind. Sometimes these kind of mistakes make money. My own 'mistake profit /loss' was around +1m USD.
NEVER assume that information learned because of your job is shielded from insider trading, even for a completely different company. From ten years ago, here are two data analysts from Capital One who thought they could use the data from credit card transactions to jump the gun on quarterly earnings reports for retail stores. Never traded Capital One stock. Didn't matter - SEC hammered them.

https://www.sec.gov/litigation/litreleases/lr-23216
Technically, that is only if fentanyl is disproportionately killing young people who are already addicted due to some other cause and not likely to be economically productive again.
And to piggyback on this, these people may have between 0 and 100% understand of the core business.

For me personally, it’s a turn off.
Ask HN: Non-Chinese Laptops?
Are there any good laptop options out there not manufactured in China? Even brands like System 76 fail this test. Looking for suggestions for devices made in the EU, USA, Canada, Japan, etc.
Exactly, which makes it the smallest post earnings price action in the past 4 quarters (last one was also smaller than the 4 that preceded it iirc). And today was the only one that had stock split. It'd have probably been even less than 5.5% if it wasn't for that.

Not saying it's not going to beat the market in years to come but it is slowing.
No, this isn't correct. The content moderation is another model that runs locally on the NPU, similar to the group of models used for image generation. There is no image uploaded to Microsoft. Note that there is no support for non-NPU devices.
Nothing quite like a contract’s consideration consisting solely of a pre-existing obligation. I wonder what they were thinking with that?
LHR

(Least Hallucinated Response)
Since you take no extra charges from the end user, the presumption is you would charge LLM's for giving them traffic?
FWIW, "startup" is almost just as bad as "Microsoft" in this headline. Hell, I'd trust Microsoft more with my ADHD than a random startup, because the former is a large legal and media target and has a lot to lose, while many startups - including a lot of well-known ones - are glorified fly-by-night operations that, even if they won't screw you outright, will disappear in a couple of years (whether by shutting down or getting acquired), leaving you with sunk costs and no alternatives (well-funded startups tend to suck out air from the space they're operating in before disappearing themselves).
What about Window's built in "Capture last 5 minutes" screen recording, as a part of their gaming features? Or the same feature that's just enabled from the nvidia drivers?
You're revealing your bias by calling one group "addicts" but not calling the other "alcoholics". Both drugs are possible to use responsibly, and both drugs are possible to OD on.
True. But it's generally only common with older C-based languages where the goal was packing as many features as you can instead of high level design aimed to guard software from inexperienced overeager devs.
Thanks for the answers! Good to know that ClickHouse support might be on the roadmap.

Re 1: Yeah, it's a hard problem, from what I understand. I recommend reading that clickhouse-obfuscator README, in case it helps with your implementation. The tool works similarly to what you mention: it first generates a Markov model, which is then used for deterministic output with a given seed. My only problem is the referential integrity, so solving that as well would be ideal.

Re 2: Gotcha, makes sense. I kind of assumed that it did maintain integrity, but it's not clear from their docs. It's definitely more difficult to setup as well, and while I appreciate its simplicity, a better user experience never hurts.

Sounds good about your service then. I can't say that I would personally want to rely on it, but I can see how it would be useful for others. Cheers, and good luck with the project!
Don’t think so. When my daughter needed the AI-powered Khan tutoring service last year for assistance with math, it was at a time when I had lost my job and depleted the family savings supporting the family. I pleaded for a waiver of the subscription, which was flatly and repeatedly denied. The result, my daughter’s math grades fell to the low 20 percent, and at no point did the teacher notify us. We’ve been repairing the damage ever since. I wonder if Sal Khan approves of abandoning low-income families, because his staff are stuffing families bad.
In most cases for low end jobs, you have a lot choices, you just work somewhere else. Amazon usually isn’t the only job in these towns, just the one that pays the most without requiring much education and experience. Ya, life still sucks for a lot of these people working in a warehouse, but less than it would without the job.

The edge could be taken off of these jobs by just giving health insurance to everyone and not making it employer responsibility anymore. This would actually hurt Amazon since they often provide health benefits more easily than the rest (by giving enough hours). Detaching healthcare and maybe even minimum wage (via UBI) would go farther than expecting companies provide everything to workers no matter the job value.
I think the new design is great, honestly. Not sure why there is a huge uproar.
Finally. As someone who is active in the local music scene, I’ve spent thousands on junk fees over the years. Not sure why it has taken this long.
War on Drugs I was a failure. Time to declare a War on Drugs II, fought with counseling, mental health resources, government assistance programs for food, housing, jobs, hope.
The mob that Vox represents these days is miniscule
MIT scientists learn how to control muscles with light
If we lived in a sane world we would've long since split these psycho-filled gigacorporations like M$ up into a trillion tiny little pieces, but alas we live in a world where gov'ts let them do whatever the fuck they want with no repercussions.

What depresses me the most is that many governments and corps are using M$ products. I recently got approached by a recruiter from one of the largest gov't agencies in the Netherlands, and they sent me a Teams link (itself horrible software that is barely functional), requires me to make an MS account to access some docs shared via 365, and as far as I could tell the machine you're given is a Windows machine without the possibility of using linux on it.
Nice article, but a bit different than the OP authors who published a fully fledged open-source tool, is your code also available open-source for the community?
Interesting idea, but if you need medicine for your child and are low on cash, you will sell those stocks today rather than save them for the future.

And the buyer will be someone who has enough cash to not worry, and will thus get even more cash to not worry.

That is, I don't think it'll be that simple.

edit: one way to solve the above would be like the Spanish coops, where the ownership (stock) is tied to your employment. IIRC you have to buy say one stock to get employed, and you can only sell when you leave your position.

But then it's harder to redistribute the stocks...
I bet similar claw-back clauses are waaay more common than many on this thread would imagine at private co's. I've always been under the impression that 'vested equity' doesn't mean ~anything until you actually see liquidity. The company can generally fuck you before that point if they choose to. Hope I'm being overly cynical with this take.
It’s a great idea. I could also see pricing for professionals that are creating many iterations for many industries and roles. Something in a larger bulk, but favorably priced
> The thing is just, you are excited about this technology, and you are equating "engineering" with "security"

I do no such thing. I am not at all excited about Rust in fact anymore, I just learned where it excels at and I know when to reach for it.

> You are willing to pretend that other merits and factors don't exist, including ergonomics of iteration, or inertia

I have literally just responded to you before this comment where I made it clear that I stopped actively using Rust due to slower speed of iteration -- and that is said in another comment as well (including the inertia or lack-of-choice factor).

Can you please not misrepresent what I said? It's clearly written in at least two places.

> Choice of language and ecosystem is an economic matter. They get chosen based on what one knows and what one wants and how one evaluates the possibilities.

Which agrees with my "right tool for the job" take elsewhere in the thread. We're aligned.

> I frankly am not getting paid in finding the nicest or "most secure" way to write a piece of code, but to get it done.

Yes, and that explains why the programming at large is always teetering on the verge of ruin and stuff is barely working and is kept together by goodwill and spit. Though obviously worker bees like you and me can't change that reality for now. I have partially made my peace with that fact but not entirely; hence I reach for Rust every now and then.

> But you are seeing only "security". Well, it's most secure to just shut your computer off. Maybe you _are_ the zealot!

You seem to have gotten quite worked up and I'll ask you to stop. When I told you that I am open to discussion in a previous comment I was genuine.

Both Microsoft and Google said that from 60% to 75% of all C bugs are memory safety problems -- not my words, not my research, but that of two of the largest IT corporations out there.

That is proof. That is objective info. We can bikeshed and throw feces at each other until the end of time but there are people who got out there and gathered the info.

I refuse to be viewed as a zealot simply because I want to attack the lowest hanging fruit in terms of bugs and security vulnerabilities. No, that makes me both a pragmatic and a guy who is no longer willing to live with the broken status quo.

And I'll not agree with your polarizing take that "the only security is shutting your computer down". That's nonsense. You are simply not motivated to advance anything but your career. That's your right, surely, but at the same time it makes you dismiss any well-intended discussion about the current state of our profession and how can it be advanced further. You dismiss stuff off-hand and then you blame me for being a zealot. Not acceptable to me and I'll not take it.

So try and calm down and read better. We in fact agree on much more than you think but you are not seeing it because you seem to have formed an opinion of me before you even started writing.
The Sweden Democrats have done the same as e.g. the Social Democrats have been doing for a very long time, it is just that the regular media - which has had its focus on the Sweden Democrats for a very long time now - have thus far ignored this. This leaves the 'alternative' media which does report on such things, e.g. Samnytt [1] has a piece on how SAP (which is the full acronym for this party, it stands for 'Sveriges socialdemokratiska arbetareparti' - Sweden's social-democratic workers party, the biggest party in the country and the one which has had sole control over Sweden for most of the last century) has spent more than 5 million Swedish kronor (~$500.000) on their own 'troll factories'. Unfortunately those alternative media are just as biased as the regular media but where this is usually ignored for the latter it is used as an excuse to ignore anything published by the former - very convenient for SAP but not that good for the political discourse in Sweden.

[1] https://samnytt.se/socialdemokraterna-har-satsat-over-fem-mi...
> People dislike Musk out of pure jealousy and try to rationalize it via other means.

I don't think this is true. Most people I hear express that they don't particularly like him, also attribute it to things that made me not like him. The rescuer story, the absurd trolling, the disparaging of specific individuals, the pretending to be for "freedom of speech" until the speech is about him.

This is a person I once thought had the desire and the means to push humanity forward. He's done so much, all of it tainted by, well, being absolutely unhinged.
Every legal clause that affects company ownership is accepted by the CEO and the board. It's not something VP or general counsel can put there. Lo and behold, signatures from Altman and Kwon are there.

>Company documents obtained by Vox with signatures from Altman and Kwon complicate their claim that the clawback provisions were something they hadn’t known about.

>OpenAI contains multiple passages with language that gives the company near-arbitrary authority to claw back equity from former employees or — just as importantly — block them from selling it.

>Those incorporation documents were signed on April 10, 2023, by Sam Altman in his capacity as CEO of OpenAI.
> It is trained in a supervised manner on several open LLM datasets, using GPT4 as a judge.

Does this mean GPT4 predictions are used as labels? Is that allowed?
it's probably going to get worse. Now that we have normalized using 2GB of ram for a text chat app because it's a bit easier to code, I bet it's only a matter of time before they go one abstraction level higher and start emulating an entire OS.
> Amazon's uncompetitive

Could you expand on this? If they were uncompetitive, from a worker perspective, they wouldn't have any workers. Having workers means they are the best choice out of all the other companies competing for those workers. It, quite literally, means all the other choices were even worse!
Not a mistake...

"...But there's a problem with those apologies from company leadership. Company documents obtained by Vox with signatures from Altman and Kwon complicate their claim that the clawback provisions were something they hadn’t known about..."
Because we all but entirely stopped enforcing anti-trust in the 80s :-(
Can also recommend the newpipe fork Tubular which integrates sponsor block

https://apt.izzysoft.de/fdroid/index/apk/org.polymorphicshad...
I agree that the LLMs of today 100% work for education. It's how I use them anyways, constantly have it open when I'm reading or doing a learning activity and throwing questions at it, or generating summaries, and it is extremely enriching as a layer on top of that self directed work. I'm sure people like Sal Khan will continue to innovate ways to make them more useful for guided curriculum and other capabilities without needing any real fundamental technology research. I think to play devils advocate though, there is a ceiling on learning placed by how much the student cares, can focus, and is motivated. That will still exist, we can just make the motivated students path easier.
Yes, because those aid drivers collaborate with the Israelis. This was going on long before the current war, when they were driving products and not aid.
Well, they say they are. But the nondisparagement agreement repeatedly forbids revealing the agreement itself, so if it wasn't cancelled those subject to it would be forbidden to point out that the public claim they were going to release people from it was a lie (or done only for people from whom OpenAI was not particularly concerned about potential disparagement.)
Agree with all that. The criticism is that this is a big, American company, one of the largest and most impactful ever, that makes lots of money and is quite profitable, and yet pays its workers low enough that they need to be subsidized with tax dollars. Your tax dollars are given to Amazon's workers, so that Amazon can continue employing them for low wages, and the money saved by paying low wages is going into the shareholder's pockets. Is that a system that you are happy with, and would be fine with continuing in perpetuity?

Obviously, there isn't a silver bullet, and every potential solution has thorns, but are food stamps really meant to perpetually sustain individuals that make low wages at companies that can afford to pay them more?