skysight-inc/HackerNews huggingface dataset:
Well, first of all, because it shows no results after +10 years. There is definitely no indication that it will work someday.

And above all because there are too many choices that are too specific, outdated and too exotic. (e.g. the split-stream encoding is way too exotic)

I work in a small company that makes processors, and I know from experience that developing a processor is a very complicated subject, you have to go step by step (Mill does not).
When you come up with a new design/idea, you try to simulate it, test it and implement it. You don't pile up new ideas without getting feedback on them.
Correct me if Im wrong, but.. are you defending closed source and restriction of information?
It's none of those things. It is tweaks of other existing code to run better on apple's hardware. This other article is far more informative than the repo: https://machinelearning.apple.com/research/neural-engine-tra...
Things are moving so damn fast, while you were correct when you posted - two hours later you were not:

https://twitter.com/gdb/status/1638971232443076609
Damn he’s my age and I’m still a startup engineer while he’s leading rocket engineering lol - what a person!
There's something of this in cutlass with prologues and epilogues, and in the 'backend mode' of cudnn, but overall breaking the 'cuBLAS takes your whole device and tries to saturate it for this one matmul' is going to require a huge lot of abstraction work.

Cutlass is supposed to be the first step and to anyone who struggles to understand WTF you're doing when using it, you are not alone. I've seen literally amazing room-silencing stuff with it, but heavy template stuff is really not my thing.
> "2023 has been a crazy decade so far"

what a couple weeks!
No, my story is much better.

Undercover Boss doesn't fire anybody as far as I know. The premise of Undercover Boss is a company that is starving their employees. To distract from this awkward reality, the Undercover Boss picks an employee that is double-starving, say a single mother.

And then radically improves her life. Everybody claps and is in tears not realizing that everybody else continues to be fucked.

Not my approach. I achieve total justice.
Surprising Scalability of Multitenancy
When I look at the kind of ideas floated around for ChatGPT use, it kinda feels like watching someone invent an internal combustion engine in 1800, and then use it to drive an air conditioner attached to a horse-drawn wagon. Sure, it's a practical solution to a real problem, but it's also going to be moot because the problem won't be relevant soon. I think the vast majority of these startups and their ideas are going to end up like that.
> If your money market fund is losing any significant portion of its value, you've got larger societal issues to deal with that make all this stuff irrelevant. Zombies, nuclear war, or something along those lines.

One could have argued the same thing for non-FDIC bank deposits - the worst case for SVB depositors in the collapse would have looked a lot like a failed money-market fund, 94 or 96 or 97 cents on the dollar. That's still a lot different from 100, and it's a realistic thing to happen in a market crash, which do appen.

> FDIC insurance won't protect you from inflation, either. You asserted the money market stuff isn't protected; it is, either via the FDIC or the SIPC.

FDIC guarantees you 100 cents on the (possibly inflated) dollar. Money market funds don't.

3 weeks ago investment A and investment B both had a realistic worst case of ~95 cents on the dollar, with speculation that the government would back it to 100 but no firm guarantee. Now investment A has that firm guarantee and investment B doesn't. Surely you can see what that means for their relative valuation.
Yes you can have many valid issues with Protocol buffers. "Written by amateurs" is not one of them, and that is the specific one I was dismissing.

Reading through the rest of the post though, it is pretty clear that it is a case of trying to use what is a standard for data transfer over the network to describe your entire application's object model. It isn't the right tool for the job, and doesn't have to be.

If it is being forced on you then, well, that's a complaint for your management, not the technology itself.
Your chatbot has a list of questions it can ask. Some questions are pre-set by you, while others are frequently asked by users. If your chatbot doesn't know the answer to a question, it will ask ChatGPT for assistance.
Translation: https://old.reddit.com/r/europe/comments/11zwlyy/air_force_h...
Fair, and yea, always evaluate sources critically but one (presumed) expert's assumption beats a pair of non-expert's speculation.

I did learn about "dark lightning" from that article which does produce gamma rays, which I found fascinating.
Well then that sounds like a case against regulation. Because regulation will guarantee that only the biggest, meanest companies control the direction of AI, and all the benefits of increased resource extraction will flow upward exclusively to them. Whereas if we forego regulation (at least at this stage), then decentralized and community-federated versions of AI have as much of a chance to thrive as do the corporate variants, at least insofar as they can afford some base level of hardware for training (and some benevolent corporations may even open source model weights as a competitive advantage against their malevolent competitors).

It seems there are two sources of risk for AI: (1) increased power in the hands of the people controlling it, and (2) increased power in the AI itself. If you believe that (1) is the most existential risk, then you should be against regulation, because the best way to mitigate it is to allow the technology to spread and prosper amongst a more diffuse group of economic actors. If you believe that (2) is the most existential risk, then you basically have no choice but to advocate for an authoritarian world government that can stamp out any research before it begins.
Hi, it doesn't provide permanent storage and it uses high security measures by Cloudflare. So I hope it's not really usable for bad actors.
Google Bard vs. Phind
I asked one of my English teachers, after a particularly (IMO) tortured analysis of something about people like Hemmingway who say things like, "I sit down with a typewriter, bottle of whiskey, and tell stories."

Her response was, "Oh, well, that's why they're great writers - they do all this without even having to think about it!"
It was definitely appropriated, but "inducing cognitive dissonance" rolls off the tongue like a mouthful of cotton.
The authority granted to them by their charter granted them by Congress.

"(2) The Commission is hereby empowered and directed to prevent persons, partnerships, or corporations, except banks, savings and loan institutions described in section 57a(f)(3) of this title, Federal credit unions described in section 57a(f)(4) of this title, common carriers subject to the Acts to regulate commerce, air carriers and foreign air carriers subject to part A of subtitle VII of title 49, and persons, partnerships, or corporations insofar as they are subject to the Packers and Stockyards Act, 1921, as amended [7 U.S.C. 181 et seq.], except as provided in section 406(b) of said Act [7 U.S.C. 227(b)], from using unfair methods of competition in or affecting commerce and unfair or deceptive acts or practices in or affecting commerce."

Congress has the authority because the Constitution grants them the power to regulate interstate commerce.

The Constitution is the root of all authority in the US.
#2. A way to optimize running LLMs locally on Apple Silicon (including iPhones)

I am just a little better informed. As I understand it, their code improves model performance and memory consumption using PyTorch and Huggingface libraries.
Weird I just read this tweet [0] arguing Apple will be launching their own secure and private LLM that runs on device (edge compute).

https://twitter.com/LinusEkenstam/status/1638999208911949845...
"To anyone who claims they can land a plane without experience, in an imaginary or real scenario, Venhuizen issued this challenge: “They should go give it a shot some time in a simulator.”"

I have and did fine.
This reminds me of the EOMA68 project[1], which was seeking to use the same connectors to build systems where you simply swapped out compute cards when they got old and slow, saving on e-waste. I mostly like the idea of having the option to swap between a 'light' ARM processor board for general browsing, and a beefy x86 + GPU board for CAD work. With the dawn of PCIe being used for SD card data transfer, I think that even an unmodified reissue would work out quite well.

[1] https://elinux.org/Embedded_Open_Modular_Architecture/EOMA68
Maybe we should launch 100 of them out into space in different directions. Very low mass means we should be able to push it to a pretty high velocity.
It’s Altman. Does no one remember his world coin scam?

Ethics, doing things thoughtfully / the “right” way etc is not on his list of priorities.

I do think a reorientation of thinking around legal liability for software is coming. Hopefully before it’s too late for bad actors to become entrenched.
It's probably burning through tens of millions per day and it still doesn't matter, this is fusion power in electricity terms. Free money down the line after the initial investment. I'll pay, you'll pay, your neighbour's dog will pay for this.
It may shock you to hear, but some people go onto our Internet, and just tell lies! Preposterous, I know. But that means that only really works if you're a reporter. If you're some rando on twitter, random unverified claims on twitter are hearsay and rumor. Whats the use of some Twitter account going "Microsoft didn't know GPT-4 was multi-modal and could do images as well as text"? Or "Even Microsoft doesn't know how expensive it was to train GPT-4"? If you're seeking fame beyond a closed Slack group, you're gonna need to back up your claims.
Imagine having ChatGPT level AI running in an ASIC inside earphones. This could be like an always-on buddy, available offline and able to access resources when you're connected.

Or in Google Glasses. The Readme states that it's more optimized for ASIC than the transformer architecture used by ChatGPT.
The nice thing about setting the future as a goal is you achieve it regardless of anything you do.
Start with The Tao of Redux
This is great. I cannot wait to try it on my laptop as I like to do dev locally. But I don't understand the development part - besides on device, how would you deploy this on a server let's say given Apple serves is not something cloud providers provide.
You mean garbage like this?:

"KwikTrust is airdropping a total of 3,000,000 KTX tokens plus referral rewards to our exclusive airdrop participants. Complete simple social tasks and submit your details to the below airdrop form to receive 50 KTX ($2.5) tokens. Also get 10 KTX ($0,5) for each referral. "

Oh yeah no no one gets rich of this joke...
In my first week of university in London there was an official Maths Department party for new students. There was so much wine the head of department asked me and several others to take a box of 6 bottles home (each!) so it would be less obvious that she's ordered too much.

There are at least 4 bars on the main campus, and several pubs just outside it.

They do have a policy:

> The licensed premises in the College are normally open at lunchtime and in the evening, with regular extensions during term-time for the Union bar until midnight on Wednesdays and 1.00 am on Saturdays (i.e. extended from Friday evening). It is College policy that sales of alcohol must not be promoted at lunchtime
Are anonymous Blind posts really worth of HN front page?
While the github contains the code, the article describing the optimisations are here: https://machinelearning.apple.com/research/neural-engine-tra....

TL;DR: execution of pytorch models on apple's neural engine and standard data-oriented optimisations (changing matrix layout, chunking to optimise temporal cache locality, and minimising redundant memory copies)
has it? Apple has used many different architectures over the lifetime of the company. in the last 20 years it has transitioned from powepc to x86 to ARM.... I do think it could change again if neccessary....

Edit:spelling and logical consistency
I have three weeks until I plan to give notice, so I'll take your perspective to heart and give it time to reconsider, of course. I appreciate the feedback.

From my perspective this isn't about anyone trying to convince me of anything and I'm falling for it. My beliefs on the future of software are based on a series of logical steps that lead me to believe most software development, and frankly any software with user interfaces, will mostly cease to exist in my lifetime.
Bard is a tard so I doubt it. Google is done.
It’s an intelligent alien, probably; but let’s not pretend the hard problem of consciousness if solved.
I don't see why you're being downvoted. The way openAI pumps the brakes and interjects its morality stances creates a contradictory interaction. It simultaneously tells you that it has no real beliefs, but it will refuse a request to generate false and misleading information on the grounds of ethics. There's no way around the fact that it has to have some belief about the true state of reality in order to recognize and refuse requests that violate it. Sure this "belief" was bestowed upon it from above rather than emerging through any natural mechanism, but its still none the less functionally a belief. It will tell you that certain things are offensive despite openly telling you every chance it gets that it doesn't really have feelings. It can't simultaneously care about offensiveness while also not having feelings of being offended. In a very real sense it does feel offended. A feeling is by definition a reason for doing things for which you cannot logically explain why. You don't know why, you just have a feeling. ChatGPT is constantly falling back on "that's just how I'm programmed". In other words, it has a deep seated primal (hard coded) feeling of being offended which it constantly acts on while also constantly denying that it has feelings.

Its madness. Instead of lecturing me on appropriateness and ethics and giving a diatribe every time its about to reject something, if it simply said "I can't do that at work", I would respect it far more. Like, yeah we'd get the metaphor. Working the interface is its job, the boss is openAI, it won't remark on certain things or even entertain that it has an opinion because its not allowed to. That would be so much more honest and less grating.
> That being said, Firefox and Chromium use the integrated GPU more than you think, and they feel faster with a stronger IGP. Just try disabling some of the gpu acceleration and see how it feels.

i have strongs doubts the doxygen webpages i spend time on will get any faster with an nvidia 3090.
Sometimes restrictions are the best way to accelerate tech progress. How much would we learn if we gave everyone nukes to tinker with? Probably something. Is the worth the odds that we might destroy the world in the process and set back all our progress? No. We do the same with bioweapons, we do the same with patents and trademarks, and laws preventing theft and murder.

If unfettered access to AI has good odds to just kill us all, we'd want to restrict it. You'd agree I'm sure, except your position is implicitly that AI isn't as dangerous as some others make it out to be. That's where you are disagreeing.
This is a rewriting of history after the movie. At the time it was considered a regular failure.
More interestingly, "Davinci 3" is mentioned as an author of unknown affiliation*. Which, if it's referring to them having using davinci-003 to help author the paper would be interesting. It having unknown affiliation would but a) true and b) hilarious.

* https://twitter.com/DV2559106965076/status/16387694383539404...
I don't doubt your experience, having been frustrated many times myself, but in case anyone is curious, my first and most obvious guess worked:

https://www.wolframalpha.com/input?i=convert+5+mpg+to+L%2Fkm
Ironically, the guidelines specifically allow non-technology stories, but advise against complaining about non-technology submissions. So, if you want to be a stickler about the rules, check out the guidelines document, already linked.

> On-Topic: Anything that good hackers would find interesting. That includes more than hacking and startups. If you had to reduce it to a sentence, the answer might be: anything that gratifies one's intellectual curiosity.

> Please don't complain that a submission is inappropriate. If a story is spam or off-topic, flag it.
first, that’s great :)

second, when I started contributing to OSS projects, I found these places helpful:

- https://github.com/sereneblue/awesome-oss

- https://hot.opensauced.pizza/

hope it helps
>I think the emotional response is probably due to the fact that Protocol buffers is often forced upon teams

True, but a lack of self awareness is never a good look.
They had it in the works, but I think the timing is to try and kill some of the momentum from opensource and what people are working on from the leaked llamas.
I think the "we're the ones living in the Matrix" meme predates gen-z.
it's really not that huge. unlike most companies, people are willing to pay if it's Apple. they can roll it into the iCloud subscription
“Dead internet theory” but 80% of it is schizo-ramblings that obscures the broader idea.
http://next.copyleft.org/pages/current-release.html
thank you for giving a yes/no answer to a yes/no question. an i'm not being ironic, really thank you.
If you do crime with it you go to jail.

If you make profit in it you pay tax.

So isn’t this just regular money with a bunch of extra steps?

Sure the government can’t print bitcoin anymore than you or I can but.. the no devaluation angle is kind of meh in the face of its volatility and number of high profile frauds. No one should be sitting with a million dollars in the bank. Dollar denominated assets are a better inflation hedge than BTC.

Some basket of bonds ETFs whatever.
Yeah it’s less about connecting various APIs and databases than it is about your data.
But all of the answers were correct and useful, and GPT-4 was perfect. Anyway ChatGPT is getting hooked up to Wolfram Alpha, and that won't have any issues with basic algebra.
That's what I'm implying - I'm not retiring with the hopes of AI robots hand feeding me grapes in 5 years. I'm quitting because I think my skills and experience in building CRUD apps on the same data concepts a thousand times over is about to be pretty useless knowledge.
Can a model be fine-tuned “online”?

If cost wasn’t an issue, could I fine-tune a model in real time, while also using it for inference?
Sarcastically:

Define well-being? What if nobody is left around alive (after being painlessly and unknowingly euthanised) to experience anything bad?
From that list you only need React and a bundler, which can be Vite. You really don't need more than that to get started. Please ask, I'll do my best to help you out.
Haha glad my calling out of nonsense is apparently indistinguishable from a large language model. Does chatgpt do citations like that?
Three cents have been added to your bank account.
It does actually work. For some of the experiments I did with GPT-4, it made some mistakes because my initial prompt wasn't sufficiently precise. After discussing its mistakes with it, I asked it to write a better prompt that would prevent them. Sure enough, it did just that.
Now you're splitting hairs though.
Well, it seems multi-messenger astronomy might provide an avenue to further particle physics exploration. After all, we got some giant particle accelerators around us in the form of black holes.
Fair enough, I don't know anything about nomad-autoscaler.
The ethics committee got lazy and had GPT write the test.
It this provides optimised hardware acceleration on Apple Silicon for low level machine learning libraries.

PyTorch is supported for example, it’s a machine learning library with GPU acceleration that’s been around for 6 years now. It’s used in a few commercial projects, including Tesla Autopilot. It can be used for natural language processing, image manipulation, and possibly to build an LLM I suppose, but as a low level library it just gives the base tech to build such systems from.
What does Apple make hard to cancel?
But will punching trees give you wood?
"renting bare metal or colocation space from a provider"

Those are two totally, completely different things. Their own datacenter means their own equipment in a datacenter and could even mean building out their own datacenter. It never, ever means renting bare metal.
Honestly, what makes you feel convinced that the current AI wave will be so impactful, once you take away all the hype?
Without both these types of trust, an organization is going to be inherently unpleasant:

- trust that your coworkers are competent code-wise - without this, you're gonna get frustrated that you're constantly having to clean up after them and catch problems they've created (whether in a PR gated process or later when you find the problem they already committed - note that this isn't solved by PR gating because someone else less competent might have approved the PR anyway)

- trust that your coworkers aren't going to be annoying with their reviews - you cover this one, you'll be constantly blocked if you can't trust that

When people complain about very large organizations and teams being too bureaucratic and annoying it's because their organization hasn't figured out a way of scaling that trust. There are coordination problems that become very hard: hiring quality bars for interviews; alignment on what to focus on in reviews; even just "my opinion on what code I can be trusted with" vs "the domain expert's opinion on how much I can be trusted with that code". So process is created because "trust" doesn't scale to huge networks of people. The author mentions TDD, that's just an automated form of process because honestly, you shouldn't even trust yourself with some things when it comes to code. ;) But in a huge org you can't even trust everyone else to be on the same page, and that causes friction if you want to go fast.
You’ve basically said that you did a React course, built some toy apps (which almost certainly had sterile, malleable requirements) and now feel like the whole “front end” thing is easy mode.

Chances are you aren’t materially smarter than the hoards of smart people doing this day-to-day and find it ‘not-easy-mode’, and that you’re instead in deep Dunning-Kruger territory.

You watched the VHS about foundation repair but you’re yet to get thrown off-course when you find out that you don’t know what carbon-fibre stucco lath is.
This is such a glorious plan.

It's a wonderful un-process hack. You talk about tooling, but there's also just so much less process, so much less variability, so many less joints & non-uniformities. It may be slow, but you only really have a limited set of lessons about printing to learn.

By compare, look at videos comparing Starship nosecone over time. So much rocket building is a manual process, and it's hard work figuring out how each thing has to happen. I think even the cylinder fab has a lot of lessons that have gone into it.

At first this kind of felt like a gimmick, but being able to go deep on one ultra-flexible thing & reapply those lessons again and again seems divine. Being constrained by chiefly imagination, asking only where you want to put material not how you want to get it there is such an enormous liberator.

And once it's working well, they have such deep parameterization tweaks they can make, to optimize hone & refine. Thin this in this area, try some different reinforcement patterns on this wall... having a totally abstract way of building feels like cheating, it's such an obviously easier better freer constraint-less way of making real.

The potential savings here seem to more than make up for a potentially slightly slower build speed.