skysight-inc/HackerNews huggingface dataset:
> much more inefficient

The tricky part here is that "efficiency" is not a single dimension! Transformers are much more "efficient" in one sense, in that they appear to be able to absorb much more data before they saturate; they're in general less computationally efficient in that you can't exploit symmetries as hard, for example, at implementation time.

Let's talk about that in terms of a concrete example: the big inductive bias of CNNs for vision problems is that CNNs essentially presuppose that the model should be translation-invariant. This works great — speeds up training and makes it more stable – until it doesn't and that inductive bias starts limiting your performance, which is in the large-data limit.

Fully-connected NNs are more general than transformers, but they have _so many_ degrees of freedom that the numerical optimization problem is impractical. If someone figures out how to stabilize that training and make these implementable on current or future hardware, you're absolutely right that you'll see people use them. I don't think transformers are magic; you're entirely correct in saying that they're the current knee on the implementability/trainability curve, and that can easily shift given different unit economics.

I think one of the fundamental disconnects here is that people who come at AI from the perspective of logic down think of things very differently to people like me who come at it from thermodynamics _up_.

Modern machine learning is just "applications of maximum entropy", and to someone with a thermodynamics background, that's intuitively obvious (not necessarily correct! just obvious) –in a meaningful sense the _universe_ is a process of gradient descent, so "of course" the answer for some local domain models is maximum-entropy too. In that world view, the higher-order structure is _entirely emergent_. I'm, by training, a crystallographer, so the idea that you can get highly regular structure emerging from merciless application of a single principle is just baked into my worldview very deeply.

Someone who comes at things from the perspective of mathematical logic is going to find that worldview very weird, I suspect.
Reminds me of when the mostly loved Google Inbox was killed because people spent less time in gmail
my sister use to work at McKinsey, her favorite story was working on Obama's and McCain's campaign strategy at the same time. Heh talking about picking winners..
> But it did not mention the most similar-sounding pair "F" (Foxtrot) and "S" (Sierra), which are nearly indistinguishable.

My family name begins with a 'F' and, indeed, I can't count the number of times where people write a 'S' instead. I've got invoices with a 'S' instead of a 'F'!
I agree, but all of the alternatives are no better. Bing and Duck Duck Go are okay sometimes, but truly terrible other times. Google is consistently worse than it once was, but still better than the competition.

I know search is hard to do well, but if Google is truly floundering where is the startup that for it better and not just better for a very specific niche area, but truly better across the board?
The odds of the conservative activism SCOTUS siding with employees and COTUS (bought off by corporate lobbyists) passing a worker-friendly prohibition on noncompetes are both zero. OTOH, it's not outside the realm of possibility that COTUS might pass a federal law superseding laws in California, Colorado, Illinois, Oregon, Nevada, Washington state, and Washington DC to roll back states rights favoring workers. Similar state bills in NY and NJ died in committee in 2022.
I was part of one of these oaths, I have an iron ring (Canada). It's just, look around you. Every bridge collapse, every oil spill had some "certified oathkeeper" or a team of them behind it.

The presence of a ceremony - no matter how important it was in the past - just doesn't hold value anymore. I doubt that Professional Engineers(TM) that have signed the oath are among us operating on a higher plane of morality and gravitas. They're, most likely, by Occam's razor, just another person.

The idea that any amount of my peers (or myself) present at the same ceremony take this oath seriously is laughable. It's a wine and cheese event before you get your degree, nothing more.
I don't think that this is obvious at all. Yes, AI people who read papers on arxiv and know what "SOTA" stands for know it, but that is no longer the main user base of LLMs.

This is meant to be for the developer who doesn't fit the above profile and thinks a model that has a million token context window and "can handle complex analysis, longer tasks with multiple steps, and higher-order math and coding tasks" (direct quote from Anthropic's website), actually can do those things.
I think of robots as being physically embodied somehow. I don't think of a software program like a virus as being a robot.
Which would be great. These agencies and bureaus have grown to an enormous scope, completely without the consent of the governed. Doesn't sound like a republic to me.
QAnon is so obviously a pun/joke on Q rumors, I'm not sure what the outrage is about.

His GRT outlook is quite logical. More illegal immigrants = more votes for particular politicians, more expensive housing, and lower wages. He's been very clear he prefers extremely tight borders for illegal immigrants and hugely open ones for highly qualified legal immigrants. I think the majority of American's would agree with that.

I also disagree with his Ukraine/Crimea thoughts, but it's quite logical from his viewpoint. He sees an increased risk of Nuclear War over Eastern Ukraine as not worth it, and has mentioned that a few times. I'm sure he understands his mortality and time left, and is just thinking on a civilizational level. I will point out the irony in you stating this, when Starlink has been instrumental in the Ukrainian defense.

Again, I haven't seen anything particularly damning.
Oh sure everyones a "citizen" but you're not a SuperPremiumPlus++ Citizen so you don't have access to that feature. /s

I think most of these symptoms are due to the death of "us". Civics and government, "We The People" refers to a collective "us" that share things. All powers, privileges and norms flow from a brain worm that my neighbor and I are alike, that you stranger are like me, and what is good for you is good for me.

That auto-chisel of isolationism marketing uses to sell us things, the death of third spaces, and a reality where you don't know if this comment was generated by a machine owned by a corporation, has the side effect of greatly weakening the concept of "us." Now its all a fight of demographics.

In this case the code bodies, inspectors, builders and municipalities are the concerned party and "us" citizens are as forgotten as powder wigs.
> Each code line incurs usually between $0.01 - $0.07 fee via LLM

Cool idea, how advanced an llm is required to "compile" the language?
Kanji is believed to be introduced by Korea, and Katakana is originated from Korean Buddhism monks' scripting system for representing grammatical particle of Korean language in Korean Silla kingdom period.

Please original writer, either don't say anything about history if you don't know actual history or do better research.
Given that these rules are very similar to those in California, and California has a big enough economy to be a good representative sample, I don't see this being a real issue.

Otherwise, why aren't well capitalized competitors in California hiring up the best people at their competitors and crippling competition, as it were? We just don't see this happen on a large scale like this suggestions.

Now, that's my take on it at charitably. My honest opinion about it is simply: who cares. If you want people to stay, give them reasons to stay that aren't the legal equivalent of holding a gun to their head
You're looking for ERISA. And the ACA.
Reminds me a little of my fav sub-reddit browsing tool - https://anvaka.github.io/map-of-reddit/

One nice feature that would be helpful is the ability to preview the blog.
There is enormous value in polishing the user experience, especially if no one else is doing it (or maybe capable of doing it?). It will never get old as long as they are the only ones doing it.
PCB manufacturing. They said the assembly is just about to start and they'll be shipping day after tomorrow. I'm in London so will have to see how long shipping takes!
Wow. Another incredible bar raiser for open-weight language models. I can't wait to see a fine-tuned version.
Funny, for me its opposite. And I never saw a virus on Android in the last 10 years.
Yeah, do you think its fine for me to send people my Khan Academy profile link or should I export all my projects to my personal website?
Scrolling down that page it seems many photographers had a really fun time with this eclipse. Obviously the birds pics, but also the mountaineer and the guy "holding" the eclipse are absolutely amazing.
Direct quote from Anthropic's website: "Opus -Our most intelligent model, which can handle complex analysis, longer tasks with multiple steps, and higher-order math and coding tasks."

So you tell me: if a regular developer reads the above, how can they surmise that the model which can do higher-order math can't count?
There's speech recognition (pretty good these days, but probably still not as good as it could be), and gunshot detection (which doesn't work so well). There has been a fair amount of work in emotion detection from speech over the last decade, again with not so great results, though it's used in call centers. It's true as far as I can tell that deep learning has not been applied to emotion recognition and other types of sound events (animal noises, human presence, fire detection, etc.) as far as I can tell from public news (though I haven't gone looking for it). There has been a huge effort to detect anomolies in machine noises and vibrations in the past since that has industrial uses in detecting machine failure (why doesn't it exist in cars?). Music recognition works very well (Shazam). Haven't seen an app that can tell people "what made that noise in my house and where?".
The only reason I have an Apple Watch today is because I 1) broke my iPhone when the waterproof case I had failed, and 2) sale on amazon pushing it below $200. If the watch waterproofing fails, it's a lot less catastrophic than an iPhone would be.

I only use the watch when surfing or doing mountain biking. It's still not all that great of a device, and not much (in a practical sense) has changed since 2015. Limited functionality and what is there is frustrating to use, especially while in action.
All the comments here remind me of the same sentiment [0] when Meta went all the way down to $89 and nobody bought it and it was all over for Zuckerberg and Facebook.

What happened next was just business as usual with the price rising from $89 to $500.

Lets hope that $TSLA's price crashes 50% and it would be a perfect time to buy.

[0] https://news.ycombinator.com/item?id=31832439
Thank you for the response. I had to think about what I wrote. Yeah, I am most likely affected by anti-China / CCP propaganda. My mind does go to theft when I think about Chinese advancements relative to American ones (such as EVs and CPUs). It's hard to unwind that, but I'll think more in the future before I'd confidently express such thoughts if they should even be said with confidence.

I do not think Chinese are dumb at all. They're definitely gaining footholds in different sectors that America is supposedly strong in and that is not something a "dumb" nation would be able to accomplish. Underestimating people in these situations would probably be fatal.

My issues are with the CCP / Chinese gov and not the people themselves. Probably as a result of said propaganda. One can dislike a government and still respect its people.

> It's fully owned by Tesla

Is it really? Correct me here. I currently think that foreign businesses in China must be partially owned by a Chinese entity and that eventually leads to some form of CCP meddling.
Page 83-84 provides some guidance on garden leave and suggests that it will still be allowed under the new rule:

> With respect to garden leave agreements, as noted previously, commenters used the term “garden leave” to refer to a wide variety of agreements. The Commission declines to opine on how the definition of non-compete clause in § 910.1 would apply in every potential factual scenario. However, the Commission notes that an agreement whereby the worker is still employed and receiving the same total annual compensation and benefits on a pro rata basis would not be a non-compete clause under the definition, because such an agreement is not a post-employment restriction. Instead, the worker continues to be employed, even though the worker’s job duties or access to colleagues or the workplace may be significantly or entirely curtailed. Furthermore, where a worker does not meet a condition to earn a particular aspect of their expected compensation, like a prerequisite for a bonus, the Commission would still consider the arrangement “garden leave” that is not a non-compete clause under this final rule
even if the employer did not pay the bonus or other expected compensation. Similarly, a severance agreement that imposes no restrictions on where the worker may work following the employment associated with the severance agreement is not a non-compete clause under § 910.1, because it does not impose a post-employment restriction.
A) This is short-sighted. What you're suggesting is in fact a way to optimize short-term gain over long-term viability. It's pure MBA tactics.

Additionally, it's complete and total oversimplification. If you look at Google's earnings it's pretty damn clear that at least until 2020 they were not just going for maximum total spend, but for a steady, gradual raise in total spend. Not too slow, not too fast. They were NOT taking every opportunity they had, in fact they're famous for systematically refusing many opportunities (see the original founders' letter, but even after that). They were farming the ad market, the ad spend, growing it, nurturing it. Then COVID blew up the farm.

Maybe you're right now, but I do hope they're recovering their old tactics. Because if they maximize it you'd see nothing but scams ... wait a second.

B) Google was built by providing a vision, and getting out of the way of ground-up engineer efforts. "Scaring workers into compliance" IS killing the golden goose.

You can see this in AI. Every story from an AI engineer that ran away from Google is the same. They didn't run away for the money, they ran away because they were getting scared into compliance.

Now AI may make it, or not. I don't know. But this is happening EVERYWHERE in Google. Every effort. Every good idea, and every bad idea runs away, usually inside the mind of "a worker". Not to make them personally maximum money, but it's natural selection: if the idea doesn't run away, the engineer it's in is "scared into compliance", into killing the idea.

Whatever the next big thing turns out to be, it simply cannot come out of Google. And it will hit suddenly, just like it did for Yahoo.
Interesting, I did different choices:

5-bit base-32 oi23456789 abcdefghkl mnpqrstuvw y

o = 0
i = 1
j, x and z removed.

I like that you can fit 6 characters in an 32-bit integer and still have to bits to spare... makes for compact usernames and network bandwidth.
Original title of article:

"The eSafety commissioner and X are due back in court today. Here's what to expect"

https://news.ycombinator.com/newsguidelines.html
Sized, DynSized, and Unsized
Ask HN: How can I get a cloud Mac server for iMessage?
I daily-drive Linux, but recently for social reasons have reluctantly adopted iMessage. Looking for a way to respond to texts from my laptop, so I need a cloud server where I can log in and start a BlueBubbles/Beeper bridge. Any cheap providers?
This is exactly what prototype PCB manufacturers are for. If you're in the Bay area, SF Circuits (and a dozen others) will give you 24h/48h turnaround times. This is a highly commoditized service. Even the generic manufacturers like PCBway have options you can purchase for faster turnaround if you meet the constraints.

Don't move to Shenzhen. You don't have the social connections for that and it'd just give you a bunch of new problems.
Do you have in-house SMD assembly experience? When I was doing fast turnaround prototyping, being able to build up the boards in house was invaluable.

Do you need your prototypes to be on flex PCBs? If you can get the electronics ironed out on FR4 you're going to save a lot of time and money on prototype revisions.

If you're waiting for JLCPCB to assemble all your boards for you you're slowing your process way down. Pay for 2-3 day processing at PCBWay and then assemble in-house. If you can prototype on FR4, PCBWay can literally manufacture the boards overnight and DHL them to you before noon the next day.
Secretiveness in a startup at that stage is not a good sign. See e.g. Theranos or Magic Leap.
I can already change my race. I just check a different box on government forms...
Interesting I see. I'm moving from breadboarding to PCBs because I'm using ICs which are way too small to solder by hand and I've already prototyped with their off-the-shelf dev board versions.
For an alternative viewpoint on the supposed “vagueness” of Japanese, I would recommend “Gone Fishin: New Angles on Perennial Problems,” by Jay Rubin, from the Power Japanese series.

https://openlibrary.org/works/OL5609329W/Gone_Fishin%27
I had to look this up — I've never heard it used in Britain.

> Ratfucking is an American slang term for behind the scenes (covert) political sabotage or dirty tricks, particularly pertaining to elections

https://en.wikipedia.org/wiki/Ratfucking
> Under common law, courts typically presume a law does not apply 'extraterritorially' (outside Australia) unless this is made explicit. But lawyers for eSafety argued in the initial hearing on Monday that the only reasonable interpretation of the law was that it did cover overseas content, since the law is about online safety for Australians and Australians can easily see content available anywhere in the world via a VPN.

Although the "worldwide" part of it is important, its frustrating that the contours of the debate in Australia is about whether twitter should be censored globally or just for Australia, rather then the incredibly chilling speech implications that censoring this has in general.
vodafone has been blocking my site daniel.haxx.se for several years.

Discussed on this very site for example back in 2022: https://news.ycombinator.com/item?id=31248250
Well be surprised. I write them down, by hand.

> They’re long and gibberish, odds of an unnoticed error are high.

That's why you "whitelist" those you wrote down and re-used with success: a little checkbox, which when checked means "Successfully re-initialized an authenticator with this 2FA?", works wonder.

A "dot" underneath a character means it's a number (so I'm sure not to mistake '5' with 'S', for example).

My "paper 2FAs" then go to the bank, in a safe.

I've never ever lost a 2FA access code.
Noncompete clauses have often been used by employers to scare their employees into thinking they'll be sued just for simply finding a new job at a different company.
It's really not that complicated. I can tell a lot of things by looking in the mirror. That I need a haircut. That I need a shave. Despite the fact that I've literally never used a measuring tape on my hair. That my hair color changes slightly (lighter or darker) with the seasons. That my hair has gotten grayer with age. (I would prefer to deny that, but eyes can't actually lie that much.) I can tell if I'm sunburned (I never tan, sadly). And yes, I can tell that my stomach has gotten thinner or thicker over time. These are not exact measures, but you can in fact reliably tell when your body changes. Subjectivity is not blindness.

By the way, your previous comment was flagged dead. You might want to reconsider the way you reply in light of that.
Get born into a wealthier family
Wrong reading. I never intended to make a generalisation out of 6% or even triple that amount. I just wanted to establish that rich assholes are a thing.
I see, I'm also based in Europe (London) so hopefully shipping time ends up being similar!
Fair point, thanks for the clarification.
> And MCTS still the SOTA search algo in Go etc

It's often forgotten that Rich Sutton said the two things which work are learning (the AlphaGo/Leela Zero policy network) and search (MCTS). (I think the most interesting research in ML is around the circumstances in which large models wind up performing implicit search.)
I have worked jobs where the best bonus over 5 years was $500, while the typical year all we got was a promise that if things go well there will be a bonus. I've worked other jobs where the worst bonus was $15000 (a really bad year for the company), and could be up to $50,000. This is as a regular engineer, management can get a lot more. The first company taught me at until the money is in my account the bonus is meaningless. The second taught me that they aren't just a rumor. Most companies don't even pretend to offer a bonus which is acceptable - at least I know what I will make.

I think everyone should make 2-3x the poverty level income (we can debate exact numbers), and everything after that is bonus. So long as the company pays a bonus most years it means in a bad year you have enough to live on and don't need to find a new job, while in a good year you have a nice bonus to buy nice toys.
Print instructions would get outdated with each OS release. But they do have comprehensive online instructions which do cover how to maximise windows.

https://support.apple.com/en-gb/guide/mac-help/mchlp2469/mac

In addition, macOS and iOS come with a “Tips” app (yellow with a lightbulb icon) which covers several topics.
What are these missteps?
"Fifty Sounds" by Polly Barton is a book-length essay about this. Very entertaining read. Plus some Wittgenstein thrown in ...
Illegal immigrants driving up housing prices and Great Replacement Theory are not the same things.
"this is something we can do now"

Liar.
It's not bad when people are copying you, it signals that California is ahead of the curve on the issue and - upon further examination - others too like decriminalization of cannabis including removing it from background checks and drug testing for most employment, as well as certain tenant and landlord rights other states don't have.

Some of those non-competes were ridiculous with their "in perpetuity throughout the ends of the Universe" type wordplay, I'm surprised governments haven't been more vigilant on things like the stifling of entrepreneurial mobility, since it only helps their economies in the long run to do so.

Make it possible to disrupt, design economies for entrepreneurs as much as for corporations, and reap the benefits IMO. Let those big evil uglies get disrupted if they can't stay relevant or retain top talent.
They do stifle innovation when one company locks up a huge portfolio of them. Forcing the employees who came up with the patentable ideas to sign non-compete agreements prevents them from working on anything related to those inventions elsewhere.
No. It explicitly does not do that.

"The Commission declines to extend the reach of the final rule to restraints on concurrent employment. Although several commenters raised this issue, the evidentiary record before the Commission at this time principally relates to post-employment restraints, not concurrent employment restraints. The fact that the Commission is not covering concurrent-employment restraints in this final rule does not represent a finding or determination as to whether these terms are beneficial or harmful to competition. The Commission relatedly clarifies that fixed-duration employment contracts, i.e., contracts between employers and workers whereby a worker agrees to remain employed with an employer for a fixed term and the employer agrees to employ the worker for that period, are not non-compete clauses under the final rule because they do not restrain post-employment conduct."