skysight-inc/HackerNews huggingface dataset:
what exactly do you expect them to do about the routing? 384b gpus are as big as memory buses get in the modern era and that gives you 24gb capacity or 48gb when clamshelled. Higher-density 3GB modules that would allow 36GB/72GB have been repeatedly pushed back, which has kinda screwed over consoles as well - they are in the same bind with "insufficient" VRAM on MS and while sony is less awful they didn't give a VRAM increase with PS5 Pro either.

GB202 might be going to 512b bus which is unprecedented in the modern era (nobody has done it since the Hawaii/GCN2 days) but that's really as big as anybody cares to route right now. What do you propose for going past that?

Ironically AMD actually does have the capability to experiment and put bigger memory buses on smaller dies. And the MCM packaging actually does give you some physical fanout that makes the routing easier. But again, ultimately there is just no appetite for going to 512b or 768b buses at a design level, for very good technical reasons.

like it just is what it is - GDDR is just not very dense, this is what you can get out of it. Production of HBM-based gpus is constrained by stacking capacity, which is the same reason people can't get enough datacenter cards in the first place.

Higher-density LPDDR does exist, but you still have to route it, and bandwidth goes down quite a bit. And that's the Apple Silicon approach, which solves your problem but unfortunately a lot of people just flatly reject any offering from the Fruit Company for interpersonal reasons.
Seems like they didn’t see it coming…
Implementing this approach could significantly enhance the adoption of LLMs within mobile phone libraries and other compact devices. I highly recommend opening an improvement issue for llama.cpp.
Well there is Dimmu Borgir, with an orchestra and a choir: https://www.youtube.com/watch?v=El4zsUZjsDc - and it is just nuts. Yes that's 90 minutes, but watch 5 and then decide.

And that's why I love folk-ish metal so much.

Why shouldn't we have a lead/harmony violin on top of a metal rhythm section? https://www.youtube.com/watch?v=F17sxgZdXZw

Or a hurdy gurdy? https://www.youtube.com/watch?v=LT7HqIP55tI

Or a pipa, which was btw very hilarious in poland: https://www.youtube.com/watch?v=MwpKZtPBIEQ

I'm honestly thinking of dropping some money to get myself an A-tuned drone flute[0]. Drone flutes sound really cool, and the drone would be tuned to just about the highest two notes on the guitar... and if you work with it a bit, drums/bass/rhythm guitars helping with rhythms, chords and harmony could really push that somewhere really interesting.

0: https://www.youtube.com/watch?v=j3OlNNEuu88
It depends. On my personal projects, I'd put my passion at around 95. On my work projects, about 30.

In terms of programming generally, as in passion for programming theory and whatnot, I'm honestly not sure how to answer that. In my younger years, I was very passionate about such things. But as the decades passed and my skills and knowledge grew, I reached a place where I became more passionate about what I was programming than the programming process itself. Which doesn't mean I don't have passion for the process. It's just complicated.
OK, sounds counter-intuitive, but I'll take your word for it!

It seems odd since the basis of word similarity captured in this type of way is that word meanings are associated with local context, which doesn't seem related to these global occurrence counts.

Perhaps it works because two words with similar occurrence counts are more likely to often appear close to each other than two words where one has a high count, and another a small count? But this wouldn't seem to work for small counts, and anyways the counts are just being added to the base index rather than making similar-count words closer in the embedding space.

Do you have any explanation for why this captures any similarity in meaning?
I strongly suspect that humans ingesting only output of other humans in a vacuum, e.g. social media without any other feedback mechanisms, suffer exactly the same degradation.

Outside of social media like bubbles, human learning in fact has a sort of oracle providing correct examples: the world around us. In fact, if you provide a world for an AI to interact with, such a game like Go, then it can in fact learn simply interacting with versions of itself and the world.

Put a little more simply, only talking will not lead to new knowledge if there is no testing of ideas or conclusions involved. If anything, extended talking without feedback often leads to damaging rumination and/or possible misinformation.

If this notion is correct, actively limiting and directing the sorts of inputs we give ourselves could help us improve our knowledge and abilities.
Yeah and in Europe the can is not 12oz (35.5cl) but 33cl
Dems didn't "know" they'd be losing the South, but LBJ certainly feared it. He, of course, was the one who pushed the Civil Rights Act through the Southern-dominated Senate; Bill Moyers recounted that: "When he [LBJ] signed the act he was euphoric, but late that very night I found him in a melancholy mood as he lay in bed reading the bulldog edition of the Washington Post with headlines celebrating the day. I asked him what was troubling him. "I think we just delivered the South to the Republican party for a long time to come," he said." [0]

Long-term changes in voting patterns don't happen in one election, and they're a multi-variate phenomenon. In 1976, Carter was the incumbent, a Southerner himself, and a beneficiary of the Watergate fallout and the Nixon pardon. Reportedly, his own pollster "Patrick Caddell stated that televisions ads by the Carter campaign in the south 'were blatant-waving the bloody rebel flag'. To avoid being viewed as a liberal in the south Carter campaigned with [George] Wallace and voice[d] opposition to welfare and support for balanced budgets and national defense. He also campaigned with segregationist senators James Eastland and John C. Stennis." [1]

Before that, in 1964, Goldwater opposed the Civil Rights Act, and in that year's presidential race, he carried the Deep South, less Florida with its New York retirees, plus his home state of Arizona — and that was it. Previously, the South had been solidly Democratic since Reconstruction (except for war-hero Ike).

In 1968, "segregation forever" third-party candidate George Wallace carried most of the Deep South.

The 1972 election pitted the supposed peacenik Democratic candidate George McGovern against incumbent Nixon.

In 1980, Reagan famously announced his support for "states' rights" and excoriated "welfare queens," both of which of course were dog whistles to Southern segregationists. [2]

[0] https://www.google.com/books/edition/_/x-o9qAO_oEEC?hl=en&gb...

[1] https://en.wikipedia.org/wiki/Southern_strategy#1976_electio...

[2] https://en.wikipedia.org/wiki/Southern_strategy#Reagan's_Nes...
Pop music really does do this as he described. There are lots of songs that play with expectations of timbre in the same way that normal music plays with expectations of pitch.

When I get mentally crystallized, I hear music as proof-of-work in the vein of Bitcoin hashes.
Not entirely "nothing", as a result of HFT market making all participants are getting smaller spreads and increased liquidity. However... That has huge diminishing returns. The first few steps to electronic markets and fast market makers dropped the spread considerably (making trading cheaper for everyone), all the steps that came after cost a lot more and didn't really improve things much.

So they're not adding a lot now relative to the cost and complexity. But banning the whole practice will make the markets function much worse and more expensive for everyone.
Peoplw conceptualize businesses likr some super organism that should try to maximize the quality of its products.

In reality, it most.often maximizes its executives lives while minimizing all other forms of frictions.

Everyone whose worked with small businesses will rscognize this pattern easily. Uts only when you get a few e?tra executives that the equation itself gets comolicated, but its still typically about maximizing the executives livlihood.
Da Vinci perhaps did not lament, but hustled hard to minimize the amount of boring commissions people were most willing to pay for (portraits of noblewomen, of merchants' daughters etc.). And, when he did take a boring commission work, he could procrastinate on it for years, or never finish it at all.
I think it's crazy how $100k seriously can't cut it in the US?

Here where I live, in Norway, $100k is more than enough to live very comfortably almost anywhere in the country. Only exceptions would be certain expensive parts of Oslo, and some other high-income areas/towns around Oslo.

And if you're two people earning that kind of money? Early retirement would be a viable option in as little as 10-15 years, if you have a sober lifestyle.

But, then again, I have friends and ex-colleagues that live in the US - and I'm not talking about expensive places like NYC, SF, etc. - bur rather medium sized cities in flyover country, and even there people are paying rents (or purchasing homes) that feel pretty stiff to me.
Reddit doesn't allow vpns or or cloud/hosted ips and unlike google, when it censors you, you lose data plus their horrible clinky ui and "please install our spyware app if you want our artificial ui slowdowns to go away" b.s.. i don't know why so many people think this is a good thing. It might as well be facebook or twitter.
It does seem like an incredible waste of resources of all kinds, but I'm not sure whether a tax would fix things.

This is a problem of market structures, if I understand it correctly; facilitated largely by Reg NMI in the US and its equivalents globally. And it's not like all was well before that: Instead of HFTs, it was market makers or specialists pocketing impressive, largely risk-free profits.

What you'd ideally want is to preserve the good that the HFTs facilitate (liquidity, more efficient price discovery, smaller spreads etc.) while avoiding the bad (siphoning off investors' money from the markets and math and physics PhDs from the world's top schools), but I haven't yet heard a convincing proposal for that.
There are no extra costs other than the what we'd normally charge for Edge Function invocations (you get up to 500K in the free plan and 2M in the Pro plan)
Really? The situation isn't so simple. High income earners are paying historically low taxes.
Not to mention cuts in inheritance taxes from the 80s onward.
You'll need to explain your data more carefully than claiming it is all being stolen by taxes.

https://www.wolterskluwer.com/en/expert-insights/whole-ball-...
No, resolution is not a digital concept. Pixels are a digital concept[0], but in an analog signal there is still a limit on how much frequency content you can resolve.

CRTs additionally impose their own limit on how sharp the picture can get horizontally. Confusingly, these are called "television lines", even though you'd think that refers to the horizontal scanlines that do discretely divide up the picture vertically. Color CRTs further limit the amount of color resolution independent of luminance resolution, and how they do that depends on what specific phosphor pattern they use, how they separate electrons from each color gun, etc.

[0] And one that's just as misleading as sample-and-hold diagrams of digital audio that make people go out and buy really expensive DACs for reproducing ultrasonics they can't hear
I beg to differ look at the amount of conde nast reposts, posts that just link to Wikipedia and posts that are repated over and over.
I'm fascinated that this apparently supports Itanium.
> This journey will start with Hyundai

Wonder if that includes weapon systems?

https://en.hyundai-wia.com/business/defense_business.asp

> With its cutting-edge unmanned and automated weapons systems, Hyundai WIA upgraded the level of defense industry system.
KISS doesn't get me employed though. I narrowly missed being the chosen candidate for a State job which called for Apache Spark experience. I missed two questions relating to Spark and "what is a parquet file?" but otherwise did great on the remaining behavioral questions (the hiring manager gave me feedback after requesting it). Too bad they did not have a question about processing data using command lines tools.
Jane Street has a tech podcast that's worth listening: https://open.spotify.com/show/3ig6FgIbASpqJbc9chD2CI?si=etXY...

The episodes on compiler optimization, time keeping and multicast are specifically interesting if you want to know more about the oddities of high frequency trading.
Bostrom has always had the air of knowing he’s phenomenally intelligent and absolutely brilliant and almost certainly the smartest person in any room. Yet his work smacks of grind and storytelling rather than genius.
> but sucks with smaller displays.

That's the system working as intended. Why would they invest in making the site better on smaller displays (i.e. mobile) when their priority is to get you to use the app? From the normal not long term enough business perspective, doing so could only cannabalize those conversions to the app that would have otherwise happened. And conversion rate from web to app is almost certainly a explicitly tracked metric.
Thanks, I think the cloud approach is the only way, I wanted to do it locally. For personal use, cloud providers are very hostile, especially if your use case is to do things that aren't normally done.
Halfweight. Half the weights, half the wait, half the wit.
The founders admitted themselves to start traction on the site with a multitude of fake users.

All the "just asking questions" posts pushing certain narratives in every regional subrredit are also quite noticeable.

For me that is proof enough, but other people might have different standards.
One of the big mysteries of the software industry. Not specifically singling out reddit here, since I don't even search on reddit: Why can we not simply have search functions, that at least optionally do a substring search? If I had a $currency-unit for every search that fails at this basic thing, I wouldn't need to work any longer.
They're still in use for people who work in SCIFs.
Starting in 2020, the Faculty imposed a freeze on fundraising and hiring. In late 2023, the Faculty of Philosophy decided that the contracts of the remaining FHI staff would not be renewed.

Can anybody offer insight into the reasons here? Obviously there is not going to be an objective answer to this question. And that is probably why the linked page does not try to give an answer.

I'm assuming lack of funding wasn't the problem, since they froze fundraising (if the inability to raise funds was the problem it is unlikely that they would have done this).

Edit: looks like he got smeared in January of 2023, but that doesn't explain the freeze starting three years earlier: https://news.ycombinator.com/item?id=40066352
You may get way more accurate results from relatively small models as well as logits for each class if you ask one question per class instead.
Effortless would be another great name (since you are literally reducing effort to get speed). OK, maybe not "great", but "an option if you're going for puns".
This reminds me of a podcast episode that featured Rick Rubin.

He said make your art for yourself, make it like it is a diary entry.
The whole inference is slow, but it's matrix multiplications that count. They work reliably on all the Macbooks that I tested - at 50% effort it's the same speed as the state of the art matrix multiplications, at 25% they are twice as fast.

The apple's MPS matrix multiplications from Apple are comparable in speed to the speed of Llama.cpp and the other models. When I was doing tests, I was comparing the Llama.cpp benchmarks ( https://github.com/ggerganov/llama.cpp/discussions/4167 ) to Apple's MPS - they match very closely. And then I was comparing Apple's MPS to my results.

Even if the end-results would show that the models somehow break (which they might on Q8), there is no other implemented method right now that would give you such speedups with matrixes of 25% sparsity. The usual methods break even with full matrix multiplications around 15% mark, and show speed improvements under 10% (as far as I know, but I'm new to the field, so I wait to be corrected).

As for the other metrics - I hope to get help from the community to get the implementation done properly. So far it's been 3 months of work 12 hours a day - even during Easter - to get this version going. It is as far as I can push it without the community support, which I'm happy I received over the last hour.

Also, I'm not sure what you'd expect really. A full production ready system on the day one? From a solo developer? Seriously? :)

Let's get the flame war going! :D
Wow, such impressive work! Congratulations on receiving your well-destined bug bounty.
[not related to this thread]

working on a project that I'd love to run by you in the men's health space.

came across a comment you made on a previous post, so figured I'd reach out.

amitthakrarcoaching@gmail.com
If you read the Wiki, you'll see that weapon's manufacturing is nowhere near the worst thing Krupp did. Krupp used Jewish slave labor during WWII, and treated the slaves so badly that the SS criticized them for it.
I think this nearly 100 year quote puts it succinctly:

"The essence of American capitalism is to allow the rapid emergence of new companies, the essence of European capitalism is to do everything so that old companies do not die."

- Léon Blum (1932)
Yea... sorry about it :/
I'm assuming you're not speaking about law enforcement since you didn't mention it specifically but I think there's a big difference between a chaotic and interested crowd vs an antagonistic crowd.

Law enforcement are often trying to handle a person they view as dangerous and, if there's a crowd of people around who are vocalizing their displeasure with you, you're going to feel more in danger.

I don't disagree with you about police escalating _violence_ in these situations which is why I specifically said "tensions".

IMO, a bad cop who is completely in the wrong and prone to violence will be more likely to commit violence if their attention is split between their suspect and the antagonistic crowd. Being surrounded by unfriendly people doesn't make people react better than they would have otherwise.

There are plenty of bad cops around. All I'm advocating for is that, if you're recording an altercation you believe unjust, record it and don't become part of it.
Corporations and shareholders are.becoming extraordinary citizens and no longer represent a social net.good.
> Eventually almost everyone wants to customize according to their own needs,

Citation needed.
Bitwig, SublimeText, Tusky (Mastodon client for Android), Midnight Commander, my highly customized i3 setup.
https://www.economist.com/technology-quarterly/2024/01/29/da... has some actual data on use.

A recent analysis in Joule, an energy journal, suggests that at the rate they are being produced, ai servers could use about 100 terawatt-hours of electricity each year by 2027, between a quarter and a fifth of total data-centre consumption. Schneider Electric, a French firm that builds power supplies for data centres, projects that ai’s share of data-centre electricity use will jump from 8% in 2023 to 15-20% in 2028.
Zero tolerance policies are a direct response to discrimination claims.

If you allow people to have discretion, then it will be used(and abused).

Also some of the stories I hear about school in the 70's and 80's make me think that the current claim that "schools were always authoritarian and used to subjugate children to turn them into compliant workers" is probably BS.

Probably current administration needs to justify it's existence and high pay by making rules.
The MTEB leaderboard has you covered. That is a goto for finding the leading embedding models and I believe many of them can run locally.

https://huggingface.co/spaces/mteb/leaderboard
I just finished reading it.

It's extremely repetitive; he could have written a book one-third of its length without leaving anything out. There's some good stuff in there, but I was sort of annoyed that the author forces you to read everything three times. Kinda disrespectful to his readers' available free time.
libdispatch/GCD is a task scheduler built on top of kqueue. It's meant for moving things away from the main UI thread without thinking how often you do that.
https://knowyourmeme.com/memes/shut-up-and-take-my-money
Let's see how it goes in the US. If everything goes as expected, I'll maybe publish a second edition after the Summer :)
Tips for Chakra UI Developers
How does this longer baseline sensor affect what kind of gravitational waves we'd be able to detect? Such awesome engineering, such an incredible instrument to listen with. But I'm not sure what this means in terms of sensing resolutions, or what else this means in terms of our ability to see these ripples.
I don't think it is. If this was the main goal they would have just done nothing. Instead they rolled out a design which sucks for both desktop as well as maintaining shittiness on mobile..
Yes.

It was worse in the "good old days". The cost of trading was much higher and the people that felt that were the people who needed the market to make the world work (risk management, investment etc.)

Markets make the world a better place (it's not a new idea), and more efficient markets are better than less efficient ones.

> If not, how about a per-transaction tax on securities trades, one that wouldn't be out of line for individual investors,

Why do you want my pension fund to spend more of my money on trading costs?
> But will they be making car parts? Almost certainly.

What can humanoid robots making car parts do, that the already-existing and already widely deployed robots making car parts can't?
There were more than a few “Wait a sec, that’s really hard to do” light bulbs that popped into my head watching that.

I wonder if the result is more of a product management/focus failure than a technical one? Perhaps the outcome would have been better if they had just picked one or two hard problems instead of trying to make the everything device right at launch.
I think many people interact with Krupp's modern incarnation on a very regular basis; ThyssenKrupp is one of the largest manufacturers of elevators in the world. https://en.wikipedia.org/wiki/ThyssenKrupp
We've merged them. (other one was https://news.ycombinator.com/item?id=40067489)
I think I do understand why the other people in this thread wrote what they did. It's true their worldview is probably extremely different from mine.

I find the extreme wealth inequality we witness to be a great tragedy. That people are destroying their minds and bodies to be given the privilege to exist on this planet, while people lucky enough to be rich can simply order 99% of other humans around, and convince them that it's a good thing. That it's fair they're giving away their health, their sexuality, their blood or all of their time, as they are getting paid money in exchange. Something that to them is only achievable by hard work and extreme sacrifice, and in small quantities, while the same amount represents a minuscule value to the person on the other side of the deal.

Adding to that legally selling your organs, is inconceivable to me. What's next, selling babies for adoption?

I'm sorry if this seems poorly thought out and weakly formed argument, but I don't even know how to begin expressing my opinion on this matter. I can't see how I can be convinced this is all OK and something to be intensified.
wear a five finger glove if you are going to take pictures.
I don't think that. I find that open source software very rarely "gets worse". There are exceptions of course, but day-to-day software like zsh, bash, comma line utilities just don't get worse. The X window system typically gets better.

I may have a narrow view of things, I don't use Windows. I know that Windows is the standard business operating system, but I haven't used it in almost 6 years.