skysight-inc/HackerNews huggingface dataset:
Batched inference will increase your overall throughput, but each user will still be seeing the original throughput number. It's not necessarily a memory vs compute issue in the same way training is. It's more a function of the auto-regressive nature of transformer inference as far as I understand which presents unique challenges.

If you have an H100 doing 100 tokens/sec and you batch 1000 requests, you might be able to get to 100K tok/sec but each user's request will still be outputting 100 tokens/sec which will make the speed of the response stream the same. So if your output stream speed is slow, batching might not improve user experience, even if you can get a higher chip utilization / "overall" throughput.
> Definitely not visiting that spot ever again.

Sounds like there's already a cap on it.
I always found it strange that modern socialists and leftists are very supportive of income taxes, even though it is a dreadful burden on those people who have to work for their survival. Why wouldn't leftists instead be more for taxes and tariffs on land, on commerce, on natural resources or on luxuries?

The funny thing is that one of the goals of the communist party in the Soviet Union was to abolish all income taxes! Khrushchev even lamented later that they couldn't reach that goal. I suspect many hackers would have loved to be members of the Supreme Soviet, but how would they have reacted when Khrushchev suggested to abolish all income taxes?
Solar waste is similar to Nuclear per energy created:

https://ars.els-cdn.com/content/image/1-s2.0-S09596526220213...

Much lower than fossils. Magnitudes lower than municipal waste or other e-waste.

From https://www.sciencedirect.com/science/article/pii/S095965262...
I admin two FB groups, and a lot of people in those groups now know me which makes it a lot harder.

They are the main reason I am still on FB. Occasional posts from friends, and I do post (three psots this mont, and that is pretty typical)
Except no cultured adult programmer would use the original PHP syntax for templating, unless it's some 5-minutes worth development script. It's too powerful and too complicated. People use smarty or twig, which are basically the same thing as Jinja.
> Idea: tax loans taken out using assets as collateral at regular income tax rates.

I don’t think it’s as simple as this. This will end up catching normal people (any mortgage, automotive loan, etc) but may result in tricky accounting/loan structuring to avoid having literal collateral for the billionaires you’re trying to hit.

I don’t think that taxing unrealized gains is the solution either, but I also don’t think doing nothing is the solution. This is a very tricky problem without an obvious solution (and it doesn’t help that the ultra-wealthy can fairly easily influence lawmakers).
thanks, sorry should've just posted this link instead!
I think this is one of those wordcel arguments that sounds nice but probably has no bearing on actual reality.

If we live in a world where human effort has no marginal utility, we also live in a world where human life has no value. If we don't, you're in a world where you're competing with other humans for some set of resources. Regardless of whether you believe that you are competing with them, others are competing with you.

I think competition is perhaps one of the most basic rules of reality.
It's exactly the same service at the deli counter at my grocery store. They make sandwiches to order. Yet there's no tipping at all there. No jar, no tip line on the receipt.
"Stone-columning" is the new "bikeshedding".
It’s worse & an intractable problem. “Close the damn ports” may very well be one of those useless items for 1 team and relevant to another. So do you have team specific checklists or generic checklists that everyone must follow. If you have specific checklists, then you miss things that are relevant. And what happens when you make a change to how the system works & some item is no longer relevant while another becomes relevant? There’s no easy answers here I think with respect to checklists.
On mobile, iPhone 15 PM, feels janky as well. It’s subtle but it’s there. Thought it was just me, but checked the comments to find similar experiences.

Also, poor accessibility as well.
So long as you can survive the encounter, if you inflict any kind of decent wound, wouldn’t the animal eventually die due to blood loss or infection? Not at metal as an immediate kill, but whatever works.
It’s hilarious when they ask for tips but yet I’m expected to get my order when they call out my name as well as expected to clean/bus my own table and serve myself water from a communal water vessel.
I was at a small train station in New England heading to Boston with a friend a few weeks ago. We each got a bottle of water. $5 each (should have seen that coming), but the real shocker was that the convenience store inside the train station asked for a tip on the terminal. On the $5 bottles of water we picked up and brought to the counter. The absurdity there makes me feel like I'm in Waiting for Godot.
Comparing Cost/Performance of Different AWS EFS Options and Alternatives
They were not always so bad. I tried one out when they were just installed (and everyone avoided them); they ran a lot faster, with no upselling or ads. The adware garbage that has long infected the internet has gone right into their kiosks.

Just like how McDs just raised prices endlessly for the past few years, they've also intentionally turned ordering into an adversarial experience.
He didn’t have a second term, even if it’s true social media was censored to help his opponent.
why would you tip a barber? because they cut your hair good? what was the base payment for then?
Wild to me given the processing power cheaply available that those touchscreens also feel unresponsive and laggy.
> Your response has no bearing on your pay. Who cares what you say?

Then why not say what you know is right?
Some theories:

1. It's easier to land someone on the moon than to do something long-term like a base. The switch from impressive one offs to less impressive slow, big projects is going to lead to an impression of stagnation.

2. They do exist! Just look at the COVID vaccine. We went from disease to vaccine in under a year.

3. We've had a lot more monopolies, and monopolies make there be less of an incentive to innovate. When there are multiple companies, they spur innovation.

4. You might be interested in this read from Aeon: https://aeon.co/essays/has-progress-in-science-and-technolog....
Interesting perspective, so I should just assume all these get-girls-interested-in-STEM initiatives should instead be focused on boys, since your argument means that boys suck so much more at STEM?
Has that FSB leak analysis been vetted by anyone besides that Russian newspaper that published it?

If it's true then he was reckless in his traveling not just to France.
What do you call the processing after a splat, that identifies what's in the model and generates what should exist on the other side?
Personal experience:

Counterexample 1: company had two products, one java one c++ based. Founders decided to focus on one product to extend runway. Everyone on 2nd product team laid off, regardless of perf reviews.

Counterexample 2: layoff needed to boost short term profit metrics for potential sale of company. Since focus is cost cutting, not long term viability, expensive folks targeted (ie senior high performers)

Counterexample 3 (union shop, yes rare I know but gov and academia often have union IT workers. Layoffs are purely seniority based (as in most recently joined union = first to be laid off)
The parent comment is not comparing coal and nuclear. The parent comment is comparing hydroelectric dam failures with nuclear power plant failures (on normal operation, neither nuclear power plants nor hydroelectric power plants leak any significant amount of radiation into the atmosphere).
SpaceX to launch Polaris Dawn spacewalk, farthest human spaceflight since Apollo
The winner will be one of two approaches: 1) Getting great performance using regular DRAM - system memory. 2) Bringing the compute to the RAM chips - DRAM is accessed 64Kb per row (or more?) and at ~10ns per read you can use small/slow ALUs along the row to do MAC operations. Not sure how you program that though.

Current "at home" inference tends to be limited by how much RAM your graphics card has, but system RAM scales better.
Absolutely not. Compensation should reflect value received. This idea effectively forces a business to subsidize their employees, because you damn sure can't pass all that to the customer (because then we are just back where we started, just with an extra 0 on every transaction). Small businesses and business with low profit margins will be forced out of business. And this would consolidate capital into the hands of the big businesses and billionaires who can afford to pay everyone tens of thousands of dollars more than they can bring into the company.

A McDonald's cashier is not worth $55,000 just because they are >18 years old. That position is not supposed to be a career. That position is supposed to be a first job for a dumb 16 year old who needs gas money and $500 for a PS5. When their needs outgrow their paycheck, they are supposed to move to a job that pays more. Can McDonalds afford to pay the extra? Sure. But Jimmy's Hotdog Stand down the street can't, so he goes out of business and the money he would have made goes to McDonald's instead and the rich get richer.
IBM [in China] closes two research labs, announces large-scale layoffs
Biology has changed recently, we have never been more obese with as many synthetic hormones in our diets.
Nonsense.... I lived on under 10k/year for close to a decade in rural Oregon- a while enough ago that that would be about $14k/year now adjusted for inflation.

I had a decent 2 bedroom apartment, two older but reliable cars I got for nearly free at auto auctions and a fast motorcycle, and cooked my own meals 3x/day from top quality local farmers market ingredients. I'm talking REALLY good food, the best quality fresh local meat and vegetables money can buy, that was the one thing I would not compromise on.

I traveled a lot for fun also, but it was in my own (very fuel efficient) vehicles, cooking for myself on a camp stove while traveling and I could only afford restaurants a few times a year.

Almost all of my possessions like furniture, etc. were high quality things I had slowly sourced for free over craigslist, with some dumpster diving and word of mouth. Mostly high end vintage hardwood stuff that looked expensive- Rich people don't sell that stuff, they give or throw it away.

Personally, I felt like I was living very comfortably, and I quite enjoyed the challenge of living frugally. I felt a bit smug about how I creatively found ways to have pretty nice things, and a nice lifestyle without much cost.

I'll add that nowadays I'm into 'sea foraging' and can jump in the ocean with a mask and a pole spear and eat like a king for free in a few minutes.
please! learn how to mark your trail to suitable standards. it prevents a lot of anguish.

https://northcountrytrail.org/blazing-best-practices-2/

https://greatdividetrail.com/blazing-the-trail/
The answer can be found by clicking Feeds > Friends [0] and it's an overwhelming "Yes, this is great! Wait, 90% is 'shared' from someone I don't know anyway, not written by my friend, so it's only a slight improvement."

[0] https://www.facebook.com/?filter=friends&sk=h_chr (this URL seems to work on a desktop browser only; use the menu items in other situations)
Well there are several problems that lead to the failure.

One is conditioning, models are not typically tuned to say no when they don't know, because confidently bullshitting unfortunately sometimes results in higher benchmark performance which looks good on competitor comparison reports. If you want to see a model that is tuned to do this slightly better than average, see Claude Opus.

Two, you're asking the model to do something that doesn't make any sense to it, since it can't see the letters. It has never seen them, it hasn't learned to intuitively understand what they are. It can tell you what a letter is the same way it can tell you that an old man has white hair despite having no concept of what either of that looks like.

Three, the model is incredibly dumb in terms of raw inteligence, like a third of average human reasoning inteligence for SOTA models at best according to some attempts to test with really tricky logic puzzles that push responses out of the learned distribution. Good memorization helps obfuscate this in lots of cases, especially for 70B+ sized models.

Four, models can only really do an analogue of what "fast thinking" would be in humans, chain of thought and various hidden thought tag approaches help a bit but fundamentally they can't really stop and reflect recursively. So if it knows something it blurts it out, otherwise bullshit it is.
That's a fair point. It's definitely pretty different from an unrealized capital gain because, like you said, it's not about your net gain or loss on the house. But, I'd still say that it's practically similar enough to a wealth tax precisely because it's a tax based only on the current value of the thing that I own.

Also, just to add to the above discussion, it's even worse in practice than a tax on unrealized gains because I'll have to pay the same amount of tax every year if my house stays the same value. If it were a tax on the unrealized "gains" of my house, I'd pay $0 if it stayed the same value. And if the value of my house decreases, I'll still have to pay more than $0 in property tax, whereas a capital loss would mean I would pay at most $0.

So, I think I still stand by my sentiment that property taxes are more burdensome than a tax on unrealized capital gains.
Garmin scuba diving products now have underwater communication features built in. Unfortunately they're locked down so you can't use them for any other purposes.

https://www.garmin.com/en-US/garmin-technology/dive-science/...
> If you can't use another library because they use tabs rather than spaces, that should be a red flag.

Now that’s just disingenuous. Coding style differences cause issues in collaboration and man-years of bike shedding and have wasted an incredible amount of time in the open source community. Settling on a single standard and be done with it seems very much sensible to me. It’s not about being unable to use a library, but having trouble (or causing it) when contributing.

> PSRs don't define a logging library. They define a logging interface, […]

You’re right of course, although I’m sure you knew exactly what I meant. We’re dealing with a specification that has several implementations, and that doesn’t finish its usefulness at all. I don’t know where your grief around syslog comes from, and I honestly don’t care; Monolog is both flexible and extensible enough to cater to 99% of all use cases or can be adapted to, out of the box. How someone could care that much how the log levels are implemented internally is beyond me; in the meantime, I have built a bunch of applications chugging out logs just fine.

I’ve seen the benefits of PSR firsthand for many years now, but I guess I’m not going to convince you, so I think we can leave it at that.
Can be used on bears too.

https://www.youtube.com/watch?v=U5rhOfa8Woc
Good example of what to expect should Trump be re-elected.
I used Finale in the last year of high school (roughly), 1999. On PowerPC macs with MacOS 8 or 9. It was unbelievably bad. The UI was absolutely terrible - it had a huge photoshop/paint-like "drawing tools" palette, but what was in this palette changed depending on other things. Exotic things like resizing note heads or stems were easy. Basic things like a pickup beat you would never, ever figure out how to do correctly on your own.

The developers had also given up trying to get rendering to work correctly. They had a "rerender the whole UI from scratch" menu option for when the rendering inevitably messed up horribly.

It also crashed a lot.

It may honestly have been a factor in me deciding that I could do better in programming than in music, because I felt like even I could do better than that.

I have heard musician friends claim it got better in later years, but I don't quite trust it, since I know what musicians put up with in terms of awkward user interfaces.

So, good riddance.
France did that, didn't work out that well. Sure, it was cheaper, but still f**ing expensive.
Though after ruining city streets, in a drastic utter failure of basic civil engineering, and then entirely exiting a city in disgrace [1] they've left a lot of doubt and mistrust in their continued expansion "efforts".

[1] https://arstechnica.com/information-technology/2019/04/googl...
Haha. Your uncle probably had waitstaff that did not understand that he was talking about a tax distinction and thought he was creepy. :P
>But nonetheless, it's obvious that "the center" of American politics today is drastically far to the left from where it was previously.

Ronald Reagan gave 3 million illegal immigrants permanent resident status.
> based on the quality of the service provide

It should be based on quality of service, or at least on some service being provided, but what has now become the norm is the expectation that you pay a tip (and a hefty percentage one, not just a dollar in the tip jar) just for buying a food item at the counter, with zero service provided.
Minimum wage is already $20/hr where I live. Tips can approximately double that. There is no version of the world where employees will willing give up those tips and no restaurant can afford a $40/hr minimum wage.

This is just a one-way ratchet on employment costs, not a plausible way to eliminate tipping.
Definitely. The letter only mentions Biden who is a lame duck and now safe to criticize.
minimum wage is not a problem

the value backing the currency is the problem, government is spending too much and your cash is not worth anything

the artificial minimum or maximum you're owed is a hoax and only hurts the economy by preventing people from working if they can't achieve that amount, and by hurting the economy makes you poorer by devaluing your currency, meaning what you're paid will be worth less due to the value of the currency, not its amount
The biggest issue I have with it is that the touch screen is unresponsive. You press something, and it responds a second later. Completely unforgivable.
That's true... but african elephant is fairly close in side to Wooly mammoth? (though with less majestic tusks)
LLMs like GPT-4o have some pretty impressive image performance. It can actually pick up some of the more obvious defects on our buckets (Steph tested it out just now).

Two problems though with the OpenAI approach:
1. You'd need a cloud connection to send those images up to and get the answer back down so that's cost in terms of your round-trip latency, network infra, and the OpenAI account itself.

2. It doesn't do well with the very subtle defects - mild shape changes, loss of features from short shots, etc

It might be worth using in the offline pipeline for auto labeling though!
Science works on consensus and iteration. Government policy generally (and I think should) follow that process, not form policies on minority opinions at the time. For instance, although the droplet vs airborne debate was incorrect initially, the error was found and corrected via consensus, and government policy follow that consensus. That's how it SHOULD work.

Most of your writing is a bias filled rant, complete with misinformation (no, the consensus for science was that the lab leak was extremely unlikely, and still remains so today as far as I've seen, again, a few individual researchers thinking it likely does not make consensus).

You seem heavily invested in going against consensus and best practice, and I'm genuinely not interested in that position as I disagree with it. While things could have been better, given the circumstances the scientific community and world governments generally did a good job at protecting people.

On the topic of what should be allowed on social media, there is room for debate there, but I stand by that freedom of speech does not require you have equal standing or that people listen to you. I don't believe fringe science or non-science deserves equal time in the spotlight. So I suspect we won't be coming to any agreement.
They are, but I'm not sure what will cause a critical mass to switch. Short of the EU mandating that the existing platforms federate, which could be problematic.
How about a choice for which social circle you'd like to view at one time. We could call it "Circles".
I think a difference between a bribe and gratitude is pretty obvious. If the official had prior knowledge that he would receive an award, its a bribe. If he had no reason to expect it before making a decision, it's gratitude.
This looks great! I am a big fan of the single header format. I've linked Clay from my list of game resources for C developers. Cheers!

https://github.com/aaron9000/c-game-resources
This ethos should be standard everywhere.
I don’t think that Jinja is the right way to build HTML heavy anything. Look at JSX for that. However I do find it interesting how this is a constant back and forth.

I remember when the template engine that everybody in Python used was kid (precursor to genshi) which was XML based and looked a lot like vue/jsx does today. Back in the day people did not like it at all because designers found it hard to work with.

Now the situation is a bit different but what do I know where we land in 10 years. It feels like a constant cycle ;)
Those contentious threads never last long here for that reason. Reddit is 90% those sorts of heavily moderated comment threads where everyone agrees with each other and those who don't align get removed or downvoted. People can always just go there.
So it’s all just stupidly big PDFs used as images of the different models?

Not what I was expecting. I was expecting it to be more like the Colgate app mentioned later in thread.
Yeah sure, in a way. It’s kinda dumb in the sense that ‘as long as your computer is working’ actually means ‘ending soon’, for the majority of people in the real world. That seems obvious though. Few people if anyone can keep their current computer working with a software app that freezes. It might stop working in a year, it might be more than that, or might be less than that (which they explicitly admit re: Sequoia).

It’s a sort of glass-half-full spin, perhaps, but doesn’t seem misleading to me in light of all the FAQ entries and the letter. They are very clearly and explicitly recommending users move off of Finale asap, and not wait for the computer to stop working, whatever that might mean. If someone really truly depends on Finale professionally, and can’t move within a year, it’s not outside the bounds of possibility to freeze their computer, buy a new one for everything else, and keep Finale running for a while. I would in no way recommend that, but I’ve seen people do it before.
> Gratuity is post factum, technically based on the quality of the service provided.

Based on this, almost everyone using a Stripe/Toast/whatever terminal is accepting a bribe, not a tip.
The underlying sentiment of making these distinctions is that I'm better than you, which is one way to approach everyone else in your
life, but it's kinda odious.
"Donates"? A code base is a maintenance burden.
Statistically speaking, really rich people never cross paths with most establishments
Microsoft Donates the Mono Project to the Wine Team
Especially in states like California, where there is no separate lower tipped wage for anyone.
Not sharing the same namespace is a benefit, I agree. Not a huge one, as I don’t name my variables “map”, “string” and similar anyway. And would not look favorably if any of my employees did that.
As long as you don’t use title bars, menus, or scrollbars you’re golden.
Show HN: Storing and Analyzing 160 billion Quotes in ClickHouse