skysight-inc/HackerNews huggingface dataset:
Wow, thanks again!

I really enjoyed this response and I have learned from it. (Which I guess an LLM could not do while generating something!)

Some references I glanced at (I mostly read the top paras):

- https://en.wikipedia.org/wiki/In_situ

- https://en.wikipedia.org/wiki/Theory_of_mind

Really enjoyed this response, and feel like I've developed a better understanding of some of the concepts relating to generative ML as it is used in LLMs.

An aside: I took a course on ML in a university a few years back, and it was interesting (it was an intro and survey course offered by the CompSci faculty), but difficult for me. I excelled at implementing using Keras/TF code in Python, and I had fun manually implementing some gradient descent algorithm but a lot of the math including all of the multi-var calc, stats, probability was quite difficult for me to wrap my head around, and I really didn't feel like I got a solid grounding on a meta-level of what we were doing or why. I have been reading a bit about LLMs and I think your post has filled in some of the gaps in what at this point I was really looking to understand.
Mine makes perfect oatmeal for my family every morning, and makes stews/slow-cooks meat for a few dinners/week during the winter.
One thing to add to this is tipping with POS systems at fast food restaurants, coffee shops, etc. is always done before you receive your items. I much prefer to tip after I have received everything, since the tip is supposed to reflect your satisfaction with service and is a useful incentive for good, quick service.
Or an upfront payment of ~$25m at 10k per H100.
This varies greatly.

Most of the subs I'm in, the mods are thought of pretty highly or not at all.
I think he went about this completely in the wrong way and comes off as arrogant but on this I agree.

Many subs that didn’t go dark still seem to have plenty of participants and people need their digital crack.

I don’t see this being a digg moment for Reddit.
A tax from 1696 that was replaced 154 years later? Nothing was driven away or killed so it's not even a proper example.
why not just raise prices by 20%? or remove the "restaurant wage" and force them to do minimum wage?
> Do you mean your frontend sends a "send message X to user Y" request to your backend, which then enqueues it internally and handles the actual SMTP later?

No, I'm very familiar with transactional email services and why its superior to SMTP.

> You just send an API call to someone else's transactional email service and let them worry about all that.

100%. But you also need code to do that. Typically the front-end form calls a backend endpoint (a controller for example in MVC) and then the back-end manages the request with the external API. Hence why there are endless docs like this: https://docs.sendgrid.com/for-developers/sending-email/quick...

At scale, those calls are actually handled by a message queue (like Redis). If you let the front-end code handle it, you would likely get throttled by the transactional email service provider.
If they don't know how to call an API, they won't know how to run local models (at the moment it's quite a pain to set-up all the dependencies)
Its not like private companies and foreign governments aren't doing the exact same thing. See the recent eBay security case, the Khashoggi journalist case, etc. Plenty of examples of things like Saudi's sovereign fund being a primary investor and demanding user data on dissidents.

The idea that this data can be collected and kept safe at all is fiction. Even if the legal framework is in place to prohibit selling or misusing it there will always be bad actors and compromised employees willing to subvert any controls you care to implement. Even something as simple as hijacking phone numbers happens at massive scale because both call center and retail cellular employees are so easy to fool or buy off.

FWIW I agree with you on corrupt corporate media. Consolidation has put a vast amount of media in just a few people's hands. Those extremely rich people don't want anyone telling them what to do and have bought a lot of deregulation especially of campaign finance so they can use the purse strings to control policy.

In the US the political parties used to have a tighter reign on things because they were the money funnel and party leaders were at least subject to party elections so at some level politicians who didn't do something to advance the party platform approved by the party's members would lose funding. That whole system has more or less been smashed to pieces. Politicians need to make the supposedly "arm's length" PACs and other groups happy. Groups directly funded by a handful of very rich people. Voters at large and within the party are less and less relevant.
Thats different from what OP said though. Every tech company complies with lawful requests by the government for user data.

As an example, Apple complied with 90% of government requests for user data:
https://www.businessinsider.com/apple-complies-percent-us-go...
Sometimes yes, often no.

In CA, there is a huge North-South divide when it comes to water. Northern CA constantly complains about LA 'stealing' all the water. In this case, it's urban vs urban.

In CO, it's rural mountain areas where the water comes from versus the rural plains ranchers where the water is needed. Frontrange cities mostly have their own water rights figured out, mostly.

In UT, it's just a hell of a mess and everyone is angry at everyone else and the Great Salt Lake becomes ever more that little brine pond over there.

Then you add in all the compacts along the Colorado and everyone just has more to fight about.

I guess you can sorta squint and say it's urban v. rural in some cases. And that would only be due to the square mileage per capita in the definitions. But, it's so much more than that and so much more complicated and legalistic and messy. The only common thread in the western US is water and how there just isn't enough of it for cheap.
Interestingly (though perhaps a bit off topic) I received a survey from reddit today in my inbox of my 11 year old account. This is the first of any communication reddit has had with me.

It had questions like how comfortable are you with the information on reddit etc. At first I thought it was because of the possible IPO but I did recently ask for my data so that might have been the trigger.
"you can run a company for nearly a decade while spending a great deal on lawyers talking to the government the whole time and still have no clue if your business is legal"
> I'm honestly asking because that term is thrown around in the US, but no one can ever define a number.

There is no definition because it is impossible to define. Everyone will say a number based on their very specific circumstances, problems and expected quality of life (Which will also vary from person to person)

The elephant in the room is that besides trying to define a number for a livable wage there is nothing else but an extreme status quo replacement.
I think this is a conversation worth having, but this is a tech news board. This isn't exactly on topic, and is guaranteed to be inflammatory.
Innovation Algebra
The word is foundering not floundering.
> Isn't "it's comparatively slow" what people usually mean with "doesn't scale"?

If that's the case, then they are misguided.

> You can scale anything with enough hardware

No, some architectures or implementations can give you diminishing returns or a hard cap. Not everything can scale horizontally ad infinitum.
That's a pretty heavy accusation, do you have a source or any evidence for why you believe that?
When I remember to, I blank out the tip section and fill in the total. Sometimes, people will use the opportunity to give themselves a tip. (I haven't caught it happening, but I know/have read about people who have)

Those POS devices don't prompt for a tip by default. The amounts they offer for the denominations are configurable as well. Companies offering to add a tip to picking up your coffee chose to do so.

Why is this desirable for employers? One: It doesn't cost them anything and improves employee retention (or: they don't have to pay their employees as much). Two: They get control over that tip money, and can distribute it (or not) how they like. Yes, I've heard about this too, where tip money is equally distributed among all shift employees, or as well as a disciplinary step employers have kept all the tip money for that day. Three: If it's a self-owned business, they may get free money from someone who feels pressured to tip. Yes, some of that may be legal, but it goes on anyways.
> crushed ice

...

> No water

The crushed ice melts and dilutes the drink, as is the case in nearly all cocktails.
Honestly sounds like a headache for outdated cache bugs. Reddit data is very fluid.
I actually remember doing this in either grade 5 or 6, as part of a unit on procedural writing or something.

The entire class was divided into groups and tasked with making the teacher make a sandwich that we wanted. She just waited in front of a whole bunch of jams, mayo and cut up veggies and would “run” your paragraph to the letter. Everyone’s laughing while she’s spreading raspberry jam on lettuce but then the group realizes that’s the snack they’re getting.

That seriously still sticks with me almost 2 decades later!
In the subreddits I saw polls, all were in favor of the blackout.
They may have just fine-tuned 3.5 to respond with valid JSON more times than not.

Building magic functions[0] I ran into many examples where JSONSchema broke for gpt-3.5-turbo but worked well for gpt-4.

[0] https://github.com/jumploops/magic
As usual of "reporting" in the United States this is devoid of anything beyond informing the reader that something happened.

Tipping in this country should be called what it is: customer subsidization of service worker wages. Restaurants are allowed to pay their workers below minimum wage because of the expectation for tips. The answer has been clear for a while now. Require full minimum wage (not that it's enough) for all service workers regardless of their role and require that all tips be pooled for everyone working a given shift.

As others have mentioned the tipping culture in the U.S. has its roots in the abuses of the antebellum South. Tipping is paternalistic and many people treat it as a way to exercise power over service workers. It needs to be abolished, but as with most things we'll probably have to do it in phases.
Got a chuckle from him addressing his employees with a "Hi Snoos".

Am I the only one surprised how hard they are doubling down on this?
How were they audited?

You can absolutely legally register your cryptocurrency as a security. The requirements just make it a non-starter.

There's is nothing inherently different between cryptocurrencies and securities. The accounting is irrelevant. If you promise people that their money will increase in value if they invest, then you need to register as a security if you want to sell to retail customers. You can continue selling the unregistered securities all you want to professional traders.
I think the sense of martyrdom comes from the fact that these changes directly affect how millions of users spend large chunks of their day, which is itself the location where these discussions are happening. Stack that with the very visible corporatization of many of their other favorite websites, and you see this emotional backlash. The internet is just different now.
> why not just raise prices by 20%?

Because if every restaurant doesn't do it, the one that holds out from doing it and hides the extra cost behind a noticed-on-the-menu-later surcharge (or simply keeps asking for tips) will get more business because customers have trained ourselves to sort by lowest-price-first-then-choose-that-one.

> or remove the "restaurant wage" and force them to do minimum wage?

Several states and cities don't have the tip-credit restaurant wage and do require restaurants to follow minimum wage, regardless of tips. Tipping is still incredibly prevalent in those places because it's still a way for employees to make more money without the owner having to figure out how to pay for it through prices.
Programmers don't have time for love.

/s
> the signals are programmed in a 40 year old language that only a very small group of highly paid traffic engineers know how to write.

This is interesting. What language is this, or more generally, where can I read more about this?
I read the whole thing, and it really isn't relevant to this particular forum.
Right this is a very exciting release but disappointing that there was no price reduction at all or rate limit increase for gpt-4. I guess it just uses a lot of GPU and RAM.
I'm so happy that this Reddit stuff is giving HN something to talk about other than ChatGPT.
> For something like C or C++? Usually the most complicated part is running `make` or `cmake` with `pkgconfig` somewhere in my path. Maybe install some missing system libraries if necessary.

If you don't use virtual environments in python, isn't it basically the same in python? Just run `pip install` and maybe install some missing system libraries if necessary. In practice, it's not that simple in either language, and "maybe install some missing dependencies" sweeps a lot of pain under the rug.
Usually running costs are built into the price of something. It would feel weird if Netflix was asking you to add a tip to help pay for the developers after charging you for a subscription.

As a business owner you set the price of a product or a service while factoring in all costs, including wages.

Tipping should not be mandatory and if it is then it means something is profoundly wrong with the way the specific industry works.
Imagine thinking the world is so simplistically assholes vs decent people and you’ve magically chosen to be decent.

Here’s a hint: Being a “good person” aka compassion is not the only virtue.

Contrast with conscientiousness which is doing what is right (even when it hurts someone).
Seems like I was right to wait for price drop on GPT3.5 a few months ago, was hoping for mostly a drastic drop for GPT4 but I guess 25%(for input tokens, effectively 12.5% on average) on 3.5 works as well
I did a few google searches today and the top hit was reddit and the sub was blacked out. That was annoying.

I think people underestimate the amount of curated info/answers are in reddit subs.
The problem I see with this is that it’s not very useful for people to know if something is a +3 or +4.1 position. The qualitative descriptions that underlie that rating is what’s important. How does my pawn structure compare to my opponents? What is the balance of minor pieces (knight and knight vs bishop knight, BB vs KK, etc.)? That’s how you get to understand chess.
This is all true. The SWEs I work with in a corporate environment don't get it, but the managers do.
If Reddit really wanted to make this work they could've worked something out. They know the apps developer keys and could have specially given them a longer runway to transition similar to how they are giving accessibility exemptions[1].

To speculate... I get the sense in part that Reddit hung the big apps out to dry for being publicly vocal and interacting with the press. Apollo probably was already lacking in sympathy with executives for being the reddit app getting air time at an Apple event. It would be petty if true but it is unfortunately no less then what I expect from Reddit.

Reddit came out looking dysfunctional[2] and sleazy throughout this. There was no good reason for this to blowup in the way it did.

[1]: https://www.reddit.com/r/DystopiaForReddit/comments/145e9sk/...

[2]: https://www.reddit.com/r/reddit/comments/145bram/addressing_...
Reminds me of Apple’s Chalkboard font, which basically fixes everything that’s off putting about Comic Sans while still being casual and child-like: http://www.identifont.com/differences?first=Chalkboard&secon...
Sounds like the only actual bad stuff is the (hypothesized future) fat government bail-outs of the idiot banks - which allowed "just give us back the keys and you can walk away" clauses in a bunch of big-money contracts.

Obvious (if politically impossible) fix - banks that go bust become U.S. Gov't. property. Bank executives are fired as unneeded/incompetent, and their stock options become worthless paper. U.S. DoJ gets nasty about clawing back recent executive bonuses, compensation, and such.
I've spent the majority of my time on Ruby since 2005, and only about 2 of those years have involved any Rails at all. There are plenty of opportunities to use Ruby in other contexts, but it's often less flashy. Most of my Ruby use have been e.g. in devops behind the scenes where the job description might not list a language.
H100s cost $35-40k each
Also remember that the union representing Apple store employees is pushing for tipping: https://www.entrepreneur.com/business-news/apple-store-propo....
Also, if you spend just a few days in Thailand talking to foreigners, you quickly realize that there are tens of thousands of people who moved to Thailand on a whim.

Many of them flame out in tragic (or tragicomic) fashion, some succeed and settle down, others move on to the next thing with some more life experience under their belt, like the author did.

His path is a typical one among young Westerners who move to Thailand. “Normal” is all relative.
I pulled the repositories, built it, and was looking to get involved.

If you or others are interested in working on it with me I'd be open to it.
Did you just realize HN is anti-crypto?
I don't understand. If the LLM is effectively designed to predict the next token in any given sequence, and attention helps it predict each token by deriving context, why wouldn't it just continue to expand upon the original question by predicting more tokens for it. This is the essential thing I'm not understanding here.

If I were to assume how an LLM would work based entirely on the basic theory I've learned from it...

Then if I asked "Why do dogs have four legs?", it would keep predicting more related tokens, producing a longer plausible question, like "Why do dogs have four legs? Do all animals have four legs? etc.."
A tool to calculate the cost of meetings
Private equity is buying everything from vet offices to tech conglomerates
If plenty of countries have tried give an example where the rich fled and the country reversed the tax
> I imagine they’re upset that they can’t send adverts through the API

Even that doesn’t make sense. They could’ve just told app developers a) we’re going to start co-mingling ads in API responses and b) that failure to render those ads according to our guidelines will result in banning your client id. Users would still be free to purchase a premium account to avoid ads.

Everyone would find that reasonable and there would’ve been no revolt. They could’ve even imposed per-user API quotas to avoid the kind of data harvesting that was being done to train LLMs. And they could’ve even threatened Christian with a ban if he didn’t improve the caching in his app, since that’s another criticism they’ve lobbed his way.

All that is targeted at making 3P app users contributing members of a profitable platform. But they did none of that and, instead, quoted him an FU price that will force him to shut down.
An algorithm intended to reduce poverty might disqualify people in need
That's exactly what people are typically complaining about they complain about tipping culture. People don't complain about having the option of tipping for above-and-beyond service; people complain about having a universal expectation of tipping for all service.
Is there a simple question / answer that you would find illuminating?
> Tipping is a tax on decency. Decent people tip well. Assholes don't tip.

Or how about we just just get rid of this tipping ridiculousness altogether and the social judgement associated with it?
Maybe the net effect of default tip screens on POS terminals is positive from the vendor’s perspective; but for me it’s negative. I tip less now than ever because the whole system is opaque to me. I have no idea who’s getting how much. I don’t know how the cost of the goods and services I’m purchasing relate to actual cost of provision. Why am I voluntarily putting in more than the asking price when I have no idea who is operating behind the scenes to extract value from the transaction. I’m sympathetic toward worker’s rights but the solution is in collective and political action, not in hiding it behind these one-off transactions.
Could you share any tips? I'm always looking to learn more on Prompting, especially with 3.5.
https://www.nber.org/digest/jan03/what-reduced-crime-new-yor...

> The contribution of such deterrence measures (the "stick") offers more explanation for the decline in New York City crime than the improvement in the economy, the authors conclude. Between 1990 and 1999, homicide dropped 73 percent, burglary 66 percent, assault 40 percent, robbery 67 percent, and vehicle hoists 73 percent. The authors' model manages to explain between 33 and 86 percent of those declines
Sounds like the real problem is that those questions were drowning out all other content. Personally I don't object to moderators setting rules that reduce noise. Or, to put it another way, moderating.
Immigrants from poorer countries will do anything for a buck. It becomes a race to the bottom. As long as conditions here don't get worse than where they came from they'll be happy. But for us, its just down, down down in terms of quality of living.

If rural hospitals need to pay doctors even more than so be it. I want that job going to an American.

Is it concerning because I don't care about what society thinks? Is it concerning that I don't care about getting an attaboy (e.g. karma) for towing society's latest groupthink?
A perennial gripe about tipping is that it’s usually based on value of goods, rather than value of service. Pouring a $7 glass of wine takes exactly the same effort as a $14 glass of wine, but one earns the wait staff double the tip.
I've been using llama.cpp with the python wrappers and it's the speed increase has been great, but it seemed to be limited to a max of 40 N_GPU_LAYERS. Going to have to update and see what sort of improvement I see.
I'm interested in what came before that clip, but, it sounds like he's awkwardly asking for $10M in exchange for... nothing? Why would Reddit take that deal?

1) Shut Apollo down: increase ad revenues, decrease server costs (if the claim that Apollo is inefficient is true)

2) Apollo pays $20M: increase api revenues

3) Pay Apollo $10M: decreased revenue, maintain high server costs.

I don't even understand how this kind of deal would make any sense to propose.
Your example about navigating roads has nothing to do with hierarchy. And, in fact, most road networks are not hierarchical and the interconnectedness is their strength:

https://en.wikipedia.org/wiki/A_City_Is_Not_a_Tree

Your brain doesn't organize information hierarchically. Let's say I ask you:

1. Name a band that starts with "B".

2. Name a band from England.

3. Name a rock band.

If your brain stored bands in a hierarchy, you'd only be able to come up with "The Beatles" as an answer for one of those questions. You'd have to figure out whether to categorize the Beatles by name, location, or genre and it would be absent from the other categories.