skysight-inc/HackerNews huggingface dataset:
Something that I’m intrigued by with tokenization is that there are obviously overlapping tokenizations for the same text - SolidGoldMagikarp can also be represented as Solid+Gold+Mag+ikarp or S+o+lid+Go+l+d+M+agi+Ka+r+p or a bunch of other representations.

Now at training time, I guess these tokens were matched maximally - the greediest token was always chosen. So the LLM was trained on datasets where whenever SolidGoldMagikarp showed up, it used the full token. But when SolidGoldPikachu appears it gets tokenized as Solid+Gold+P+ik+achu.

So when an LLM is predicting tokens and for some reason it decides it wants to suggest more things in the vein of

FlappyOrangePikachu
WetGreenCharmander
FluffySilverSnorlax

It seems like it’s going to output tokens much more hesitantly, gradually building a plausible adjective/color/Pokémon combination.

If it actually did output

SolidGoldMagikarp

Token by token, doesn’t that mean it would miss any embedding that that full token has? It would only see it as a random adjective/color/Pokémon combination.

Now maybe choosing a glitch token is a bad idea here because the problem with that token is that it lacks any further associations in the LLM model.

But the same applies to like programming language keyword tokens. If it has a token for xmlHttpRequest doesn’t that mean the LLM might just throw together a variable name like that because the individual pieces make sense, without realizing ‘Oh hey! I know that word!’
Hi!

It does seem possible that we'll build utility function maximizers on top of the current systems, with things like system messages and AutoGPT being the very early rough steps towards those. But they'll be sloppier than people imagined, unless we start integrating some kind of old school symbolic/knowledge-based AI systems alongside it, to work from concrete formal knowledge rather than piles of the Internet.

But in terms of differences, I was mainly thinking about the social/non-technical differences of the way we're progressing towards AI - with the LLaMa leak and open systems anyone can run and multiple viable competitors, the landscape will be very different and a lot more chaotic than if we'd had some hard-to-reproduce, genius breakthrough like Hanna had.
I am definitely not one for outlandish claims.

Amidst all the noise, my understanding of the key points is:

- We know that airborne diseases primarily spread indoors

- We know that we can clean the air, and that cleaning the air reduces disease spread

Putting the two together, I believe that cleaning the air can improve public health.

I don't expect most diseases to disappear entirely. But I do expect a dramatic reduction.

Analogy: like cholera. It hasn't disappeared entirely, but I don't personally need to think about it during my day-to-day life because the incidence rate is now so low.
The particular issue here is you believe that this lawyer just isn't dumber than a bag of hammers. There is no conspiracy needed. People are dumb. This is why when you see warning labels all over some item, "Big Label" didn't do that, no some dumbass got their tallywacker ripped off by their Easy Bake Oven. Now everyone has to deal with 10 stickers on the item and a dictionary sized book of what you can and can't do with it.
> What we need is a legal way for companies to keep the data open, but also require OpenAI and friends to pay them for it.

Couldn't that be accomplished by a law or ruling that using something for training AI doesn't exempt you from having to follow its license? OpenAI is already in blatant violation of both the "BY" and "SA" parts of the existing license.
There are public data dumps of Reddit comments available all the way up to December 2022. And they're only roughly ~2TB all together.

There's nothing stopping AI companies from just using those instead of paying Reddit $50 million to scrape all of them using the API. It would also be 10x-100x quicker to do that rather than hammer their API for the comments (the API sucks for mass data retrieval)
According to that, the entire war cost ~$105 million dollars, which is about $2 billion dollars today. So 3 years of war equals around one day of the current US military budget.

I realize your post was mostly silly, but it made me curious so I ran the numbers.
That argument works the other way around too, either way you are asking others to accommodate your preference.

I think “let people choose” is the right idea at the “choose your job” or sometimes “choose your team” level.
Yeah, that's right up there with "Free, and always will be", except there's different costs not covered by that free.
Actually, the legal battle between Apple and VirnetX is ongoing to this very day, over a decade later.

The latest event: https://www.reuters.com/legal/apple-wins-reversal-502-mln-vi...

It's since exploded into things beyond just FaceTime. The FaceTime one though, Apple ultimately lost their appeal in 2019 and paid out $440M for FaceTime infringement (so, yes, legally speaking, VirnetX won). It's now over VPN patents which had some patents cancelled.

With FaceTime being legally infringing... hard to make an open standard. Plus, why would they now? Not only would it primarily benefit the competition; but it would also undermine FaceTime's security. The beauty of FaceTime is that it is very much tied to physical devices, making it very expensive and difficult to spam call without detection. An open standard would likely lose that ability, causing spam video calls everywhere.
You'll still run into the same problem these guys did (i.e. not checking the citations). It's easy enough to just search to see if a thing it tells you is real.
I agree. That is actually the point I was making... differentiating Being a capable painter/draftsman from being a capable artist.

Check out Mary Casset... A great technician but a meh artist compared to Renoir who had a tenth the skill but ten times the soul.
The US will add more nameplate power capacity of batteries to the grid this year than it will new gas generators:

https://arstechnica.com/science/2023/02/us-will-see-more-new...

(Noting of course that power characteristics of entirely different tools can be an apples an oranges comparison... but look at solar versus fossil fuel generators in that.)

Depends on the definition of scale, but the 2010s was where it was in GW added every year:

https://www.pv-magazine.com/2023/04/17/the-world-installed-2...
It's not like it was a situation he was going to try and take advantage of, and on a little reflection he figured they were probably working a scam on him.
OpenAI wanted to preach safety. I think we hold them liable for literally everything, everything Chat GPT does or says, until the model is open and they can argue that they have no control over it.

They wanted this liability, they accepted this liability, they said they'd keep it safe and they haven't. It's on them.
Because if you're a ruthless company going public, you want to avoid ways for your users to block the ads or "cheat the walled garden." Forcing them to use the official app is the way to go. And advertisers feel safe.

I'm not saying I approve the practice. I'm saying that it makes sense from their perspective.
Most of these tools first edit+save the comment with a word or single letter overwriting the original text in the db, then delete it.
That's my understanding. If you wait, you'll probably have to do it manually.
The main US visa for investors are E-2 and EB-5. The former can not lead to a green card and citizenship, the latter can. Or, in other words, E-2 is a non-immigrant visa that has to be renewed periodically, EB-5 starts as a conditional green card that becomes an unconditional green card after a few years.

Googling these 2 visas will get you some more information. Take note that the word "investor" in this context does not refer to playing on the stock market, but to actively investing in a local business or passively investing in a professionally managed project. In both cases, substantial amounts (hundreds of thousands of dollars) are required.

You can also participate in the annual green card lottery ("Diversity Visa Lottery"). As a European you have a 1%-2% chance to win in each draw, double chance if your spouse participates too.

Get advice from an immigration attorney in the US or from an emigration adviser in Norway.
The battery is good enough for me.
A lot of that struggle has to do with what others point out already: the onboarding processes and documentation being of shoddy quality and relying on word-of-mouth to transfer knowledge and repeatedly check in.

If you start raising future generations to be, you know, adults, instead of mentally stunting them into being eternal teens well into their 30s, and companies make an effort not to have a horrible onboarding and rely on 3 year tenures (and paradoxically do nothing to keep said employees that long), the problem is far less prevalent. Heck, most CS students are expected to do far more complex things at school without any assistance these days.
Yep, admitting would be immediate disbarment. With the proper amount of bullshit you might just be able to escape disbarment.
My guess is that the price is comparable (adjusted for inflation) to what my parents' generation paid for encyclopedias in the 1950s and 1960s.
How many online encyclopedias are there? How many print encyclopedias are there? Price s aren’t (only) determined by costs
It is kind of wild that we stumbled upon transmitting information via electromagnetic waves so early on. They seem to be hard to beat.
500 employees, not 500 engineers.
|| An hour is too long, just cut it short if you’ve got nothing to chat about.

A easy tip for this is to set every meeting to 30 mins but keep the next 30 mins free. Sometimes people worry that they did something wrong when a long meeting is cut short. Works for most meetings not just 1-1s.
All this may become consistent:
https://www.imperial.ac.uk/news/180592/european-cooperation-...
I agree but it's not so dire, the tuple type (and variants like namedtuple) is pretty powerful, non-mutable and often my first choice for data structure in python. Everything else can be built on top of it if you're really motivated.
Every (collection of) comments is eventually identifiable
In Germany they decided to make the EPA (electronic medical record) opt-out starting by 2024. Managed by "gematik GmbH", a company with limited liability. Because why should the entity responsible for all medical records have some liability. It is a joke, a bad one.

They don't even say how to opt-out.
I find that learning functional style in a language that does not enforce it, is extra difficult. If the language does not provide guard rails, then new learners will fall back on non-functional methods, and not even realize it.
The impact of the ‘long peace’ on modern military capabilities
I'm trying to understand various activist goals regarding Reddit. Is it some combination of the following?

(a) Burn down Reddit, as vengeance for their behavior in recent years.

(b) Burn down Reddit, to lay the groundwork for a more user-friendly alternative.

(c) Temporarily apply pressure on Reddit, especially regarding their planned IPO, as a rebuke so they become more user-friendly.

(d) some thing else, and/or some combination of the above
Nuclear is expensive compared to solar even if you add storage to the nuclear. Even if you ignore the storage and/or curtailment that nuclear needs in order to match demand on the grid.
As much as that sucks, let us keep it mind that on HN, this wouldn't even be possible
One thing I find fascinating about GPT-4 (and I'm curious about your take) is that it can not only generate novel, non-trivial code, but it can (upon request) output that code as a base64 encoded string... seemingly all from the model itself.
CCPA also has a right to delete clause
I still have my 1966 Britannica. Learned a lot as a kid just picking a volume and reading random articles. I hate to give it up.
I thought I knew functional programming from knowing Python, but looking back I didn't really "grok" it until I moved to Elixir. Now I like it and prefer it. I don't run into any of the types of bugs I used to create in Python, mostly from being lazy and fiddling with data inside of a loop. I miss do miss early returns though.
“There’s simply no way we could have known these were bogus cases.” the lawyers are quoted as saying.

They are currently using Bard to help draft a lawsuit against OpenAI, claiming the company knowingly misrepresents the capabilities of their technology.
Testing API's and Loggers with Rich Steinmetz – Ruby 598
I could probably pick just about any large volunteer group, online or otherwise, and I'd agree.

>tend to get burnt out

People can also just overcommit to volunteer activities in general for a period. If people can just dial down their involvement, that can be OK. But if it's an activity that's all-in or nothing, it probably won't last for more than a while as people burn out or their priorities just change.
I was thinking about this issue with regard to office vacancy rates.

All these real estate based companies roll their equity into new real estate investments,
so they can’t afford any drop in their valuation or all their loans will be underwater.
That means they can’t reduce the price of their office rentals or in this case, hotel rooms, because their valuation is based on a multiple of their rent. Better to leave it vacant at the original asking rent.

It’s a fucked up trade-off for governments (who can pull the incentive levers to modify this behavior) because on one hand by allowing this to continue by giving tax write offs to vacant commercial property owners, they prevent collapse. But on the other hand, they are also sabotaging the economy because people who are starting a new business can’t get cheap office space, they’re reducing tourism by propping up hotel rates, etc.

I think in the end it comes down to the fact that there would be a big news cycle about how their city is in trouble if commercial properties start getting repossessed, and the other problems caused by artificially high commercial RE prices are a quiet burn that dont cause any specific events to garner media attention.
Yikes. Reddit. Stack overflow. It's all going south.

Maybe we won't even have to wait for LLMs to destroy the web we used to know.
Unleashing the Gaming Revolution: CrossOver Mac's DirectX 12 Support Update
This is probably true, but at least one implication of what the program in the title does is edit your existing comments with something before marking them as deleted, because at some point (this is probably no longer true) Reddit did not store your entire comment history.

There are obviously ways to defeat this in analysis, but it does make Reddit's job slightly harder if they want to leverage that data. It would also probably be interesting to also just edit them and not delete them in some cases in some randomized way, which would make it even harder to reliably tease out good comments from noise.
1 hour is long as hell. wtf are you going to talk about for an hour?

but 15-30 makes sense. Check-in, air grievances, get feedback, etc. If there is nothing to discuss then do the "how 'bout those Patriots?" watercooler shit for 10 min and then get back to work.

same idea with standups. they're good, but you don't need them every day, and they don't need to be more than 20 minutes. regular touchpoints make sense, but unless you need to be on it everyday they're just burning daylight
and i'm sure the idea floated around in non FP languages too, but

1) mutable programming shifts the idioms very very far away from passive destructuring, they like to deref pointers and reuse memory cells

2) it's also linked to parametric type systems I believe, which was missing until cpp/java5 in the mainstream (while FP had this since milner which was in the 70s)
1. No need to replace Reddit specifically. People just use whatever works for them.

2. Hosting forums can be very very very cumbersome. It takes lots of man-hour to operate a service and moderate the community on it.

3. Hosting is very cheap. What's better? A 1GbE/10GbE connection at home can host a moderately sized community.
It seems Gallium Nitride are quite the revolution in power density for charging equipment
It's important to highlight that SO mods remove very little. Almost the whole community can contribute and in my experience (as a mod) it's usually the enthusiasm of non-mod users that causes the problems you're describing.

They gamified community moderation. When you reward people for taking action, expect people to take lots of action.
Interesting. Should it? I don't have much experience installing ruby gems with the OS package managers, I've always done it through the language-specific ones like bundler / gem. Here's a github issue showing the kind of things that come up when the versions are mismatched: https://github.com/net-ssh/net-ssh/issues/843
It's not greed, it's capitalism. This is the system working as it's intended.
Sure, but opt-in nominal types that you describe is still something of a foot-gun that you have to be wary of since its easy to accidentally pass something that conforms to the structural type but violates whatever expectation. Like here's an example:

type SpecificJsonBlob = {x: number};
function serialize(s: SpecificJsonBlob) { return JSON.stringify(s); }
function addOneToX(s: SpecificJsonBlob) { s.x += 1 }
[...]
let o = { get x() { return 1 } }
serialize(o)
addOneToX(o)

This compiles because the getter makes it structurally conform to the type, but the 'serialize' will surprisingly return just '{}' since JSON.stringify doesn't care about getters, and addOneToX(o) is actually just a runtime crash since it doesn't implement set x. These are runtime issues that would be precluded by the type system in a normal structural typed language.

There's obviously other cases of ergonomic benefit to structural typing (including that idiomatic JS duck-typing patterns work as you'd hope), but I think its not unreasonable for someone to feel that it's their biggest problem with typescript (as grandparent OP did).
Perhaps these sort of things shouldn't be for profit enterprise, given the inability of companies to not slaughter the goose that lay the golden eggs.
The dwarves "Yeah, wadda you want?" cracked me up, and their reactions when their tosses were closer than danger close
https://archive.is/sK8Lj
Unfortunately most "web-scale" apps I've worked on are basically immutable (aside from retention policies). You just keep appending forever because updates are too expensive. So more than likely your comment history will exist on Reddit's servers but they use a clever "GROUP BY" semantic on read to only return the most recent version.
Show HN: Feedback and Analysis Powered by OpenAI
GDPR only applies to EU citizens though. If the data is truly valuable, I could imagine some work-arounds as well. E.g. maybe each reddit post is automatically a copyright work which you immediate give a perpetual license to reddit inc. You also automatically transfer copyright ownership to reddit inc and they license back your ability to share your comment.
The plug in I use (I think nuke Reddit) overwrites comments with random blarg that’s realistic sounding text, then deletes them.

I’m sure Reddit keeps all versions as well. But I think it would be impractical to restore to the correct version at scale unless they want to manually review to find the “right” version to restore.

I think if they got a specific subpoena for me, they could find my comments with a manual investigation, but I expect that will never happen as there’s no reason for anyone to do that.

I just want to remove my content from Reddit.com and make it harder if they decide to undelete or otherwise not respect my decision.

I’m surprised Reddit still allows edit and undelete and expect them to remove the functionality soon.
> raising an "ipad kid", where the phone & games are used to shut the child up so the parents dont have to put in any effort.

"pay for it now with time w/ baby, or pay for it later with therapy"

sounds like it was a 64k thing instead, but same idea.
Not in this article, and I something I heard second-hand, so take it with some salt:

The lawyer wasn't admitted to Federal court, so he signed his partner's name on the filing.

That's an incompetent lawyer, and a dishonest one. It's not 3D chess, it's just "sleazy lawyers gonna sleaze".
That's a pretty different case, and exactly why I asked the question.

I have heard of cases where essentially a mod went on a power trip/tantrum and wanted to shut down a subreddit, but that behavior specifically angered the vast majority of subscribers to that subreddit. I think the optics and reality of that are very different from a subreddit shutting down to protest the API changes (in some cases, subreddits held polls).
> they are fundamentally changing the basic understanding between users and SE

Given the way they've communicated in the last 2 weeks or so, this seems pretty clear. Before we had employees engaging as real human beings all over the place, and you were talking to Jon, Tim, Robert, Shog, etc. and not "Mr. Ericson, title such-and-such, representing Stack Exchange Inc."

Now all we have is a bunch of announcements, with no discussion, engagement, or even a recognition that anything is even being read. It feels like pissing in the wind – disagreement is one thing, reasonable people can disagree, but ignoring is so much worse; it's like you're not even taken serious.

Stack Exchange has gone through various phases (e.g. the "Jeff era" was different from the "stagnation era" that followed after he left), but the implied social contract was always that the community would offer their spare time and in return they would get a platform and some voice in how that platform is run. There have certainly been moments of friction in this relationship, but the basics of it never changed until now (not even with the whole debacle surrounding the firing of a moderator a few years back).
With theoretically perfect AR (e.g. AR contact lenses with perfect pass through), it would be better than anything you use a screen for today, because it would be a strict superset of today’s experience.

Imagine using your phone but you don’t have to hold it up to your face, or tilt your head to look at it. You don’t need to sit at a desk, because your work screen is wherever you are.

If you really want the old experience, you could make the contacts emulate a fixed display in space, or on top of a soap bar.

The goggles today are much worse than the theoretically perfect version, but it isn’t clear where the experiential threshold is for “better”.
Actually we have lots of data on sociopath and narcissistic tendencies in management. Management consistently scores higher in these negative personality traits.
Does the type system let you express that a class shouldn't be subclassed? I remember this possibility was mentioned in a PEP and got deferred. It would be really useful with the new match/case pattern matching feature, because then you could have proper sum types, and mypy could enforce exhaustiveness. AFAIK you have to do a workaround with a "assert False" or similar at the end.
>You may be interested to hear that community developers

Why yes, yes I am. Thanks for the post. Just in time for a weekend light in the calendar!
What an awesome comment.
I believe that the best way to understand these large language models is that they have models of patterns of text. To the extent that patterns of text are congruent with patterns in the world, they appear to function well, but I think, in the end, they are statistical models of text, not of the world, and that substantially limits their capabilities.

I do think multi-modal models will be interesting, but text is a very special sort of thing. It is widely available, semantically rich, and informationally pretty dense. I'm not sure there is such a nice set of properties for other modes. Consider that we have already almost reached training data exhaustion with text and it is, by far, the most voluminous/dense training mode there is.
They were referencing reddit's slogan, although I don't know if they still use it anywhere.