skysight-inc/HackerNews huggingface dataset:
> job hop every three years

I was told by a manager at a startup we worked with, that he expects his employees to be there about 18 months, and described that as “average” for Silicon Valley.

I can’t even imagine working with code, written by someone like that.
I built a proof of concept [0] of exactly this because I listen to tons of podcasts but then fetching back that info is a pain. I left it at that because I saw there were plenty of other efforts doing something similar (e.g. [1])

[0] https://youtu.be/Q6G2m4xw3E4

[1] https://podsmart-frontend.vercel.app/
How's would you check that?
What if they're using a self hosted LLM?
Uncertainty in Machine Learning Deployments
Money maybe? Bots downvoting? It was at the top 60 at some point.
I suppose that the Dunning Kruger effect is "well studied" in that there have been many attempts to study it, which so far cannot find reproducible results, and suggest that it isn't a real psychological phenomenon.
> exploiting workers

What would the workers do without those jobs?
So mechanical turk, which was a robot that actually contained a human, is actually a robot that contains a human that contains a robot.

We have achieved complete ouroboros.
This is more like cousins having a baby with 3 nostrils
I think the idea put out by some people here that Reddit might be in the process of radically changing tracks is plausible.

Reddit was always very hands-off. They had lots of very unpleasant and controversial content until their hand was forced. Overall they seem to want a site that runs itself as much as possible and over time content that required interaction and management (eg, AMAs, Secret Santa) got de-prioritized and dropped.

Also, Reddit has quite a lot of mindless consumption content.

Put those together and it's plausible that Reddit wants to go from a discussion site with cats to a cats feed site with meaningless discussion, and a bunch of ads mixed in.

Such a site would require minimal care, and might even be possible to maintain with AI moderation. For moderating something like r/DebateReligion human brains are needed. But for deciding whether something is a cat or not, probably not.
> It's the best thing to happen to Mac gaming in 30 years.

> In an ideal world, Apple would be in talks with Valve to bring the Apple Game Porting Toolkit to the Apple silicon macOS version of Steam

No mention of Proton running on MacOS, funny. Valve intended to support MacOS with Proton originally, but the MacOS runtime was too unstable to support consistently.

It's a nice change, but it's really weird to read people talking about this like it wasn't something we had a half-decade ago. DirectX translation is nothing new, even on MacOS.
And then those workers are unemployed.
It’s amazing that this isn’t a solved problem, but we have all of this crazy language model stuff.

Unfortunately Spanner isn’t open source. Yugabyte and Citus are close but have annoying issues. Cockroach isn’t 100% compatible (and has its own issues) and things like FoundationDB which are truly HA and comparable to Spanner in terms of consistency and fault tolerance are not easily plugged into Postgres as the underlying storage engine since sadly it’s only a key value store.

edit: when I say close, I'm talking strictly about HA, not general functionality.

lately I've been thinking of using FoundationDB, which is closest to Spanner in terms of ACID and serializability and mvsqlite.

Then, I was thinking, since SQLite doesn't have online schema changes (nor does mvsqlite) to have a schema such as:

[UUID, Data, Version, CreatedAt, UpdatedAt]

Where Data is a JSON or Proto and Version is an integer. You then could mimic an online schema change by in your application code supporting two adjacent "versions", and then in an eventually consistent manner run [small] transactions to update the Data to the new Version as necessary. You would index Version, and UpdatedAt as necessary to find the rows in the table that are not "migrated."

In SQLite you can also create indexes on expressions so technically all of your JSON or Proto could also have indexes.
The benefits of having a neutral, bookish (to use pg's old word) front page are so priced-in to everyone's experience of HN that people assume it just happens. Au contraire! It is laboriously maintained with daily effort. The default of homo internetus, especially at scale, is clickbait and outrage. That's what the arrow of entropy points to, so if we stopped putting energy into maintaining order here, it would quickly revert.

HN's quality, such as it is, very much includes "selectively altering an author or publisher's chosen headline" - publishers and authors (and headline specialists, at media sites) are incentivized to take advantage of the default dynamics to get attention. It's their job to sex up their titles and our job to knock them down to size, if we can. That takes sustained moderator attention.

That's not to criticize the community. HN's system consists of community, software, and moderation, and the community is by far the most valuable of the three. But all three must be active in order to keep HN from deteriorating (or at least to stave it off - https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...). Moderation's job isn't to determine discussion, it's to serve the community by jiggling the system out of its failure modes when it gets stuck in one of them.
As far as I'm aware, Reddit still allows you to append .json to any of their pages and you get the results as a nicely formatted json document.

No LLM required.
What evidence do we have that it blew up in their face? There is clearly a large backlash, but it's not at all clear how much that will impact their key metrics, which is probably all they care about moving into IPO.

I agree they made awful decisions, my usage patterns will definitely be changing due to a re-enable /etc/hosts entry. However, what is the impact on a broader scale? This is like Twitter firing a ton of engineers - we can't really evaluate until much further down the road.
This is an easy thing for spez to fix. Simply allow for external links to be followed to their destinations but block the view-all view of the subreddit when a sub goes private.
Why Did Microsoft Build VSCode? Turns Out, GitHub Copilot
The human content will contain the n-word or other shibboleths.
> which is in my opinion even worse

It’s not just your opinion. Discord is a black hole for content. There won’t crawlers for the content in these spaces. I’d like to see more activity in the ActivityPub & modern, self-hosted forum/blog spaces (where Atom feeds can aggregate), but history likes to repeat itself as we move from one closed, proprietary communications service to the next because there’s ‘no cost’ to join.
The use of the word "must" (in both the title and the body) is uninformative. What on Earth does it mean? Does it mean there's a law? A moral imperative? A strategic necessity? A technical requirement? Is the author claiming some form of jurisdiction?

"It must provide APIs" isn't an argument. It can't be taken literally because it's clearly false. And it can't be taken in any other form because the author doesn't tell us what those forms might be.

It continues, equally poorly stated: "Millions of users create the content expecting it will be widely available. Locking down an API breaks that social contract." Now that IS an argument, but it's not a good one for a surprisingly large number of reasons, the simplest of which is that websites like Reddit are widely available regardless of a free API.

Finally, we get to the only actual statement of merit: "The short sighted thing about these API fees is they will harm the company in the long term." Yes, that's quite likely true. Is that the whole argument? That this is a short sighted plan? Companies are free to make stupid plans. They do it all the time, and you are free to stop doing business with them. "Must" doesn't enter into it.
> Reddit's new garbage redesign contains other posts from a subreddit in the page.

StackOverflow has done that for a while, by linking to related or recent questions (which obviously aren't the same each visit).
$80 as an upgrade price is still a bit steep considering that last time I paid for a license upgrade it was around $50 and it doesn't feel like it has changed a whole lot since then.
Unless they are devoting that $113M to making and releasing open source models a consumer can run, which seems unlikely, I see no way they can succeed in building a better proprietary AI.

Google is already feeling the threat to their $100 Billion/year business and is willing to throw massive amounts of money at AI.

OpenAI isn’t so much a startup but should be seen as Microsoft’s strategic vision and as such has all the Microsoft resources to push it forward. Microsoft has poured billions into Bing for years in vain hoping to cut into Google’s search dominance. Now comes the chance to use AI to outcompete Google and they will pour their resources into it.

With neural networks, massive amounts of data tend to overwhelm any secret sauce. Google and Microsoft have access to massive amounts of data as well as the hardware required to process these massive amounts of data to train neural networks

I see this as mostly a way for a European company to ride the hype wave of AI, combine that with European paranoia and envy with regards to the US and make a lot of their investors rich.
La Round, er, Laronde, seems to have a singular focus.
Do people really find Reddit useful? I usually find lots of "hey guys has anyone got <same problem as I am searching about>" from 2018 with no solution but a few token "Me too!" Responses, or worse a response but "Never mind - I solved it. <No explanation>"

I skip over most Reddit links in the search because of that sort of thing being 95% of results. I genuinely have not ever found that much useful on it - I can probably count on one hand a time where it has been useful.

Is it just me that thinks Reddit is deeply overrated? Or is there some magic part of Reddit with people who know what they are talking about and who properly answer questions in a timely manner? I've never found it if so. Perhaps I need to have an account to access the best bits? But if so how would Google find it?
Agreed, but is it a choice or a requirement from the software? I love choice, that instances (and users!) can and should get to choose the level of indexing. If it's software wide, not sure i can get behind that. Especially since .. doesn't ActivityPub sort of ruin that? Ie any instance you federate with could expose your data, regardless of Mastodon's rules.

Federated instance data visibility and agreed visibility rules of course come into play. But if i understand this right it would mean you can only federate with instances or software that agrees to your privacy rules. Which is totally viable, but that also then means Mastodon can't federate with, for example, a Reddit clone that wants to be indexed.

It's a complex web of requirements. Definitely something i'll be thinking on as i implement my own ActivityPub instance.
Protocols, not sites.

But there's no profit in that, so I've no idea how we get back to it.
> if I were to run a web forum then I must provide an API

Realistically you're using Open source forum software like discourse that itself could provide an API interface at an amortized cost.

Expecting individuals to code it themselves (and follow standards etc) is a big ask. I don't think its a hard sticking point and the majority of the encouragement is for large providers.
Software development is easier than ever

Yeah but also no? The skills required to be a basic "full stack" developer have multiplied to the point where I think that term is on the verge of obsolesence just as "webmaster" was before it.

There is of course nothing stopping anybody from simply writing PHP like it's 2005 even though it's 2023, but going against the currents has its own set of costs.
I agree entirely.

There were many things that upset me about our system/process. We were a messaging based service (not voice) and we were trained to not lie, but not be entirely forthcoming with folks either. For example, if they asked about privacy, we would skirt around the situation or point them to legal documents rather than be honest.

Another example is that on rare occasion, a person might be talking to a person and they had to leave. In those situations, one of us might continue to talk to them as if we were the other person.

I always felt creepy doing this. Our service was very focused on making everything very procedural and standardized, but in doing so, I felt like we were simply serving up fast-food help- consistent but lacking in depth as well.

I can see both sides of all of this... there were so many people that needed help and not enough volunteers, so standardizing helps. At the same time, I bet that today a ChatGPT service could do basically what we did (and I know they collected our chats and did analytics on them, so I bet that's what they're thinking too).
Not sure of the jurisdiction issues where the judgement was issued but the last time I looked into it you can't meaningfully collect a judgement from small claims court in my area.
> If that were true, C and Rust (which are typically faster) would be just as complex as C++ (but no language is).

I don't think that this assertion follows from my statement.

It's totally possible that there exist simpler languages which give exactly the same level of performance and expressiveness as C++ while being simpler. Nobody said that the C++ design was optimal with regard to the complexity/zero cost abstraction ratio. Bjarne him self think so (https://www.stroustrup.com/quotes.html), and both carbon and cppfront are effort in that direction.

The point was that when comparing (as of today) java vs C++ we shouldn't be surprised that a language which has "zero cost abstraction" as a core principle, and which is willing to be arbitrary complex ended up being faster.

With regard to the language you mentioned, C is simpler because it does less... And rust is much more recent and completely rethinks the native language landscape. I am not sure that we had the understanding (or even the tech) necessary to create rust 20 years ago.

But more importantly, i don't really buy the premise, of "are typically faster". Some concrete example would be nice, otherwise from experience this statement is wildly incorrect.

> It chose to jump into the OOP fad while staying low level ("what if we had C with classes?"). That's the cause of most of the complexity

Disagree.

> The rest is age, backwards compatibility handcuffs

Very true, if we remove backwards compact. C++ would be simpler.

> like move semantics and functional

Adding features paradoxically can simplify a language by providing a coherent/unified version of previously distinct usage pattern. uniform initialization is the canonical example.
I would say that move semantics also simplify the language by folding resources reuses patterns inside RAII.

Same for C++ lamda, just simpler syntax ...

So you seems to say that we can choosing to forgo low-level control (ruby,java,python) or general abstraction structure(which is what OOP is really) to would produce a simpler language.

But C++ is exploring a different design question, trying to have in the same language low-level control, and abstraction that are general enough to expression complex design, and which can be efficiently deconstructed as to not impact performance. And the C++ community seems to be willing to pay some level of complexity for that.
> Google can't index an internet that doesn't exist.

Then it should index the internet that does, and stop trying to convince me that there are only 10 pages of results for any possible query.

> The open web is truly dying.

Of starvation, because the search indexes don't index it, preferring to index the part of the web that is aggressively marketing itself (and buying and showing ads.)
use a searx instance. can aggregate search from almost any relatively known search engine and bypasses tracking.
$50/year for fastmail. One of the very few things I pay for online other than my ISP service.

A VPS is cheaper if you actually want to run your own, but the cheap VPSs typically have very bad IP reputations.
You're 100% right this makes automation mandatory for anything that's not a toy service.
Whatever you do as an individual is none of my business.

As to human relations, this is a public forum where messages are published publicly for everyone to read. My response to your post was not a reply to you, it was an opportunity to examine the impacts of the ideology you proclaim at scale. You feeling bad because it was observed that this ideology has extremely negative consequences at scale is not a guilt trip. Do whatever you want.
For sure. They threw in the towel around '08 or '09. The prior years of yo-yoing between front page results containing ~60% webspam and 0% webspam settled into a permanent 60%, and they evidently just heavily downranked and/or started ignoring low-traffic sites to keep it from growing to 100%.

Their shifting from text-only "ethical" ads to being a more-ordinary web ad service, and putting ads inline with results, roughly corresponds with that, IIRC, which probably isn't a coincidence. Your ad-"results" probably get more clicks if much of the rest of first result page is crap. Many of the webspammers probably funnel money to Google one way or another, now. It screwed up their incentives to keep fighting that battle, I'd guess, which is likely part of why they stopped putting so much effort into it.
Around London in 13 Pigeons
The entire fake-review cottage industry harkens back to web search before Google was a thing. Search results were being gamed as implied relevance, ultimately making Yahoo and Excite and Alta Vista also-rans.

Online reviews need their Google-search moment. Something that levels the playing field, establishes a mechanism for credibility, and doesn't require an extortion-based business model.
I feel like I explained that pretty clearly.

The problem is that you cannot easily define people on call. If $33/hr is the average comp for trip time when just one person is working at $18 overall, then they're saying an average worker works 55% of the time. If you add another person who just idles on call for the whole hour, you must now pay the one worker guy $66/hr for his working time.

The game theory here is not going to work.
Perhaps the source training data will shift to transcripts or subtitles of podcasts, cable television, TV shows, and other sources that haven't (yet) been polluted.

Combined with pre-LLM data sets.
Met seej ow seej kaa.
You mean the sentence you completely invented is rank arrogance? I agree.
>> You can be an expert in one things and a beginner in another at the same time.

That's apparent or implied mastery. Psych friend says it happens all the time, executive type comes to therapy. He's a master at his business, has all sorts of industry experience, really knows his stuff, but then has trouble in say... personal relationships because he's absolutely clueless on those types of things. Mastery in one area does not imply it in another. So when you think "this person is really smart, why are they making xxx stupid decision?" just check if the reason you think they are smart is in any way related to the area of the stupid decision ;-)
I don't think you can even remotely compare Jobs and Altman here, especially given how badly he missmanaged the enormous advance OpenAI had with Dall-E. In fact, he was lucky to have midjourney and stable diffusion kicking his ass on image generation and pushing him to actually release a product, otherwise Anthropic and Llama could have done the same on the LLM side.
Another way to look at it is that customer is sending money to another jurisdiction.

Countries can and do pass laws about whom their citizens can trade with. It seems like that is a better route than inventing jurisdiction over foreign companies.
^^ This comment was generated by A.I.
I think opinions are harder to curate/moderate than knowledge. If you have one single organization, who's going to decide what you're allowed to say?
Regarding 1: I firmly believe that in the future, what you say doesn't matter. What matters is what you can prove you've said.

What's the difference between the following two? (a) You say something and someone takes a screenshot of it, and (b) Someone just conjures up a fake screenshot of you saying something. These are indistinguishable. With LLM and SD, these fakes will become easier and easier.

The solution is some crypto that allows you to do two things: (a) Be able to prove that you said something, and (b) later revoke it, such that your prove doesn't work anymore and there's no trace it was ever used.
> define open source

denoting software for which the original source code is made freely available and may be redistributed and modified.

> agpl limitations

The AGPL License does not permit sublicensing of the code; that is, you cannot rework or add to the code and then close those changes off to the public.

considering these facts, your opinion is honestly ... pretty dumb.

There is nothing hard about forking the repository and then creating a readonly mirror of your working copy on a public github repo.
Possibly such data will be used in a different way. If it's embedded in a social network, engagement (votes, retweets,wwillhstecer) will act as a sort of crowd sourced reinforcement learning source instead of being direct part of the training set.
The M2 is a lineup of chips with a range of specs (much like i3, i5, i7, i9 lineups). The M2 that powers the iPad is 1/3 the performance of the M2 in my MBP. I suspect the Vision Pro's M2 will be somewhere in the middle to manage heat and battery life. While the Vision Pro M2 can technically "run it", it will still run faster on a dedicated external machine that can handle the heat and power better.

Add in the need to render a very large virtual space and you end up with a lot of capacity being used by default. That's likely fine for "iPad like tasks" (web-browsing, email, messaging), but it seems insufficient for anything requiring processing or memory.
Who doesn't love puppies?
Right, the article talks about "type Point = Point1D | Point2D | Point3D" syntax at the end... which would work just as well with dataclasses as with structs!
I actually have this exact problem right now with SQL Server on AWS RDS. Unless I want to pay for standard+ editions in my dev/stage/qa/etc. environments, I can't use the baked in CDC features. And because of the minimum instance sizes for Standard+ edition, it costs ~1700 bucks per month per database. This is fine for production, because I need features like High Availability, but paying a significant premium over web/express in those environments seems like lighting money on fire.

We're already tracking changes for the purposes of time travel queries and other auditing purposes using Temporal Tables (SQL:2011 feature). I'm thinking a cron job triggering a lambda every minute should be sufficient to read from the history tables and publish out change data events over a bus.

Anyone see any problems with this approach?
The article also didn't say whether the judgement was collected, just that it was won.
Bay Area CA at least. Not sure where all, but the link is PG&E, so probably everywhere PG&E serves.
A childhood fear of mine was that every time I lost consciousness my mind could be going through the worst torture imaginable and I just don't remember it. I still wonder if I'm having horrific nightmares every time I wake up sweaty.
Thank you, this has been insightful! Sometimes it’s hard to make a report that makes sense. For instance when having to deal with conversion lag I had to deal with this week. https://support.google.com/google-ads/answer/9347141
Fauna can do multi-region HA, across clouds, serverless, with transparent sharding and replication. We get plenty of people struggling with not being able to do low-latency, performant, strict serializability distributed writes. It is designed to be a turnkey hosted solution. https://dev.to/luiseduardocolon/fauna-deep-dive-architecting... - Luis