MurphyA/hacker-news huggingface dataset:
by matthewsh | 2025-05-06 01:39:42+00:00
Correct me if I'm wrong but didn't they say they were basically gonna train their LLMs of message data?

I know that there was a post here: https://medium.com/lightspeed-venture-partners/circle-labs-t...

Which states: "What’s more, community members have already interacted with Shapes enough to trigger millions of messages over the short, several month duration that the product has been in beta. We believe this head start in an emergent market will further enrich the conversation datasets which power Circle’s NPCs, and serve as a competitive moat over time."

This is an old post though, so it's philosophy could've changed, but even back then stating something like that is concerning. I do feel like it's worth calling out that the Discord developer policy did not explicitly state this until the 2024 policy, but it's been in effect since July 8th, 2024...so they had plenty of time to stop training their "shapes" on the user data before this happened and it seems they've been in contact with them before too so they could've just gotten clarification on it or just asked for permission.

Complete side-note it bothers me how they're using all these examples of people who use these "shapes" as emotional support and basically therapists as a way to "strengthen" their argument when IMO it weakens it. If so many people are reliant on robots and code for emotional support then they need to seek help or seek real, human connection. It's not healthy to talk to these "shapes" all day. What's even more concerning is that trauma you're dumping is then being used to "enrich the conversation datasets."

ETA: I also think Discord is probably taking action now so they can release their own version later on without any competition, but this still could've been mitigated. Even if they got them on the tokens aspect they could've had a really strong argument considering that's what they were advised to do.
by janalsncm | 2025-05-06 01:41:35+00:00
I would be careful about drawing any analogies which are “too cute”. We use LLMs because they work, not because they are are theoretically optimal. They are full of lossy tradeoffs that work in practice because they are a good match for the hardware and data we have.

What is true is that you can get good results by projecting lower dimensional data into higher dimensions, applying operations, and then projecting it back down.
by risson | 2025-05-06 01:42:22+00:00
I do things somewhat similarly but still rely on Helm/customize/ArgoCD as it's what I know best. I don't have a documentation to offer, but I do have all of it publicly at https://gitlab.com/lama-corp/infra/infrastructure It's probably a bit more involved than your OP's setup as I operate my own AS, but hopefully you'll find some interesting things in there.
by AngryData | 2025-05-06 01:43:00+00:00
Because the US is run by wealthy people and highly corrupt. If it isn't a problem for those with money, nothing will change. Look at all the major problems the US has and nearly every one of them can be easily walked around if you have a lot of money. Expensive healthcare? Well I got money. Overzealous police force? Well in an expensive neighborhood cops don't dare harass/extort random citizens. Harsh and exploitive justice system? Money will bleed to courts dry until they give up. Shitty local schools? Private education. Shitty infrastructure? Buy large SUV and generator. Polluted water? You can get good water delivered or run a whole-house reverse osmosis system.

It is highly inefficient, but if you are on top of the wealth pyramid none of that matters to you. Average citizens however can't afford all of that.
by asdff | 2025-05-06 01:43:20+00:00
It is even more accurate to consider job growth in terms of income growth. Job growth could very well go negative but if it means replacement of a working population with one of higher income, that also contributes to upward pressure on prices from this high income job growth.

Even worse for the supply side crunch is that this high income population is not like the previous population in the sense that they aren't as sensitive to this given price level. So demand based responses to price increases aren't seen until the prices are truly bewildering due to the amount of disposable income available for some of these workers that could be spent on housing.
by Barrin92 | 2025-05-06 01:44:45+00:00
Exactly my experience as someone in the ostensible target demographic, late twenties to mid forties social circle. Granted I'm German with most friends/family in central/Eastern Europe so a bit less Instagram obsessed than the Anglosphere but so much has moved to Whatsapp (technically Meta I guess, but not really a public facing social network), Signal, Telegram.

And from what I see working with younger people out of uni, it's almost all private group chats, Discord, only real social platform seems to be TikTok. If there wasn't a date on the blog post I'd have guessed it was from 2017 or something, because the problem just feels obsolete now. Didn't Zuckerberg himself even say something to that effect?
by soulofmischief | 2025-05-06 01:45:09+00:00
This comes off as projective judgement. I don't think everyone agrees with you, holds the same moral values, or has the same negative relationship with sex, porn or other "vices". Some people are able to integrate things like alcohol, porn or whatever other moral sin of the week without negative effects on their life or relationships. These things aren't addictions for many people and there is also no value in making sweeping generalizations.
by makeitdouble | 2025-05-06 01:48:19+00:00
I think there's the disconnect between the US perspective and the other countries which makes the discussions difficult.

The EU caps the credit card rate at 0.2-0.3%, so the moral argument for not using card payments is a lot weaker, and most countries have also widely used non credit card electronic payment.

SEA countries are mostly in the same boat, with higher credit card fees but more competition.
by johnnyanmac | 2025-05-06 01:48:27+00:00
>Totally, if you're willing to trade in your half-million or more annual compensation for $150k or less.

I will take 60k at this point. I've been living ono half of that for almost 2 years now.

I have no idea how anyone is navigating this job market. Maybe it's just 10x worse and most people here are in the Bay area that's a tiny bit more shielded from this.

>Their number is absolutely miniscule compared to the number of big-tech jobs.

give it another year of layoffs. We'll get there.
by cadamsdotcom | 2025-05-06 01:49:15+00:00
The value of knowledge is plummeting. It can, will, and should be subsumed by LLMs. Consider London’s black cabs. Drivers pass a gruelling exam to prove they know “everything” about one part of London. But, Google Maps puts that knowledge and more on every rideshare driver’s dashboard, for free, no advance study needed.

Map knowledge doesn’t make you able to drive. Driving happens in real time - steering, obeying road rules, avoiding accidents.

In engineering, the real time part is when you use mental models you’ve painstakingly developed - how the hardware works so you can debug it, what syntax is valid in your programming languages, what APIs exist in your stack. But, those depend on knowledge - so mental models can be self-taught with AI as tutor in your own time. The LLMs supply the knowledge, you integrate it via study - or a side project.

An organization cannot clone itself a team, it’s true. They need engineers now, not in 6-12 months. But - a motivated individual can use AI to make themselves employable as a full stack engineer faster now than at any point in history.

How cool is that!
by mensetmanusman | 2025-05-06 01:49:26+00:00
Random question, is anyone else unable to see a ‘select all’ on their iPhone?

I was trying to put all the text into gpt4 to see what it thought, but the select all function is gone.

Some websites do that to protect their text IP, which would be crazy to me if that’s what they did considering how their ai is built. Ha
by jmathai | 2025-05-06 01:49:52+00:00
I haven’t been diagnosed with ADHD and this isn’t a particular weak spot for me but even I can relate. I find it most hard when there’s a mismatch in reciprocity.

I enjoy learning from posts like this because it can help identify patterns I might not have otherwise noticed. From there I can do something.

Something I do periodically is scroll my iMessages and see if there are conversations that have been dormant longer than I’d like. If so, I try to think of something to resurrect the thread.
by asdff | 2025-05-06 01:50:08+00:00
No one is active on social media anymore like they were in college or high school. People just age out or get too busy for that kind of stuff. They might lurk but posts are pretty rare for most people who would have been posting 3 times a day 15 years ago. I'm not sure if the younger generation is actually active anymore or if they also just lurk now. Dead internet theory and all...
by davetron5000 | 2025-05-06 01:51:36+00:00
This is my favorite game for the 2600.

I built a clone of it for Windows using Direct X in probably 1999/2000. I don't have a Windows machine, but I think Microsoft's obsession with backward compatibility means it probably still works:

https://naildrivin5.com/adventure/index.html

Here's the C++ code in all its glory: https://github.com/davetron5000/adventureclone/

It replicates the 2600 game, and adds two new levels (additional castle and maze), and two new (optional) objects, a candle that shows more of the labyrinths, and a shield that prevents the dragons from eating you.
by Brybry | 2025-05-06 01:52:17+00:00
As a sibling comment noted, the National School Lunch Program started in 1946. [1]

The School Breakfast Program started in the 1960s/70s. [2]

More recently, in 2010, the Healthy, Hunger-Free Kids Act was passed which enabled the Community Eligibility Provision which lets low income area schools offer free food to all kids without individual application/qualification. [3][4]

Various schools I went to in the 90s/00s had some kids bringing their lunch, some kids paying the school for lunch, and some getting free lunch (because they were poor enough to qualify).

[1] https://www.fns.usda.gov/nslp

[2] https://www.fns.usda.gov/sbp/factsheet

[3] https://www.usda.gov/about-usda/news/press-releases/2014/05/...

[4] https://www.fns.usda.gov/cn/cep
by jameshart | 2025-05-06 01:52:55+00:00
Sadly I think people are confusing ‘citing sources’ with ‘journalistic sources’ which are two different things.

Journalists are generally very good at attributing information to journalistic sources. That is, when they relay a claim someone has made, they state who made that claim - ideally by naming them, but if the person making the claim wishes to remain anonymous and the journalist chooses to respect that anonymity, by attributing the information to e.g. ‘sources familiar with the matter’; in such a case the journalist is asserting ‘I know this person is in a position to know this information, but I can’t tell you who that is’.

That’s all fine. And has nothing to do with APA or MLA citation standards though.

When it comes to citing reporting from other media, there’s definitely some sloppiness. In general the instinct is to use the same ‘journalistic sourcing’ standard as above, but caveat it with a sort of hearsay warning: ‘according to reporting in the Washington Post, sources familiar with the meeting said “…”’. And that’s where Marisa Kabas’s complaints lie: she wants to get that level of attribution which print journalists typically accord one another, and not be relegated to ‘an independent journalist’.

But when it comes to citations, the thing you’re most right about where journalists often do not cite their sources is in the form of linking to primary material they used in preparation of the report. Academic papers, government reports, court judgements, official transcripts of speeches… there’s a lot of primary documents it would be great to be able to get hold of if you want to dig further into a story.
by photon_rancher | 2025-05-06 01:53:25+00:00
Yeah, this is a well known technique for boosting resolution.

For example: You add a dithering signal which can be processed out. If the signal has the right properties (for example, random but evenly distributed noise bounded to one LSB), you can then average out multiple samples to get more effective resolution than the ADC has. The additional number of bits scales something like 2^n samples, although if you don’t take sufficient samples this mainly just reduces your SNR. It also requires a periodic input.

However you can also pull similar tricks in the time domain or using simultaneous sampling with multiple ADCs. You can also interleave slower ADCs with a phase shift. This produces stitching artifacts unless you average them out though because ADCs generally are not well matched at the limits. You can bin or calibrate this out somewhat if you can characterize the error.

You can do a similar thing in the frequency domain if the ADC sample window is narrow enough but it has arguably the worst artifacts. Lo-pass the first ADC around N/2. The second ADC use a bandpass from N/2 upto N. The third is N upto 3N/2 etc… but the fourier transform will have a bunch of junk at the stitching points.

Or you can take the sampling scope approach using a fast but low sample rate ADC and many triggers.

I’ve seen most of these done on commercial instruments if you dig into the settings. Some of them you can see in normal operation (like the stitching in the frequency domain).

But I think the other poster was suggesting the first case applies - if you think about it there are certain periodic signals you can add instead of a random signal. That has the advantage of limiting SNR degradation and can also be filtered out easier/ detected i n the data.
by apothegm | 2025-05-06 01:54:50+00:00
For sorting the table, perhaps. But for displaying the table in the first place? Static HTML is invariably faster in my experience. IMO there is just no excuse for placeholder elements with loading animations on a content or e-commerce site where it should be possible to provide all the content up front and add some very light JS on top to handle things like image carousels.
by 0xDEAFBEAD | 2025-05-06 01:56:13+00:00
The EU can say all it wants about banning AI applications with unacceptable risk. But ASML is still selling machines to TSMC, which makes the chips which the AI companies are using. The EU is very much profiting off of the AI boom. ASML makes significantly more money than OpenAI, even.
by b0a04gl | 2025-05-06 01:56:51+00:00
>Recently, we also trained an experimental social model which was well received by our community. However, this was not trained on Discord API data. In fact, we would have no use of such data. Shapes have exchanged millions of messages through our website, through X, through email and other experimental integrations. We used a small anonymised dataset of prompts between users and shapes on these non-Discord platforms to train this model. We have always used Discord's API data as directed by users, to enable interactions with their Shapes.

not sure what's meant here? so you meant you used data collected from other platforms to train model but not discord one? if so why is that even valid coz you confirm that most of users traffic from discord. it would be more better off if you've released detailed research paper to cover the details of how you anonymised the data no matter what platform you took the data. what if someother integration platforms you mentioned above wanted to sue shapes again?
by iandanforth | 2025-05-06 01:56:55+00:00
On the off chance you're interested in school lunches I highly recommend watching videos of Japanese school lunches on YouTube. There's a bunch out there now and if you were raised in the American system it will probably blow your mind. The idea that lunches can be freshly made, on site, out of healthy ingredients and children are active participants in serving and cleaning up is just crazy. When I encountered it for the first time I felt like a big part of my childhood had been sold to the lowest bidder.
by koito17 | 2025-05-06 01:57:26+00:00
HTTPS is not necessary to encrypt DNS traffic. DNS-over-TLS exists, but it has much less traction compared to DNS-over-HTTPS. I am guessing the reason is that HTTPS traffic all goes through port 443, so "censorship" of DNS becomes tricky, since DNS traffic becomes a bit harder to distinguish from ordinary web traffic.

Encapsulating DNS packets in HTTP payloads still feels a bit strange to me. Reminds me a bit of DOCSIS, which encapsulates ethernet frames in MPEG-2 Transport Stream packets (this is not a joke).
by photon_rancher | 2025-05-06 01:57:55+00:00
The PCB is easy to screw up, so are the cables. And scopes that go that high are expensive but customers expect USB3 even on low volume low cost products so there’s definitely advantages.

There can even just be manufacturing defects the FR4 weave that mess up SI that you might want to check for as a QA step on the assembly line. For hi volume that gets slow or expensive
by jongjong | 2025-05-06 01:57:57+00:00
It's actually quite profound, politically speaking. I understand why Kim Jong Il thought it was a Masterpiece. To get hung up on visuals and call it a knockoff is itself tacky and shows a lack of appreciation for context; which is what art is about. It's an honest take on modern human society and the tradeoffs that are made.

It gives insights into the minds of some modern leaders... The idea that you have to kill the monster which saved you.

The part at the very end where the woman kills the monster and sacrifices herself with it (out of principle) is brilliant. At the end, the soul of the monster joins with the body of the woman and the camera zooms in on her face... You assume that it will bring her back to life but actually, she is not moving and you can't quite tell if her eyes are open or closed (dead or alive)? There's something deep behind the ambiguity.

I suspect Kim Jong Il saw the monster as a metaphor for capitalism or globalization, the woman as a metaphor for a revolutionary leader (maybe Kim himself) and the monster's relentless hunger for metals as a metaphor for greed-driven industrialization but I wonder to what extent did he see it as a metaphor for his own communist movement? The message seems to be that even though she did a bad thing killing their saviour, she did it with sound morals because she was willing to sacrifice herself. She knew it was the right thing to do to contain the monster's relentless greed. But I feel like the part at the very end where the soul of the monster joins her body is a way to show that she is forgiven because it's the intent that counts... Maybe a subtle hint that a good leader is rewarded for having good intentions and conviction but is it purely an ideological reward of being spiritually 'made whole' or also material (she gets to live)?

It makes me wonder if Kim Jong Il may have been tempted to turn North Korea into a capitalist society under the thumb of globalists; keep feeding the beast which had originally (in his view) freed his people from past oppression but instead, he decided to politically 'sacrifice himself' for his people by betraying that globalist monster which had helped him.

There is a statement at the end which essentially amounts to blasphemy in the west: "To keep feeding him, we will have to keep sending him to other countries to wage war. We cannot do this to the world." Ouch.

As unfree and poor as North Korea may be, this is an incredibly blunt, honest take.
by inetknght | 2025-05-06 01:58:23+00:00
> Shifting the cost from the parents who had the kids onto the taxpayers is not solving the problem.

No, but it's well documented that students who eat lunches generally perform better.

> It's making people who didn't cause the problem subsidize the people who did cause the problem.

Sorry buddy, but you won't find a lot of sympathy from people who actually care. School lunches *are not expensive*, and there are plenty of parents who are in poverty and literally cannot afford to pay for their child's lunch.

Should the child starve? No. I strongly believe that anyone who thinks a child should starve, for whatever reason, does not belong in civilized society.

> That's not solving the problem.

You're right, it's not. But you also don't offer a different suggestion. How will you solve poverty? How will you solve neglect?

Until you offer suggestions for that, your comment strikes me as coming from someone who (at best) is sociopathic in a bad way and (possibly) someone who does not belong in civilization.

> It's making sure there will be more problems.

Perhaps.

But you could also consider it as several different types of investments in the future.

An investment, at the mere cost of one child's meal per day, is an investment whose return is in the form of that child's future taxes; the lack of investment is instead the death-by-starvation of that child and loss of that child's future income and/or business taxes.

An investment, at the mere cost of one child's meal per day, is an investment in that child's care for their fellow person. Children who have been there (in poverty and starving); who have literally had only one meal per day, are more likely to be more empathetic to the plights of the people (not just children) around them in similar situations. You should hope that, if you're in such a situation, that you could find someone who would be willing to help you.

An investment, at the mere cost of one child's meal per day, does solve problems. Most parents are happy to be able to afford that investment themselves, but some parents -- through pride or neglect or other reasons -- are unable to afford that much. Why do you think you shouldn't help them?
by nothrabannosir | 2025-05-06 01:59:22+00:00
> ticketmaster is just a sin eater for greedy popstars

Apparently Live Nation owns many performance venues and leverages their power in that market to gain an advantage in the ticket sales market. “Sell through us or you won’t be allowed to play at any famous venue in this city” kind of deal.

Don’t have any sources beyond “heard it on a podcast” though ¯\_(ツ)_/¯
by evo_9 | 2025-05-06 02:00:50+00:00
Thx for posting this I never ran across it before. I too played the original when it came out and actually wrote to Atari after I found the invisible dot and the hidden room / Easter egg. They wrote me back and told me I was one of the first people to find / report it to them which was kind of an honor for my eight-year-old self. I wish I kept that letter lol
by simonw | 2025-05-06 02:02:05+00:00
If you are a journalist working with a source who asks to stay anonymous your number one job is to ensure that they aren't lying to you in order to to advance their own agenda.

Obviously they have an agenda, and want to advance it, so you need to figure out what that agenda is.

The next challenge is confirming that what they are telling you is true, to an appropriate level of confidence at least. Your professional ethics and your editor (and your legal team at larger publications) won't let you publish if you can't do that.

There are many ways you can do that - ask them to show you supporting evidence (usually documents) for example - but the most common is to try and find a different source who can confirm what they are telling you is true.

If you can get two sources - anonymous or not - to confirm the same detail and you're reasonably confident that those sources don't know about each other that's often good enough to get to something you can publish.