MurphyA/hacker-news huggingface dataset:
by matthewolfe | 2025-06-30 15:02:49+00:00
A lot of model-specific tokenizers have reference implementations ([0], [1]). Underlying them is a core algorithm like SentencePiece or Byte-pair encoding (BPE). Tiktoken and TokenDagger are BPE implementations. The wrapping "tokenizer" mostly deals with the quirks of the vocabulary and handling special tokens.

For this project, I think there is value in building some of these model-specific quirks into the library. Could see some minor performance gains and generally make it easier to integrate with. It's probably not too much work to keep up with newer models. Tokenizers change much less frequently.

[0] https://github.com/meta-llama/llama-models/blob/01dc8ce46fec...

[1] https://github.com/mistralai/mistral-common/tree/main/src/mi...
by theptip | 2025-06-30 15:02:56+00:00
> LLMs seem to be in that vein

My opinion is that even if capabilities halted now, LLMs would be more economically valuable than the internet (compared over the same 50 year trajectory). And I predict that they will not halt any time soon.

Maybe this yields more resources to invest in education like the OP author, and we end up more enriched than ever before:

> I teach at a small liberal-arts college, and I often joke that a student is more likely to hand in a big paper a year late (as recently happened) than to take a dishonorable shortcut. My classes are small and intimate, driven by processes and pedagogical modes, like letting awkward silences linger, that are difficult to scale.

The only thing I’m confident about is volatility, the range of outcomes is wide.
by paulgerhardt | 2025-06-30 15:03:00+00:00
Heh. I remember similarly spending a few hours inside LambdaMOO. Successfully managed to clone myself, put myself in my clone’s pocket, and then put my clone in my own pocket and kind of broke room reversal. It was only later I discovered this was an intentional mechanic/bug that some designers that used to create very, very difficult puzzles.

Weird things happen when you give your MOO players a REPL in LISP land.
by jleyank | 2025-06-30 15:03:13+00:00
That world existed and we all lived through it. Hobbyists really hated paying for software, as did academics. Fair number of people being paid to write code as there was nothing commercial that didn’t require customization. Or, smaller sites did it with a few programmers rather than renting software. No web though, nor phones so it’s not a fair comparison to today. But there were really skilled hackers doing open software in the 60’s.
by IAmBroom | 2025-06-30 15:03:24+00:00
It's already the case.

Even one step lower in the chain, ASML sells prototypes of their new photolitho chip makers to the big chip houses years before they develop them. The chip houses understand that the first releases will require ASML engineers to babysit the new tech, patching design issues as they become visible through use.

That is a de facto joint venture.
by bmitc | 2025-06-30 15:03:41+00:00
Does anyone have any suggestions for the best way to learn WebGPU/wpgu without much exposure to prior APIs such as OpenGL, WebGL, or Vulkan? As in, I'm wanting to learn WebGPU/wgpu inside and out, but I don't much want to learn about other APIs. But this has proved difficult due to a dearth of resources on WebGPU and it's new shader language, WGSL.
by timacles | 2025-06-30 15:03:50+00:00
We are looking at the a reshuffling of the USA economic order. Small businesses are essentially being (slowly) completely erased from the US economy, and monopolies are all that will be left. The middle class is being wiped out. Wealth is being transferred to the top

> Tech may just be dying in general.

Its not just tech, its any company that doesnt have infinite capital to integrate and monopolize every bit of the supply chain.
Show HN: Quoth – Semantic search for quotes using pgvector and OpenAI embeddings
by nickdaze | 2025-06-30 15:03:51+00:00
I built Quoth (https://quoth.app) to solve a personal problem: finding quotes by meaning rather than exact words. You can search for "adventure" and discover quotes about exploration you've never seen before.

The project uses Next.js 15 with App Router, TypeScript, Prisma 6, PostgreSQL with pgvector for semantic search, OpenAI embeddings for quote vectors, Dynamic OG image generation for sharing. It was built in ~3 weeks using AI-assisted development (Claude/Copilot).

Features include semantic search across ~1000 curated quotes, community submissions with verification system, daily newsletter, social sharing with custom typography.

This is a passion project with no business model. I'm particularly interested in feedback on the search relevance and any ideas for improving the curation process.

Source isn't public yet but considering it. Happy to discuss the AI-assisted development workflow that made this feasible as a solo side project.
by dylan604 | 2025-06-30 15:04:43+00:00
Not really sure what this has to do with the price of tea in China, but okay, now I know a new term. When you accepted a job at a company, there was an agreement on wages earned for work performed. If there was a definition of the hours to be worked that you agreed to, then you should not be shocked when you realize the company expects that many hours from you. Just because you have become more efficient does not mean you owe less hours than what was agreed upon when accepting the position. If you want to renegotiate your position, that’s between you and the employer. Do not be surprised if your desire for fewer hours is followed by a lower wages as a response.
by gruez | 2025-06-30 15:05:15+00:00
>The “collapse” of the traditional family is why we have social and economic problems in the United States.

You're making the same mistake as the parent comment, by conflating social issues with economic ones. Evangelicals have a lot to hate about trans people on the social front, but I'm not aware of any that thinks the decline of American manufacturing is due to trans people. At best it's something like "low birth rates is shrinking the labor force", but even that's more social than economic.
by 34y5t45y7u | 2025-06-30 15:05:16+00:00
Frankly, you need to understand some things - people, especially on this site are beyond conversations - they are guided by their beliefs. Those beliefs are not going to change - they will die with them. Humans are very violent in their minds. And pretty much the intensity of that insanity is the only signal that is a warning for imminent global conflict, that has been postponed for some time.
by bgwalter | 2025-06-30 15:05:19+00:00
I don't buy that. You can block Chinese companies. Human influencers are more effective than "AI" slop, etc.

And again (you didn't make that argument, just for completeness' sake): Military applications aren't affected anyway. They can train on whatever they want as long as the products stay in the military and do not compete with writers and artists etc.
by ManBeardPc | 2025-06-30 15:05:25+00:00
As someone working for the German automotive industry I see part of the reason being a nearly constant crisis situation. Software is another part that seems to consume a huge amount of resources for little outcome. See Cariad from Volkswagen for an example.

Suppliers suffer from a constant flood and drought of contracts. Crisis -> We need so save money -> Supplier contracts are frozen or cancelled -> "Oh, we can't do stuff ourselves/We need help" -> Supplier had to let go experienced staff, hire cheap/unexperienced replacements/outsource -> Quality suffers and costs explode -> Repeat. Also not paying/delaying payments drives more suppliers out of business.

You also better promise the impossible because the cheapest offer wins. One time I got a PowerPoint as the technical drawings for electric charger test station. Just some black boxes, lines and names. That was the documentation. I should help the project management with documentation of the current state, but had to provide quite a bit of engineering in addition. Also had to talk to the Chinese supplier directly (nobody in the team spoke Mandarin). What a joy.
by MisterTea | 2025-06-30 15:06:09+00:00
I don't have kids but my close friend does. One thing I noticed is his kids, 10 and 8, barely touch phones or play video games. I asked him about it and if they instated any kind of ban or limitation and he said no.

The key takeaway is they sped a lot of time with their kids, discipline them, give them chores on a schedule and they are allowed to explore hobbies. My friends are social people and invite neighbors to parties they host which brings the neighborhood kids together. They spend time with family, who also have kids, and go on small trips like a car ride upstate or amusement park for a day. This constant interaction keeps them occupied with real world activities and socialization which builds their self worth and place in life.

Idle kids are bored kids and that boredom is a vacuum easily filled by screens.
by gavmor | 2025-06-30 15:06:16+00:00
Now if only someone would invent a tool to do the opposite. I have too easy a time of forgetting what I wrote, and penning new lines in obliviousness. It's a habit from many years of stream-of-consciousness writing a la The Artist's Way and https://750words.com.

The hard thing, I find, is structuring text so that each paragraph has a purpose in relation to the others. I was once taught this in school, but I haven't kept up with my practice.

So, maybe a tool that takes previous paragraphs and--contrariwise to letting them recede into obscurity--shoves them repeatedly in my face?

Anyway, very elegant and pleasant. Like a foggy quayside cafe.
by bborud | 2025-06-30 15:06:16+00:00
It would be interesting to see some research on exactly how much sustained productivity boost programmers can get by using LLMs. The reason this is a bit complicated is that the code would have to pass certain quality metrics. In particular when it comes to structural soundness -- whether a piece of code is something you can build on and evolve, or if it is disposable.

I think different generations of programmers have different opinions on what is quality output. Which makes judging the quality of code very context dependent.

If I were to guess I probably get somewhere in the range 10% to 20% productivity boost from LLMs. I think those are pretty astonishing numbers. The last time I got this kind of boost was when we got web search engines and sites like stack exchange.

I would suspect that if people experience 100% or more productivity boost from LLMs, something is off. Either we have very different ideas about quality, or we are talking about people who were not very productive to begin with.

I also think that LLMs are probably more useful if you are already a senior developer. You will have a better idea of what to ask for. You will also be in a better position to guide de LLM towards good answers.

...which kind of hints at my biggest worry: I think the gen-z programmers are facing a tough future. They'll have a harder time finding jobs with good mentors. They're faced with unrealistic expectations in terms of productivity. And they have to deal with the unrealistic expectations from "muggles" who understand neither AI nor programming. They will lack the knowledge to get the most from LLMs while having to deal with the expectation that they perform at senior levels.

We already see this in the job market. There has been a slight contraction and there are still a significant portion of senior developers available. Of course employers will prefer more experienced developers. And if younger developers believe in the hype that they can just vibe-code their way to success, this is just going to get worse.
by DanielHB | 2025-06-30 15:06:21+00:00
It is like that in Western Europe as well, "if you live outside a city" you need a car. However small cities don't have the massive gridlocks that big cities have so they can support a car-centric life.

And sure taking a train sure is faster/nicer for long travel, but in practice what matters the most for the economy and people's life/health is the daily commute which mostly happens inside cities.

But you don't quite get how it is in the US (and Canada). In the US it is "if you live *inside* a city" you need a car*, no matter if small, large, or metropolis.

* Except for a few metro areas
by lan321 | 2025-06-30 15:07:30+00:00
Don't worry, would be my main advice. Find an official service manual online and follow it. Avoid following YouTube advice without checking the manual as well. Many people on there are not the smartest and will make things difficult for themselves or dangerous for no reason. (I only like M539 Restorations and The Workshop nowadays)

Aside from that, get a clunker or, even better, a motorcycle to work on (if they float your boat, of course). Motorcycles are wonderful because everything is easy to reach, light and usually kinda sexy for the year and price.

Again, don't worry too much. You can rebuild an engine if you have the tools and follow the manual. It's all just following steps. Just don't get clever if you're lacking a tool or something. Take a break, get what you need, don't start doing "clever" things because you feel like it's life and death to finish something right this moment, and you'll be good.

Edit: Oh yeah, and a welding course is probably a good idea down the road. I keep delaying it, but it'd be useful, and it'll also surely be kind of fun.
by triceratops | 2025-06-30 15:07:38+00:00
> I suspect you wouldn't put them in the same group as "people who have hoovered up the majority of wealth" or whatever.

59% of Americans have a 401k or other retirement account.[1] They accumulate capital so they don't need to work when they're old. A small fraction of them are the "Reddit FIRE" types.

The top 1% own more than 50% of all equity in private and public companies.[2] They and their kids and maybe grandkids don't need to work to live.

Would you put both in the same group? Other than "owns productive assets" they don't have that much in common.

1. https://news.gallup.com/poll/691202/percentage-americans-ret...

2. https://www.investopedia.com/financial-edge/1212/average-net...
by rpastuszak | 2025-06-30 15:08:32+00:00
It's great if you want to "think aloud but with your mouth shut". I wrote 7k words with it just thinking through a problem. The exact word count is meaningless of course -- my main point is that it was really easy to just sit and think with it, without editing myself. I used the Coffeeshop mode for a large chunk of that (plus some Aphex Twin)
by cyberax | 2025-06-30 15:08:56+00:00
You're thinking of Amsterdam? I used to live there.

Bikes are used there ONLY because there's no alternative to them. Transit takes too long, and there's no space for cars. And yet still around 20% of commutes in Amsterdam are by car.

> not every country has to be a nightmare for life quality like the US aspires to be.

The US is far, far, far ahead of Europe in urban quality of life that it's not even funny, if you disregard the dense hellscapes of SF and NYC.

This is easily seen in the number of children per capita. In modern societies, two groups of people tend to have more children ("inverted J-curve"):

1. Happy content people.

2. Desperately poor people.

Now look at Europe and the US, and I suggest looking at the US suburbs and not the dense cores.
by danjl | 2025-06-30 15:09:20+00:00
What if education became research? If, in the hypothetical future, the AI can answer any question about any book or scientific theory, perhaps the educational system could focus on teaching people how to come up with good ideas to research, and how to do that research effectively? Rather than making the questions about historical information more difficult, or answering them in person or writing them in bluebooks, make the process of learning about how to create new knowledge? Educators would become people who teach you how to learn, how to design questions, and how to research those questions to produce factual answers. We've known lectures have been the worst way to teach for decades. Why maintain that failed system? If the reductionist goal of the college system is a degree that certifies you as an expert in historical knowledge, maybe we can just throw that away since the AI can handle that part now, and instead certify that people know how to ask the right questions of the AI, and how to interpret their answers to create new knowledge for humanity?
by serial_dev | 2025-06-30 15:09:31+00:00
Flutter and Dart. It's not that bad, I'm not saying it's dead, I'm saying it's a dead end for me.

I don't see many opportunities that pay well, are interesting, and available for remote. I'm happy at my current position, but if they were to ever "right-size" the team, I'd be fckd, so I spend my nights learning other stuff.

I started Flutter in 2018, back then it felt "magical" for mobile development, now all the competitors caught up. They also (IMO) waste their time reimplementing Flash on the web, it's horrible for 99% of the cases. The community is also off-putting, you observe obvious flaws, 10 GDEs come at you that you are a POS.

In general, mobile has a lower ceiling than backend, frontend, systems, etc... Mobile is also usually a lower priority for the business than web.
by fduran | 2025-06-30 15:09:44+00:00
You area a Site Reliability Engineer and you get a page notifying your service is down and you rush to see your logs, metrics and other dashboards, start communicating in Slack and entering checking commands in a shell prompt.

In the same way pilots get put in emergency situations in flight simulators, I'm building an "SRE incident simulator" , a generalization of SadServers.
by phtrivier | 2025-06-30 15:10:07+00:00
The article makes a correlation between the loss of "entry-level jobs" and the release of ChatGPT, implying that AI is displacing those "entry-level" jobs.

But then it gives details:

> By contrast, the healthcare and nursing sector – previously a consistent driver of job growth – saw vacancies fall by 10.21% in May. Other sectors with notable drops included admin (-9.22%), maintenance (-7.95%), and domestic help and cleaning (-5.72%).

Am I missing something here ? Apart from the "admin" part, I fail to see how the reduction in "healthcare, nursing, maintenance, domestic help and cleaning" can be attributed to ChatGPT, or LLMs in general.

Or am I misunderstanding the claim ?

I can completely imagine why people would fire their house cleaner, care for they elderly themselves, postpone repairing that fridge, etc... But it would purely be because: "we can't afford it". So, revenue inequality, energy shortage, world insecurity, etc... could play a part. LLMs ? I don't see how.

(Or would it be a ripple effect of growing inequality ? The AI boost is increasing inequality, and now, tech bros are the only one who can afford going to the restaurant or hiring a cleaner - but they only eat 3 times a day, and only have x rooms to clean ?)

Quite frankly: "in the last 2 years since ChatGPT came out, we had dozen of trade wars and three real ones, no one wants to invest any more" looks like a more plausible explanation.
by fzeroracer | 2025-06-30 15:10:21+00:00
I have a 401k and a decent amount invested in the stock market. I have almost no power because my capital cannot be meaningfully exercised in the same way other groups of capital can. My influence (as a middle class software engineer) has dwindled over the past 30+ years or so because more and more power (ie, capital) is being taken from the lower classes and being distributed to fewer hands at the upper end of society.
by cyberax | 2025-06-30 15:11:02+00:00
> Naive intuition says adding more roads and lanes would finally solve the bottlenecks, right?

No. I'm well aware of induced demand. Now apply the same argument to _housing_.

And the fix for housing prices is to reduce the housing _density_. We already have more housing than needed (there are 1.1 housing units per family in the US), we just need to make sure all of it is viable.
by nerdyadventurer | 2025-06-30 15:11:31+00:00
> We don't know because she's cut off all contact with friends and family and refuses to see a doctor.

It is not just schizophrenia, any mental health condition is isolating, others cannot understand it. I have OCD,ADHD etc so I know it, that's why we prefer who have been or going through same thing than normal people.
by gavmor | 2025-06-30 15:11:55+00:00
Direct links to some of his papers:

https://www.frontiersin.org/journals/microbiology/articles/1...

https://www.pnas.org/doi/pdf/10.1073/pnas.2310223120?trk=pub...

https://www.mdpi.com/2075-1729/10/4/42/pdf
by cogman10 | 2025-06-30 15:11:56+00:00
There is fundamentally no difference between a golf car and an electric car other than a higher top speed and more powerful motor.

> What should it do when the throttle pedal goes from 0 to 99 percent?

How fast? 0->99% in 1 second is likely the user gunning it. 0 to 99 percent in a millisecond is likely a fault. In either case, the simplest solution is a capacitor in-between the signal and throttle. Doesn't need to be particularly beefy to get the job done.

The problem is you are thinking about this as a software problem when it's an electrical problem. There are a lot of electrical components that have instantaneous response times, well known curves, and perform exactly the jobs you'd want faster than what you can do with software.

You want to minimize the amount of software between the accelerator and the motor precisely because you want to make the car as responsive as possible. Putting software in the middle creates delays and needs for very complex real time software and more expensive components.
by chozeur | 2025-06-30 15:12:49+00:00
Hi guys, it's my first post here.

I discovered n8n a few weeks ago, and started my automation journey with a pretty basic workflow.

I had the idea thanks to a guy on Twitter who posted a Google dork to find Reddit posts where ppl ask for a tool to solve their problem.

Since I love to create SaaS solutions, I thought about automating this to get ideas daily.

I shared the workflow on social medias, and it had some success (+300 ppl used it).

So I thought it would be interesting to make it bigger, and so I created SaaSPrint.

It's a website where SaaS ideas from Reddit are posted everyday, with a short business analysis (ICP, potential MRR, competitors, etc.)

I also added a weekly newsletter where I send the 5 ideas of the week with the best potential.

I'd love to know what you think of it.

Thanks for reading me guys, have a good one.
by rpastuszak | 2025-06-30 15:12:59+00:00
Haha, I'm actually working on that too! Currently experimenting with a graph based editor.

Also, you might like The Fieldstone Method (Weinberg).

PS. Andy Matuschak's notes: http://notes.andymatuschak.org have some good tips on a similar subject. (My "digital garden" is more of a choose your own adventure book, I'm not married to a single methodology, but I appreciate much of their work)
by tzs | 2025-06-30 15:13:48+00:00
It depends on the field.

For example in programming base e is more common. For example log is base e in C/C++, JavaScript, Java, Python, Perl, Mathematica, Fortran, and Rust.

Another example is number theory. I just checked a few number theory books from my library and most used base e: Hardy & Wright's "An Introduction to the Theory of Numbers", Apostol's "Introduction to Analytic Number Theory", Baker's "A Comprehensive Course in Number Theory", Ingham's "The Distribution of Prime Numbers", Baker's "Transcendental Number Theory", Ribenboim's "The Book of Prime Number Records", Kumanduri & Romero's "Number Theory with Computer Applications", and Niven's "Irrational Numbers".

The only number theory book I found using ln rather than log was Gelfond's "Transcendental & Algebraic Numbers".