skysight-inc/HackerNews huggingface dataset:
There was a long period where the internet was intimidating and unattractive to regular people. It acted as a strong filter for determining who the people that frequented early sites where.
I use caps lock a ton because I’ve used the stock Mac setting to rebind it to escape.
I have been using this today for some one off prompts that I would normally use ChatGPT for and it has nailed every single one.
If only we felt this sentimental about human beings.
Ysll noy paying.attentiom'

What.matters is.who will pyt upt with it and if.thatll be worth more.

If.your 1$ boner.pills can be sold for $1000 and you sell enought on net, it doesnt maggdr if you lose 1000s of customets.
It’s a weird market, I’ve mainly come across Moodle which was easily the most difficult integration I’ve ever worked on. I had the displeasure of using it several times for testing purposes and I had to wonder, how much money did a director get backhanded for buying that piece of crap?

I presume it’s a very difficult market to break into though for various reasons, a lot of which tech won’t solve any time soon, to the detriment of our new generations.

Edit: wait, Facebook education groups? Is this a thing that schools run, or something else?
The timer heap currently lives on a different thread instead of the main thread, which means timers have to be allocated and scheduled separately for each one. Scheduling things to other threads is expensive. The reason it works this way isn't good and we will fix it but haven't prioritized it yet
Genome study reveals prehistoric Ethiopian origins of coffee
Coca-Cola did not change their standard "Coca-Cola Original Taste" drink to contain any less sugar in the UK.

Some other drinks (including Pepsi) have been reformulated with less sugar in the UK, but Coca Cola isn't one of them.
> Most of the rest is also incestuous stuff aimed at supporting the useless-in-the-first-place goal of putting humans in space.

useless I guess if you're fine with humanity dying off entirely. One way or another, if humanity is going to survive it has to get into space and out of our solar system because we only have so long before our sun dies and takes all life on Earth with it. That's already assuming that we don't kill ourselves first, or that something else doesn't. Since we have no idea how long we really have, it seems very smart to take what steps we can and develop the technology we know we'll need.

Maybe you just don't care since you can assume you'll already be long dead before it happens, but it's still a fact that we're up against an uncertain deadline.
How close is or isn't this to a genetic algorithm in practice? It seems like as soon as you start scaling out to multiple threads/nodes you'd benefit from crossover, selection techniques and so on?
The front page reads to me like a tabloid written by teenagers. Absolute trash.
> "Unfortunately, what has happened is that wages haven’t kept up with the cost of living, by and large, for the last 50 years or so"

Not sure about 50 years, but from 2001-2020 (period where data is most easily available for me) things seem fine?

CPI: 175.1->257.971 (2.1%/yr)

Median wage: $27060 -> $46310 (2.9%/yr)

Mean wage: $34020 -> $61900 (3.2%/yr)

Bottom 10% wage: $18140 -> $27340 (2.2%/yr)

Rent burden (median_wage / median_rent): 25% -> 28% (and it's now back down to 27%)

[1] https://data.bls.gov/cgi-bin/surveymost?bls
[2] eg https://www.wolframalpha.com/input?i=median+US+wage+2022
Well, he published a nonfiction book, the best part of which is the first chapter which consists of literally a fiction story.

He also has some serious problems with blinders, but they're the same blinders HN has so if I explain any further this post will get flagged, flogged, deleted, and downvoted. Ah well.
What an insufferable person
As for the optics, timing couldn't be worse.
But how much would it cost each month to implement your solution at a steady load of 1M clients?
> it's a net good for our society for young adults.

Nearly 70% of Canadians 24-35 have a post-secondary degree and is considered the most educated nation in the world. For comparison, only 51% of Americans and 37% of Germans have the same. The trend is the same when expanding out to the entire population.

What net good is found in Canada that is not seen in the USA and especially Germany to the same degree? It is not economic. Canada is quite poor, comparatively. It does not appear to be political. Germany is considered much more democratic than Canada (Canada beats the USA, granted). It does not appear to be in, say, happiness. Canada is unhappier than both Germany and the USA. Cost of living? Haha. Don't even try to talk to Canadians about that. You will make them cry. Maybe health? Canada does seem to be more healthy than the other two. But is still not as healthy as many other countries that are less educated, so I'm not sure we're actually seeing any correlation there. I'm not sure there is correlation, let alone causation, in any of these cases.

So what is it? Let's say we implement your plan. What measures are we using to ensure that it is and remains a net good?

> I don't think it should require debt at all.

Indeed, it shouldn't. The idea that it requires debt is built on a false premise.

The utility of college can only be useful after you have established a clear goal and need to engage in research to achieve your desired result. Young people who haven't yet contributed anything to the world lack that. Interestingly, it turns out that those who are truly ready for college and those who have already saved up for college by way of productive efforts on the way to finding a meaningful goal are the same set. The reality is that debt isn't needed if college is to be used for the role it claims to serve.

But, let's be honest, the only reason most people go to college is to access a curated dating market. Here, there is something to be said about the people being 18 years old and not 45. Now, you might argue that should produce a net good (more children being born), but the data shows that is not the case[1]. In fact, once people get the uninhibited college sex (with protection) out of their system, it seems they are less likely to have children.

[1] In fairness, there is the perspective that fewer children born domestically with more immigration is the greater good. But at the same time these nations will only accept top immigrants, not any old random Joe who wants to emigrate, which is quite bad for the countries losing those people. As such, I am not sure this take is being honest.
Upvoted your comment because it’s so true. The Quakers have a great tradition of setting up ethical enterprises. I mostly know Rowntree because of the chocolate but I also remember the family came to Ireland during the Great Famine to provide relief to the victims of racist British “laissez faire” economics.

By the way, the name is spelled “Rowntree” (I also used to think the first syllable was “round”).
It's a rule of thumb. Most authoritarians are not Lee Kuan Yew. Most times it does not go well.
Which alterative benchmarks do you recommend?
I think this is just another point of frustration with trying to define timbre. There's definitely some points directly under control: attack and brightness come to mind. Then there's some that are less directly under control: the room and the instrument itself.

It's no accident that musicians spend a lot of money on instruments -- even electric guitar players -- an instrument that is electronically amplified and often distorted and otherwise augmented -- will have strong feelings about the particular type of guitar they use. Leaving shape-based decisions out of it (and pickups), hollow bodies are going to produce a different sound than solid. Different wood types will produce different tonal characteristics.

So the things that are directly controlled are less like terroir, more like choice of grape used maybe? While the make of the instrument, the shape of the room a recording was made in, these are much more like terroir I think.

But it's probably just not a great metaphor.
I don't use a MacBook, so perhaps this isn't of interest to you. I've never measured my keyboard use, but based on the wear on the keycaps, here are the keys I use the most: space bar; all letters except Q, P, Z, and X; backspace; and cursor keys.
Why are we still discussing hydrogen if methane is a solved problem? (CNG/LPG). My car gets full tank for about 20 EUR and drives 400km. Creating green methane out of bio sources or from CO2 is pretty ok too given solar/wind as energy source. Transportation is not an issue , leaking through solid containers is not an issue. Why choose hard mode and try to build out hydrogen?
No bots in this case. See my reply upthread: https://news.ycombinator.com/item?id=40069963
Discovery of products has often been outsourced to influencers, think DJs influencing music or fashion icons with style trends.
I don't recall there ever being a social contract.

Further, what makes you assume everyone is on the same page about what that social contract is? Have you even considered the possibility that there might be differences of opinion on a social contract which are incompatible? It's why the best course of action is to follow the license rather than delusional fantasies.

The idea there's a social contract is sophistry. Plain and simple.
Ahah! So you admit the ban worked!
> Somehow this gets promoted to the front page because of the Django framework

That's not why. It was picked for the second-chance pool (explained at https://news.ycombinator.com/item?id=26998308).

> valuable articles being flagged as dead in the new section

What are some examples?
The full dataset is quite huge (~9 petabytes and growing) out of which I'm using just ~8 terabytes. Still quite big to upload.

The data is freely available from the Climate Change Service [1] which has a nice API but download speeds can be a bit slow.

NCAR's Research Data Archive [2] provides some of the data (as pre-generated NetCDF files) but at higher download speeds.

It's not super well documented but I hosted the Python scripts I used to download the data on the accompanying GitHub repository [3].

[1]: https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysi...

[2]: https://rda.ucar.edu/datasets/ds633-0/

[3]: https://github.com/ali-ramadhan/timescaledb-insert-benchmark...
Based on the "Controversies" section on that wikipedia page, it does not appear that the modern incarnation is particularly evil.

The current incarnation of the East India Company is also not particularly evil, despite the many evils done centuries ago: https://www.bbc.com/news/world-south-asia-10971109
I just rewatched the end of the video to make sure I didn't miss anything. Deterministic execution and replay is very-very well-known and understood. It is possible that your packaging and market fit is right on. Lots of cottage industry in DB testing and bug finding -- but not clear how this generalizes and why something like Coyote [1] (to pick one) wouldn't work as well.

So, fuzzing has been applied to very stateful and very large industrial systems for some time. And yes it is very cool but I feel like I am seeing more "sizzle than steak" so to speak. Great engineering though, hypervisor work is very challenging.

[1] https://www.microsoft.com/en-us/research/blog/coyote-making-...
Hard, but, you know, what else you gonna do' rich people worked hard to be social parasites that chopshop companies for shareholdr values'
Putting "cut-throat bureaucrats" in the "do not care for impact" side of the axis seems unnatural to me: I think these people do care for impact, and that's why they are so decided about imposing their ways. But their definition of impact is "doing things the right way", which corrupts their want for improvement into a pile of processes.
For a nonprofit research group with no patents/IP/etc, simply starting over with the same people is actually a better strategy than trying to "move". Nothing is lost (no capital, equipment, etc) and you don't have to deal with entanglements with the previous institution.
Yeah the smaller memory interface hurts at 4k, that is unfortunately to be expected. Raw rasterizer/raytracer power shouldn't regress It think.
Show HN: Trained Tiny Tales GPT(30M model)from scratch and deployed in $15
For the last few weeks, I have been working on training an LLM from scratch and deploying it in production on Google Cloud Platform.
Finally, I trained a 30 million parameter model on 1 billion tokens and deployed it as a web service.
You can access the LLM using this site - https://kunalmishra.info

The following steps were taken to build Tiny Tales GPT
1. Downloaded and preprocessed 8GB of dataset using multiprocessing library.
2. Tokenized the data using byte pair encoding to create 1 billion tokens sharded in different bin files.
3. Defined a training setup and trained the model on a small version of the LLaMA model architecture with 30 million parameters.
4. The training was done using Distributed Data-Parallel on two A-100 GPUs provided by JarvisLabs.ai (they are most cost-optimized)
5. After the training is done, an inference script is created to predict the tokens from the trained model given the input context vector.
6. Developed REST-based API service using Flask framework to interact with the inference service to the end user.
7. Finally used GCP's virtual machines, instance groups, load balancers, and DNS services to deploy the service on the internet.
GPT-4 is configurable up to 96 layers, each running their own embeddings. I think it was a business choice to afford the compute while they scale.
Thank you so much! Love your questions.

> How expensive/difficult is it to have each page in different colour?
The production was very specific to our design needs. For this edition, each book cost me more than $65 to produce.

> it looked like "product sans" at first glance
We have licensed all our fonts which are: ABC White, Affairs and IBM Plex Mono.

> Tell me more about the page quality
The paper is Fedrigoni Arena Rough Extra White

> Why didn't you choose flat binding?
This question is great! We wanted to have that characteristic curve of opened books. It was very much a thoughtful decision.
AsyncAPI v3 Feedback
Postgres vs. Pinecone: For vector search, easy isn't so easy
Hi!

It's Pavel, maintainer of AsyncAPI

I want to ask you to share your experience with AsyncAPI

I'm also interested in feedback about JAsyncAPI and JAsyncAPI IDEA plugin to better understand your expectations and hear your opinion about current state

I welcome any feedback, whether it's positive or negative

For example:
• I don't use AsyncAPI and I don't have plans, because of <reason>
• I was using AsyncAPI, but due to ‹reason>, I have stopped using it
• I am currently using AsyncAPI in my projects and I aim to change several aspects

So let's talk about documentation for your EDA applications.

If not AsyncAPI, than how do you document your applications?
Im convinced just cleaning existing dataseys would be more effective
Shrugguy.com
Nah it's good work, you'll be able to flame me in a couple weeks...months?..too when I ship my yawn-worthy yet another llama.cpp / OpenAI wrapper. :p

I'd love this knob, particularly in llama.cpp, inference is a bit too slow on Android, 6 tkn/s for 3B. just can't stand it when people don't actually read anything but the title, and go crazy overboard, like, how are we in a thread where people are like "oh this confirm local models will definitely win like I heard on a podcast" and "big bad OpenAI will steal this".
One of the tokens represents stopping. If you sample stop from the probability distribution instead of a normal text token, then you stop autoregressive sampling.
> After that, the PDE is non-linear and non-separable, so. you have to resort to numeric methods. But the computational demands are very heavy, and even with today’s machines you can only get up to ~10 valence electrons

Well as you mention, many of the models can be simplified at levels. For example regular QM and solid state physics like semiconductor assume nuclei’s are essentially stable compared to electrons. Applying this and other simplifications allowed us to build amazing semiconductors tech for example. DFT lets us estimate far more chemical interactions than pure QM, much less full QFT.

However fundamentally knowing the core rules doesn’t help us predict complex scenarios. Personally I don’t see it as too different to the halting problem in CS. It doesn’t prevent us from creating and understanding amazing things.

Actually I’m quite excited the rise of AI in quantum chemistry. These AI models can learn complex rules to simplify calculations like physicists figured out by hand, but can scale it out absurdly.

> Yes you have Pauli exclusion principle, Hund's rule, based on QFT, but there are exceptions, and I never got a good explanation it doesn't apply to the entire compound (or the entire object, or the entire universe)

It’s not clear to me exactly what you meant, but usually quantum tunneling and other effects are limited by decoherence. Yes an electron in your body can tunnel to say the moon. It’s just absurdly unlikely as the number of other electrons it would possibly interact with first is staggeringly large.

Even in a single molecule evolved for tunneling like chlorophyll, the probabilities of tunneling outside a few key paths quickly become too small to represent with 64bit floating point numbers. I did the computations in my physics days, and it was challenging to compute.
The Middle East was at war when the Assyrian Empire conquered its neighbors in the 14th century BC. The Middle East was at war when the Achaemenid Empire conquered its neighbors in the 5th century BC. The Middle East was at war when Jewish tribes rebelled against the Roman Empire in the 1st century AD. The Middle East was at war when the Umayyad Caliphate expanded in the 8th century AD. The Middle East was at war when the Ottomans captured Turkey in the 15th century AD. And so on. Some of those groups managed to commit horrific genocides despite having only primitive weapons. This is all terrible but nothing has really changed and unfortunately there is no realistic prospect of breaking the cycle of violence.

As for outside invasions, the same thing has happened to almost every area of the world. Often multiple times. The Middle East is hardly unique in that regard.
I use Reddit and 4chan equally. They are like the Yin and Yang of the internet.
I don't have a Mac, but there's a lot of keys I never use.

I pretty much never use function keys for anything but setting volume and brightness, I fairly rarely use alt, escape isn't that common.

I use the arrow keys just enough that I'd be annoyed without them but definitely not all the time.

I could probably be fine with just ctrl, shift, enter, and the printing chars, with several weeks of work to learn some alternative to pgup/down/end/home, but I really like having those as single keys.
I think you are commenting on the "stealing" reply and not my original comment. And, I think you are making my point stronger.

OpenAI could easily (and will) put out a blog post or tweet saying "next models do inference 2.5x faster!" Koliko did that, or maybe he didn't and someone else put words in his mouth. I don't really care: I can validate and test your comments here (and they are great!) and I can try his experiments myself.

I cannot do that against "GPT-5-2.5x faster (c) 2024"-42B (because it isn't released yet publicly). Putting a paper and some vague ideas on Arvix isn't really doing much these days except adding to the confusion. Truly open work like koliko is doing is really exciting and feels like it can only be done against truly open models like Mistral.

Oh wait, Mistral isn't fully open either (ducks...).
Flying Aircraft Carriers (2019)
Here's my €0.02:

In 1998, I liked the active matrix LCD on my Gateway laptop a lot more than the GDM-17E11 Trinitron on my SGI because the Trinitron had these 2 fucking wires across the picture, which annoyed me, and also the RGB convergence was off on the edges, and the geometry was poor and heavily bowed by about 0.5" on the bottom. Gross.

In 2020, I bought a cheap new-old-stock CRT monitor for retro nonsense, and threw it on an underpowered Linux system in my office for funzies, and I was like HOLY FUCK the response time on this is INSANE, and the blacks are UNREAL. I felt a Responsive Computer-Feeling I hadn't felt since using my CRT'd dual PPro Debian system in college. Blew away every aspect of every LCD in the house, even my overpriced top-of-the-range Sony LCD TV-- apart from the abysmal, headache-inducing max 60Hz refresh rate at a low 1024x768 resolution, distracting flyback transformer whine, and high-ish power consumption, that is.

Conclusions: every monitor sucks. Always have, always will. CRTs flicker, LCDs muddle, OLEDs over-contrast and burn in. With apologies to Dorothy Parker: you might as well live.

But the glow is real! Gorgeous! I want it on my 70s terminals, but don't need it on my workstation.
Updated to make the download experience better.
Going to work on adding a quit option to the app.

-- For now, you can 'Cmd' + Drag the item out of the toolbar to remove it.

I'm also taking a look at the state change bug.
Anyone got any ideas on why a carwash in sunlight would be a warranty-voiding incident for a Cybertruck? I'm struggling to think of a reason for that.
No, maximum cut is a significantly harder problem. Minimum cut, on the other hand, is equivalent to maximum flow: https://en.wikipedia.org/wiki/Max-flow_min-cut_theorem
I can definitely agree on this point. Same for the newer Taiko versions utilizing a 120 Hz panel as well.

High refresh rate displays have been gaining a lot of traction in the past few years with 1080p or 1440p displays running at 120 or 144 Hz being affordable.
> “Mankind has ah only one mm-m-m science,” the Count said as they
picked up their parade of followers and emerged from the hall into the
waiting room—a narrow space with high windows and floor of patterned
white and purple tile.

> “And what science is that?” the Baron asked.

> “It’s the um-m-m-ah-h science of ah-h-h discontent,” the Count said.

-- Dune (1965)

P.S.: That said, I think the author extended "science of discontent" to mean a future-directed practice of making people unhappy to "toughen mankind up", but IMO it works fine as a general observation of past trends.
My feeling is that Chomsky, Zizek and Dennett aren't free of being guided by something other than logic for some of their arguments as well. For example, Dennett's arguments against the hard problem of consciousness come across as dogmatic materialism.
Because without institutional funding, one's sci-fi has to appeal to a mass audience to pay its way.
But the median wage is up 40% in the last 15 years... If your pay has been constant, you're getting salary decreases in real terms.
Algorithms don't promote things on HN.
> "I am resigning from NPR, a great American institution where I have worked for 25 years," Berliner wrote in an email to CEO Katherine Maher. "I respect the integrity of my colleagues and wish for NPR to thrive and do important journalism. But I cannot work in a newsroom where I am disparaged by a new CEO whose divisive views confirm the very problems at NPR I cite in my Free Press essay."

I dunno, "blast" doesn't seem like the right word, but I'm sure it'll get the clicks.

More discussion from the other day: https://news.ycombinator.com/item?id=40050844
> Games designed for CRT often looked their best on the CRT because of the subtle blending and screen pattern which the graphics were designed around

No. They looked their best because CRT were able to reproduce more colors than an a LCD.

Only now, after more than 10 years, LCDs with HDR come close to CRTs.

I remember vividly my first LCDs who were marketed as 24 bit but you could see the colour gradient like in 16 bit mode on CRTs.
"Highly sensitive person". Basically hypervigilant