skysight-inc/HackerNews huggingface dataset:
Yes. There are plenty forward leaps, most of them are not new and are just waiting to be integrated or released :

Let's pave the road for SkyNet hard lift-off :

-The first obvious one is use of external knowledge store, aka instead of having to store facts in the neural weights where they struggle, just store them in a database and teach your neural network to use it. (This is also similar to something like webgpt where you allow your network to search the web). This will allow you to have a network of 1G parameters (and external indexes of a few TB) that is as performant as a network of 100G parameters, and with better scaling property too. You can probably gain at least 2 orders of magnitude there.

-The second leap is better architecture of your neural networks, approximating transformer that are quadratic compute by something that is linear compute (linformer) or n log n compute (reformer) can get you an order of magnitude faster by simply reducing your iteration time. Similarly using some architectures based on sparsity can give you faster computation (although some of the gains are reduced by lesser efficiency of sparse memory access pattern). Using (analog bits) Diffusion to Generatively PreTrain sentences at a time instead of token by token. You can probably gain between 1 and 3 order of magnitude here if you write and optimize everything manually (or have your advanced network/compiler optimize your code for you)

-The third leap is reduced domain : You don't have a single network that you train on everything. Training one network by domain allows you to have a smaller network that compute faster. But also it allows you to focus your training on what matters to you : for example if you want to have a mathematics network, its parameters are not influenced a lot by showing it football pictures.
There is at least 2 orders of magnitude there.

-The fourth one is external tool usage. It's kind of related to the first one but whereas in the first one is readily differentiable, this one necessitate some Reinforcement Learning (that's what decision transformer are used for).

-Compression : compress everywhere. The bottlenecks are memory bandwidth related. Work in compressed form when relevant. One order of magnitude

-Distributed training : Because the memory bandwidth of inside a GPU is in the order of TB/s where as the transfer to the GPU is in the order of 10GB/s. There is an advantage to have the parameters reside on the GPU but there is a limited quantity of memory in the GPU, so distributed training (something like petals.ml) allows you to increase your memory bandwidth by collaborating. So each actor can probably gain an order of magnitude. Provided that they can keep bad actors away.

-Use free resources : The other day Steam had 10M users with GPU waiting around doing nothing, just release a dwarf fortress mod with prettier pictures and use the compute for more important tasks.

-Remove any humans in the loop : it's faster to iterate when you don't have to rely any human, either for dataset construction or model building

:)
A tic tac toe game on a browser
Europe and in particular Germany or the US shows just how bad that can end up as well. When private companies seize control of utilities - water, electricity, gas, internet, railway, streets - they inevitably end up cutting corners, deferring or ignoring maintenance, firing support staff and generally reducing service quality while keeping to raise rates to make the money back for the banks that backed the loans. Or, in the worst case, prioritize the rich and privileged in case of under-supply over the poor masses, and not doing anything to expand the supply because it works well enough for those who pay better and those who end up shafted don't have seats in the lobby.

That's not to say that nationalized or majority-government-owned companies can't fuck up either, France's EDF or Germany's Deutsche Bahn prove that, but at least the government there can be held accountable by the general public in elections.
The cost of moving data from one gpu to the next will destroy performance.

The system are moving in the opposite direction (look at Dojo architecture or TensTorrent)

The silver lining is that the cost of training will fall substantially with those architecture that are not based in reusing gpu.
That's genius. I realized the cost advantage of text to speech on an old android versus Google cloud
That's true about the de facto ban. I just meant that sometimes there needs to be regulatory pressure. The pressure isn't painless.

Either stock up or find a new lamp that has a small business exemption or some other circumvention of the rules.
> served on a single machine. Yes, even with tens of millions of users

i don't understand how this would work
I think this is just an example but `header` is a standard HTML element. It's not always necassary to seperate every single element into it's own component. Every time you make a framework component you add overhead to the rendering of the app.
windicss is a superset of tailwind that lets you define shortcuts and aliases for easier composition, and variant grouping for less typing
If that’s across the board and there’s no relief for lower income or retirees it’s going to suck hard. My income tax rate is lower than that…. And I asked about state/local taxes as removing state revenue from source a will replace it with source b. Remove existing taxes, and the national vat will sit on top of state or provincial vats as in Canada and I assume elsewhere.
For what it's worth here in France every company I've worked at had o365 licences for email and everyone uses teams. I work as a sysadmin.
I don't know how these things work, but the most recent advisory, 027, seems to imply that United Airlines has a full ground stop until 15:00 UTC / 10:00 Eastern.

Edit: Of course as I was typing that, Advisory 028 pops up with a nationwide ground stop until 9:30 Eastern: "GROUND STOP ALL FLIGHTS / ALL DESTINATIONS EXCLUDES MILITARY AC AND MEDEVAC FLIGHTS"

https://www.fly.faa.gov/adv/adv_otherdis.jsp?advn=28&adv_dat...
OpenOrienteering Mapper
"Preview" app is quite capable.
Is it just me or has the underlying purpose and value of “cascading” in CSS been lost within these abstractions.

The only real limitations with CSS imho was just lack of variable support for easily passing in variables to set color schemes and/or dimensions etc.

These seemed to be readily fixed with SCSS and the various options for embedding CSS in JS using styled components and the like.

Tailwind seems to be all about making it easy to “pixel f*k” your way to getting the design you want in one given place at the expense of having consistency and maintainability.

E.g. with a proper CSS template I can ensure all fonts and sizes and colors are consistent across an app. With Tailwind everything starts to be like the 1990s where all your design was hard coded into table and font elements mixed into your markup!

This does NOT seem like progress!
I’m only saying it like this because I’ve been through this neurotic phase. It’s a soul leech. At one point I overthought so much that I literally laid in bed in fear for days. It took awhile to snap out of it and realize what a pointless exercise it is. I literally had to tell the voice in my head “shut the living fuck up”.

That voice in my head ran me for many years and one of the ways of turning it off is to literally press the off button on it.

You can certainly find out why that voice exists, it’s a combination of internal and external factors. Regardless, it doesn’t deserve as much time as most of us give it. We all try to rehabilitate that voice, but what we all end up learning is that it’s a one dimensional character in your head. It was never meant to be “saved” (my argument against trying to use therapy to change that voice). It’s best to not give the voice a voice.

So when I’m telling you to stop whining, it’s me talking to that voice you have in your head. You didn’t write this post, that voice did. And I don’t respect that voice in me, or in anyone else and have no problem talking down to it.

I mean, that’s the way it treats you right? That’s the way it treated me. So treat it the same.
The problem with standardizing these things is, that it makes them hard to change. A breaking change in the way you deploy must also work for all other solutions - otherwise you immediately loose your standardization. And this will happen eventually. For all this different kind of problems it is near impossible to avoid inconsistency and force rules on them.

So, imo you either have a (very) large organization with independent teams that work on independent services and give them the freedom for everything - or you develop a proper modulized monolithic software and extract services only as a last resort.
I would avoid to use a microservice architecture with a small team of developers
US biased coffee making & consuming experience.

Just about every US city I've been to is overflowing with 'serious' coffer places making 'true' espresso which can easily hold their own against every place I've been to in France and Italy.
According to this: https://gizmodo.com/elon-musk-twitter-layoffs-engineering-sp... the first round of layoffs was around 40% engineers.
>Just awful. 10 years in the making (if you can call endless bikeshedding committee meetings the "making" of anything) and still barely usable.

This seems like the norm for tech now days. A lot of meeting and work and nothing major or significant really gets done. Seems like the the whole industry is about making it easier and simpler for new developers to get develop.

Regarding React, ES should just stick and simplify E4X that would just really make all these front end lib not necessary.
The T800 said the wrong name to test the T1000. The person the T1000 pretended to be would have noticed.
Another strategy to make life easier is to separate data flow (the transformation of inputs to outputs) and control flows. The control flow knows the context, and given the current state decides how the data flow transformation is performed.

Think of an ALU that can perform add, sub, shift operations. The ALU implementation simply accepts operands and perform one of the supported operations to generate the output. The control flow would in this case look at an opcode and decide which of the ALU operations to perform.
Popular usage seems to be just you two. I have provided sources in the other subthread, telling me what you think everyone believes is unconvincing.
Nevertheless you should regularly test it, at least once a year.

Many a datacenter outage could have been prevented had there been more regular testing of all the components involved.
I don't get this comment. I don't care if a usable web component is built with stencil, lit or not, what I care about is that I can use that same library WHETHER I'm using React, Vue, Svelte, Solid or whatever.
If you read a lot of good books and watch a lot of good movies, and then also read books about psychology, philosophy, and art, and music, and read reviews about the things you consume ...

What is a good book? If it's older than 30 years and still talked about, it'll probably be worth a read. The same goes for other forms of media. Once you have developed good taste, you'll be able to find good art among contemporary stuff.

Basically, you have to grow as a human being, learn about the human condition, have lived through painful, difficult experiences yourself and fully experience them instead of pushing them away, and maybe seek help with these things from more mature people.

Then you'll probably come to this kind of interpretations.

But on some not so conscious level you will understand many of those things intuitively, without being able to put your finger on any single one. Because that's how art works. The artist will do most of the hard stuff for you.
This is really good, and I was really excited by it but then I read:

> running on a single 8XA100 40GB node in 38 hours of training

This is a $40-80k machine. Not a diss, but I would love to see an advance that would allow anyone with a high end computer to be able to improve on this model. Before that happens this whole field is going to be owned by big corporations.
Django Styleguide
someone was recently arrested in America due to facial recognition for committing a crime in a city he had never been to. being black didn't help him
Advisory 028 is a nationwide ground stop: https://www.fly.faa.gov/adv/adv_otherdis.jsp?advn=28&adv_dat...
ATC can tell pilots what they need to know, right?
With billions of GPT output streams, how do you actually discover and rank what’s significant? Screen them through some even more powerful models? I imagine it’s like a volcano eruption of text where some are absolutely brilliant and most is worthless and finding the jewels is even more demanding than generating it all.
Cloud Breaches of 2022
Curious to know how close that training loop is to actual openai code.
It was really alien to a lot of poor rural and inner city American teens as well.
Hello HN! Yes this is just like ngrok. But do not need to download any binary to get started.

You can even get a persistent subdomain by signing in. A binary client is optional for more features like stats about visitors.

The server is not a ssh server. It however uses the protocol.

More about TLS and TCP tunnels coming soon :)

Please give it a try and we would love some feedback:

https://forms.reform.app/DtpE3m/early-access/jJ9Ibq
Super-Productivity: advanced todo list app with Timeboxing and time tracking
I've only read the headline, but isn't this the consensus already?

Full disclosure: I'm on antidepressants and probably don't really need them.
Solar is lovely and all but the far more concerning thing here is that 30 years on from it's civil war, Lebanon still does not have a functioning government. More and more places seem to be ending up in this state, both in places like Lebanon AND in the West (looking at you Texas, or here in the UK). It's nice that at least some people are finding ways to work around these failures. But let's not pretend that that is a viable solution. We should address the actual core issue here.
Well at that point, some people might have the crazy crazy insight that no matter how big the model is, or how many GPUs they have, it burns up all the same.
This is what I thought initially, but in my testing with a modern laptop I saw almost no difference with and without hardware decoding.

It is possible that my testing was flawed so I would be curious if anyone has investigated power consumption more thoroughly.
2 Dots for chill puzzles. Not really a game, but iNaturalist for learning about your local flora and fauna.

Gris for empathy/symbolic understanding of emotions. It has good puzzles, and the art and storyline has no talking. I feel like it gave me a lot of good ideas about using drawing and music to represent emotion, so maybe it is useful for teaching people to talk less.
This biggest most is high-quality data. Both their proprietary datasets (WebText, WebText2 etc), but also now their human-annotated data. Another secondary moat is their expertise with training models using PPO (their RL method), they can get results that are quite better than other labs. I say this moat is secondary because it's possible that you can get similar results with other RL algorithms (e.g. DeepMind using MPO) and because maybe you don't really need RL from Human Feedback, and just fine-tuning on instructions is enough
Firefox: Enable the GPU Sandbox in Release
It's weird to me that no-one doing this kind of project compares it with nginx-unit.
That currently appears to be a different product "WebGPT", rather than a ChatGPT update.

There are two ways of giving ChatGPT access to events that post-date the time it's training set was collected.

1) Fine tune (or re-train - but very expensive) on more recent web pages, focusing on ones likely to contain current events, such as news sources.

2) Like WebGPT, train ChatGPT to generate queries for information that can be fed into a variety of external "query response" systems such as web browser, database, mathematica, etc.

I guess one difficulty with this second more promising approach, is when would ChatGPT emit it's own naive "sequence of words" response, and when would it emit the response of this indirect query lookup, and/or how would it combine the hopefully factually correct query response into the factualness-unknown word soup it inherently generates.

Although this is a more promising approach in terms of having ChatGPT behave they way people want/expect it to, it's a bit ironic in that it really means ChatGPT is itself dumber - it's just being used as a front end for search, essentially "aligned" to emit "what query is most likely to satisfy this sequence of words prompt", so really exposing itself for what it is - a language model that knows about words/language, but not about facts (or reasoning, etc).

Of course the real value of some (to be developed) future AI that actually has reasoning capabilities would be to combine multiple sources of data to deduce facts, employ chains of reasoning, and answer novel questions in a logic/fact-based manner.
> very little money in optimizing deep learning

Oh - there are a lot of people working on optimizing AI. Amongst hobbyists, academia, and corporations alike.

The thing is, if you come up with a neat optimization that saves 30% of compute for the same results, typically instead of reducing your compute budget 30%, you instead increase your model/data size 30% and get better results.
Also an option indeed, but eventually the consumers pay for this difference.

The incentive with the 'normal' merit order model is that the most expensive generator is that they make barely a profit if at all. Not too attractive.
Better build generation capacity that has lower operating costs (ie. no fuel, ie. renewables).
At least, that is the theory. I really wonder what happens to this model and the incentives once renewables are the majority and stretch further along the merit-order curve's X axis, pushing out fossil fuels.
Are you serious? Using vanilla Web Components is just god awful and I can't recommend them to anyone with a straight face. Not having had experience with "normal" web frameworks like Svelte, React or Vue.

You have to invent all your own wiring and passing of events, state-management et cetera if you go that route.
>Why Fortran is a scientific powerhouse

This is by design.

I don't know how Fortran is any more, I didn't get as far as Fortran 77 since it wasn't 1977 yet.

But students seemed to hate the old Format statements to get your printouts with.

Properly done, a few lines of code could output reams of concise tabular data, but you had to be careful you didn't print out reams of gibberish instead. Those mainframe printers could chew through kilos of paper.

OTOH, for a single page report, a customized printout of meaningful consolidated, summarized data, it could basically take up a whole page of Format statements and even more print statements in the code.

A *whole* page.

And there was no such thing as What-You-See-Is-What-You-Get for printing, it was what you expect is what you hope to get.

Now it's the modern day in the chem lab, and with 10GB of modern scientific software on top of Windows, which requires a high-end desktop for this, I have not stopped wanting to print.

And my data is cloud-ready like never before.

But I have no use for that. After my data has lived a full life, it will go to heaven by itself. Seems like it could also expose my data to hell.

What about my printout?

"Low-code" derivative of Microsoft's Report Definition Language. You've got a template and a GUI and you can even move blocks around. What you see is even less of what you get. There are two main features not shared by Fortran:

1. You will *always* need some kind of iteration before you arrive at your final page format.

2. The code generated is *pages and pages* of XML to get a single printed page.

If I had something as performant as Fortran Format statements it sure would have saved a lot of time.
It is certainly possible that the sheer quantity of online content available on the internet today has led to a saturation of information, making it difficult for individuals to find articles and blog posts that are truly worth their time. Additionally, the fast-paced, scrollable format of most online content can make it less engaging and immersive than traditional print reading.

On the other hand, books are often seen as a more immersive and satisfying reading experience, and it is possible that the perceived "deeper" or "more valuable" reading experience that they offer is leading to a resurgence in their popularity. It is also important to note that reading habits are different for people and their preference can change over time and also varied with life stage and personal circumstances.
There's a ground stop for all flights now.

GROUND STOP ALL FLIGHTS / ALL DESTINATIONS EXCLUDES MILITARY AC AND
MEDEVAC FLIGHTS
DESTINATION AIRPORT; ALL
FACILITIES INCLUDED: ALL
GROUND STOP PERIOD: UNTIL 1430Z
REASON: EQUIPMENT OUTAGE
REMARKS: US NOTAMS SYSTEM DOWN
Do you have a link to that paper by any chance? By "neurons" did they mean weights or activations?
We simply do not have the option to uninvent the internet the same way people in cholera infested London didn't have the option of getting water from elsewhere.

What you propose is taking action at the individual and family scale and that is good. But that doesn't solve the macro scale.
Europe has tons of energy storage in the form of natural gas storage tanks. If they only used gas out of those tanks when there was no sun & wind they could easily keep them topped off via LNG input terminals and they'd be fine.
An issue with many languages is the presence of mutually dependant parts of code, because how do you generate a content-hash for something whose constituent part's content-hashes depend on it? Merkle trees can be generalized to DAGs, but not directed graphs with cycles.

As far as I understand, Unison's syntax has been designed specifically to avoid such cycles, although it supports recursive functions and inductive data types which refer to themselves such as lists. A self-cycle can be handled, but I'm not sure if, and if so how, it would support mutually recursive functions or data types. I suspect they're not supported for the reason that content-hashing becomes non-trivial.

If you wanted to generalize the solution to arbitrary languages, you would need to somehow sever the cycles, which is likely to require a specific solution for each language, or come up with another solution to content-hashing which does not have the problem of Merkle-DAGs. Either way, you are looking at something non-trivial compared to having a language which simply forbids the cycles.
> Every time you make a framework component you add overhead to the rendering of the app.

not true, separating components by concern can save you a lot of fiddling with memoization
The question is, how will ATC know? I'm not that familiar with their systems, but maybe they rely on them to get critical information?
All hail the memelord!
I can see you're not planning on being hit by a car, getting cancer or being old. This is an interesting plan, I wish you the best of luck.