skysight-inc/HackerNews huggingface dataset:
> print money at prodigious rates

+All that debt will become 'real'. We could look to UK and see what happens to a nation post (currency) empire. But a word of caution here regarding the analogy: the new empire (US) were allies of the dethroned empire (UK). Come US's time, it is doubtful that the new power will be a Western power. So US will have a harder time than UK and things have not gone well for UK since WW2.

Zombie International Currency: The Pound Sterling 1945-1973, 2021:

http://repec.graduateinstitute.ch/pdfs/Working_papers/HEIDWP...
IT admins have only themselves to blame for choosing Teams in the first place.

Yes, it is included in O365 and it makes it a no-brainer as far as additional costs and things go. But then there's the risk that Microsoft leverage their captive and lazy market to foist other undesirable things on users... like this. And crappy news / adverts in Windows 11's 'start menu' replacement.

Ready to get voted down on this, but my view is pretty robust: no need to self-host EVERYTHING but avoiding vendor lock-in and maintaining independence is valuable. It is a lesson that corporate IT admins seem to forget time and time again.
Yes, I can clone this and get into a prompt in less than 5 minutes on an M2 MBA.
When humans do it we call them bullshitters.

But I agree with GP's eager-anthropomorphization complaint. When algorithms produce verifiably wrong output we call them errors.
Can someone explain how to tell if a model doesn't require a GPU and can run on a CPU?

After setting up dalai, OpenAssistant, gpt4all and a bunch of other (albeit nonworking) LLM thingies, my current hunch is:

if the model somewhere has "GGML" in its name, it doesn't require a GPU.
> That title is neither misleading nor linkbait.

Debatable, but my comment didn’t argue either way. It clarified what the guidelines say, not how they should be applied to this particular case.
I'd like to know why Spanish was only 85% for reading in this study. Did they use Spanish texts that were full of English words or foreign names or something like that? Or did they consider some informal colloquial pronunciation to be the "correct" pronunciation? Or did they have a confusing mixture of different varieties of Spanish in their dataset? I'm finding it hard to think of frequent cases in which it is incorrect to pronounce "pure" European Spanish exactly as it's written.

Another possible explanation: perhaps their ANN model was incapable of working across word boundaries? (The "n" in "en Bolivia" is pronounced like "m": it's perfectly regular and a simple rule but you do have to look beyond the current word.)

EDIT: When I write "exactly as it's written" I mean, of course, that you compute the pronunciation from the spelling by applying some simple rules. For example, B and V are pronounced the same way, and that way depends on the context, but the rules are very simple: they can be expressed in a few hundred words. Also, I don't consider an overly formal pronunciation to be "incorrect" for the purposes of this discussion!
You can use your own KMS outside the Google infrastructure. https://cloud.google.com/storage/docs/encryption/customer-su...
The precursor to .NET being born. :)
> Maybe the problem is that I never knew who my audience was.

Knowing your audience is indeed step one. Truly.

Build at least one Ideal Customer Avatar [0]. Don't skip the step about visualizing them, even if it feels silly - it helps.

Maybe start a monthly newsletter, mostly so people are reminded you exist once in a while. Your unpublished backlog is probably a great resource for this.

And yes - just start posting again.

Good luck with the game, looks fun.

0 - https://gibbonet.co.uk/5-steps-to-build-your-ideal-customer-...
Looks great, thanks for the experience!

Personally I'd like a "table of contents" where you get the title, a summary and an example. Then you could scroll and learn a bit about all techniques, clicking in one that piqued your interest.

I'm not sure if that's easy or not. Let me know if I can help.
The actual history of companies losing secrets.

It’s much harder to reconstruct actionable intelligence from a huge stream of people using Google search even if they’re using it to preform sensitive calculations.
Very insightful!! A 175B parameter model with 2 bytes per weight, and say 2 bytes per gradient (not sure if single precision gradients makes sense?) comes in at 700GB, which is beyond a single 8x80GB beefy machine!! I recall reading with tech such as RDMA, you can communicate really fast between machines .. I assume if you add a switch in there, you are toast (from a latency perspective). Perhaps using 2 such beefy machines in a pair would do the trick .. after all .. model weights aren't the only thing that needs to be on the GPU.

I saw a reference that said GPT-3, with 96 decoder layers, was trained on a 400 GPU cluster, so that seems like the ballpark for a 175B parameter model. That's 50 of the hypothetical machines we talked about (well .. really 100 for GPT-3 since back in those days, max was 40 or 48 GB per GPU).

I also wonder why NVIDIA (or Cerebras) isn't beefing up GPU memory. If someone sold a 1TB GPU, they could charge a 100grand easy. As I understood it, NVIDIA's GPU memory is just HBM-6 .. so they'd make a profit?
We're not reading news, we're reading press releases. And to be honest I would have hoped for a healthier dose of skepticism from HN. Vaporware and hype are common things in software. Ship it, let me play with it, then we'll talk about it.
All of the observable data, implicitly, plus an evaluation criterion. They can operate on that, including starting to mine it in a strategically effective order, because the whole game system except the other player is defined by a small set of rules.
You can slap out the POC without types for sure - but the addition of types helps

- tests fail faster
- code documentation
- IDE’s complain better
- teams collaborate better

It becomes more helpful as projects and teams mature.

I’d say that types aren’t the last step though, I’m starting to prefer protocols and those are proving to be even more loosely coupled and more pythonic to me. They let you “type” the behavior rather than the actual type. Say there is a case when you don’t care if it’s a set, tuple, or a list because all you’re going to do is Iterate, we’ll you’d go the behavior route and say you want an Iterator. You can create your own protocols as well and it has the effect that you document what you intend to do with the objects passed to you such that it doesn’t matter what you pass as long as it adheres to the protocol you defined. It’s documented duck typing. Here’s a great video that explains how it can simplify your code https://m.youtube.com/watch?v=xvb5hGLoK0A
We are trained in a way that involves far more back and forth, giving corrections to specific failure modes in our thinking, though. It'll be fascinating to see to what extent interleaving "independent study" (training on large chunks of data) with interaction fed back in as training data could reduce the amount of training needed.
Ask HN: What are some good aesthetic programming communites?
I am looking for hacker communities which are focused not on creating value but on creating beauty using programming. The two places I hang out a lot are HN and IndieHackers because those are the places I know programmers hang out. But the primary audience there is startup people who are focused on creating products not "just something cool". The closest I have see are some game jam discord servers, but I am not a game developer. I would appreciate any pointers.
We can see how an ant is a more primitive form of the same kind of thing that a human is, and though they're not on the same evolutionary path, we can see how humans evolved from the most primitive forms of life, because we know what the endpoint looks like.

We don't know what 70s AI and ChatGPT will evolve into. That's why everyone keeps debating and prognosticating about it, because nobody actually knows. But whatever people mean by AGI, we don’t know if it will or can evolve from the AI platforms that have come before.

We do know that the thing that evolved into ChatGPT is entirely different from primitive cellular life, so there's no reason to believe that ChatGPT will keep evolving into some kind of humanistic, self-aware intelligence.
I noticed one important point mentioned in the banking app example, but not elaborated on:

Shirnk critical scope.

By this I mean if you can produce a simpler version of whatever is that you're doing and have separate tasks for expanding it, do it.

Your e-commerce solution can start off with just one payment provider. Your form validation can initially respond with just "nope!". You don't need that color picker shaped like a peacock in your MVP.

Especially if these things prevent you from delivering something that someone, anyone can use.

Also half of such things become irrelevant and ultimately get dropped.
This is real best of the web stuff.
not sure if it's a custom model or some wrapper/fine tuning around Eleuther AI models (GPTJ, Neo etc) but they react like ChatGPT on SolidGoldMagikarp etc type tokens.

https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldm...
There is hardly maths or hard science in AI.

This is high-school skill, don't be fooled.
Quantum effects don't. There are rules but results are within range random.
> Humans "hallucinate" in the AI sense (it's an awful word that obscures how often we do it) all the time too.

Agreed. I'd like to add another point to the discussion. It seems to me, as if LLMs are held to a higher standard regarding telling the truth than humans are. In my opinion the reason for this is that computers have been traditionally used to solve deterministic tasks and that people are not used to them making wrong claims.
That might be a useful point of view if you happen to work at GitHub and you don't really want to wake up to the fact that you actually work for Microsoft now. But for anyone else, everything Microsoft owns is Microsoft, and they'll use the products and properties they owned to further the goal of Microsoft, which is maximizing shareholder profits, just like any other public company.
Apple controls the browser on iOS with an iron fist. Even if you are using a different app, its still Safari under the hood. And even though they control the rendering, they still open all links from Apple apps in Safari.

Oh and music. I use an alternative to Apple music because I choose to. That doesn’t stop Apple music from being the auto play choice even when I don’t use Apple Music.

If Apple’s products are so much better they should allow choice and bot be threatened by it.
Recall that Microsoft initially tried to make the hot reload feature of .NET 6 available only in Visual Studio. Their 3E strategy continues to this day.
Here's the thing, though. Gronk is Robert James Gronkowski, a football player and celebrity, playing mainly for the New England Patriots.

For that reason, I'd say the 'intelligent' answer would be a clever play on the notion that this celebrity was the ruler of a 'republic' of some sort, and associating some kind of location or thing to serve as the 'capital' of either a physical or conceptual 'republic', playing along with the gag.

So, you'd get 'Boston'.

Or you'd get 'Gillette Stadium… the END ZONE'.

(since I had to google all that, first answer is the biggest city representing the New England Patriots, and the second abstracts the 'republic' to be 'the area Gronk rules', depicting him as returning to his property by scoring points in football)

The thing is, this sort of wild associativeness IS 'intelligence' and it's simultaneously complete hallucination. It's valuable. Hallucination is potentially the most valuable thing an AI can do. Without it, you're doing nothing but regurgitating the work of others.

I work day in and day out at a job that demands I exploit associativeness, and that makes it not easy for AI to simply step in and replace me, but by the same token I can SPOT when it's moving in that direction, and I can exploit the abilities of AI (such as Stable Diffusion) to hallucinate and make wild associations, because I know the contexts in which that is useful. To handicap this is a bad mistake. You're asking AI to do the wrong things when you're asking it to be free of error. If it's perfectly free of error it's not intelligence anymore, it's a dataset.

It took me a minute and a little googling to track down who Gronk was, what he did, the rules of football, and why 'Gillette Stadium, the END ZONE' is actually a fantastic and intelligent answer to the question. It's a creative 'slipping' of the grounds of the question, in the absence of a literal answer, to provide a satisfying figurative answer that reframes the question in an unexpected way. When AI is able to do this, that will itself be a useful kind of intelligence… and we are already slightly there, without realizing it.
This is the link I am most happy I pressed today. Thank you for making this.
> Yuan is still only 3% of global currency reserve

Which is half of the Yen and Pound, and not far off from the CA$ and AU$:

* https://data.imf.org/?sk=E6A5F467-C14B-4AA8-9F6D-5A09EC4E62A...
My favorite quote from the essay:

"When they [AI companies] do ‘do’ science, they are still using science mostly as an aesthetic. They publish papers with grand claims but provide no access to any of the data or code used in the research. Their approach to science is what “my girlfriend goes to another school; you wouldn’t know her” is to high school cliques."
Not answering for the GP:

There are so many people out there, who should know better, or even do know better. Yet, for whatever reason install VS Code instead of VS Codium. Even when you inform people about the existence of VS Codium, they still don't move and keep using VS Code. It is like they do not even care at all.

That this is even allowed to happen in organizations is already an oversight. It should not even be allowed to install VS Code on organization machines or use it to ever view or work on the code of an organization.

To me it looks very unprofessional. It is like a shiny toy has been dangled in front of their eyes and they reach for it, never willing to let go of it, even when they are being told that there is telemetry and non-reproducible builds and whatever other mistreatment of them as useds. Like children they stick to their shiny toy, even if they could have the same features, same UI, just without built in telemetry. (And they can still install any extensions they want later, if they trust that extension or marketplace of extensions.) It is very similar to people installing Chrome instead of Ungoogled Chromium. I have personally experienced how uninformed people at a university went wide-eyed, thinking I was talking crazy stuff, when I told them that it should not be installed on university computers, since it is spyware.

I wish I could get people to get off their behinds and improve the situation. But it is of course very difficult to always create awareness and people are so damn ignorant. Often I am not even suggesting, that they should switch to free software tools yet. They could literally have the same experience, but no, most of the time you cannot tell them anything and they continue to take us with them into dystopia of our own making as a society with collective uninformedness and ignorance.
> why would I use a clone instead of the real thing

Has nothing to do with why people don't use Edge (they still didn't use Edge when it was using a custom engine; same for IE before it).

And it's only the techy minority that even knows Edge is built on top of Chromium.
I write an email with my poor language skills, bad grammer and autism and paste it into the text box and prompt chatgpt to "rewrite this message in a concise and friendly manner: <email>"
Where do you stand on the right of self-determination?
my understanding is that within microsoft there are different factions competing with each other for i don't know what, dominance maybe. it kind of makes sense since microsoft has several different strong products that can stand on their own (unlike google whose main income is from advertising so really all google products subsume to that), and some of these factions may well genuinely love FOSS.
might try it first. seems to be only CPU?
For some reason I assumed it was to do with https://ncases.com/ - it's unrelated!
It kind of is, and you could verify all of it by checking the USCIS website, and the dozens of other sites where they collect and parse H-1B application data, e.g. https://www.h1bdata.org
A tangent to the essay but I also really dislike the new term "alignment" and how it is used uncritically. Maybe I misunderstand the concept, but to me it is subtly oppressive and possessive. Does one characterize their children or parents as being "aligned" or "unaligned"? Were the Non-Aligned Nations in the scifi show Babylon 5 an existential threat? Or was non-alignment the highest ideal of political autonomy?

Alignment sounds like something a bad school principal or Nurse Ratched would say.
I tried to go wrong way and i was not able to do.
Thanks for telling us
Is everyone misreading the article?

The new policy is to ignore your default browser from Outlook and Teams and open Edge. There is an option to turn off this policy to use your default browser.

> Microsoft 365 Enterprise IT admins will be able to alter the policy, but those on Microsoft 365 for business will have to manage this change on individual machines.
Yep same here and also for some strange reason, there is always a mixed race couple and the man is almost always black and the woman white. Almost never any other races involved basically and it's almost never a black woman and a white man.

It makes me a bit disgusting when it's so obvious and somehow it's like many, many companies colludes to spread this image. It's shit like that which makes conspiracy theories seem less like theories.
Peaceful? We all saw what happened in real time. What I saw was not peaceful. If it was peaceful, why did they bring (and use) so many weapons? Why did Rudy Giuliani call for “trial by combat” at the Ellipse Rally? Why did so many people get injured? Why was so much damage done? Why did people die?
What percentage of companies do you think actually use AWS securely?

There’s plenty of high profile fuckups from people falling to AWS specific gotcha’s.
I find it odd that every time that a language topic comes up it turns into "my language is much harder than your language".

It is like some form of patriotism?

Genders and verb tenses are hard if you choose to see them as that. However, what I do is treat the gender part of the word I'm learning. The same thing with learning Chinese and seeing that the tone is part of the word and shouldn't be seen as separate.

Literally any language you chose to pick up a book on grammar will feel daunting. Realistically, you don't need to "learn" most of it. If you keep learning how to speak the language the grammar will come naturally.

Think about it like this, Japanese is described as one of the harder languages to pick up and learn. However, does a Japanese speaker automatically find it easier to learn Spanish because that's described as an easier language? I'm sure if they open a book on Spanish grammar they'll also feel completely overwhelmed.
Aren't you sort of saying that it's okay because they have a vision where you use their products for everything? Hard to tickle that out from antitrust, no?

The worst thing about the integration is that their safelink checker thing is slow as hell.
This would make the bank extremely vulnerable if the community is hit by a recession.
You need to diversify the risks not bet it all on a single hand.
ULEZ did improve air quality in central London - owing to the large concentration of cars. I'd say probably strong incentives for non-gas vehicles helped also (exemptions from Congestion Charge, reduced parking fees in certain boroughs, etc)

The ULEZ 'extension' is different. It extends ULEZ to areas on the outskirts of London (the suburbs). There are a number of problems with this:

* Public transport options not as great, so car ownership is far higher. Lots of commuters (that either have to travel to surrounding areas or commute in from nearby).

* The area is not as densely populated as the central areas and there are more highways and things designed to support greater volumes of traffic.

* The costs are high (daily £12.50)

* From 2030, all new cars in the UK will be non-gas. The shift is already gaining momentum so naturally through incentives those that can afford to move to an EV are doing so. TfL's own analysis shows that the scheme will cost more to rollout than the revenue it generates.

Also, I detest the 'pulling at heart strings' approach taken to justify this extension. It is akin to the people who want to break E2E encryption and privacy crying 'think of the children' - the basis is not logically sound.
Study: Impact of oil and gas infrastructure on nesting birds in Arctic Alaska
Thank you for this, ideal customer design is within my wheelhouse, I'll give it a try. I rationally get the benefit of newsletters but I need to nail some things down first.

I think this is a good first step you've pointed me towards.
that is one weird looking game... I'll keep an eye out on it.
I think the French go in for competitive dictation rather than spelling bees, i.e., running text rather than individual words. It’s a challenge because French is so full of homophones and puns.
I see this argument all the time and it perplexes me. A thing so huge to rival the wheel, the control of fire, etc, and yet people say that we might not be sure when it's here. If it is AGI it will change the world in dramatic ways, you will not spend time arguing that we rolled things on top of logs before we had the wheel. The freaking war chariot is charging your ranks, taking your home and your family in slavery, there is no room for doubt about the impact.
I agree with you totally.

For me AGI is achieved when AutoGPT is at a point when it's able to improve its own algorithm (specifically improve on the GPT architecture).

Flash attention came out a bit less than a year ago (27 May 2022), which was a great scaling improvement for getting rid of O(n^2) memory requirement in the length of attention.

I guess the next one we need will be one of the solutions that change the FLOPS for computing attention from n^2 to n*log(n) (there was already a paper that achieved it using resizable gauss filters where the size and the base convolution filter is learned separately).

A few of these kind of ,,breakthroughs''/algorithmic improvements are the only ones needed to get to AGI (self improving machine) in my opinion.
That is just taking data in and generating data out, though. Language is just data, not something fundamentally different.

There are certainly some missing elements, such as ongoing training and memory, but it's not at all clear that there's any major conceptual differences. There could be, we just don't really know.
“Nearly as big as Canada or Australia” isn’t the big flex your comment makes it out to be.

Australia is a country of 25M people.
I think this time actually is different. For the first time ever we now have a currency that is controlled by no one, with no third party risk, that can be sent in seconds across the world. It's called Bitcoin.