skysight-inc/HackerNews huggingface dataset:
LLMs are a pretty big breakthrough which can be useful for some applications, but not others. There is always room for futher breakthroughs, and as more time is devoted to research the LLMs of the future could be highly optimized for any number of metrics from power usage to token count.

So with that in mind, while it isn't a silver bullet which is guaranteed to lead to AGI, it can certainly fill a role in many other places and is bound to lead to cool tech layered on top of better LLMs. It's nowhere near robust enough to replace every human, but might be enough to at least displace some.
I guess the analogy in this situation would be someone taking a photo of a master artwork.
Putting too much information in the context window is counter-productive in my experience. Low signal/noise ratio tends to increate the likelihood of model hallucinations, and we don't want that!

What works in my experience - structuring the task similar to a human-driven workflow, breaking it down into small steps is needed. Each step could be driven by a small prompt, relevant document fragments (if RAG is used) and condensed essays/tutorials/guides that were written by a powerful LLM (ideally, GPT-4 pre-Turbo).

Using this approach, you could stay well below 8k token limit even on the most demanding tasks.

(Big size contexts are leaky on all LLMs anyway)
I'd argue the other side of the this: you don't need a non technical cofounder.
Hmmm, an extremely interesting thought! Basically, agentifying might be the next programming.

Do you have a guess how that would play out or how likely that might be? It seems like the main blocker here would be if the agents remain relatively weak in pure reasoning.
Of course there's ideology on all sides - almost everything we do is informed by one or more ideologies. The real question is which ideology is correct, or at least more correct? There's one side, which seems to rely on tenuous arguments based on poor interpretations of select evidence, or the other, which is based on a massive expert consensus centered on a mountain of evidence which all seems to lend itself to a single general conclusion. And then there's people like you, whose refusal to meaningfully engage is very convenient for continuing the status quo, a position that suits the first side just fine.
Figma, Apple One, Netflix, Disney+
Without doubt, implying that lack of screenshots of software designed for blind users is unfair should tickle a self-aware person’s sense of irony and one should be careful with phrasing.

That said, I suspect such requests are not fully baseless.

While nothing beats actually putting on a blindfold and trying, it does not seem unreasonable for a sighted person to try to find out what, e.g., Braille looks like. This knowledge may give them ideas into how it could be possible to incorporate more of it into predominantly visual spaces, for example. We have different modes of attending to the world, and in fact it is seeing Braille in public spaces that reminds many sighted people that not being able to see it is actually a thing (and perhaps even prompts some to learn it).

Is it not similar with software? If it could increase adoption of accessible software among users who do not need it in their current state, would that not support the goal? (Not to deny that screenshots are really beside the point when it comes to documentation completeness of such software, of course.)
Absolutely true. Of course, a non-technical cofounder probably knows more than just marketing. He may add a lot of value in terms of fundraising, product management, and other areas. Teaching all of these things to an engineer wouldn't be trivial.
"Found art" is a niche that's irrelevant to most 2d-image art, as a producer or consumer. And that's all text prompting / inpainting / etc is at this point. Vague, overbroad suggestions to the AI that leaves all the interesting and meaningful decisions and choices in the hands of latent noise.

I find illustrations, amateur or professional, interesting and engaging because people's style heavily reflects what they value in the imagery they create - deliberate choices made in pursuit of depicting or conveying an aesthetic, a theme, a subject-category, an idea, a notion. Paths taken in developing their skill = style.

Current AI image generators are too blunt of an instrument to be a part of that process.

The communication capabilities / concept space of image-gen AI needs a couple more paradigm shifts before it can join the pantheon of tools for "making better art". That means pursuing what they really want to depict, not filling space on the canvas with the AI's vague notions of it. Right now "style" in AI art is just a shorthand for surface-level LORA-ripoffs of existing artists, and attempts to statistically blend them together.
No, they didn't. They figured out a workaround. Since they didn't find the root cause of the problem themselves and apparently didn't take it up with the Chrome or Grammarly development teams, they don't actually know what happened or when it might bite their customers again.
> The algorithm leaks 1:1 personal details of people

Which would usually require prompting about certain people or about certain bodies of personal information. What does this have to do with copyright? Claiming that a model as a whole infringes (infringes on which works?) is separate from claiming that a particular model output infringes on a particular work. Under current copyright law I think that the question of infringement doesn't apply to models. How do you compare an apple tree to a pear? Copyright is about actual similarity between new works and actual existing works first, method of creation (including theoretical reproduction of style, style not being an actual work) second.

Pasting what I wrote in a different comment:

My argument is that similarity of new works (including AI model outputs) to actual works (not to non-existing works, existing styles, or theoretical aggregations of multiple works) is a prerequisite to infringement. From an article about the substantial similarity test in the US [1]:

> To win a claim of copyright infringement in civil or criminal court, a plaintiff must show he or she owns a valid copyright, the defendant actually copied the work, and the level of copying amounts to misappropriation.[1][3]

In order to get an infringing output, the user usually has to include a reference to an existing author or an existing work in the prompt. Sometimes that's not the case (which I've worried about with respect to Copilot), but in order to damn the model as a whole, you would have to establish that in over some percentage of cases the model produces infringing outputs for prompts which don't reference a particular author (whether individual or collective), a particular work, or a style strongly associated with a single or a few authors.

[1] https://en.wikipedia.org/wiki/Substantial_similarity
I think this year I have achieved less reading than last probs 9-10 books.
C'mon, you're a Roman senator's wife, it's raining, you need to get to the Vestals or whatever ... of course you're not hoofing it.
Well, ostensibly, "green initiatives" would do that to gauge the efficacy of their own endeavors. Either the CC company could pay for their own, independent audit, or a fellow "partner" or "foundation" would periodically pay for it.

I dont necessarily disagree with you that CC is bs, but why would anyone be against going MythBusters on it? And what better mythbuster than a big-name accounting firm?

If your position is correct, then the green movement has some explaining to do. Claiming to fight something, as a non-profit, and not having any auditing or accounting measures is deceitful to their cause and makes us question whether they in fact care about the environment whatsoever. Having one of the big-five blow their cover would help rip the bandaid off and redirect that money to an effective cause.
Yeah, that would have been a good first step, but he does admit to not really knowing much about browsers:

> This was fairly far outside the usual scope of our on-call issues. Our team is generally well-insulated by other teams from issues like browser compatibility, so I didn’t know the first thing about browser debugging.
I just saw one on the road yesterday here in Chino Hills California, and I was astonished at how incredibly worse the thing it looks in person than in the promo photos. I was pretty ambivalent about this truck before seeing one in person, now it's hard to imagine how anyone thought this was going to turn out well.

The back tailgate is just an enormous grey not-quite-flat slab that looks exactly like a commercial kitchen dishwasher door that someone clicked on in a CAD program and stretched to truck size.

And the stainless steel panels overall, despite being nearly brand new already looked like they had a bunch of fingerprint streaks or some sort of surface discoloration in a number of places, that really detracted from what was, I expect, an intended effect of clean severity. All the proportions read as very ungainly with the weight gathered in awkward visual masses, at least when seen up close from eye level. The panels already displayed just the slightest bit of imperfect matching between adjacent coplanar surfaces. I can't imagine how rough the thing is going to look in two or three years.

I would take a rivian over two of these things any day of the week, even if it does look like Bomberman.
Tcl had it for years
I don't know what point you think you're making. In a democratic (not necessarily a Democracy of which the US is not) country, people are allowed to disagree with each other, and they do. That doesn't change the fact that our laws are absolutely based on equal protection and equal treatment.
> But if China fails like Samsung, they're at no strategic disadvantage at all and the US technology embargo will have effectively failed to do anything.

China is in no position of "failing like Samsung", right now. At most, they may fail like Samsung did five years ago.

It would also mean that the sanctions worked.
Yep, prototype exactly that this past week. With a strong instruction spec prompt from the start, you can have an AI come up with a much better answer by making sure it knows it has time to answer the questions and how it should approach the problem in stages.

The great part is with clear enough directions it also knows how to evaluate whether its done or not.
I wonder if superintelligent AI will discover a tactic that works the same way on humans.
Embeddings can be tricky. They are just an average semantic vector over a chunk of text.

There is a high chance that a plain similarity search (dot product or cosine distance) will bring a lot of noise and junk into the request. And high noise/signal ratio in the context tends to lead to hallucinations.
I would hope it was blatantly obvious that was exactly what he is doing. It doesn't require any particular skill to decipher that he's engaging in blameshifting, he's flatly stating it.
Why would they disable crash reporting for security reasons (which might actually help solve the root cause of their availability problem, which they never did solve)... yet run Grammarly (which I'd guess, security-wise, is less trustworthy than Google, in how they secure data themselves once they've inevitably stolen it from the customer)?
Disagree, and I say this as a technical founder with no cofounder. Once things start to take off, a majority of the things you deal with are non-technical. There’s so much that goes into building a company, and you really need someone who understands how businesses work and can run G2M.

Sure, you can hire for it… but you’ll almost never find someone as invested in it as the founder, and it’s just as important as the product.
ESP32 has no display hardware even if it is more powerful than many computers of the 80’s those did come with dedicated graphics/display cards.

Modern display signaling takes a lot of compute power simply due to the sheer complexity of it and even emulating something like VGA over I/O pins would eat most of not all the compute power available on an MCU.

So you’re essentially stuck with a terminal over the network with an ESP which if you again make graphical would cost more in rendering and stream compression than there is compute so you’re stuck with text based terminals.
all text ever written has only ever had meaning imbued by the reader (including this text).
If you were to serve this on a datacenter server, is the client to server roundtrip networking the slowest part of the inference? Curious if it would be faster to run this cloud GPUs on better hardware but farther compute, or locally with worse hardware.
Except... you can recharge a lithium-ion battery many, many times before you have to replace it. You get to use gasoline one time.

The absolute best efficiency of a gasoline engine is somewhere around 40% efficiency, with most being a lot lower. So your 48MJ number is a lot closer to ~19MJ. So, assuming you can recharge a lithium battery 100 times (most are going to be capable of many times that), you're break even in terms of 'efficiency' of Li-Ion vs. gas.

Even adding in all the additional costs of product, transport, energy generation costs, etc etc, lithium-ion batteries are still better.
One obvious use case is that it makes per-token generation much cheaper.
Are news articles considered intellectual property, like books? If so, wouldn't it already be considered piracy for Google to copy and redistribute significant portions of the articles? If so - and if this law is not actually a "link tax" like you claim - then what is this law really preventing?
clipboard?

edit: can we just say the company names, this site is anonymous lmao
Depends on the stage of the startup lifecycle you're at.

But in general, reaching profitability (which is the real hard part) will require making scaling efficient and operations smooth.
here's an idea - UTC everywhere
What I mean is that in Physalia each individual in the floating city is still a clone of the other members of the colony. All members of the floating city came from an unique larva. This mean also that each Physalia is either male or female but not both.
> it's the headline and any included blurb/summary/image from the article.

Why would that be a problem? Open Graph was created by Meta exactly so that these news sites have editorial control over those details. And the Canadian news outlets have adopted Open Graph, so that is not an issue. If they don't like what is shown, they have full control to change it. The headline/blurb/image you see is what they have specified. That is what they want you to see.

The real problem is that reporting the news doesn't pay very well anymore and certain news players were on the hunt for a government subsidy to offset that reality.
Mine had, like, zero resemblance to my photo. It looks like a completely different person. Flagging this as a scam and I regret having sent a photo.
Yes, The Invincible is a great book. Actually I've just realized that for me a re-read is overdue!

BTW, for Polish users--there's a comic book [1] that makes a nice gift (tested).

[1] https://www.dobrestronybooki.pl/niezwyciezony/
> There’s about 2000 years of Christian theology that reject the idea that you and your body are strongly bound.

I meant that in the sense that your soul and your body are in some sense matched for one another, not that they cannot be separated. But your soul cannot (or at least typically does not) enter a different body than the one it started out in, at least not during your tenure here on earth.
Yeah, for sure. I think for deployment purposes, many times these model conversions are necessary (such as if you don't want to use Python).

However, I do think these model conversions are often a significant pain for users.

So, in some sense, the goal here is to show that the performance component and the "convert your model for deployment" component can be disentangled.

We also have work on allowing you to "export" an AOT-compiled version of your model with torch.compile, and that should allow you to deploy your models to run in other settings.
Of course, habitability largely relies on radiation from the star hitting the surface. A system like this would mean that the second ring from the star would experience multiple eclipses a day, the third even more and so on. These affect habitability considerably. By the time you're on the outermost ring you'll be cutting the amount of radiation reaching the surface down, I suspect, well below habitability. You can resolve this to some degree with a complex design for tilted orbits, but they'd intersect somewhere, so you're still reducing radiation often enough that you narrow your zone of habitability.

The habitable zone is the zone in which, unobstructed, the area of the disc of a planet receives enough radiation from the star that it is warm. It's all about the surface area of the star and it's luminosity, and the area of the disc of the planet. Anything obscuring direct line of sight between the star and the planet effectively reduces the luminosity of the star from the perspective of the planet.
It doesn't need to be an exclusive choice. Hosted and local models can complement each other.

On one of the projects I used Chat GPT-4 to write instructions/tutorials that were then executed by local model on a large chunk of data (cleaning up product catalogues).

GPT-4 then reviewed some results and fine-tuned the instructions.
How much am I allowed to quote from a book before I'm considered a pirate?
What a cool mystery-solving post! I wish all technology writing were this clear and explanatory.

For another fun debugging tale, google: Mazda radio Seattle NPR bug
I really like the man/woman inversion.

I wonder how many permutations could legibly be generated in a single image with an extended version of the same technique. I don't understand the math, but would two orthogonal transformations in sequence still be an orthogonal transformation and thus work?
In my case, I don't have kids, I don't have a consistent schedule, and I travel enough than a one hour timezone shift isn't something I even notice--the early airport pickup is far more likely to affect my rhythms. My preference is probably year-round DST in the Boston area. (We're basically in the wrong timezone.) But I understand being in sync with the rest of the east coast.

I'd also pretty much be fine with year-round standard time at this point but the time shift just isn't really on my radar.
He Wanted Privacy. His College Gave Him None
Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Models
Facebook thought that the Beaverton was a news org and blocked them. They threatened a defamation lawsuit in retaliation:

https://www.thebeaverton.com/2023/08/read-our-letter-threate...
Thanks for the knowledge share!

MIG does need hardware suppoet, and from what I understand really expensive licensing. I don't know if AMD has a parallel technology.

That is pretty cool that it is vendor agnostic. I've found a few docs from a few years ago talking about stuff like it on Linux, but development of it seems to have stopped or just not progressed at all.

But she is they would use it in Azure, I imagine there they are using enterprise GPUs. But in Andheri scale datacenters it definitely sounds like an advantage!
Short form content?
I was not being naive, as I said above I was expecting the model to be able to move but not to be good. That is why I created an engine to play against, to see how good/bad it is.

My exact entire point was that it would be really surprising that chatgt only knowing chess rules could play at 1400 ELO level.

And I did not give a crap about how to play a single game and was not meant to see how smart HN users are but how chatGPT is, but whatever conclusion a human would take without playing a single game (not trying to move the queeen) is what chatgpt should do, right?

BTW, I simulated few games of the engine against the engine to see what happened and it does not seem as obvious as you say.
How pgroll works under the hood
Cities don't have the same kind of relationship to state governments that states do to the federal government. Legally, cities (apart from charter cities) are just an administrative detail of the state government: they exist solely to further the state government's policy goals and have no independent existence (or democratic mandate) outside that telos. Cities might be able to sue if there's a specific state law being violated like CEQA, but if that's not the case and the cities are just making a generic complaint that the state is overriding their control, the state can tell them to shove it and there's nothing the city can do.
Upvoted. Not an expert myself but I feel that SSL/SSL certificate optimization is a very overlooked performance optimization.
While the conclusion may be on to something (intuitively probably so), a study this short especially as it relates to health with minimal other variables is just dumb.
> There is always room for further breakthroughs

What would one of those breakthroughs hypothetically look like, if it's not an LLM (which is a robust trained model with a complex scoring system)

> So with that in mind, while it isn't a silver bullet which is guaranteed to lead to AGI

Could you give me an example on what AGI looks like/means to you specifically? People say like "oh, once AGI is here, it'll automate some tasks humans do today away and free them up to do other things"

Can you think of a task off the top of your head that is potentially realistically ripe for automation through AGI? I can't.
If you've ever been in the cab of a recent F-150, you'd know that they don't have more interior space than a VW Golf. More practical, sure, but only if the one time per year you haul your boat out to a desert reservoir is worth the countless attempts at parking.

Secondly, battery + motor is actually more efficient than ICE. You might be thinking of power density, which is significantly lower on an EV.

Thirdly, I don't love the pro-car company attitude: people don't have to compromise on low emissions vs. safety vs. practicality. Car companies have forced the choice upon us from a century and billions of dollars of marketing and lobbying.
Surprisingly, no. And part of this is that text generation is really expensive. Unlike traditional ML inference (like with, resnets), you don't just pass your data through your model once. You need to pass it over and over again (once for each token you generate).

So, in practice, a full "text completion request" can often take on the order of seconds, which dwarfs the client <-> server roundtrip.
> There are many terrible products in this world that were successful only because of good sales and marketing. And vice versa.

Name one.
Here is more detail:

http://lists.busybox.net/pipermail/busybox/2010-December/074...
oh wow, I would have never imagined that 'that' would be preventing me from running llama + llava! Confirming that I have Crowdstrike running too.
Probably by placing a small glowing rectangle in their hand.
This reminds me of similar issues I've encountered as a software engineer. I first ran into this issue about a decade ago, albeit not because of Grammerly,but due to some specific gif causing web app to crash. Both times the gifs were animated. Happened years apart and at different companies.

I see some comments highlighting RAM, which could totally have been the issue. Totally looking forward to a follow up to this later down the road, I am sure this isn't going to be the last time we hear of this.
But more work for programmers
Did someone forget to tell Elon that for social media platforms *advertisers are the customer*?

Good luck building that everything app out of pure spite for your real customers.
Must admit, I absolutely agree with your concerns, that it is extremely bad if AGI will be used at war.

I hope, we will end this war before AGI appear.
Somewhat related game: https://store.steampowered.com/app/1533050/Press_Ctrl/
Perhaps you could automate rebuilding the drawers with some IKEA/TaskRabbit APIs.
Firefox for Android is adding support for 400 add-ons