skysight-inc/HackerNews huggingface dataset:
Discrete diffusion with rewriting can work well. It feels loosely similar to backtracking, if you assume n_steps large enough - need to be able to rewrite any non-provided position though I think (not all setups do this). Downside is the noise in discrete diffusion (in simplest case randomizing over all vocabulary space) is pretty harsh and makes things very difficult practically. Don't have an exact reference on the relationship, but feels similar to backtracking type mechanics in my experience. I found things tend to "lock in" quickly once a good path is found, which feels a lot like pathfinding to me.

Some early personal experiments with adding "prefix-style" context by a cross-attention (in the vein of PerceiverAR) seemed like it really helped things along, which would kind of point to search-like behavior as well.

Probably the closest theory I can think of is orderless NADE, which builds on the "all orders" training of https://arxiv.org/abs/1310.1757 , which in my opinion closely relates to BERT and all kinds of other masked language work. There's a lot of other NAR language work I'm skipping here that may be more relevant...

On discrete diffusion:

Continuous diffusion for categorical data shows some promise "walking the boundary" between discrete and continuous diffusion https://arxiv.org/abs/2211.15089 , personally like this direction a lot.

If you have a pre-made embedding space, SSD-LM is a straightforward method https://arxiv.org/abs/2210.17432

SUNDAE worked well for translation https://arxiv.org/abs/2112.06749 and many other tasks.

My own contribution, SUNMASK, worked reasonably well for symbolic music/small datasets (https://openreview.net/forum?id=GIZlheqznkT), but really struggled with anything text or moderately large vocabulary, maybe due to training/compute/arch issues. Personally think large vocabulary discrete diffusion (thinking of the huge vocabs in modern universal LM work) will continue to be a challenge.

Decoding strategies:

As a general aside, I still don't understand how many of the large generative tools aren't exposing more decoding strategies, or hooks to implement them. Beam search with stochastic/diverse group objectives, per-step temperature/top-k/top-p, hooks for things like COLD decoding https://arxiv.org/abs/2202.11705, minimum Bayes risk https://medium.com/mlearning-ai/mbr-decoding-get-better-resu..., check/correct systems during decode based on simple domain rules and previous outputs, etc.

These kinds of decoding tools have always been a huge boost to model performance for me, and having access to add in these hooks to "big API models" would be really nice... though I guess you would need to limit/lock compute use since a full backtracking search would pretty swiftly crash most systems. Maybe the new "plugins" access from OpenAI will allow some of this.
It's a view library. You'd expect there to be one opinionated way to use it?

> `react new`

This is basically what create-react-app was, but the community came out with better options.
It takes years or decades for 3D to catch up to where the best 2D games were graphically.
I’d wager it’d be even more useless for me to vote for sheriff than president. The sheriff where I live is a populist figure who’s continuously re-elected in power for nearly 20 years at this point. He’s probably going to re-elected till he dies since he has that “celebrity” mentality Americans love.
There's a difference between "does Code Jam help attract quality candidates to Google" and "does participating in Code Jam help a candidate in getting a job at Google". Presumably, Google cares about the former, and participants care about the latter. Both statements can be true or false to various extents regardless of each other.
Most of those pigs are, by western standards, inedible. With the exception of the very young adults (and the piglets), their meat is tough and has a very objectionable gamer/musty/garbage-y flavor.

Texas is contending with a similar problem, and if Texans can’t find a way to eat them, you know that meat is worthless.
Here's the thing:

Plants don't really give a shit. Implementing a convoluted tech solution in greenhouses for an additional 5% efficiency will never pay back for itself.

> (My bias: I work for a startup that is working on this and I'm kind of obsessed with the industry.)

I suggest you actually learn more about growing plants than optimizing 20 different atmospheric and HVAC parameters. Many of these recent startups folded because they couldn't figure out that growing lettuce indoors hydroponically doesn't actually make anyone any money.
Scene analysis in photos, image captions, and machine translations are also done using ANE. CoreML also utilizes it when possible.
Self help genre nerd snipes a lot of otherwise intelligent people. It is a bottomless pit.

Vaguely useful is reading biographies of interesting people/companies like John Carmack or the Chucky Cheese dude, and so on. Gives you a bit of color on their experience, look at that crazy journey, sounds wild, I want to have a life like that..

Think of it like Harvard business case reviews but without the just-so tea-leaves retroactive nonsense - that path is for consultants. A mind is a terrible thing to waste.

If you have a cool idea just chase it down and see what happens, figure out the rest as you go. :)
No part of the bill requires actually securing software, or, like, running scans, or fixing vulns, or anything like that. It's a weird jobs program and mostly just adds bureaucracy.
Factorio as a game is basically software improvement/maintenance as a game.
> I’m torn on the “writing for robots.” On one hand you’re writing a blog for the internet and people/robots are free to do what they want with that info.

Yep. This is true. I wasn’t meaning it in the sense of blocking robots. More of a practical sense, if traffic continues falling and the only traffic you see is robots, in effect you are writing for robots. And that’s when the rewards you outlined no longer apply.

I hope that Bing and ChatGPT can further the work to cite sources. That will go some way towards helping the situation I believe.
No, sorry, that was private project.
The likely best solution to the 2-party system is a change to balloting from single-choice to something like approval voting (check any number of candidates you could live with) or ranked-choice/instant run-off (number candidates by preference).

If I were king, I’d do away with party primaries completely. Run a jungle primary with all candidates on a single ballot. Ranked choice to pick the top 4-5 for the general. Then ranked choice in the general to select the winner. Something like that.

I’d also ditch the EC for direct election of the president. And legislate the size of a House district be derived from the smallest state population. This adds hundreds of members to the House, and brings voting parity back to CA and TX (who currently have districts substantially larger than Wyoming’s single seat.
Several actually. I've posted this before, but I've had issues with their security people essentially stalking me after I made some negative comments here awhile ago. It seems most of those people have been fired or have resigned after all the bad press, but for awhile their security team was pretty far right.
>The characterization that IP law is only intended to spur creative activity is incorrect. It was designed to balance the interests of the creator with those of society.

I will just note that characterization is a very American one, and that different cultures have different characterizations.
Hypothesis: it’s not being copied because it connects users to more users, instead of connecting users to brands.
I agree. I've grown to really love Go the more I've used it and gotten the chance to compare it to other languages. There's a certain "completeness" and philosophical consistency to it that's really hard to find in other languages these days imo (some older languages, like Standard ML, C, Scheme, and some others also achieve this) because I think a lot of language designs now evolve more organically instead of being formally thought out up front.
Some versions of divinity (both from real-world beliefs and sci-fi/fantasy) have it being essentially a gestalt of either all the souls that have ever died, or all those alive now—a kind of "oversoul" or collective consciousness.

While that's an interesting thought experiment, I don't think it can meaningfully apply to any kind of AI we have the capability to make today, even if we could hook it up directly to all our knowledge. Information alone can't make something sentient; it requires a sufficiently complex and sophisticated information processing system, one that can reason about its knowledge and itself.
I have a soft spot for Civ 3. I actually installed Windows to play that one.

I was playing as America one time, I tend to be quiet and keep myself to myself, enough army to defend but no interest in going to war.

However along came oil, which I needed for modern units. And I didn't have any. But a nearby civ did. I was left with no choice but to invade and secure the resources.
To be clear here, the government's only business in my example scheme is investigating the crime of say, Facebook, of allowing an 8-year-old to register.

I wouldn't suggest empowering the government to compel Facebook to hand over the ID of said person so that they can be prosecuted for saying mean things about the President or whatever.

As it stands today if the government is mad about something a user posts they already have the power to demand that person's IP so they can pursue them in meatspace.
Here is the proposed legislation

text: https://www.congress.gov/bill/117th-congress/senate-bill/491...

pdf: https://www.congress.gov/117/bills/s4913/BILLS-117s4913rs.pd...
maybe https://github.com/apple/ml-ane-transformers
Does Duo on Apple Watch not make you unlock your phone? On Android it seems to refuse to allow you to approve access via Watch without unlocking the phone, and if I have to reach for my phone anyway, I don’t really benefit from trying to approve it from my watch.
And Charlie Munger (99) is still somehow doing press junkets.
For me, C-like languages like Golang don't come close to be as minimal as lisp-like languages. I agree that the standard library of Golang is smaller compared to it's contemporaries, but the language itself is not small, there is a bunch of syntax to be learned compared to languages like Clojure, where the actual language is tiny, and the standard library on the bigger side.
If you want me to not use cloudflare you're going to have to provide a solution to the fact that a DDOS falls on my responsibility.

I can't host a website for my home internet without the risk of getting black holed.

Can't ask the website for my home internet because Comcast won't let me.

Providers will charge you out the ass for bandwidth if someone ddoses you.

The internet just isn't a sustainable place for self run websites now,
Because they don't care at all about progressive politics and their mouth just says what the most vocal people want to hear. It's all just woke washing.
Most things in life aren’t mathematical objects and therefore don’t have perfect theoretical models anyway. For example, what is a “chair”?
> - I'm trying to remember a 90s movie about a boy prodigy that goes to an event with other prodigies and then shouts out an answer to a math question from the audience.

I love that movie! I had the same experience a few years ago of trying to remember its name.

This is a great example of something ChatGPT does amazingly well at. I did almost the same thing myself recently, trying to find the name of a show featuring an actor in a different show or something. A straight-up search returns nothing for it; you have to look up the actor's name, then look at his shows, then try to remember the name. But a search with ChatGPT found the result easily.

I tried a "similar" thing now. I was thinking of the movie Gifted, and wanted to see if I could get ChatGPT to pick it up, here's my query:

> I'm trying to remember the name of a movie about a child, featuring an actor that was in a marvel movie.

And the result:

> There are many movies featuring actors who have appeared in Marvel films, so it's a bit difficult to pinpoint the exact movie you're thinking of without more information. However, one possibility could be "Gifted" (2017), starring Chris Evans, who is well-known for playing Captain America in the Marvel Cinematic Universe. In "Gifted," Evans plays the role of a man raising his young niece, who turns out to be a child prodigy. If you could provide more details about the plot or other actors, I'd be happy to help narrow down the list further.

This is obviously a tiny use case, and really not worth thinking about. Who cares, right? I thought the same thing about search in general 20 years ago, and that turned into one of the biggest businesses of all time.

This is the search that I did that made me the most afraid for Google.
I still don't understand what the supposed value add of Docker Desktop really was for developers who just needed to run Linux Docker containers (I know there was some value for those needing Windows or Mac containers probably). A nice UI?

At my company, we all had to uninstall Docker Desktop while they sorted out licensing and billing or whatever.

While that was happening, everyone just switched to using Docker in WSL, almost overnight. For me the setup involved changing some settings in my IDE so that it used WSL, it was one drop-down in IntelliJ. I also used VS Code and that was even easier.

The whole thing was very puzzling for me and thousands of other engineers. Many business decisions Docker makes are puzzling. But it seems to be working out for them.
My dad told me it was just one.
Thanks for sharing.

> Basically, I’ve never thought about doing something because the idea itself is what’s carrying me.

On the opposite spectrum, I don't think I can do something unless the idea itself is what’s carrying me.
My 3yo used to say to me "No phone daddy!"

I gave up having a smart phone last year. Has made my life better. Highly recommend.
I remember this fondly. Too bad they took it out.
Boghossian is a professional contrarian who used half-baked academic hoaxes in conjunction with well-known racists like Stefan Molyneaux.
Judges here to apply the law made by the legislators. That's the basis of the separation of powers. If it wasn't the case we wouldn't have a legislation in the first place turning judges into oligarchs.

The way people are supposed to support better laws is by electing better legislators. Easier said than done I admit, but I think that's better than giving judges power beyond their role.
> The current law is broken

I think many agree that copyright needs to be shortened, but what does “broken” mean, exactly?

I have good feelings for the Internet Archive, but in this case it’s about a handful of books that are being copied and distributed a mere 5 years after initial publication, which I think a lot of people who want copyright shortened would still agree is quite a bit too short. Books frequently get popular long after initial publication, they’re not anything like blockbuster movies that make most of their income in a few weeks (which used to be true before streaming but might not even be true anymore).

Keep in mind that this isn’t about the Internet Archive specifically. If the court ruled it’s okay for them to copy and rent books, then anyone can copy and rent books, it undermines the entire market for books (and also web sites and images and other media, because this is the Internet Archive). Think about what it means for the company you work for, or the creative works you or your artist friends create, if people can copy their things legally and take away their revenue streams after only 5 years.

I wonder why the Internet Archive doesn’t keep things unpublished on their site until it’s not generally available online, this would keep them clear of the most obvious copyright violations.
> [The] reality is still that outside of the Prairie Provinces of Alberta, Saskatchewan, and Manitoba, there are no meaningful opportunities to hunt wild pigs, which is not allowed in Ontario and Quebec

In the southern United States it’s open season on wild pigs to keep the population under control.

In at least Texas, you can take a machine gun mounted to a helicopter to go hog hunting: https://www.helibacon.com/texas-helicopter-hog-hunting/

This article is light on the risks of an unchecked feral pig population. Pigs are dangerous. They’re mean, dirty, and can wreak havoc in ecosystems. Coming across a feral pig is dangerous, and they travel in squadrons so it’s likely you’ll cross a handful at a time. Unlike most animals that will leave humans alone unless they have reason, feral pigs will pick a fight.

That these researchers are saying the pigs are pushing into human settlements is cause for concern.
Where's the centralization concern? Libgen sites can just switch to non-Cloudflare IPFS gateways. I don't see how this move causes any harm. Cloudflare's decision impacts nothing, precisely because IPFS is decentralized.
Poor guy considering the obesity epidemic.
With the new ChatGPT Plugins, it seems they may actually be able to make POST requests to social media APIs soon. It is likely that an LLM could have "I should post a tweet about this" in its training data.

Granted... currently it is likely humans that have written the code that the new Plugins are allowed to call -- but they have given ChatGPT the ability to execute rudimentary Python scrips and even ffmpeg so I think it is only a matter of time before one outputs a Tweet written by its own code.
> The mechanism is entirely concerned with retaining semantic context and semantic "global dependencies" spanning the entire input and output.

This is not quite true: GPT, specifically, is auto-regressive. It computes things only looking back, not forward.

Given that each token has only a fixed computing budget, it is likely that GPT precomputes information which will be relevant to later tokens, to be routed via attention.

In fact, this effect was demonstrated in practice: e.g. in a prompt like "Question: Where is the Eiffel tower located? Answer: " people found that information about "Paris" is routed from tokens "Eiffel tower", i.e. this associative memory was looked up earlier than it was needed.

So I was answering from that perspective: it can do better if it knows what to pre-compute.
Your example exposes an edge of Go that speaks to this essay.

Yes io.Copy works with any Reader and Writer but dig into the documentation and there's a runtime check for the revised ReaderFrom and WriterTo interfaces that you might also implement for faster performance. It's just something you have to know, otherwise you will not get an optimal copy.

Go 1 is right on the edge of being a big language, but what might stop it is that Google don't need it to get any bigger.
In Texas we trap them, blow them up, shoot them from helicopters, and shoot them from quads while chasing them at 50mph. They're too smart to shoot them from a standing position.

I've seen packs of 15-20 running along together while riding my motorcycle along county roads in the middle of nowhere, San Saba County. But they normally stay out of sight; they're super smart.

Good luck.
I've been running my own website since the early 2000s and while there have been occasional issues I've never felt the need to use cloudflare.
But isn't that true of most any game meat?

I've heard that bear meat can be tough and grisly, but I was told it depends on how you butcher it.
Current Googler for close to a decade.

Another big problem is that the current leadership formed their leadership skills in history's longest bull run (2009-2020), and none of them seem to know how to be scrappy and get stuff done. Our engineering leadership loves to just sit around and pontificate about theoreticals. Without blinking an eye they'll happily block projects for months on end over minutiae that don't matter. Often even simple features would languish in design reviews for 6-12 months. A lot of my job is "driving for alignment" between dozens of stakeholders on any given project, often at the request of our eng leaders. There is an incredible amount of bureaucracy to get anything done. People who don't leap through every hoop get labeled as having "not enough technical rigor".

Our product team has begun to wisen up on how we need to start shipping more things. Currently a lot of the eng teams are caught between our eng leaders who move at the rate as molasses, and product teams who are pushing us to actually get things done. It'll be interesting to see who wins here.
Really, I thought it was more of a US phenomenon.
Just asked this one to chatgpt 4.0:

The information provided seems to be incorrect. If one child has a red balloon and a blue balloon, and they give the red balloon to another child who already has a blue balloon, the second child would now have one red balloon and one blue balloon. The first child would be left with just the blue balloon.
>China's constitution protects free speech. Rendering many 'laws' unconstitutional.

China's constitution is interesting, as it grants both rights and obligations on citizens, such as the obligation to observe public order and respect social morality.

http://www.npc.gov.cn/englishnpc/constitution2019/201911/1f6...
There will always be new programs that matter; they matter because they are new.
As far as fossil-fuel-free steel goes, this technology is a competitor to direct hydrogen reduction. A side-by-side comparison would be interesting (i.e. is it cheaper to use electricity to make hydrogen to feed into DHR, or just use the electricity directly in this manner?):

https://industrydecarbonization.com/news/the-path-to-green-s...
A segment of HN is allergic to humor. Real Jabronis/Giambones.
The prompt can make a big difference. For example:

<Start prompt>
"When deploying into the enterprise, there is a lot of flexibility when it comes to deciding how you structure the deployment, whether you want to run supporting services on premise, and which ones (if any) you choose to deploy. The decisions depend on how you plan to use our software and your security requirements. We’ll be happy to discuss these with you at [email]."

I rewrote the above. The recipient read the new version much more easily than they would have for the original:
<End prompt>

When deploying our software into the enterprise, there are many options to consider. Depending on how you plan to use our software and your security requirements, you can decide which supporting services to run on-premise. If you have any questions, please don't hesitate to reach out to us at [email].
Sure, but “one namespace per file” is a much more obvious idea than “one class per file” (especially with C# IDEs aggressively tying namespaces to the filesystem layout).
Sad? Are you expecting lectures from economists? I’m sure you can find that somewhere, but I would expect podcast from a major media outlet to sim to be more accessible. There’s a lot of complex economics involved and I think they do a good job of explaining it in a layman’s terms.
It's not public, it's regulated commons.[1]

1. https://plato.stanford.edu/entries/property/
It's absolutely a tradeoff requireing a cost-benefit analysis.

Prior to Java 5, the language was quite simple, the spec readable and understandable without requiring deep knowledge of compilers.

The introduction of generics and lambdas massively complicated the language specification. But those features also were huge improvements that pretty much anyone would consider worth the cost.
Thank you! Been searching for a tool like this. It needs to be a browser extension to be more awesome.