skysight-inc/HackerNews huggingface dataset:
Oh, I thought it was a reference to the oysters from New York being claimed by the British.
My non-English-speaking first-gen immigrant grandma that assembled rice cookers in factories back in her day figured slide down for notifications, right slide down for control panel, and slide up on day 4.

My mom didn’t ask about it until after the first year.

So to answer your question… maybe it doesn’t take to be the top 1% of something.
Right, I get the goal of removing the outlier activations, but I just don't understand why outlier activations are a consequence of the model trying to "pass". The story from the linked paper earlier in the post (https://arxiv.org/pdf/2306.12929.pdf) is that the model is doing the following:

-Learn a near-zero representation for some otherwise low-importance token, like delimiters or whitespace.

-When a head wants to "pass", emit an outlier activation to attend to that token nearly-exclusively.

But I'm surprised the model can't just use its existing tools (the post-concat projection layer and the following MLP block) to achieve the same thing. And if the answer is that it could do that, but tends to learn to use the outlier activation trick instead, will giving it a new tool that still allows the use of outlier activations be sufficient?
Just pouring one out for my twittr
I really wish I understood how I estimate the effects of performance improvements to code. (I also wish I could estimate stories the way I estimate changes).

Where businesses often seem to fall down is that, if they round-trip lessons from capacity planning to the business strategy, they sure don't look like it. They don't talk about it, and they make decisions that don't align with the capacity planning numbers.

If you know the cost of 1000 new customers is $M of new hardware, and revenue from the new customers is $N, then if you spend more than $(N-M) on acquiring the customers you're digging a hole, and the more successful you are the faster you dig. And then there's the grey area where you actually make money, but so little that any other initiative would have been a better use of your time.
> MiFi support down the road will be unlikely to solve the issue since without bundled controllers, the market size for games that require them won’t be big enough to justify making them & vice versa… unless each studio does something like Guitar Hero & releases their own peripheral & bundles it together with their game

Yeah, you're already talking about the most expensive headset, nevermind that added cost for controllers. With this price tag you're going to be talking about a tiny installed base.

If it's easy enough to port stuff... and the controller ecosystem develops... well, sure, I guess this thing could find its niche. From an ROI perspective though it can't possibly be the primary target for game developers, which means it gets ports... and with ports to niche platforms there's always the risk of low quality / jank, which would only hurt the brand.
As someone who is a non-user and a bystander watching all this twitter stuff -- I got two words "yikes... yikes"
But if the source can't get the title right in a clean and objective sort or way, isn't that a signal for "there's got to be a better source"? For example, how many times have we've seen a click-bait-y title followed by content or narrative reflective of that mindset?
Thanks for giving it a shot! If you go to the account menu (upper right) > Export, you can export your data as JSON.

The sim uses cost basis as how much of the existing $ in there represents your contributions (as opposed to gains), which is useful to know b/c your contributions to a Roth IRA can be withdrawn tax-free and penalty-free. You should see a corresponding category for that in Plan Settings > Drawdown as well.
Presumably the analogy is between an addictive substance (alcohol) and an addictive behavior (overspending on credit). Each can be used responsibly or not.
Is there an option to add Non-Publicly Traded Securities?
Are you equating engaging with internet nonsense to changing the world?

Helping vaccinate the 3rd world and fund the WHO, I can see a changing the world. Ranting on the internet 24/7, not so much.
All of that is fine and good if we were talking about servers that were made for 100-200 people. This is not the case. When we are talking about servers that are house as many people as a large village, we are way past the realm of "community".

> human social structures don't endure like friendships do

IOW, the donation-based instances are not sustainable. If you want to have a service that you can rely on, you will need to resort to a professional service.
I had it reappear 3 times when I was trying it out moving between pages. First time was before I created an account though in the sandbox. Not sure exactly the replication steps for the second and third time it showed up.
We achieved SOC2 Type 1 in record time and you can too
Is there one to replace its CEO?
> Because until he tries it, who knows if it works?

That's precisely what he shared this for, though. So someone willing to train a model with this tweak tries it.
Hell. Is that amount of global correlation even possible? What if I route through 7 countries? Surely the data of every single ISP on earth cannot be collected in the hands of a single entity?

Btw I2P provides imho decent amount of protection for timing and packet sniffing attacks.
Some people are visual learners. Some people are auditory learners.
Assuming their hand tracking is super fast (no noticable latency over controllers like on the quest), the biggest loss to not having controllers is haptic feedback. I can see haptic feedback being useful even in non-gaming situations, feeling buttons is better than not feeling buttons.
Can someone share a good tutorial how to prepare the data? And for fine tuning, does a 3090 have enough VRAM? I want to do what the author mentioned by fine tuning the model on my personal data but I’m not sure how to prepare the data. I tried using vector search + LLM but I find the results very subpar when using a local LLM.
https://qdrant.tech/benchmarks/
Love people implying their beliefs are empirical by arbitrarily assigning percentage values.
> It seems like, when you have something of substance to say, you say it.

And this blog post probably could be condensed into 1/4 of its size or less with a less conversational/bloggy tone.
Some people think you need "the ability to execute arbitrary code in an unprivileged context" to perform this exploit. Which is of course a false assumption. The bug class in this case is basically a user-after-free, for a function which keeps its state per-cpu-core, for a function that is (for almost all intents and purposes) unprivileged.

From the article:

We now know that basic operations like strlen, memcpy and strcmp will use the vector registers -
so we can effectively spy on those operations happening anywhere on the system! It doesn’t matter
if they’re happening in other virtual machines, sandboxes, containers, processes, whatever!

All you need to do is write some JavaScript that will "trigger something called the XMM Register Merge Optimization2, followed by a register rename and a mispredicted vzeroupper". It's up to the hacker to determine how to do this explicitly in JS, but it's theoretically possible by literally any application at any time on any operating system. Even if some language or interpreter claims to prevent it, it's possible to find an exploit in that particular language/interpreter/etc to get it to happen.

This is how exploit development works; if you can't go straight ahead, go sideways. I guarantee you that someone will find a way, if they haven't yet.
The USG isn't setting out to make money on major ventures. Publicly traded companies are.
I am also concerned about existential threats from AI, but part of the problem is that I have no idea which research directions help and which ones hurt.
Parking, toll roads, tabs, gasoline, insurance, interest payments, maintenance, depreciation will all happily run up to that amount for a new car, and to $6,000 for an old car.

The IRS mileage deductible rate is 65 cents/mile, and it's pretty close to operational cost of a vehicle. Parking and tolls and 10,000 miles a year will easily get you to these numbers.

Some call this freedom, but I call this a financial millstone around your neck.

-----

(Not to mention the mountains of public[1] and private money that get spent on automobile infrastructure, parking offsets, etc, etc.)

[1] Most of which comes from the general tax fund...
Gentoo already has it, however the latest ebuild is still masked, so one would need to put "sys-kernel/linux-firmware ~amd64" inside a file in /etc/portage/package.accept_keywords, or better yet, always run the git version, using * instead of ~amd64.

Apart from that, it's necessary to "sudo emaint sync -A && sudo emerge -av sys-kernel/linux-firmware", while checking that the correct files are included in the savedconfig file if using it. After that, rebuild the kernel or the initramfs and reboot.
I was involved in an IBM mainframe to RS/6000 migration in the mid 1990s for a major aerospace company. We moved the engineering functionality to a client/server system, including many custom programs and CAD/CAM/CAE.

Like the article mentioned, migration was a Herculean task done over a period of years, with a good chance it wouldn't succeed. I worked many 70 hour weeks, I had to drive to the factory at 2AM some days to monitor jobs because only certain people had remote access. Floating point and text encoding was different between the systems, decades of legacy engineering and manufacturing data and code (having cost hundreds of millions of dollars to produce) had to be translated and verified. There was a rivalry with the mainframe group who wanted it to see it fail, reluctant programmers, engineers, and line workers. On and on and on...we had to apply start-up levels of creativity and ingenuity while working in an MegaAeroCorp bureaucratic atmosphere.

Ultimately, the project was a success, although the system soon moved to PC-based desktops as graphics cards became more powerful. I got a company award from my internal engineering customers. Shortly after the dust settled, I got called into a secretive meeting with my boss and the department head, expecting a promotion and a raise, or at least an "Attaboy!" No, I was reprimanded by an HR rep with a formal note in my records about my attitude ("You risked everything by cowboying!"). I was admonished for having the gall to take a couple of sick days during the ordeal (my coworkers were concerned when they found me passed out at my workstation, my boss warned me after my time-off "If you are sick be sick" and called me a filthy name.) I was put on double secret probation.

Our whole department was eventually outsourced, and I ended my tenure there by being escorted by security to the door and told not to let it hit me in the backside. I guess I should have joined the mainframe group on the business side, in retrospect, they are still around grinding out profit statements. It was a challenge to get rid of a mainframe, maybe more so than eliminating our entire engineering support team.
Is it possible those large tax returns are a result of not having any tax withholding configured on your income sources?
In the future/present there might even be complete "DeekFake AI" girlfriends where you can go to your highschool/college crush instagram page that you never talked to, download all her ig photos and use it to generate the model.

Wonder how this till play into topics like copyright/revenge porn etc. blackmirror stuff.
Also on codepoints.net:

https://codepoints.net/U+1D54F
What “PII” has risk of theft?

Passwords should be properly hashed. Heck, just delete the password and let the user ask for another if need be.

If there is ANY unnecessary data that was collected but that doesn’t need to be there, or that needs consent to be stored, just delete it. Easy peasy.

List of games owned? Email address? That doesn’t need consent, because it’s legitimate interest. It is 100% in the customer’s interest to have game ownership information long term, and deleting it would cause actual loss to the customer. That’s probably as bad as having PII leak!

And what's that “cost of maintaining accounts”? Less than a kb of data per customer, on average? Probably just a few database tables?

Once again, if there's unnecessary PII, just delete it.

This whole thing is just to force customers to re-purchase games.

> In real world nearly everything has an expiry date, beyond which product is no longer usable

That’s clearly not true. There are several products that don’t have it.

But in the case of games/software it is worse, because the expiration date is 100% artificial: since the games need authorization servers to run, the expiration is under control of the company.
Personally, I think the "spend time with loved ones and donate money" approach is the far preferable wealthy lifestyle over the "narcissistic egomaniac constantly talking about how theyre 'changing the world for the better' while mostly just being an asshole" approach.
1. Summary

The author is suggesting that we add 1 to the denominator of the softmax that is used within attention mechanisms (not the final output softmax).

The softmax inside an attention unit allows it to see key/query matches as probabilities; those probabilities support a continuous-valued version of a key-value lookup (instead of 1/0 output of a lookup, we get weights where a high weight = the desired key-value lookup).

Adding 1 to the denominator would change an attention unit by no longer working with a true probability vector of weights, but rather working with weights that add up to less than 1. The motivation is that the network can learn to provide high weights so that the adjusted softmax is very close to a probability vector; and it has a new option to provide all-low weights which give all-low output weights, meaning it can opt out of having high confidence in anything.

(switching to opinion mode)

2. How can we tell if this is good?

2a. We should just try it out: Train an LLM with this, see if it works.

2b. There are two reasons I suspect it won't make a big difference.

First, if an attention node has low confidence, it can already assign similar scores pre-softmax. Then we get what looks like a uniform distribution as output. Then we're basically taking an average of a bunch of vectors (vs a weighted average that is more like choosing one of them). Statistically, we expect that averaged vector to be close to zero. In other words, the node already has a way to effectively opt-out by providing a near-zero output vector.

Second, in a transformer, each attention unit has many other learned weights that can support the ability to opt out. Both the V matrix and the feed-forward layer after the attention unit give that module a way to provide low values to the activation function after the feed-forward layer, which would result in a value as small as you like — again, a way to opt out.

3. I appreciate the non-academic tone of the article and the willingness to play around with fundamental ideas. Although I'm not totally convinced by the note, I'd love to read more stuff like this.
The worst thing that ever happened to Twitter is Elon Musk
Feeling the need to cite a particular work out of convention or for social reasons is understandable and very common AFAIK, but I'd consider it a part of academic rigour to at least take look at the work one is citing. Blindly citing without ever even laying one's eyes on the work doesn't sound quite right.

Of course if nobody can get their hands on a particular work, as seems to be the case here, that makes things kind of hard. But I'd expect most works you need to cite in a fast-moving field such as CS to be available at least somewhere, even if it takes a bit of effort.
I used Amazon Polly (text to speech engine) on a project a few years ago - the “neural” voices were decent. I’ve since heard much better synthetic voice engines, but don’t know names. What’s the best quality one you have found recently?
I think what you're describing is very similar to the Diderot effect [1], which has been discussed in here several times (I'm too lazy to search for those threads, but that's how myself have learned about it):

> The Diderot Effect is a phenomenon that occurs when acquiring a new possession leads to a spiral of consumption that results in the acquisition of even more possessions. In other words, it means that buying something new can cause a chain reaction of buying more and more things because the new item makes one feel like one needs other things to go with it or to keep up with it. This can lead to overspending and accumulating more possessions than one actually needs or uses.

[1] https://en.wikipedia.org/wiki/Diderot_effect
Does anyone have an approximation of the brand value of Twitter, the bird icon, and "tweets" "retweet"? Those things have 90+% name recognition.

I would be surprised if this wasn't in the billions of dollars.

And all discarded...
Literally just RSS.
> one of the worst douchebags to ever grace our planet

Cool your jets, man!

Musk has done plenty of good, for the country and the world. I can think of plenty, plenty others who have accomplished nothing but feel entitled to run other peoples' lives.
To be honest, I'm not even particularly impressed by the claim that the only mathematical universes that can exist are the self-consistent ones. I think that is mostly stipulated in these theories for post hoc reasons. So some of them aren't consistent... so what? Do the consistency police come along and strip you of your "existence"? How? Why? We humans use inconsistent logics all the time. When confronted by inconsistencies we often just fix them up, either with some other logic or just plain ad hoc new rules. Inconsistent universes can similarly each be rescued by an infinite number of "fixups", up to and including uncountably infinite functions that simply brute force resolve the inconsistencies. This renders the term "inconsistent" meaningless in this context because rather than an inconsistent universe not being able to "exist" it instead represents some infinite class of existing universes with some fixups applied.

The main problem I have with this line of argumentation is that in its zeal to explain why anything exists, it actually goes all the way to the other end of the spectrum and can't explain why anything doesn't exist. But clearly there are things that don't exist, by virtue of the fact that the subjective experience of being in a universe where literally everything exists would be one of total chaos; in any given moment, the countably-infinite possible futures where the next subjective instant is "reasonable" to you is dwarfed by the uncountably infinite possible futures that contain an embedding of "you" and your next subjective instant is not reasonable to you. (And if you're objecting to my casual assertion that your next instant is at best countably infinite, I'm already erring on the side of giving grace to the argument; I'd personally characterize them as straight-up finite.)

Things exist; some things also don't exist. The mathematical universe hypothesis covers the first at the cost of failing the second. Math isn't parabolas and conic sections and tiny integers getting added together; math is uncountably infinite functions of uncountably infinite structures being mapped to other uncountably infinite structures with no pattern, out of which we carve our little niches that are useful and comprehensible and mistake them as being the rule, rather than than the vanishingly tiny exception. Something isn't just causing things to exist, it is also holding back the incomprehensible chaos of total, undifferentiated existence.

(The fine tuning of the physical universe is a nearly insignificant mystery next to this. How is reality reasonable to any degree at all? Forget the question of life, how does there exist any structure that has a reasonable subjective existence rather than total, utter chaos beyond any capability we have to imagine?)
I certainly wouldn't claim Hemingway was obscure, but I don't see any of those figures undermining my point that the average person in 1926 wouldn't feel the inclination to read him over more digestible stuff (and the Bible) if they read at all.

Sure, the first eight print runs of The Sun Also Rises probably had a total circulation equivalent to the playthrough of some tediously-narrated niche videos on YouTube, and by 1961 when Hemingway was firmly established as a Great American Novelist it had as many copies over more than quarter of a century as Where the Crawdads Sing sells in a quarter, but I don't think you can infer anything much about attention spans from the appeal of literary fiction.
Hung browser tab on Safari iPad.
It is a problem, because if theoretically Musk were to trademark that character (improbable), Unicode would likely be forced to remove that character and break every instance of it across the internet. Not to mention that anybody using that symbol, which already has an established meaning in mathematics, would be infringing on that trademark.
So I think you are running on a false premise here efarrer.

The false premises is that anyone ships bug free code. It can be done but it's stupidly expensive. Formal methods Z proofs, etc.

Unit testing and static typing are 2 different techniques which eliminate bugs.

The question that needs to be answered is which of the 2 techniques is the most effective per developer hour spent.

Unit tests do not caught all the bugs that static typing would catch nor does static typing catch all the bugs unit tests would catch. That's not an useful observation.

Nor is there a moral here that you should be doing both, doing both is expensive and costs $$$.
Probably closer to 1000%. You can get working PCBs of that size for $16/unit from PCBWay: you can probably drive that price down a lot if you don't actually care about the PCBs working. UV printing costs on the order of cents, and PCBs are an especially easy substrate to print on (flat and thin).
That was a gripping read!
It's not like people are reading high quality things though. They are watching tick tock. There is no demand for high quality work. People aren't reading gonzo journalism books, they are eating up soundbites and clickbait and very pleased about it.
An "everything app" sounds a lot like what I understand WeChat to be. Can't say I want it, but it's not without precedent, apparently.
IPv6 standard came out in 1998, and a lot of devices still don't support it.
Litestar v2 brings new features to the production-ready, powerful ASGI framework
*Note*: Starlite was renamed to Litestar. Read more here: https://www.reddit.com/r/Python/comments/129n4dc/renaming_st...

Effortlessly build performant APIs with Litestar, the powerful, lightweight and flexible ASGI framework.

Litestar v2 introduces some great new features, including enhanced websocket support, introduced (distributed) broadcasting via channels, server-sent events support, HTMX, Pydantic v2 (with Pydantic now being completely optional!), and much more.

Come chat with us on Discord: https://discord.gg/MmcwxztmQb or r/Litestar: https://litestarapi.reddit.com!

- Website https://litestar.dev

- Documentation https://docs.litestar.dev/2

- Twitter https://twitter.com/LitestarAPI

- PyPI https://pypi.org/project/litestar/
It's Debian based so allows you to run glibc binaries.
Have they dealt with the lead escaping the encapsulation problem yet?
There's two different ways of looking at the internet.

The greybeards philosophy is how it initially was. There aren't multiple networks, there is supposed to be ONE network, THE internet with ONE global address space.

The philosophy of those who grew up with NAT, who think that sounds insane. The internet is just the glue network between heaps and heaps of separate networks, each with their own, enclosed address space. Why would you want all networks to be one network, why should your printer have a globally-unique globally-routable address?

The two different philosophies don't tend to get along.