skysight-inc/HackerNews huggingface dataset:
You mean "Multiply the vectors by the other vectors. This is attention - it's the magic of transformers, that enables combining information from multiple tokens together. This generates a new matrix."?

It's really oversimplified, as I mentioned. A more granular look is:

- Project the vectors with a linear regression. In decoder-only attention (what we usually use), we project the same vectors twice with different coefficients. We call the first projection queries, and the second keys. This transforms the vectors linearly.
- Find the dot product of each query vector against the key vectors (multiply them)
- (training only) Mask out future vectors, so a token can't look at tokens that come after it
- At this point, you will have a matrix indicating how important each query vector considers each other vector (how important each token considers the other tokens)
- Take the softmax, which both ensures all of the attention values for a vector sum to 1, and penalizes small attention values
- Use the softmax values to get a weighted sum of tokens according to the attention calc.
- This will turn one vector into the weighted sum of the other vectors it considers important.

The goal of this is to incorporate information from multiple tokens into a single representation.
Well if anyone else was still wondering whether WotC is scum on earth...
Ask HN: Registering common .zip domains to help prevent phishing attacks?
Hi HN,

I recently registered the domain bank-statement.zip (and some mistyped variations), not because I plan to use it, but to prevent it from falling into the wrong hands. As some of you may know, .zip is a potentially dangerous TLD, as many chat and email clients will convert it to a clickable link, making it easy for attackers to trick unsuspecting users into downloading malicious files.

That got me thinking: what if we could collectively register common domain names that correspond to common .zip names that ordinary users or parents might get confused about? For example, we could register tax-return.zip, invoice.zip, or receipt.zip, among others. By doing so, we could prevent these domains from being misused for phishing attacks.

Of course, this initiative would require some coordination and funding, but I believe it's a worthwhile effort to protect users from falling victim to phishing scams. What do you think? Would you be interested in participating or supporting this initiative? It would be easy to register many domains as they are about $12. But some famous names will be more expensive beyond what a PhD student on stipend like me can afford.
"Cultural norms" has never, ever gotten in the way of profit.

Companies have been working with offshore talent for decades.
PCH = Packet Clearing House, one of Quad9's founding organizations... and sponsors?

https://www.quad9.net/about/sponsors/

https://en.m.wikipedia.org/wiki/Packet_Clearing_House

https://support.quad9.net/hc/en-us/articles/4422044032781-Qu...

https://www.quad9.net/news/blog/quad9-and-your-data/

May you elaborate what you imply by "with the analytics behind it"?
That would actually already be difficult with the current go tool, since it's more than "just" a compiler but also fetches dependencies. If all dependencies are already in place it won't hit the network, so there are options, but you'd have to find another way to retrieve those.

The telemetry is opt-in,and failing to send them won't fail the compile (it won't even run on every compile). It's not really preventing you from applying your SELinux policy if you want, even if it would have been opt-out.
Love the lo-fi aesthetic of these sites:

https://csrankings.org/
"It's 'open source'"... https://youtu.be/dTRKCXC0JFg?t=6
I wouldn't bet on it. Automatic1111 already has a strong community and growing ecosystem. Stability.ai would have to try really hard and offer something significant to win people over.
> The rich pay significantly less taxes than when America was in its prime.

> The US will only get worse until citizens vote for corporations to pay their historical tax rates

When do you consider America at its prime? Because I guarantee both taxation and government expenditure as a fraction of GDP were less than what they are now.

If you're talking about the Gilded Age in the late 1800s, there literally wasn't an income tax on either people or corporations, and federal spend was single-digit percent of GDP. Yet America accomplished many feats like the construction of the Transcontinental Railroad, and poverty rates fell greatly.

If you're talking about the 80s when the tax rate in the highest income bracket was 70%, the top 1% of income earners actually paid a considerably smaller share of all income tax receipts than they do now. The poverty rate didn't change much between then and now.

> Poverty is the cause.

Sure. But there is no empirical evidence to suggest that more redistributive taxation and bigger government alleviates poverty. The War on Poverty has been about as effective as the War on Drugs or the War on Terror.
Fair points. I agree the wording could be better.

No, the source code is not available. This dataset is a subset of the raw data our system collects. Our final product made available via the API does a variety of processing steps on the raw data (dedupes, joins, ML predictions, etc). The final, processed data is the piece that is proprietary / subject to the terms.

We will update the site terms to reference this dataset, as we aim to continue releasing an updated version each quarter. I'll have to double check with the lawyers, but it will most likely be MIT licensed.
They can, and do.
Yes, but right now for GCP we're only aggregating cost recommendations from Google Recommender.

For AWS on the other hand we're also computing dozens of our own savings opportunities.

In the coming month we'll be adding more GCP opportunities - would be very excited to hear what you'd want prioritized
The Zero and Zero 2 are both coming into stock on almost a daily basis now if you follow rpilocator. Things seem to slowly be getting better.
Nice resource.

Meta question: Can I trust cryptographic schemes that are too clever for me to understand? We're taking things on faith too often already; much simpler things bite us like "the CPU's random number generator works and is actually being used."
I'm not entirely sure I would call it denied. She was supposed to go to prison april 27th [1] and her lawyers have gotten it extended to may 30th [2].

[1]: https://www.courtlistener.com/docket/7185174/1761/united-sta...
[2]: https://www.courtlistener.com/docket/7185174/1761/2/united-s...
Sorry maybe I should have added more explanation. One way to think about attention, which is the main distinguishing element in a transformer, is as an adaptable matrix. A feedforward layer is a matrix with static entries that do not change at inference time (only during training). The attention mechanism offers a way to have adaptable weight matrices at inference time (this is implemented by using three different matrices, K,Q & V called keys query and value in case you want to dig deeper).
Self checkout is fine, but wow do I detest the garbled insanity of a half dozen machines loudly reporting every little change.

There's a huge section of the store that is now cursed by these absurd idiotic monster's incessant bleetings.
“Malverposting”: Facebook Ads Fuel This Evolving Stealer Campaign
I assume you know this already from the way you put the word on scare quotes, but for everyone else: there is no "economy" in a sense that it even can be said to be good or bad. There are only people and transactions (on a spectrum between freely negotiated and forcibly imposed) and the people are either better off or worse off after each transaction. Ideally, everyone involved is better off after a transaction, including bystanders, and no one is coerced into anything, but this standard is not always (or ever?) met.

Anybody who tells you the economy is good or bad is priming you for some other form of propaganda.
The interesting thing is that even this good comment you wrote will become grist for the mill.

ML is very good at classification. We have jailbreaks, but we don't have a lot of "write me racist pornography" prompts, in part because pre or post processing systems classify it correctly.

"Does this user prompt contain prompt injection" may end up being just another classification problem, rather than requiring LLM-text completion on the tokens.

Or not. Maybe? It's going to be an interesting few years.
At the end of the day, it either happens or it doesn’t - and that has pros and cons either way.

You’re correct on the impact to those folks, but there are also a LOT of other folks who benefit from the new rail (or should, anyway!).

At the end of the day, their strategy works for the majority better.

We’re deadlocked trying to not offend anyone (and get scammed by the contractors in the process). They say ‘fuck it’ and pave it over, and then tuck the little people in a closet and tell them to shut up or else.

But if they didn’t, they’d have no rail where they need to go, like…. us.

Eventually, without some compromise or balance, either system reaches a breaking point. Ours, we’ll eventually be so mired in shit not working that people will leave to somewhere different (if they can) wherever it’s really bad. Think NYC/Detroit/LA/etc. in the 70’s and 80’s.

In China, they crack down too hard (or stay too focused on ‘the plan’) that they destroy what they are trying to preserve/create. Either Violently (Russia), or by going broke/financial crisis (Japan).
For some reason the self checkouts I’ve used in California seem much worse than the ones I used in the UK before I moved 10 years ago. There’s also the silly rule that you can’t put beer through the self checkout (in the UK you just had a cashier authorise you) and have to go to the really long non self checkout line instead.
I actually find the string macro syntax even more convenient: `big"1e-300"`.
In my screed, N is the attention width. (How many token it looks at at a time) number of parameters is O(KxNxNxL) where k is the vector size of your tokens, and l is the # of layers. There are other parameters floating around, like in the encoder and decoder matrices, but the NXN matrix dominates.
100%

Movies and TV often sow them as a policing the West in the early days of the US but what they should be known for is as thugs and strike breakers for hire who intimidate and threaten whoever you ask while providing distance and cover.
> I would like an example from within the last, say, 75 years. Regardless, you didn't even cite an example.

From Wikipedia[0]:

"In 2020, Matthew Dolloff, an unlicensed security guard contracted through Pinkerton, shot and killed Lee Keltner, a conservative protestor in Denver, Colorado."

Not exactly kicking down doors and assaulting the residents, I know, but hopefully we can agree that its adjacent.

Of course the premise is that "they get away with it all of the time." If such examples existed, citing them would be contrary to the act of getting away with it. I'm not saying that I know for a fact that the Pinkertons or other such similar organizations "get away with it." But I know the United States has produced numerous examples of police officers getting away with it, and in my mind it's very possible that detective agencies do all manner of reprehensible things, especially to people in poverty, and get away with it.

We're hearing about it in the case of a YouTuber because they have a platform.

0. https://en.wikipedia.org/wiki/Pinkerton_(detective_agency)
Oh, I see. I didn't lower my scumbag bar enough, I guess. Yeah, that's nuts.
Same thing. You need everything to be differentiable in order to run gradient descent. To first approximation, training a neural network is just gradient descent.
Nothing that isn't stories by friends working for securitas (the main company for which pinkerton is a brand), or anecdotes. I am certain I could find a story like that just by googling for it, but real statistics are what are interesting, and I cant be bothered to research it. So let me instead ask, what evidence do you have that they are better than the police? because that is what you are arguing. In general you can become a security guard in a tiny fraction of the time it takes to become a police, and they have much lower requirements compared to becoming a police. Oh and by the way, most of them believe themselves to have the same powers and protections as police, that they do not does not matter much. The real shitheads get pruned pretty quickly, but the middling level assholes instead sometimes get shifted into one of the offbrands.
For tech, I think this is a win-win situation. Tech workers have the options to stay and work in their home country. It is not like tech workers do not have a choice they prefer it this alternative, even given the uncertainty or not having a permanent residency.
> And yet when NASA went to the moon, they had telemetry data.

NASA couldn't obtain that same data locally, they had to know how the vehicle and software behaved in the real situation. NASA's telemetry also ran on their own hardware, not on arbitrary users'.

Contrast that to Go, which is used in real situations internally at Google. They don't need to spy on their users, they have first hand experience using the tool.
I sometimes get this when I'm tired. The solution is not to think about it more, but instead to just have some sleep.
Mounting it right behind an A/C vent might be much better.
At least it's only $99.

Sadly, it's not a shipping product yet. It's a "preorder".
Ask HN: What is your experience with holacracy?
Hey HN! I was wondering if anyone has experienced the organization form called holacracy and can share some insights?

What are pros/cons? Is it snake oil or is it actually useful?
He could have been placated with the cards he ordered some extras or merch.

Hiring security was the more expensive option, in short and long term.
I reviewed the hearing in more details, and I'm now still in the opinion that it's not the same, but now I think that Sam Altman is a huge c** for this regulatory capture BS.

I cancelled my ChatGPT plus membership. I'll be using OSS solutions like Vicuna from now ion.
Differentiable in this context, means that it can be learned by gradient descent, which uses derivatives to adjust a neural network model's parameters to minimise some error measure. As for how that applies to a hash function, I think the lookup gives some sort of weighting for each possible output, for each input, with the largest weightings corresponding to a "match". But tbh I'm not certain on that last part...
> I mostly sit with my noise cancelling headphones on, with no sound. And lately, I'm just moving towards not having them on at all when I'm not in meetings.

I find it very difficult to sit in complete silence. It's as if the silence exerts some pressure on me. But I've recently discovered brown noise and it works wonderfully well for me.

It has become my go to sound/noise whenever I'm doing something that requires thinking.
This is my favorite: https://www.youtube.com/watch?v=P48QELwruQs
Yeah, it's surprising that OpenAI don't put what model it is in the system prompt. I guess the cost would add up, unless they can reuse the kv cache from the system prompt?
I don’t know if the Pinkertons directly...

Then you probably should not have responded to a question specifically asking for an example of Pinkerton kicking down doors. As you've clearly stated that you can't answer the question, but rather prefer to go off on some vaguely related tangent, then I will go on about my day.
Migrating from a legacy orchestration stack to Prefect
I always appreciate seeing demos of how folks go about implementation. I hope this is helpful for anyone looking into setting up Prefect in AWS ECS, or otherwise moving off of a limited legacy orchestration stack!
I don't follow how this affects her ability to run a company post-release. It just affects her ability to get (somewhat) rich from it.
Except for the scenario the parent is talking about:

> It's common that someone starts typing but immediately change their mind and clears the input after only a couple of characters.
that was my thought exactly! I wonder if we're ever going to see a shift toward single-compiled-binary websites, away from increasingly complex deployments that exist solely to facilitate interpreted language stacks.

this is the question driving the framework I'm building—it even has support for simple HTML templates, but they're interpreted, type-checked against the structs that get passed into them, and baked into the executable, all at compile time. this is all coming off of building a website for a client using PHP for the first time in over a decade—on one hand, I appreciate the relative simplicity and ease of deployment compared to modern backend stacks, but on the other hand, it's still an interpreted language, with all the baggage associated with that. I believe it is possible to take the ease of use and speed of iteration of interpreted languages, and the benefits of strongly-typed compiled languages, and get the best of both worlds—at least, for the scale and complexity of website that I want to build and maintain.
I recently switched to Beeper and as exciting as this looks, I wish that the team spent a little bit more time working on their primary app rather than working on what appears to be a toy hardware project.

Beeper is supposed to be a "universal messenger" that acts as a central place for all your messaging apps. I originally signed up because I wanted to be able to iMessage on my Android device, which has worked relatively well. In order to use the app's SMS bridge though, you have to set the app as your default SMS app (an Android requirement, no getting around it.) Unfortunately, it's just really difficult to compete with the system-level messenger app.

I've been chatting back and forth with them, and their support team has been pretty responsive, but I'll likely stop using it soon. Their app is just too buggy to be such an important part of my workflow as a default SMS app. No RCS support, notification issues, totally missing SMS messages entirely with no way to recover them? (Rare, but destructive.)

Love the idea, but needs a good bit more work. (Sorry to the team, I know some of them are here on HN.)
They claim their other models are "open source" too, but their licence violates several points of the open source definition.
wild, this explains a particular relationship. I deliver what I perceive as good news and the response is consistently the worst interpretation of every detail.
thanks! yeah, lower-right corner. i added a walk-through that highlights it to help. =D
You use both. Once your data fits comfortably in memory it's naive to try to build histograms, pivots and charts using pure SQL.
Crazy wide amount of chips supported. My main barrier would be that my current camera has nice hardware h.265 encoding. I haven't dug deep but whether I can keep that or not would be a potential deal breaker.

Github: https://github.com/OpenIPC/firmware
Your advice is to add cops to the Pinkertons?
> you were massively overselling it.

My thesis was "I don't consider nuclear to be sustainable. Here's why I think it's not sustainable." I wasn't saying "It's worse than coal.", I wasn't even saying "There are NO circumstances under which anyone should ever build more fission plants." - - I don't particularly have a strong opinion on whether coal or nuclear are worse but offhand I suspect the answer is coal -- it's definitely in the same broad category of causing non-remediateable pollution. So I probably wouldn't suggest spending a shitload of money to replace nuclear plants with something that's at least qualitatively similarly bad like coal.

I would suggest spending 20% more to get an actually sustainable solution to baseload power. But I would understand someone who says:

- 20% is way too low, actual cost would be much more

- 20% more isn't worth the benefits vs. what else we could spend the money on

- Even if fission isn't environmentally sustainable, we should still use it instead of coal

But arguments like these will not hold any water with me:

- Fission can't possibly poison land even though it has before

- Something that will eventually poison large amounts of land if neglected for 2,000 years is "environmentally sustainable"

- Fission is better than coal so you're not allowed to claim that fission isn't "sustainable" because that makes you an opponent to progress and we have tell ourselves lies about that to make progress happen.
I would use it to ssh and tmux to my servers, to display stats/logs and start simple scripts when needed, like a "wireless KVM".

I understand many people use smartphones or tablets for that, but I don't like the idea of having a smartphone with me at all times: I have one, but in a drawer. I charge it and use it when I need to travel. It's too intrusive otherwise.

I can use ssh from my laptop, but I like a distraction free environment: most of my apps run in full screen, to help me maintain my concentration.

So a separate device I could turn quickly, check what's happening, and type commands, would be very valuable.

I would certainly try to find a way to add sixel support to the terminal (BSD console terminals have that) then have gnuplot display some key measurements like latency scatters on top of the moving averages.

Another role would be very natural thanks to being cheap: the USB port could help me check devices without having to fear hardware damage to my laptop USB ports (voltage issues etc) or software issues (virus/trojan etc)
Not when underlying inflation is over 100% and there is severe capital controls. See https://en.wikipedia.org/wiki/Carry_(investment)#Currency
Hej. Har du hittat det bästa spelandet på ett svenskt casino? Besök Campobet och få en oförglömlig tid. Här hittar du ett brett utbud av spel och möjligheter till stora vinster. https://campobet.se/sv/ har en modern och användarvänlig design som gör det lätt att hitta dina favoritspel. Dessutom erbjuder de snabba och säkra betalningsmetoder och ett supportteam som alltid är redo att hjälpa dig. Bli medlem idag och upplev spänningen på Campobet Casino!
I think you’re distilling things down far to simplicity but we might just have to agree to disagree on this topic.
Not remotely the same thing, that was cops executing a search warrant signed by a judge. https://www.businessinsider.com/a-san-mateo-court-has-withdr...
> But hey, if you wrote an article and many many people, even in your own business, misunderstand it as fan-girling, did you succeed at your job?

There are a lot of people who post dumb hot takes without reading the article to the end, that very much includes people in journalism.
You can take a (calculus) derivative of the mathematical construct that represents the lookup table. And yeah, it is very not obvious how a "lookup/hash table" could be differentiable, based on how it's implemented say, in a leetcode exercise. That's part of the genius of the transformer.
They dont really, they are just an offbrand for securitas who bought up the trademark and brand after they went under.
If only there were some good samaritans who would toss lit cigarettes out of their cars in the spring...
I think there also is a factor where good things move slowly. I always liked the thought experiment of imagining newspapers that are published at increasingly long intervals. What would the content be in a newspaper that's published every 50 or 100 years? Sure you'd cover major wars, but so much more space than we dedicate right now would go to phenomenal improvements that took a long time. Incredible advances of medical improvements, including eradication of entire diseases, much higher life expectancy and so many fewer famines, massively increased literacy rates. One could go on and on. Yet, few of these things, unless they are discreet events which is rare, ever go into a daily newspaper and certainly don't make headlines.