skysight-inc/HackerNews huggingface dataset:
> I suspect, though, that memory safety is one of the most important kinds of safety.

I don't.
It seems to me like "memory-safety" is a response to the legacy of C and "C-compatibility) WRT poor behavior/respect of types; example: int/address punning, int/boolean punning, array/pointer punning, etc. (NUL-terminated stings could fit here, too as they're a consequence of C's address/array confusion.)

Contrary to this, would be correct typing.
Consider SQL-injection and how the "best practice" is to never take data from the user... well we can take data from the user AND ensure there's no possibility of injection:

Subtype Numeric is String
with Dynamic_Predicate => (for all C of Numeric => C in '0'..'9'),
Predicate_Falure => raise Constraint_Error with "'" & Numeric &"' is not numeric.";
--...
Count : Numeric renames Get_User_Value;
--...
return Query("SELECT \* FROM Some_Table WHERE Count=" & Count & ";");

The above is perfectly safe because the constraint imposed prohibits the SQL-injection... and you can even enforce something like SQL_Escaping:

PACKAGE Example IS
-- The only way to get a value of ESCAPED_STRING is via calling Create.
Type Escaped_String is private;
Function Create( X:String ) return Escaped_String;
PRIVATE
Type Escaped_String is new String;
Function Create( X:String ) return Escaped_String is
( SQL_Escape(X) );
END Example;
Wow. Why, considering the spread? We (average age probably over 50) actually even have over 50% FF on desktop
This seems to be largely enabled by the observation that Softmax has to add up to one. From quick a glance [1], the model tends to use the first token as a placeholder for cases when you don't need to attend any of the prior tokens.

The first time I read about this issue, that Softmax is somewhat flawed, was in a HN post by Evan Miller [2] where he observes that forcing attention heads to allocate all attention to prior tokens is wrong, and we should allow them to "not attend" by adding one to the softmax denominator.

I love that they found a way to capitalize on this observation without having to retrain models. However, I wonder how the models would look like if they followed Evan's suggestion!

[1] Their description of attention sinks:

```

To understand the failure of window attention, we find an interesting phenomenon of autoregressive
LLMs: a surprisingly large amount of attention score is allocated to the initial tokens, irrespective
of their relevance to the language modeling task, as visualized in Figure 2. We term these tokens
“attention sinks". Despite their lack of semantic significance, they collect significant attention scores.
We attribute the reason to the Softmax operation, which requires attention scores to sum up to one
for all contextual tokens. Thus, even when the current query does not have a strong match in many
previous tokens, the model still needs to allocate these unneeded attention values somewhere so it
sums up to one. The reason behind initial tokens as sink tokens is intuitive: initial tokens are visible
to almost all subsequent tokens because of the autoregressive language modeling nature, making
them more readily trained to serve as attention sinks.

```

[2] https://news.ycombinator.com/item?id=36851494
Is there a way to read this with the mouse cursors disabled? It seems like great content but all the movement on the page is way too distracting.

EDIT: I've never been downvoted for asking a question before. Weird, but okay.
Which French layout would that be? I've never seen a French keyboard where this is true. French is my native language. On layouts I'm familiar with, some accented letters have separate keys like é, but not all, the others are made by composing an accent key with a letter.
I don't think it means quite the same thing as random.

"The judge is giving out random sentences" means the judge is rolling a die or something, literally randomizing each sentence.

"The judge is giving out arbitrary sentences" means the judge is sentencing based on how they feel in morning, or the opinion of the last person they talked to. The decisions are not random, but they aren't based on any coherent set of rules or logical framework. The judge could have made a different decision and it would have made just as much (or just as little) sense.

Another common usage is calling something an "arbitrary distinction". For example, skyscrapers are often defined as buildings that are at least 100 meters tall. That is an arbitrary distinction, in that there is no significant difference between a 99 meter and 101 meter building. It's obviously not random, it was picked because 100 is a nice round number, but when we say it's arbitrary that means we could have drawn the line at any other number and it would have worked fine. In fact, some people define skyscrapers as being at least 150 meters tall, and there is no logical reason that either of these number are better. They are both arbitrary, and saying that "your 23-story building is a high-rise but my 24-story building is a skyscraper" is making an arbitrary distinction.

So back to Nate Silver's quote:

> I don’t think it’s quite right to say these decisions are arbitrary. Ideally they’ll reflect a statistician’s judgment, experience and familiarity with the subject matter.

If these decisions were arbitrary, that would mean the statistician isn't making educated choices. They're thinking "I just saw a cool article on this regression technique, let me try that", or "my favorite programming language is good at X technique", or "I've been wanting to practice Y technique". When asked why they made a particular decision, the statistician might not have a logical explanation.

If the decisions are not arbitrary, that would mean that other statisticians are likely to agree with the decision, or at least understand the logic behind it.
Not like physical danger, but can lose a lot of money in minutes in some places.
"the long history of the US."

You mean, the long history of overthrowing governments, imperialistic wars and debt-trapping entire nations into selling their state-owned assets to US interest groups and funds?

Your memory may be short lived, but there are many of us who know and remember.

And, by the way, China hasn't started invading random countries all over the world...yet.
> maybe directly into the eye

We still haven't solved the problem of screen burn-in, so the outcome of that is going to be hilarious.

My money's on cyberpunk-style HUD visors. Not Oculus, not Google Glass, a transparent, wraparound screen on your face.
I think people are misreading this work, and assuming this is equivalent to full dense-attention. This is just saying its an efficiency gain over sliding window re-computation, where instead of computing the L^2 cost over and over (T times), you can re-use a cache and maintain perplexity. I don't think they are claiming that this allows for attending to content that was far away.

They tested by running concatenating and measuring -> `Q A Q A Q A Q A...` not by doing `Q Q Q Q A A A A...`

They also measure perplexity, showing that it produces "readable text" (coherent, locally viable); not that it is "extracting anything" from the big-triangle-gap of no-attention.

I think this would fail to be given a book, then write the first word of every paragraph. Or, given a book, write a 1 sentence summary of each chapter. I might be wrong, because they didn't test tasks like this, but I'd be very very surprised.
Admins here have a lot of editorial control over what appears on the front page, when it serves their interests.
Is the port worth it though? The article points out it's not very busy and doesn't seem to have been made well. It seems like China is acting on very short term thinking here.
The majority of Chick-fil-A's are not renting their space. Most Chick-fil-A locations are built new on free-standing property physically owned outright by corporate headquarters and franchised to Owner-Operators with a revenue sharing model.

The "Business Model" section of their Wikipedia page has more info on this if you're curious: https://en.wikipedia.org/wiki/Chick-fil-A

(BTW, it also says they gross an average of $4.8 million per year per location, in 2016 at least. That's the highest sales of any Fast Food franchise in the US, vs the next in line, Whataburger, at only $2.7M per location per year. So being closed on Sunday doesn't seem like a big issue for them.)
Nobody is going to be completely correct across the full breath of human knowledge. However, people can be wrong without their ideas being crazy.

If I was going to pick my most controversial idea it would be something like, humanity was like a ring species going back thousands of years with people somewhat regularly crossing the Baring Sea without realizing anything particularly unusual was going on. That’s a somewhat wacky idea because diseases didn’t make the jump etc. But it’s wildly more reasonable than ancient aliens.

So as long as we are talking crazy rather than simply incorrect, crazy isn’t evenly distributed.
I disagree that this somehow disqualifies their marginalization that they started with. They may have had another characteristics about their lives that affected that marginalization in unexpected ways. For instance, before Kim Kardashian was the "western beauty standard" she was effectively a nobody who did a pornography film with an R&B artist. Generally we regard sex workers as marginalized by default and yet the way she maneuvered everything made it like rocket fuel to her career. Had she messed that up we'd be talking about her more like Paris Hilton, who had vastly different outcomes. Brian Kolfage was similar; the man has to travel in a wheel chair and has a prosthetic hand most of the time, so I heavily disagree that he's relatable to any degree. You may have a point about Holmes and SBF, but I rather doubt many of the people who did business with them knew their parents. That's to say, I think you can find an abundance of reasons to eschew someones marginalization once they're successful. That's what intersectionality tries to address, and your reply seems to be the antithesis to intersectionality.
I'd recommend working on editing any public-facing copy and unifying your message. I'm assuming I know what this tool does, but these examples do not validate that assumption. Is it a platform or a service? In 3 different locations, OpenStatus is listed as the "open source monitoring XYZ with...": "on-call managements", "Incident Management", and "beautiful status page".

Examples copied from the landing page and front page of the GH repo.

> Open-source monitoring service

> OpenStatus is an open source monitoring services with on-call managements.

> The Open-Source Synthetic Monitoring Platform with Incident Management

> OpenStatus is open-source synthetic monitoring platform with beautiful status page.

> The open-source monitoring platform
It is a hard problem.

Poor countries need a lot of investment (0). Historically many investments failed and creditors ruined the country and made live of the involved people even more miserable. My gut feeling is that chinese investors are a little bit smarter but there are obviously problems as well.

(another gut feeling: china has too much money, they can't invest in US treasuries anymore) (1)

This US/China conflict is just stupid. Nearly everybody looses.

(0) Adam Tooze "The west has failed to keep its promises on aid"

https://www.ft.com/content/75d35382-32e4-4548-82e6-0d20d9984...

(1) https://markets.businessinsider.com/news/bonds/dedollarizati...
I'm not Korean but seeing that said of the Hangul example definitely made me pause - I doubt Koreans think of that example as a single grapheme (open to correction), though it is an excellent example all the same since it demonstrates the complexity of defining "units" consistently across language.

It reminds me a little of Open Street Map's inconsistent administrative hierarchies ("states", "countries", "counties", etc. being represented at different administrative "levels" in their hierarchy for each geographical area), and how that hinders consistency in styling- font size, zoom levels, etc. being generally applied by level.
> listening to economists

Noah Smith isn't even an economist, he's just some know-it-all internet pundit who happened to have graduated in economics a decade ago.
We have Fortran code from several decades ago defining scientific domain knowledge. The next Einstein formula may require 3.12 to run.
I know my rustc will get mad at my programs and refuse to compile them.
This sort of makes sense to me:

> Mr. Sinha told me that he was concerned that the addition would make South Asians like him more vulnerable to unfair accusations of discrimination.

Basically, most people can't be accused of caste discrimination, since they are completely unaware of caste markers. This understandably makes the people who could conceivably be accused of it less-than-happy because it's another thing they have to think about when hiring, promoting, etc.
https://archive.ph/p449A
> So the ﬁ ligature was in a legacy encoding system and thus must be in Unicode.

Most of the pre-composed latin ligatures are generally from EBCDIC codepages. People in the ancient Mainframe era wanted nice typesetting too, but computer fonts with ligature support were a much later invention.

You can see ﬁ and several others directly in EBCDIC code page 361:

https://en.wikibooks.org/wiki/Character_Encodings/Code_Table...
According to this page [1], they do use external sources (Google, Mojeek, Yandex and more), but not Bing ;)

They also have their (two) own indexes.

Tbh, for me (as small town dev) it feels like magic how fast those different sources are combined, additionally with user search preferences like raising or blocking certain domains. Insides welcome :)

Edit: Here [2] are some benchmarks and general strategies they pursue. Would love to read more details.

[1] https://help.kagi.com/kagi/search-details/search-sources.htm...

[2] https://help.kagi.com/kagi/search-details/search-speed.html
Can there be legal liability with anti malware? By example, could flagging some software as malware expose you to being sued for libel?
I could be wrong, but I'm not sure this is about what people seem to think it is, e.g., letting LLMs reference content past the trained length

I think it may just be about the performance of the model with longer texts (on the things still within the context window?). It sounds like they're arguing that the model is essentially learning to stick some baggage in the attention to the initial tokens of the text, and break when that isn't within the window anymore for reasons I'm not sure I understand (after all, isn't text in the middle just as good as text at the start for non instruction inputs?)
> What do you mean by "work"? That you can store arbitrary bytes in a string? That's a pretty low bar.

That's all that's needed for a backend language.

The backend does not need to understand, or even acknowledge the existence, of grapheme clusters. Because the frontend is already having to understand all of this, it should be normalising any multi-codepoint ambiguous cluster anyway.
But... there's no way you could possible have 300k after 2 years of contributions to a 401k. If you were maxing it you'd have about 40.

Unless you've made a typo and you mean 20 years? (in which case, now 300k is below maxing out, but slightly closer (although with returns it should be a good bit more))
As a non native speaker, it does sound a bit like Michael Jackson imo…
Avy | Multiple Roles | Salt Lake City, UT | REMOTE (USA) | ONSITE

We are an early-stage, stealth startup making humans and computers work together more efficiently.

Experienced team from Apple AIML, Bose, Amazon, and other great companies.

We're hiring for:

- Design (UI/UX)

- MacOS (Swift, Objective-C, C/C++, etc)

- Applied ML (including LLM fine-tuning, various NLP tasks)

- Part-time/contract roles for TypeScript and Python, and server work (Go)

- Marketing (in the "growth hacker" spirit)

We're distributed but expect travel for regular on-site, in-person work in SLC, with future presence in New York City.

jobs@avy.ai
This isn't a good argument. The road is, at least, nonexcludable. The policy I described is fully exclude able and fully rivalous.

It is not a public good.
I can't tell if this is the sixties and I'm reading some argument against the Civil Rights Act.
The world has developed a lot in 40 years, that's a pretty silly comparison. But let's play this game -- the cost of delay is now more like 800 gigatons of CO2.

It wasn't worth it, but I'm glad the bleeding has finally begun to slow.
I think people kind of miss the idea of kwargs in python, the idea is that they are a dict. You can cast a dict to kwargs, in contrast to positional args.
I see the typedict being super useful. I really don’t see your argument and would say that this typed dict is more developer friendly than having positional arguments.
https://docs.python.org/3/tutorial/controlflow.html#more-on-...
Spill (https://www.spill.chat/) | Senior Frontend Engineer & Senior Fullstack Engineer | London, UK (HQ) | £84-100k | ONSITE 2 days per week | Full-time

Our aim is to make counselling and therapy free at the point of use for as many people as possible. We do this by selling a mental health support product to businesses.

We're hiring a Senior Frontend Engineer and a Senior Fullstack Engineer into our small product and engineering team of 10.

You'll be expected to take responsibility for delivering thoughtful features for our customers and share responsibility for architectural decisions on the Frontend.

email calvin[at]spill[dot]chat for a more thorough job spec
On Ubuntu at least you can install versions of Python separate from the system one.

https://www.cherryservers.com/blog/install-python-on-ubuntu
Show HN: The NYC Subway Rat Detector
What do you mean our views are opposite? I am Bulgarian and I very much agree with you that we need an actual European army.

Now, you can always assume I only say this because I live in a poor country that everyone pushes around. But when we zoom out a bit, the same could soon apply to the entire continent. We are not united and that's bad for all of us because our competitors are more much bigger and better integrated.

Did you have something else in mind? I don't exactly pay any attention to US politics but I am sure their states are competing with each other because they have their own interests in mind. But that applies to cities too, does it not?
Location: Karachi, Pakistan
Remote: Yes
Willing to relocate: Yes
Technologies: Python, Django, React, Firebase, Cloud
Résumé/CV: https://kashifaziz.me/kashif_aziz_independent_consultant.pdf

Senior Software Developer with more than 15 years of experience is available for short and long term assignments.

If you are a startup looking for a backend resource who can hit the ground running, or a business interested in MVP to test a hunch, feel free to reach out. I have extensive experience of working as offshore senior developer & team lead with multi-million dollar organizations.

Brief list of accomplishments:

Data pipeline to ingest book rankings, aggregate, and generate structured JSON for further consumption

Data pipeline to ingest property listings from 3rd party services and ingest into a WordPress based website

Web based employee benefits management system (IAS-19), transforming Excel based model to Django-React based solution.

Backend for a Life Insurance illustration generation mobile app, served to thousands of consumers nationwide.

Backend for a mobile application for golf tournaments in US including player profile management, updated scores and marketplace.

Translation web service that can translate Excel documents from one language to other using Google Cloud Translate API. The translation preserved sheet styles and formulas.

Web service to generate PowerPoint slide using icons from certain websites based on provided keyword.
... imagine all that beer at the pub, and no one is joining in...
Eloquent: Redesigned Text Editing for Android
No, what I am specifically asking about is these sliding window attention techniques. As far as I understand it Claude 100K actually uses a 100k context window, and not a sliding window.
Arrr, it be fine as it be, now sail off ye scallywag.
They don't come with reasonable displays.

My previous experience with low-end intel hardware has been universally negative, so I assumed the i3's are terrible. Passmark says they are far better than I would have guessed:

M1 performance at 4x the wattage.

https://www.cpubenchmark.net/cpu.php?cpu=Intel+Core+i3-12100

So, either these get hot and are power-outlet-dependent, or they throttle badly.

I wonder if suspend / resume works reliably. It did not for the last 4 intel laptops I owned, regardless of OS. That included Windows, MacOS and Linux.

Maybe the AMD ones are decent. It's a shame about the screen (and bizarre bios) though.
It seems like the very real risk for China here is if all these countries decide to act collectively on the debt. National debt isn't like other sorts after all, there is ultimately no higher authority that can intervene or that China can appeal too.
It's impossible that covid could ever have not become endemic. It can transmit through animals, we're not going to vaccinate or kill all the animals, and we haven't found the source it actually came from.
Good work, this is super cool!
A program that interpret (and sometimes compile and run, writing executable into random memory segmant and execute in place) random file fetched from random network location. You would definitely say it is a malware if you didn't know you are looking at a browser. The behavior of browser and malware really isn't that much different. I guess there really isn't a good way to know a browser binary is safe without manual intervention.
The Year of the Freigeld in Wörgl (2009)
By "nonfiction", do you mean like coding textbooks or something more casual, like narrative nonfiction stories?

I like to take my for-fun books (not work related) to some pretty natural place, like a nearby park or forest, and sit by the water to read for an hour or two at a time. Bring a cocktail and it's extra nice :)
I love Nomnoml. I have lately been using it to visualize hierarchical tag structures in a browser-based PKM project I am working on. I find it creates fairly clean layouts.

Example:

https://imgbox.com/9A1mDyNv
> If you let it lie as is the issue will not make it past the first generation immigrants let alone the second.

So 25-50 years? That doesn't sound great for people affected today.

> If you codify it legally it’s going to drag on forever.

Why do you think codifying a ban would make the banned thing last longer? (Given you say it's naturally dying anyway)
Yeah that’s kind of the theme of the YouTube channel - I think it’s hilarious honestly, but maybe you have to go into it knowing what to expect.
No shit. Rampant inflation, coupled with poor consumer spending habits such as buying expensive cars, being "house poor", iPhones, eating/drinking out non-stop, etc - def adds up.
Unfortunately, and somewhat surprising, is that the United States aren't too united when it comes to remote work in different states.

Here is one article that explains some of the challenges (and why companies may restrict which states they allow you to work remotely from): https://www.adp.com/spark/articles/2022/06/implications-of-w...
For fun things you can do with a good working jailbreak, check out this integrity validator that checks if your phone is free of malware by exploiting it:
https://github.com/trailofbits/ios-integrity-validator
Even the emoji's that you create by combining multiple emojis? Type one emoji, then a second, it merges into one. What happens when you backspace?
Yes, but it exists in pursuit of a public good.

Welfare is not a public good, and therefore we should not use the government to pursue it.
I miss my chunky Enter key! Also whenever I have to write a currency value in £ I'm always annoyed that I need to go to the Wikipedia entry for "Pound sign" and copy it from there. There's probably an easier way, but it comes up so infrequently and I'm far too lazy to learn.