skysight-inc/HackerNews huggingface dataset:
Correct, but to be fair to readers (like me) the use of the term "infinite-length inputs" is misleading.

Still, really interesting work. The most salient bit is the discovery shown in Figure 2, summarized as:

> (1) The attention maps in the first two layers (layers 0 and 1) exhibit the "local" pattern, with recent tokens receiving more attention. (2) Beyond the bottom two layers, the model heavily attends to the initial token across all layers and heads.

> surprisingly large amount of attention score is allocated to the initial tokens, irrespective of their relevance to the language modeling task, as visualized in Figure 2. We term these tokens “attention sinks". Despite their lack of semantic significance, they collect significant attention scores. We attribute the reason to the Softmax operation, which requires attention scores to sum up to one for all contextual tokens. Thus, even when the current query does not have a strong match in many previous tokens, the model still needs to allocate these unneeded attention values somewhere so it sums up to one. The reason behind initial tokens as sink tokens is intuitive: initial tokens are visible to almost all subsequent tokens because of the autoregressive language modeling nature, making them more readily trained to serve as attention sinks.

StreamingLLM is basically a "hack" that fixes this odd behavior when we go around butchering the LLM's attention window.

This actually isn't the first time cracks have been shown in the usage of softmax and it makes me wonder if a different function might be better if we want context-length flexible LLMs.
Pretty easy to get minis or studios into racks with 3rd party mounting solutions. You do need to pay attention to power needs (low, but you need AC power, not DC) so might need a PDU in the rack to convert / distribute depending on how many you're planning to put in each rack.
No, nothing of that sort has happened in the US because the rules for NN haven't changed. It was a created internet hype machine to push more new restrictive rules by acting like chicken little and shouting that the sky was falling.
DICOM technically supports lossy compression, but I think it's regarded as something of a historical mistake. It's pretty much never used and some viewers will plaster big warnings on lossily compressed series and others will outright refuse to load them.
Show HN: Qualitative now supports free AI transcription of user interviews
Qualitative processes transcripts ourselves and your interviews are not sent to chatgpt, google, facebook, etc.
That is correct, we are talking about when things enter the public domain, specifically the likeness of an individual.
> Hypothetically, would you still feel this way of it turned out that everyone being in the office (remember this is a magical hypothetical) has a significant and demonstrable improvement in productivity?

Yes, in a particular scenario.

If it improved productivity so much that it exceeds the work required to commute to the office, and the employer is willing to pay for that commute (both in cost and employee time), then sure. If the productivity gain is so large that if offsets the cost/time of the commute, and the employer is willing to pay for that time, then I think RTO makes sense.
I think most people didn't get a CD-ROM drive till the 486 was common.

386s did not come with CDs till late in their lifetime, by the time the 486 was becoming affordable most computers had a CD-ROM drive.
It's pretty exciting to me. I'd like to see more mini PCs. The takeover reminds me a bit of Lenovo buying the Thinkpad division from IBM.
also: basilisk, mypal, k-meleon
It does. This is a Alder Lake device so it's either a Brya or Nissa mainboard. Sourcecode is here[1].

[1] https://chromium.googlesource.com/chromiumos/third_party/cor...
That is kind of my point. Sun burn is not good. But without sun burn? The article you sent doesn't make clear whether photoaging always happens, or only on sun burn or other high doses of exposure.
Hope to be my own crazy string one day ;)
Location: Spain
Remote: Yes
Willing to relocate: Potentially
Technologies: TensorFlow, Pytorch, Deep learning, LLM, diffusion models, GANs
Résumé/CV: http://jorgemf.github.io/cv.pdf
Personal website: http://jorgemf.github.io
Email: (in the CV)
Storage can handle the base load.

If the sun doesn’t rise one day… we have bigger problems.
Your response is completely irrelevant to the discussion of vertical integration. Whether or not you find use in it is up to you, and I don't really care.
The world has survived many a technological advancement but, if AI were to make it so Worker B "doesn't need to work" going forward, our society is not structured to support Worker B in any meaningful way, and that's something to be concerned about.
Oxford 'explosion' after lightning strike seen from A34
> I was just saying that ultimately the CEO makes the call on RTO (at least that’s what it seems to be at megacorps), whether it’s the right or wrong one isn’t my call.

This is the part I was disagreeing with. The CEO does not make that call. The CEO and labor negotiation over that call.

If you view it as just the CEO's decision, you've ceded a tremendous amount of power.

But, actually, it's a shared decision between the CEO and the entire body of workers. If the body of workers all reject the CEO's decision, then...that decision will get reversed.
His method for computing entropy is not so good. His method works for an independent and unpredictable sequence of bytes, but the actual data is a bunch of signed 16-bit residuals that presumably are normally distributed. Really, he should be measuring the entropy of the original heightmap, but instead he is measuring the entropy of the heightmap after he has applied a couple of confounding transformations (predictive filter, words->byte pairs, and a random shuffle) that act to increase the apparent entropy.

Calculating the exact entropy of data is at least as difficult as breaking encryption. Encrypted data should be indistinguishable from random (full-entropy) noise, but really its entropy should be the entropy of the plaintext data plus the entropy of the encryption key.
The author missed my favorite, very minimal rendition of the facepalm

m(
Related article from 1 year ago on Darth Vader’s voice being AI generated going forward:

https://arstechnica.com/information-technology/2022/09/james...
The studios were clearly going to have to give in eventually. I won't really argue against that. I'm not entirely clear that this was a battle to be "won," though. It isn't like they've never left bargaining in the past thinking that they did well, only to find out that things changed later. Or that they just misunderstood stakes.

To be clear, my main doubt in that post is that this is a battle that can lead to a winning war. I am not at all opposed to it happening. Indeed, I support those that were striking. I can't but feel that there is a higher up meta battle that will be more high stakes.
Location: Poland / Germany
Remote: Yes (EST/PST timezones OK)
Willing to relocate: No but travel to HQ OK

Technologies:
* Python, Django, FastAPI
* TypeScript, React Native / NextJS
* Kubernetes, AWS, Google Cloud, Azure

Full Stack Developer, 13 years of exp, self-starter, lots of experience with early stage startups, MVP, prototyping, scaling, maintenance.

Email: rootx@rootxnet.com
Résumé/CV: https://michallech.info/static/Michal-Lech-Resume.pdf
That was the first time I'd read about it on HN, but as pointed out on that HN post it wasn't the first time Softmax + 1 was proposed. And, AFAIK, it has never resulted in better performance in practice. Maybe Softmax + 1 works better for fiddling with the attention window after training, but I don't know if anyone has tested that at scale.
The first half is correct. Nobody said it wouldn't lead to increased fraud. Every new generation of malicious tactic does until human and technological countermeasures[1] catch up. It's certainly not going to "escalate things to an unthinkable level", however.

And we do live in the same world, a world where some new major technological advancement happens, and some technophobic portion of the audience gasps and claims the sky is falling. They said it about newspapers, home computers, about the Internet, about smartphones, about AI image creation, AI chatbots, and about AGI. And while it creates challenges, the sky never falls.

Heck, there's even a Twitter account[2] that humorously documents it throughout history.

1. I feel the need to emphasize this before the next comment insinuates I'm pushing some careless, "let the chips fall where they may" approach.

2. https://twitter.com/PessimistsArc
Please do. Some of us critique capitalism
The good thing is that Intel will probably help here. The 15th gen CPUS are branded as Intel Processor, Intel Core Processor, and Intel Core Ultra Processor.
In this:
Intel Processor -> Atom, Pentium, Celeron
Core -> i3, i5
Core Ultra -> i7, i9

You can just say 'buy the Core CPU, no numbers, no other words'
I stand with the equal human rights crowd. Chik-fil-a is not one of us. Their stance on LGBTQ+ folks is clear. I’m not LGBTQ but I believe we all should be allowed to live the lives we choose so long as we don’t harm others or break the law (which normally are designed to protect others).

I do love their chicken though.
To be fair, that kind of sweeps the gigantic power imbalances at play under the rug. :D
Oh of course, you even lead with stating that you would like to make some points as devils advocate and I agree with that approach. It's like when you're doing prompt engineering for an LLM. i.e. need to make sure we loud all context into our shared memory so our neural networks can properly evaluate the scenario and make informed statements. It's a collaborative effort. :)

Regarding discharge protection and BMS safety I completely agree with a hybrid approach of discharge protection with a grace period to alert the user if the device is armed. The main issue with battery safety is when the device is left unattended charging, but I do agree that ideally it should be shutoff completely while unattended. However, when riding, I would rather my board start smoking and catch on fire than ditch me going 25mph. Obviously there needs to be a hybrid approach as you describe as the current situation is not optimal.

Yes, the EUC market is a prime example. There aren't actually that many VESC EUC builds because there is so much competition it is not needed.

Regarding "drinking the kool-aid" and "the pioneer of a technology not is not often the one that sees it through to maturity", I feel like a prime example was the Boosted boards.
It has just been used now before elections in Slovakia. Already with some effect.
Show HN: MySQL Actions
> a jailbreak for iOS 4

presumably not, the 4s launched with iOS 5
I'm surprised by your pricing. $1.20/hr for an A100? That's significantly cheaper than something like runpod. Are you offering this service at a loss?
Intel Core i3, designed for performance?!?
You raised all the points you now deride. I agree they are dumb. Glad we got there.
75% of an M1 is pretty damn good as when the M1 first came out it was the fastest laptop single core performance in the world.
How about this: in your restatement, "the market" appears to be a neutral objective weighing function that tells the truth regardless of how uncomfortable that truth might be.

But "the market" is often a personification of power, with powerful interests (sometimes hidden) working together to bend the market's behavior to their ends. When that happens, if we don't see that bias, thinking of the "market" as objective is a path to being manipulated by those interests.

In this case, the powerful forces are distributors and financiers who cannot operate without creative talent. The actual customers want the creative output, they have no interest in the logo at the front of the movie. So the distributors are powerful rent-seekers who would like to use technology to increase their share of the rent.
- When a customer submitted their signup form to Dialup World, they would add a
row for that new customer to their 20,000-row Excel spreadsheet. Then, they
would put that signup form in a pile with all the other signup forms of
customers who had signed up on that day of the month.

- Every day, they would find which one of the 31 piles of literal signup forms
corresponded to that day of the month.

- Then, they’d charge the customers in that pile, one by one, for a month of
service.

Well, if you hop into a time machine and need dial-up access from "Dialup World" back in the 1990s, I guess there's a sweet hack -- sign up on the 31st of the month and you only get billed 7 times a year.
In my experience with graphviz, the two layout problems are:

1. the lines are not distinct -- they can bunch up and overlap, making them untraceable
2. Logical groupings are hard to maintain unless they are highly connected.
Thanks, that seems a good starting point.
I thought it's blatant copying that is objectionable in the artistic industries where remixing is everywhere. Also, where does consent go into this? Do I need permission to produce a disrespectful satire (a remix) of the Nike logo?
Unfortunately, the SecureROM vulnerability that gala exploits was patched in the ROMs shipped with the 4s. Therefore, gala won't work out-of-the-box with the 4s.

However, a newer boot ROM exploit, checkm8, has become well-known in the intervening years. The A5 (that the 4s ships) is vulnerable to checkm8, which means that it'd certainly be possible to add support for this exploit chain to a project like gala!
Dead grandma locket request tricks Bing Chat’s AI into solving security puzzle
that was maybe the electric field stimulating your your jaw muscles, if I had to guess
It’s actually very hard to define in such a way that makes everyone happy.

There's an easy definition: does it give value to the user, or act against the user's interests? The former isn't, the latter is.

Of course, by that definition, Windows itself would be considered malware.

I suspect the other comment here referencing libel is why "potentially unwanted" is another category that they often use.
I like this reply (irrespective of the culture wars aspect) and it does underscore the difficulties. If you got into that Habermas book and its sequels (had to dig them out of deep archive from my Uni library they are so dense) you'd realize the problem is deep.

A "department of legitimacy" would have to give out a lot of tough love and crack down on delegitimizing behavior, that's for sure.

As case studies I would point out: (1) a sector of Republicans who pursue one kind of legitimacy, "sticking to their guns" and posturing with extreme positions (e.g. they feel like they have at least do something to buy the perception of legitimacy of somebody) and (2) Democrats who take legitimacy for granted (I'm Hillary Clinton, of course I am legitimate). In Hillary's case there was that experience of being on the receiving end of Richard Mellon Scaife's (oddly an unnamed villain in https://www.amazon.com/Zero-Sum-Society-Distribution-Possibi...) war against her husband which convinced her that any illegitimacy perceptions were part of a "vast right wing conspiracy" thus nobody could have convinced her that she could have changed her behavior and won in 2016.
The problem is not the values delivered to the DAC. It's the aperture error of when the DAC was clocked. This affects what those sample values actually represent. If the clock is being extracted from the pattern of pits and there's a way to reduce the jitter, you will get a more accurate signal.

However, I'd hope that anyone that cares about fidelity has a CD player that does a little more to generate a DAC clock. NCO run by a software PLL or a hardware PLL with a good loop filter are things I've heard of, but control systems is not my specialty.
Very good question. If you ask your friends, a good reference can help. Most people don’t have any attorneys on retainer, let alone know if they’re good or not though.

Usually what I’ve done is brute force. Every State has a State bar that usually has listings. Google Maps searches for ‘employment attorney near me’ or ‘civil law attorney near me’ also usually gives a lot of matches.

I dump it all into a spreadsheet, and then go down the list taking notes and calling each one. Attorneys should give a free consult (anywhere from 15 minutes to an hour).

Try to learn as much as you can about the applicable law and the situation; and ask questions. Not just what is legal/not-legal, but their history in getting actual results for clients and what the courts will actually take seriously or not.

Don’t pick anyone right away. Call at least 3, preferably 10 in each speciality.

If you like them and they like you, they’ll either take you on contingency or ask you to give them a retainer (funds to be put into a trust they can bill against). Either way there will be some paperwork they’ll have you sign before they’re ’your attorney’.

Additionally, some things to look out for -

1) anyone that makes you pay up front for a consultation is bad news. Run away.

2) anyone that promises a result is bad news. Run away.

3) Anyone who takes a case without asking specific questions and arguing with you sometimes is bad news. Run away.

4) anyone who tells you something that seems wrong (and you can’t verify independently, even after you ask for a reference) is probably bad news. Run away if you even suspect it.

Employment law is its own speciality.

Contract law is generally a subset of civil law. Civil law is a huge umbrella, from ‘my neighbors tree dropped a branch on my house’ to ‘the mega corp. in my county has been poisoning the water for decades and I got cancer’. You’ll run across attorneys who handle many different areas, ask them what they do and what their style is.

I hope this helps!

P.S. most states and countries put their laws online. There is still usually case laws which modify it, and gotchas, etc. but you can figure out 95% of it if you find them and do your own research. Leginfo.ca.gov is the California One. When you’re talking to attorneys, feel free to ask them for applicable cases and/or codes to start looking at.
For US residential homes the bank has set milestones where they release funds. If the developer leaves the house half-built they only get half-paid (give or take). A similar thing applies to renovations.

Banks can and do refuse to pay until things are completed and city inspections pass the work. Could a city inspector collude with a bank and developer to rip off customers? Sure... but even if that happens it can only be small scale. The odds of the scheme collapsing increases exponentially with every additional city/bank/developer participating.

Politically China works differently. I'm sure there are plenty of developers doing good work. That clearly must be the case - not every building is a pile of garbage. But being a more centralized single-party state with state-owned banks the opportunities for shenanigans is obviously higher. It may also be driven by how much local budgets are influenced by new projects rather than ongoing property taxes. There is an incentive to approve projects and it is embarrassing to admit we should be tearing down the new building because everyone involved cut massive corners... that might also scare off new customers for the next project. Better to cover everything up and keep the scam going.

For that matter state owned banks from any country are well-known for perpetually extending loans rather than admitting the loan is garbage. This is not unique to China nor news to anyone.
You’re saying “the interwebs tell me…” and taking that as stronger evidence than someone who was actually taught handwriting for both languages?

I’m speechless.
> There are plenty of situations that warrant operating on code points

Absolutely correct. All algorithms defined by the Unicode Standard and its technical reports operate on the code point. All 90+ character properties defined by the standard are queried for with the code point. The article omits this information and ironically links to the grapheme cluster break rules which operate on code points.
I don't know if they -easily- lived up to 70, but it was possible to live to that age for sure :) . death rate of "at birth" and early years was far far higher than now. they certainly lived longer than 30-35 that I hear slung around though. If you lived to 15 or so you could easily live to 50-60. Although those early corpses almost always show infection by parasites and such and not so pretty healing from injuries.
Prompt-Visual Engineering for GPT4V
Well, I don't know about the others in your list but russian propaganda is very strong here but even those who "support" them wouldn't want to live there, if you know what I mean. It's more of anti US thing than pro-Russia things.

I guess people don't like hegemonies unless they greatly benefit from them. Go figure.
My theory is that experts will be hired to train specific models. Documentation will be written to be understood my an LLM chat interface. Edge cases and tutorials will be pre-made and then fed to the model. Technical writing might be skill that will be in huge demand.
SEEKING WORK | Spain | Remote (EU and US time zones)

Technologies: TensorFlow, Pytorch, Deep learning, LLM, diffusion models, GANs
Résumé/CV: http://jorgemf.github.io/cv.pdf
Personal website: http://jorgemf.github.io
Email: (in the CV)
Sounds like the everyday job of a club DJ!
If you think that the cops are 1/ properly trained 2/ will do the right thing 3/ have your best interest in mind you're going to have a bad time.

This is not about being sober (hopefully everyone is driving sober). This is about making sure that your rights are respected.

By the time the cop asks you do to any sort of test they have already made up their mind and now are trying to justify it. Do yourself a favor and ask for the blood test - that is usually administered by a trained medical professional.
IIRC, daemon mode is a headless instance of the Emacs that the clients can connect to. Server-mode is just a standard, headful, user-session instance of Emacs that can also accept clients.
Some platforms (e.g., Android) have methods specifically for asking how to edit a string following a backspace. However, there's no standard Unicode algorithm to answer the question (and I strongly suspect that it's something that's actually locale-dependent to a degree).

On further reflection, probably the best starting point for string editing on backspace is to operate on codepoints, not grapheme clusters. For most written languages, the various elements that make up a character are likely to be separate codepoints. In Latin text, diacritics are generally precomposed (I mean, you can have a + diacritic as opposed to precomposed ä in theory, but the IME system is going to spit out ä anyways, even if dead keys are used). But if you have Indic characters or Hangul, the grapheme cluster algorithm is going to erroneously combine multiple characters into a single unit. The issue is that the biggest false positive for a codepoint-based algorithm is emoji, and if you're a monolingual speaker whose only exposure to complex written scripts is Unicode emoji, you're going to incorrectly generalize it for all written languages.
These are also hard to measure:

* Employee happiness

* Less sick employees since they don't spread their germs in an office

* Much lower attrition and retention of institutional knowledge

* Lower rent costs or possibly zero rent costs for office (actually this one is very easy to measure)

* Able to hire from outside local metro area

None of these was enough to move companies even an inch towards WFH pre-COVID. And yet now vague issues due to lack of water cooler conversations is enough to shift everything back to in-office?
Mistral-7B-OpenOrca. First 7B model to beat all other models <30B
I wonder if it's behind the subscription, but I see no reference source code for StableLM.