skysight-inc/HackerNews huggingface dataset:
It's all subjective. I learned Spanish at the defense language institute and then used it extensively in South America and Mexico for work and travel and it opens so many doors. One thing is that I'm not hispanic so people see me speaking it there and it blows their minds. For hispanic people if they don't speak it they are judged and if they do, they're judged somewhat if it's not up to snuff so maybe your experience in those situations is different.

I had friends who went through the same language school for Chinese and German among other languages and they never used it. All the German linguists got reclassed into other languages like Spanish in the 90s. Last year I went on vacation to Puerto Vallarta and it was so useful even in a tourist heavy place like that. But I am sorry you do find it useless and I don't doubt it based on whatever your daily life is like and hobbies.

On a separate note it's not too late to learn Chinese or German!
> "Sure but the Linux audience is certainly not one that pays for such things."

Eh? People just pay for their stuff. The problem is there isn't really a market for OSes (as a consumer), period. Unless you build a PC yourself, which is not the norm, you don't usually even buy an OS.

This has nothing do with whether the linux audience pays for stuff or not...they pay fine. It is true that it is relatively niche even for linux folk to want to do this sort of thing, but that has more to do with laptop vs desktop form factors than the market. If it were a common need, I think it would be a common thing found on the market. In fact the existing ext4 stuff for Windows indeed used to be paid, but this was primarily for Windows users, Linux users have had no issue accessing ntfs drives for ages, and generally didn't really enjoy giving Windows access to their drives anyways, what with the market for viruses and whatnot...
The core obstacle is financing - solar traditionally takes a long time to pay back from energy savings, so the financials of solar on warehouses didn't work out. The IRA made it possible to sell the tax credits from solar deployment on warehouse roofs (e.g. https://www.reunioninfra.com/) so now solar on warehouse rooftops can make financial sense in many more instances.
>So... I'm left wondering why anyone is listening to this guy. Especially on a subject where he has been caught lying and rewriting history multiple times.

Hot take: Because their push for more users was successful, resulting in a massively large user base, the majority of which I would argue is the "lowest common denominator" crowd (read: mindless consumption) and would more quickly go, "Reddit cool, spez cool" than actually pay attention to what's happening there internally.
SQLite NPM Package
It took me a while to cancel spotify even though YT music came free with YT premium. I assumed the algo would be on par given the quality of the video recommendations but it took months for my YT music recommendations to get close to Discover Weekly.
I really can't relate to most of your points. Words either come naturally as they do for everyone else or you don't use the word in that language therefore you will try to guess it or think of a similar one. This just means that you are not exposed to the same vocabulary in both languages. All my Comp Sci and Math vocabulary is in English because of school/online/talking to others. All my botany and plant knowledge knowledge is in Spanish because its my mother's hobby and that's how I know it. Only if I switch the languages will I struggle with the vocabulary.

The only time when I felt having to use more mental capacity was when I wasn't fluent in the language, the idea of languages being a constant cognitive load is as ridiculous as thinking that you are better off not knowing anything at all due to the toll knowledge takes on your mental capacity.
There's a Sheetz in Stephens City that adds like 10 minutes to get to. Add 15-20min for actually charging. If you do it both ways, that's probably less than 1 hour extra on a 6 hour drive. Hardly a "multi-hour" detour. And if your camping area has power, you probably don't even need to stop at all.
Reddit Outreach
Hey Guys, We just launched Our RedditOutreach platform specializing in connecting startups with active Reddit communities that are relevant to their niche. We understand the importance of finding your first customers, and our team @ RedditOutreach would like to help you achieve this milestone. We're just testing with our first few customers but it's a formula i've developed & used in my own businesses. Would like your feedback.
While I hiked a lot as a kid, philmont, etc, I did a section of the wonderland back in 2013. My buddy is gluten intolerant. My hobbies is hobbies. While it was slightly annoying and ironic to make my own dehydrated food, where you cook the dried macaroni, then dry it back out only to add it back to hot water), it was fun and easy and the food was way better than the pre-packaged. Especially if you have a food dehydrator already which many people do. makes amazing apple chips when you use a meat slicer to cut the apples.

I had tried gluten free pre-packaged but it was terribad... And even higher in sodium than the already 90% daily value per meal pre-pacakged dehydrated stuff. I made chili mac, chili, spaghetti. And a lot of jerkey, when you make the jerkey the night before the height you can get away with a lot. The turkey jerkey was delicious.
Abstract

This technical report presents the application of a recurrent memory to extend the context length of BERT, one of the most effective Transformer-based models in natural language processing. By leveraging the Recurrent Memory Transformer architecture, we have successfully increased the model's effective context length to an unprecedented two million tokens, while maintaining high memory retrieval accuracy. Our method allows for the storage and processing of both local and global information and enables information flow between segments of the input sequence through the use of recurrence. Our experiments demonstrate the effectiveness of our approach, which holds significant potential to enhance long-term dependency handling in natural language understanding and generation tasks as well as enable large-scale context processing for memory-intensive applications.

Introduction

The Transformer model (Vaswani et al., 2017) has been widely adopted and used in various research areas and industrial applications. The most important issue of the model is quadratic complexity of attention operation, that makes large models increasingly difficult to apply to longer inputs.

This report we show that by using simple token-based memory mechanism introduced in (Bulatov et al., 2022) can be combined with pretrained transformer models like BERT (Devlin et al., 2019) with full attention and full precision operations can be applied to sequences longer than 1 million
tokens using a single Nvidia GTX 1080Ti GPU.

Contributions

1. We enhance BERT by incorporating token-based memory storage and segment-level recurrence with recurrent memory (RMT).

2. We demonstrate that the memory-augmented BERT can be trained to tackle tasks on sequences with lengths up to seven times its originally designed input length (512 tokens).

3. We discovered the trained RMT’s capacity to successfully extrapolate to tasks of varying lengths, including those exceeding 1 million tokens with linear scaling of computations required.

4. Through attention pattern analysis, we found the operations RMT employs with memory, enabling its success in handling exceptionally long sequences.

Discussion

The problem of long inputs in Transformers has been extensively researched since the popularization of this architecture. In this work, we demonstrate that applying Transformers to long texts does not necessarily require large amounts of memory. By employing a recurrent approach and memory, the quadratic complexity can be reduced to linear. Furthermore, models trained on sufficiently large
inputs can extrapolate their abilities to texts orders of magnitude longer.

Synthetic tasks explored in this study serve as the first milestone for enabling RMT to generalize to tasks with unseen properties, including language modelling. In our future work, we aim to tailor the recurrent memory approach to the most commonly used Transformers to improve their effective context size.
That's the expansion. What does it represent?
If you use uBlock Origin, you can hide any element on any site. If not you could also write an extension. I remember someone saying they wrote one and called it "Eat My Shorts" (lol). Perhaps you could search for that.
I am not sure I agree with this assessment. A tirade isn't the first response and it deserves attention and a degree of empathy, but it is unprofessional almost universally. You generally don't need to do it (it is not competitively advantageous to try) and does not make the tirader nor the tiraded feel better.

This is not to say a colleague should be a zen automaton that never feels discontent. However, learning not to get too upset when giving feedback, and similarly, giving feedback before you are that upset, are professional skills.

So when the author says they can feel better about the interaction, it might make more sense to read that as "yes, I did something wrong, but this was also quite a silly exchange and it sort of lifts the intensity off a bit". Which, considering the author is indicating that they're worried they said the wrong thing to begin with, would make sense (since they are attempting to empathise).
Interesting. Never had one but I never thought about it. So there aren’t any more pesty bugs that it’s effective against?
Yes, I have started watching the "how much do you pay for rent in New York (I think there are also other cities but I mostly get nyc videos) and the comments are polite, dare I say kind even.

Very thankful for this change, whatever the cause might be :)
You seem to speak 4 languages so well that at least in one of them you can't count to 5 ;)

Please take this tongue in cheek, as in kind of like the other comment said: for lots of folks splitting that atte tion is detrimental at least in some regard.

Personally I think some diversification in language is good. It "keeps you on your toes". If you never use a muscle it will deteriorate. But you won't be able to exercise all of your muscles equally all the time.

That said I do get your point about viewpoints. It's so easy to just have exactly one if all you speak is one language. Plenty of places in the world today where that is the case. And it's not just the ones we see in the international news all the time.
I'm not sure if you're joking or trolling, but on the chance that you're not:

>So there is published evidence, that it cannot pass novel Winograd schemas?

There is no published evidence that they can, which is what I said.

>Could you please provide me with the sources?

I cannot prove a negative to you with a source. You will have to review the literature like I did.

>From my experience you can make GPT-4 pass novel Winograd Tests by giving GPT-4 additional context.

This is why I am pretty sure you're trolling. This is a lot like saying "You can make GPT-4 do prime factorisation of a semiprime by noting the constituent primes." The point of testing the model is to see if the model can give you the answer, not to give it the answer. The point of Winograd schemas as a test is that they test the ability to attribute pronouns using common sense, without additional context. The reason it's a good test is that every competent human being can pass the test, and as of yet no computer can.
eh, there is always somebody who inevitably frets on about these hallucinations, but I find that most of the people who are super worried about these aren't actually using the LLMs the way that they're intended.

For example, I needed a GitHub action that would automatically check out build and deploy a node project to a VPS. I also needed it to pipe out the secrets into a local environment variable (.env) and copy that over to the VPS as well.

GPT4 got it in one try. Its this kind of DevOps boring mundane crap that GPT excels at eliminating. Even though I had very little familiarity with the syntax for GH action yaml, I was able to read it and reason out that it was correct.

Could I have sifted through the documentation, or waited through 50 stack overflow pages? Sure, but this was a hell of a lot more convenient.
I read the paper, but I’m not sure that I understand how the memory unit works. It seems like they reserve special tokens to read and write to this memory between layers, as guided by the self-attention heads. In this way, the model can learn to squirrel away important details from the input prompt for later recall in subsequent layers. A global chalkboard mechanism. Am I on the right track?
But they had AIs that generated stories in the 1960s! Were those "intelligent"? Some people back then said they were.
Could you point me toward any more info or keywords on "the cartpoll demo famously tripped up derivative based reinforcement learning for awhile"? It sounds like an interesting bit of history but my google searches are only bringing up python tutorials.
Big subreddits are the worst for this. People will repeat poor quality comments they've seen upvoted in other posts because they know it will be upvoted by others who recognise it. Even though the original may have only been noticed because they got in early and confidently.
i know plenty of people who go on 20-25km day-hikes as a casual outing that requires no planning or forethought beyond waking up in the morning and deciding to go for a hike, and they'd all say 6 days for the west coast trail is a reasonable pace.
Analysis shows California EDD fraud at $32.6B and counting
I still remember, all these years later, how my CC statistics teacher “taught” us that airplanes don’t indeed fly by the Bernoulli principle producing lift but because the wind hits the underside of the wings and pushes it up into the air.

Totally random I know.
Agreed. Based on the headline, I was expecting more of a "gamer" gamer demographic--those that identify as gamers. But when I got to the breakdown of game categories, it was basically all digital board games and puzzle games.

Games: yes

Gamers: not the type of gamers that would self-identify as one

Not trying to be disparaging, but I just was expecting something else from the headline.
https://archive.md/n0Ses
hmm. sounds like a good use case for the chatgpt api
The funny thing is I've had the exact same experience as the author but come to the completely opposite conclusion. Working with ChatGPT as a daily driver isn't for me precisely because of this:

>I have had to be very attentive because it sometimes produces code that runs but does not do what I asked

It's like someone putting sand on your toothbrush and in your shoes. The subtle way it messes up are in many ways worse and require more attention than dumber tools. It's even worse than humans because the ways in which it fabricates nonsense aren't the kind of mistakes a human makes, it's not like you're coding with an intern but like you're coding with ALF.

The constant context switching between "it's nice" and "it's sabotaging random things" is so taxing if you don't want to mess up. It's like self-driving that way. An automated system that works 95% is worse than one that works 20% of the time.
This is bullshit. Honestly I'm disappointed to even see this posted here. I mean, as a horror story that convinces people to be careful when they experiment with drugs, maybe it has some value.

But as a description of a reasonable approach to trying LSD? Come on. He should've started with 1/10th that dose, especially considering his bad experiences with shrooms. This is asinine. It's like throwing yourself into the deep end of the pool, not knowing how to swim, and then accusing everyone else in the pool of being assholes for making you drown. Come on dude.

I've tried Codeine recreationally, a couple of times, and it gives me the spins - the nausea just isn't worth the trip. Knowing this, do I try an epic dose of Morphine? No, of course I don't. Do I make angry blog posts whining that everyone has lied to me about how good narcotics feel? No, I also do not do that.
Hammerspoon can do it for I have it in my config. I also have it so I can switch to open windows on the same Space (I can throw windows into a tiled view and jump around to them). It's extremely flexible if you are willing to play around with it.
So charge before you are down to 30 miles?
If you can pip install those libs and they work on your platform then it looks like this should work--it's just a nice opinionated wrapper around pip, virtual env and other Python tooling. If you need conda installs because those libs have specially compiled native depencies (boatloads of fortran code, etc) then you're going to run into trouble and probably should stick with conda.
with 84% identifying it as their gaming device of choice and three in ten (30%) exclusively using their smartphones for gaming.

There it is. Sure, shovelware mobile gaming is technically a part of the gaming industry but should you really give a damn beyond economic reasons? It's like saying so and so group is a growing force in cinema but they're watching The Emoji Movie.

Who is crafting amazing experiences on mobile? Which smartphone games move you to tears? What studio is pushing graphics to the breaking point and making users go "oh my god, I didn't know games could look like this"? When's the last time you bought a soundtrack from an iPhone game? Nobody and never.
Links, if you don't mind?

Inquisitive minds wish to know.
I also speak the same four languages plus one more.

I do consider there are advantages to speaking several languages.

I learned from English that you can be very precise, but also economical in exposition of complex matter.

I learned from Russian how incredibly powerful and nuanced a language can be (too bad it is currently used to scare people everywhere). I always say that "you can translate anything into Russian" and, if you have the skill, it will carry over the original style, atmosphere, and colour. Not sure how to explain this, but e.g., you can almost get a feel for the New-York accent reading a good translation into Russian. I heard from several people that Arabic has a similar power of expression.

I learned from French that there are way more words for expressing feelings than I was using before, and also a certain way of having no-pressure intellectual, exploratory conversations, exchanging ideas among peers. It has a certain rhythm and many turns of phrases that work very well for this.

In Romanian you can be incredibly sophisticated (via modern French influence), but also stay close to the agricultural and pastoral roots. The language just has this great dynamic range. Romanian literature has examples of great works that are essentially collaborative, and have hundreds maybe thousands of authors (some likely illiterate), and that were passed along in oral form with various modifications that were finally recorded and published less than two centuries ago, and are very much readable by modern speakers.

===

Bonus: More things that I learned from English are certain expressions that guide you into a (I think) pragmatic world view, e.g.:

- thinking clearly about hidden assumptions, e.g. "don't make assumptions", is easy in English, but is convoluted and indirect in the rest of languages I speak.

- what I call "scoped" phrases, e.g. "just because IDEA1 does not mean IDEA2", or "IDEA1, though IDEA2", where English language helps you to avoid exaggerating or generalizing too much, by making it easy to "scope" your statements, but also helps you to be explicit about the boundaries within which your statement is true: "Just because I refused your first request, does not mean I don't want you to try again."
Sure you could do this. But why would anyone want to?
Mosquitoes are pollinators, only the females suck blood, and that's only to produce eggs.
Outside the US ... the variables change a bit.

India for instance -- A typical kid in many places here (especially southern part of the country) has 3 languages formally taught in school and consumed as popular media daily.

Having privilege in these regions usually translates to levels of literacy like having reading ability (in addition to just speaking for trade), reading literature, speaking fluency, broader vocabulary, "better" accent, etc. -- all of which, in thousand different ways, signal one's socio-economic status in every interaction.
Did we? I didn't see it. Do you have a source?
How to install Vicuna language model on Mac (2 ways)
In French as well: "papillon de nuit"
>As someone fluent in four languages*, I agree. I would even argue that the opposite of an advantage is true. Consider this: it adds unnecessary cognitive load. When trying to think of a word, it comes to you in four different languages, which isn't helpful!

I've heard that there is an unusually high rate of mental illness among European Parliament translators.
English has a reputation of excessively borrowing words from foreign languages. I don't think English is actually any more prone to doing this any other languages, but English does have a stronger habit of insisting on using foreign spellings and pronunciations for words.
> Or am I missing something.

One of the things you may be missing is that the article is about "efficiency" as opposed to total impact.

"researchers found that 83% of insect visits to bramble flowers were made during the day. While the moths made fewer visits during the shorter summer nights, notching up only 15% of the visits, they were able to pollinate the flowers more quickly."

Moths are doing great work, but they don't have much time to do the work in and they are not doing the bulk of the work. Also it seems that the night pollinators actually may largely work different flowers than the day pollinators so one can't necessarily pick up the load left by the absence of the other.
Check out the Dyson family.
I only sub to YouTube premium and have never used Spotify because yt music is awesome.
So what species are the native pollinators here in North America?
Couldn’t it be as simple as their their auto detection is weak and their manual detection is good but isnt done on everything?

In fact, isn’t that exactly what we should expect?
A 2kW generator will get you like 6ish miles per hour running. A gallon of gas will get you less than three hours of running, so probably less than 18 miles or so.
This is a ridiculous assumption. I'll boot my PC multiple times per day because I dual-boot and I'll sometimes need to switch between OSes repeatedly.

This is also a ridiculous dismissal. Snaps don't increase your startup time because it's an intrinsic limitation of the technology (e.g. like how internet connectivity necessitates higher power draw), but because they're designed badly. There's no reason for them to act like that, and people are rightly upset at it.
> isn't suddenly going to make you better at math or physics or geography

There are other forms of intelligence. Plus, I'm not so sure you are right about those. Finally, it might be useful to read what people have written in other languages about those topics.
“training sets are useless except for creating a new thing”

So by useless you mean absolutely essential?

Hard to argue the fair use thing but it was designed around humans not AI so just because it is fair use now does not mean it should or will be in the future.
ReVanced has that capability.
I believe there was indeed some research done in the past in which multi-lingual people would generally recover better from strokes compared to people knowing only a single language.

Perhaps additional "connections" are made in the brain that can be used when other "connections" are broken due to stroke.

Anecdotic-ally, my father also recovered quite well from his stroke and he knew Dutch, English and likely a bit of latin languages as well (had Italian and Chinese penfriends when he was young, often used Latin proverbs, ...).