skysight-inc/HackerNews huggingface dataset:
They seemed to be pretty mindful of this contamination, and call out that they agressively pruned some training dataset and still observed strong performance. That said, I agree, I really want to try it out myself and see how it feels, and if the scores really translate to day-to-day capabilities.

From section 5:

In Figure 2.1, we see that training on CodeExercises leads to a substantial boost in the performance of the
model on the HumanEval benchmark. To investigate this boost, we propose to prune the CodeExercises
dataset by removing files that are “similar” to those in HumanEval. This process can be viewed as
a “strong form” of data decontamination. We then retrain our model on such pruned data, and still
observe strong performance on HumanEval. In particular, even after aggressively pruning more than
40% of the CodeExercises dataset (this even prunes files that are only vaguely similar to HumanEval, see
Appendix C), the retrained phi-1 still outperforms StarCoder.
Also, climbing with protection can be very therapeutic. As can bouldering. It doesn't have to be deadly to really, really focus your attention. Your brain doesn't want to fall even if it's just a few feet.

It's also a remarkably mental exercise. I love when they set new routes and you can watch the high level climbers gathered around, mentally rehearsing how to solve a problem.
I’m going based on what my experience of consciousness is. Why do I need to look up some definition when I can just refer to any given second of my experience on this earth to see what it is and what properties it has?
Why do you think lending exists?
In the ethereal melody of a once thriving reef, we perceive a poignant echo of profound loss, reminiscent of hearing the tender voice of a dearly departed beloved. Drawn inexorably towards it, like a moth entranced by the siren call of a flame, we seek the comforting symphony of life that once flourished. Yet, akin to the cruel illusion of pursuing the ghostly whispers of our past, we know the vibrant chorus we seek has danced away into oblivion. Akin to the article's title, the pain of this elusive quest is a melancholic symphony, a mournful reminder of the vibrant life that once was, and the silent void that has come to be.
> the most populous country in Western Europe restricts abortion completely.

Depending on how you define Western Europe, the most populous country is either Germany or the UK. Both offer abortion for practically any reason within 12 or 24 weeks, respectively, and for health reasons even later. BTW, the cost is covered by the state or statutory insurance (depending on need) in both countries.

> How many states does that apply to?

Texas, Florida, Tennessee, Wisconsin and quite a few others. About 15% of Americans.

> And I think that the "unpersoning" of the fetus is a similar coping mechanism.

I respect other people's spiritual beliefs, but you need to understand that as someone who grew up in a Jewish home, the thought that a foetus is a person sounds as foreign to me as the thought of a tree as an ancestral spirit or of a communion wafer transmuting into the body of Jesus. I know there are people who actually believe such things because of long traditions, but it's impossible for me to believe in them.
I've been following the LLMs and I don't think it's 'running out of road', except in the sense that it's expensive. The model perplexity keeps decreasing when you scale up the parameters and exaflops and dataset sizes in the right proportions, and this decreasing perplexity is what has been unlocking so many amazing cognitive capabilities. I think the limitations are about regulatory deals not about any kind of technical roadblocks.
You’ll have to call Netflix to cancel and they’ll just pass you around the call Center until they hang up by accident.
I wrote a response of all the barriers between me and my thoughts when an e-Ink tablet (Remarkable) is powered down or sleeping, but that was just kind of pedantic and obnoxious so I deleted it.

The reality is that you can go back to your papers and journals, often many years later, and see an arc, a leitmotif that you cannot with digital.

Yes, I have 20 year old plaintext notes, but there is something about flipping through pages of a diary late night or idly on a sunny day; seeing the scrawls, feeling the urgency or lethargy in the penmanship that cannot be replicated.

I have lots of devices, some of them quite fun and lovely, but really, pen and paper have the least friction and longest conveyance of subtle thought.
$20 for a month, $120 for 12 months
> in reality the populace harbours the same ambitions for a return of Russian imperial power that the Russian leadership does, and also holds similar moralistic perspective

Or people are terrified that if they appear to not be supporting the war they would end up in the gulags or, ironically, get sent to the frontlines with a gun pointed at their back.
Thank you so much for taking the time to provide all this guidance. I definitely missed the boat by not knowing to look for “parser” IF.

I’m excited again to know there’s choices out there for this kind of thing.
Because it so perfectly encapsulates man’s hubris.
That’s a real disparaging view. It’s pretty clear that he intended to survive all of his climbs.
>first striking observation was that there was no enough information about what’s going on and there is still not enough.

I "ran" a bot/crawler hobby project that takes a russian-speaking telegram channel as an input and outputs the messages in a translated form, including text, images and video. During this situation I realized this became really relevant so I improved during the coup it to support multiple input channels and to keep a queue as post processing takes long for videos, and to provide audio transcriptions (Prigozhin himself likes to post audio clips)

I don't think its true that there was not much information. There actually was minute-by-minute updates by citizens, Wagner itself, establishment-oriented channels etc. You can read the backlog if you want:
https://t.me/translatedrussianpropaganda

At the peak there was some real queue and I had to switch from running it on an ARM VM to my 12-core local system just to keep up. Whisper takes the longest to run, and given it translates spoken russian really well, I claim it was the first source of information in several occasions for people that don't speak Russian, for the few people that actually joined the channel (I didn't advertise it but on a small forum because I knew it might become a maintenance/fixing burden).
I went through Algorithm Design Manual before learning Discrete Math[0]. Suffices to say, I had plenty of these "always has been" moments you're talking about :) The book is great at explaining algorithms, math prerequisites and all. Then you try the exercises, and they leave you with a subtle feeling of "hmm, perhaps there's more to this algorithms stuff". As an example, perhaps the first time I got this was in chapter 1, when I encountered the greedy pirates puzzle[1].

[0] Had plenty of books to select from. Kenneth Rosen's was the only one I liked. Knuth's Concrete Mathematics is great if you decide to give a subject a second go -- the material is somewhat different, more abstract, and the side notes by his students are hilarious.

[1] https://www.mathsisfun.com/puzzles/5-pirates-solution.html
The original commenter is trying to build intuition so my statement was simply to help the commenter understand that Transformers can operate on patches.

As for
> after all, the original authors didn't anticipate the use case in Vision.

To quote the original "Attention is all you need" paper:
"We are excited about the future of attention-based models and plan to apply them to other tasks. We plan to extend the Transformer to problems involving input and output modalities other than text and to investigate local, restricted attention mechanisms to efficiently handle large inputs and outputs such as images, audio and video"

To say that the original authors did not anticipate the Transformers use in Vision is false.
look at MUDs. some of those are fully programmable. i am most familiar with LPmuds, which are written in LPC, which is a complete programming language. (Pike a general purpose programming language is derived from LPC. and there are also a few small MUD engines written in Pike)

though for a standalone game a full MUD may a bit much since they are designed for large words with hundreds or thousands of players. but take a look at the available game engines and see which ones come with decent documentation for you to get started easily.
but, owing to cultural changes, it turns out that women can also perform the work necessary for an economy to function.
What parent is really saying is, “it’s not going to impact me so it’s fine for humanity to suffer”
I use NixOS daily as well, I installed home-manager as part of my initial configuration and have basically just ended up using configuration.nix in a git repo for everything anyways since I'm the only user. It feels like a good idea in theory, but I don't think it's actually that useful for most
Mastodon instances have RSS feeds where each item links to it original location on its original instance, not the instance where you got the feed. This is useless for engagement, because you have to jump through hoops to reply to a post.

https://stackoverflow.com/questions/74579163/how-to-resolve-...

https://github.com/Riduidel/mastodon-rss/issues/7

The issue states that there isn't an API for it. What isn't needed is an API to resolve a foreign toot to the local one, but for the Mastodon instance to make available the local feeds in RSS form in the first place. There is no logical reason that you can see local toots on some hashtag topics in the web UI, or an app, but not in RSS.
It'll be a whole lot better to debate than not, but have accepted rules of the debate - e.g. that it'll be evidence based.
It’s the same as any other extreme sport - skill reduces risk but cannot fully eliminate it. Eventually a skydiver’s parachute will fail in a way they couldn’t have prevented, etc.
So looks like the coup was fake, I find it funny that the coup ended before you could send a single source link. I just wanted to know where people got their info, I wasn’t asking for much.

https://amp.cnn.com/cnn/2023/06/24/europe/russia-putin-wagne...
Not all programming is equal, and there's a big difference between programming alone/as a hobbyist and programming for profit. I think studying most any topic is likely to give one new or interesting perspectives in programming, but the question is: is the juice worth the squeeze?

If you asked me to describe a 'better programmer' in a professional setting, it would probably be:

* writes understandable code

* knows when to optimise/dedupe /abstract, and more importantly, when not to

* treats it like a craft, but knows that pragmatism is also key

* can communicate about code, explain concepts and just be generally helpful and pleasant to others in or outside the team

Thats IMHO anyway, and those things don't seem to have much to do with math.
This is why you need a lawyer familiar with the local regulations, which clarify these things. Thus this test is invalid because there should be an “there is not enough information to answer” answer.
What if mercedes "lobbied" to have those put in place for brand price bloating?
I do think there's an element to it of "uncanny valleyness". If you know absolutely nothing about a topic the authoritative tone and factualness of what it says is very appealing and even helpful in the same way that consulting an encyclopedia is helpful: it tells you of things you could investigate further that would never appear through a keyword search. But if you stop there, your knowledge is "roughly encyclopedic" which means it contains the hidden bias of some anonymous author, and not the harder-earned relationships of facts and logic.

If you use it to translate things between formal encodings("turn this into hexadecimal bytes, now role-play a lawyer arguing about why that is meaningful") it can produce occasionally useful aesthetic results and speed along tasks that would be challenging to model formally and don't need a lot of rigor.

But once you start pushing it to be technically accurate in a narrow, measurable direction it flounders and the probabilistic element is revealed. Once, I asked it to translate a short string of Japanese characters and it confidently said that it was Kenshiro's catch phrase from Fist of the North Star, "Omae wa mou shinderu" (you are already dead) which I could clearly see it wasn't - not a single character matched. It's just the thing if you need to learn some anime Japanese, though.
This is not as actual real episode, just a weird fan edit
It may also spell trouble for horizontal scaling. A 128 core computer with a few terabytes of RAM could handle loads that that would otherwise need dozens of computers. There are huge advantages in terms of ease of management and programming.
"Capitulate or we'll starve you" is an effective rod.
So sounds like, it is even more immutable than race. Because 1-3% is smaller than a ratio of people with 1/8 to 1/32 African blood, to those with >50% African blood, and those people between 1/8 and 1/32 have a fluid racial identity that depends on their circle of contacts, neighbourhood, and personal choice (see https://archive.is/uMVKL). Someone literally has a better chance at changing their race than losing weight.

"Anti-obesity propaganda" is as good as KKK to alienate a large group of people, and will achieve little else.
There are varying degrees of truth to what you say, but the real point is about how risk management and mental health interact.

Reasons that free soloing isn't necessarily suicidal-tendency levels of poor risk management:

1. Do Not Fall zones aren't unique to free soloing. This is also true for ALL ice climbing, but also for a lot of trad and aid climbing. And even in some cases for sport climbing and bouldering. In fact, free soloing is -- for many practitioners -- a natural extension of the run-outs found on sparsely protected lines. I've taken more risks with my life on the sharp end than out alone. I think that's probably true for most climbers. And the closest I've come to death was a stupid trundling mistake on a to-be-developed sport climb.

2. Life is dangerous. Free soloing a juggy ledge-strwen route below 5.5 definitely feels WAY, WAY less dangerous than the drive home. For example. You are more likely to die on the drive home. More to the point -- you are more likely to die on rappel or from rock fall.

3. Free soloing routes that I know up to 5.6 is no more dangerous -- for me -- than hiking on an exposed trail. And in some cases feels way safer than climbing with a rope and gear (see #1; also, climbs at that grade rarely have clean falls). I suspect that for me free soloing up to 5.9 is probably less dangerous than mountain biking or most skiing.

That said, the sort of soloing Austin was doing is definitely of the riskier "fuck that" variety. Oh, and dangerous soloing is definitely correlated with mental health events. The trope of guys doing a ton of free soloing after bad breakups exists for a reason.

Anyways. This is a hard topic to talk about -- especially online -- because "the first rule of free soloing club is...". So you don't have the usual "first hand experience" vs "hypothetically thinking about this" split. IMO it's time to be a bit more open about it, particularly given the mental health thing. I spent a lot of time free soloing. Some of it was dangerous, but some of it was probably no less irresponsible than driving late at night or skiing a bit to aggressively on a groomer. The dangerous stuff happened when I was in a bad place. Let's talk about that more. That's why I appreciated this piece.
I don't think it's not about brand recognition, it's simply about avoiding confusion (I myself thought it was about Chinese chat).
It seems likely to me that multi-way merge is better. 256-way is a bit much, but, with appropriate queueing, you can get close. Among other reasons because, unlike multi-way partition, multi-way merge does benefit from vectorisation, and hence is more efficient. (Of course, for the 'very parallel' a la gpus, partition/radix is apparently interesting again, as you can afford the out-of-place parallel scan.)
12400F max turbo power is 117 watts.
More like, if you cancel, your account gets deleted for good, so you lose your profile with users, history, recommendations. You can pay x/month to pause your membership.
I think there's a few other factors that impact visibility.

* The Bay Area is a place where you can make $100k a year and be classified as low-income [1].

* Tech employees tend to live low-key lifestyles that don't really show how much they're making. I know people who make $500k and still live with roommates.

* Income inequality and progressive politics combine to make people less reluctant to talk about their TC packages, unless you're also at a similar socio-economic level.

[1] https://www.sfgate.com/local/article/under-100k-low-income-s...
This is a bridge collapse, not just a derailment. A much rarer event.
> i don’t think rss comes close to scaling. every single subscriber will poll every single thing every 30 minutes (or whatever).

Well-behaved RSS clients send a conditional request and in most cases receive an HTTP 304 Not Modified response.

> this was a crushing amount of traffic 20 years ago when the web was much, much smaller…

It was?
I mean 'better result from less data' is at least a little bit possible. For example you can just clean out obviously bad data from the trillions of tokens data sets. It's things like the subreddit where they are counting to a million or just like long lists of hash values in random cryptocurrency logs.

I agree that in the bigger picture this doesn't matter, but it's technically true that cleaning the data in some way would help.

A related project is TinyStories where they try to use good data for unlocking the LLM cognitive capabilities without requiring as many parameters or exaflops. Again, there is obviously a limit to this, and maybe the effort is better spent on just getting even more gigantic dataset instead of nitpicking the useless or redundant data in the dataset.
If we do as you say, then goods production will need to shift to the West. China and India will become a drop in the ocean, and we'll be the biggest polluters by far.

How about we stop acting as if the West wasn't just shifting pollution onto poorer nations by exploiting them as factories and landfills?
Many are cyclops and believe that what they can't see can't harm them.
They should have stayed private then. If you're issuing stock you better make sure it goes up or you're paying dividends or nobody will buy it.
I think I read that AmpereOne isn't Neoverse.
I don't see the issue the previous poster had either.

I went to the source to find the context and linked it here for others, but it hasn't (for mysellf at least) shed any light on what they were objecting to.
They will simply make monthly plans absurdly expensive unless you commit to a 1-year contract. The more things change, the more they stay the same.
Business administration + new trade segment
Is there a newsletter that provides updates on this? It’s disconcerting that I may be conforming unwittingly.
Thankfully, this is downstream of the eponymous national park.
> He did so without the consent of many of his co-authors and
despite having been told of problems that should be corrected before publication.

I think they are point out consent issues in multiple cases, but also talk about "problems that should be corrected before publication".

I can't really see how there would problems to be corrected before publication.

If it's only a consent issue but the rest of the methodology is sound, they should just say "Drori should have waited for the consent to go ahead with publication, but the paper is fine"?
I once traveled every few days/weeks for a year wandering around South Asia. I had a similar realization that traveling is amazing in so many ways but you begin to establish a new normal. The way to break out of the ordinary is through your mind - books, meditation, breath work, etc.
Calling fish with a phone is also a good way to bring in the fish.

https://oceansciencehistory.com/2013/10/12/phoning-fish-the-...
I read this pre internet but I think the book was called “the unconscious civilisation”. I really loved it at the time, but haven’t read it for 30ish years.
I think you should do some research on the topic before you conclude that "NATO is out of ammunition". I highly recommend Perun https://www.youtube.com/watch?v=deK98IeTjfY .
One thing about church music is that many melodies can be interchangeable. There is often a Metrical Index in your hymnal, and tunes are identified often by names (ALL CAPS) and metrical numbers. So it is often the case (Ode to Joy) that there are three sets of lyrics set to the same tune, as well as several different tunes to sing a single text (Mass parts take this to an extreme: how many ways to sing the Kyrie or Pater Noster?)
Adding to my thought to answer your question:
Too many software products have failed over my 40 years of computing. Plaintext lives. ReadySetGo! documents do not.

What I do now:

- Meeting notes are always digital and plaintext for posterity and search, I use LogSeq

- I have a daily paper journal and calendar. These become interesting over time. Looking at my monthly calendar from 1993 in Prague is pretty cool. I was a cool guy back then, I swear.

- Paper journal for deeper thoughts, ambitions, plans, goals, insights. These matter, and that's where you can see the arc over time. I personally love a Pilot Metropolitan gel pen and a Leuchterm notebook. I have fountain pens and all that, but really, you need a balance between pleasure to use and not afraid to turn the book into a mess.

- For me, the joy of computing these days is using Stable Diffusion (SD) to produce incredible images. I don't want normal, I want whatever SD gives me. Its a surprise and delight. I recall an article in an art magazine about how a photographer gave his blind friend a camera; the images the blind friend produced were unbalanced, blurry and overexposed. Each one visualized a glimpse into a world we can't inhabit. SD does that for me now. I'll keep the old models as it improves.

- Oh (I've edited this like, 10 times), for brainstorming, there is nothing better than an 11x14 newsprint sketchbook. You can draw all over it in every corner and use spacial organization for your thoughts. Like a cheap, indelible portable whiteboard that you can take to the beach or mountains. Best thing ever. What about digitalization? Retyping is an editing exercise.
"Switch-on Bait" too.

Makes me think of using lights to attract certain fish... although I imagine the susceptible are getting selected-against pretty heavily when it comes to evolutionary pressures by now.
I feel like you and all the people replying to you are completely missing the obvious. To someone who has been depressed for many years, for someone who literally (according the article) contemplated jumping of the roof of a 10 story building, "probably dying at some point" is not a deal-breaker or even all that much of a downside per se.

We're all going to die at some point, and while most/many of us might want to delay that inevitability as much as possible, I don't think it's warranted at all to assume that the same premise applies to every single one of us. This guy realized that the only thing in life he could truly enjoy was climbing rocks. Do we really need to fault him for deciding to then just do that thing until fate eventually catches up as it always does?

Sure, it may be rough on the people whose lives they intersect with, but provided they're not a parent raising a child/children/etc, acceptance of one another for who we are is all that remains. Personally, I'd take short-lived good company over long-lived mediocre company any day.