skysight-inc/HackerNews huggingface dataset:
>What are you trying to say?

That every time a third world nation during the Cold War moved towards democratic rule (along with the land and resource re-distribution that will inevitably follow from politicians engaging with the interests of the franchised population) there was immediately counter-opposition in the form of reactionary para-paramilitaries, or military coups internal to the state. This subversion was often funded by foreign intelligence agencies and business interests (essentially always, though the degree may vary e.g. Brazil had a much more embedded reactionary sector thanks to the legacy of slavery and the social castes that arose, compared to say Indonesia where the CIA had to do a lot more work in directly authorizing bombing campaigns and funding anti-communist programs for young military officials in Sukarno's government) [see Vincent Bevins book on Indonesia].

>The fact that the French were as brutal or much more brutal is tangential

No its not tangential at all unless you are missing the point I've made. Do you not understand that militant terrorist tactics come out of a reaction to brutal oppression? It's not a difficult concept to grasp: any situation where peaceful opposition is stifled, democratic political action is repressed, and activists targeted for arrest and extra-legal violence, you force people to either form or support groups wielding militant guerilla tactics which include terrorism and brutality, since such groups cannot be quelled so easily.

And this is a fact well known to colonialist powers both historical and contemporary as is reflected in their tactics, since a militant opposition is much easier to frame as violent barbarians than their peaceful predecessors and is used retroactively to justify their oppression.

>I'm not sure why do some people insist on treating the world as black and white and are so obsessed with some sort of ideological purity of one type or another

Where are these people you're talking about? Can you show how anything I said relies on some explicitly moralistic or ideological argument? Do you understand that I'm not thoughtlessly cheer-leading violence but simply pointing out that it is an inevitable consequence of colonial repression?

To the contrary I think the moralistic position would be to argue that historical actors should be condemned retroactively for engaging in any kind of violence while refusing to consider the immediate (and asymmetric) cause of such violent resistance as a contingent factor. Not sure how your abstraction of history into a series of totally unrelated events, wherein the actors should be morally judged individually constitutes a less subjective analysis.

Who would you have supported in the place of FLN? What should they have done to earn your approval? Would would be the outcome of such an action in that context? Of what use is any of this speculation?
Beast Games review – one of the most undignified spectacles ever shown on TV
Rather any Logic puzzle you post on the internet as something AIs are bad at is in the next round of training data so AIs get better at that specific question. Not because AI companies are optimizing for a benchmark but because they suck up everything.
Best-Selling Cars, Trucks, and SUVs in Each State
The withheld part is really a red flag for me. Why do you want to withhold a compute number?
Here's a controversial take: electricity is incredibly cheap for the utility it provides.

It is also a fairly well working market in the current system context.

I witnessed this by working for an electricity related startup and by doing all the math involved it was really hard to make the math work out right. The possibility to optimize is there but the margins are really slim, even with the large price swings in the time of use markets in EU.

Can the infrastructure be better? Absolutely, it needs ton of work, but again margins are slim and incentives for large improvements are small.

Do we have a dire need for renewable and moreover dispatchable renewable energy? Absolutely. This means more clean generation and more storage (quite hard).

Does energy feel expensive for households? Yes.

Is it actually expensive?

Could you imagine life without it?

What would it be like?

If you were in this situation, how much would you be willing to pay then?
How do you know that LLMs “aren’t that” if you can’t even define what that is?

“I’ll know it when I see it” isn’t a compelling argument.
Intelligent systems simply cache and re-use versions and do stash deps for every toy project without consuming space.

Also installing everything with pip is a great way to enjoy unexplainable breakage when a Doesn't work with v1 and b doesn't work with v2.

It also leads to breaking Linux systems where a large part of the system is python code. Especially where user upgrades system python for no reason.
And so was Docker before Nix
Interesting about the cost:

> Of course, such generality comes at a steep cost, and wouldn't quite be economical yet: you could pay a human to solve ARC-AGI tasks for roughly $5 per task (we know, we did that), while consuming mere cents in energy. Meanwhile o3 requires $17-20 per task in the low-compute mode.
o1 is when all else fails, sometimes it does the same mistakes as weaker models if you give it simple tasks with very little context, but when a good precise context is given it usually outperforms other
Models
If every car is self driving, there is still the question of where to go.
Based on the chart, the Kaggle SOTA model is far more impressive. These O3 models are more expensive to run than just hiring a mechanical turk worker. It's nice we are proving out the scaling hypothesis further, it's just grossly inelegant.

The Kaggle SOTA performs 2x as well as o1 high at a fraction of the cost
You don’t need APIs if your app includes a web browser, though; you just need the patience to hook into the browser’s APIs, rather than the page’s, in order to backup content when viewed. User-operated Selenium is legitimately the biggest threat model to content islands. It’s too bad a third-party had to invent Grayjay as a standalone, rather than one of the browsers figuring this out and shipping it as subscription-payment functionality :/

(It has to be subscription payment to deal in a scaleable and timely manner with sites changing their page schemas anticompetitively.)
With his support for AfD in Germany it looks like this will spread and fester for some time
OpenAI spent approximately $1,503,077 to smash the SOTA on ARC-AGI with their new o3 model

semi-private evals (100 tasks):
75.7% @ $2,012 total/100 tasks (~$20/task) with just 6 samples & 33M tokens processed in ~1.3 min/task and a cost of $2012

The “low-efficiency” setting with 1024 samples scored 87.5% but required 172x more compute.

If we assume compute spent and cost are proportional, then OpenAI might have just spent ~$346.064 for the low efficiency run on the semi-private eval.

On the public eval they might have spent ~$1.148.444 to achieve 91.5% with the low efficiency setting. (high-efficiency mode: $6677)

OpenAI just spent more money to run an eval on ARC than most people spend on a full training run.
This quote so resonated with me that I thought it worth a specific call out:

> I believe that it is valuable to deeply interrogate nature, not because it is intrinsically right, but because it helps us to understand what materials we are working with.

Also the author mentions Robert Sapolsky, whose work I absolutely adore. If you haven't read any of his books or watched interviews/lectures with him, definitely do so! If you want to understand human nature, he's a phenomenal resource.
Thanks so much for giving it a look!

I can definitely add a cycling data piece or make it a toggle for the existing pieces too!

Will look into adding Strava as well, have worked with it in the past but they recently further restricted their APIs.

Have looked into Apple Music and unfortunately they only make your recently played songs available via API, so have been digging to see if there are other ways to make the visualizations with the same depth as the data I am able to get from Spotify's API.

Will share updates on these as I add them across X and Instagram @_re_pete!
Don't know if you noticed but thats already happening. Mass layoffs in customer service etc have already happened over the last 2 years
> The all-in approach required a forklift upgrade and generated a ton of e-waste.

It really wasn't that bad. I lived through it.

The iMac was pitched as an entry-level Internet computer for new computer users. Many buyers didn't have a computer at all previous to purchasing an iMac, or only had one which was old enough that its accessories would have been irrelevant (e.g. an external modem). Probably the most common USB accessory purchase was external floppy drives - and a lot of users ended up discarding those after they realized they weren't using them.
What's your explanation for why it can only get ~70% on SWE-bench Verified?

I believe about 90% of the tasks were estimated by humans to take less than one hour to solve, so we aren't talking about very complex problems, and to boot, the contamination factor is huge: o3 (or any big model) will have in-depth knowledge of the internals of these projects, and often even know about the individual issues themselves (e.g. you can say what was Github issue #4145 in project foo, and there's a decent chance it can tell you exactly what the issue was about!)
https://www.smbc-comics.com/comic/rite-on

It seems like a related phenomenon to "there's an XKCD about that"
> On Monday, Apple chief executive Steve Jobs is expected to announce a new product that allows iPhone owners to stream music from their personal iTunes collections to their phones... https://news.ycombinator.com/item?id=42473991
Hackers breach Framingham Heart Study data
I shouldn’t have skimmed the tittle
> This picture doesn't make sense. If most don't have any money to buy products, just invent some other money and start paying one of the other people who doesn't have any money to start making the products for you.

Uh, this picture doesn’t make sense. Why would anyone value this randomly invented money?
It's not wasteful if you're giving them to your local Goodwill, or listing them free on Craigslist or something.

It's only wasteful if you're throwing them in your trashcan.
> it doesn't sound compatible with any of the commonly accepted-as-FOSS licenses.

Correct, it violates the four essential freedoms by placing restrictions on commercial use amongst other things.
2011 – Amazon's and Google's Cloud Services Compared
I keep a list of everything that isn’t 100% clear in my commentary, here:

https://elite.bbcelite.com/about_site/to-do_list.html

This is not a big list, and these are all pretty subtle aspects of the game. After 4 years of analysis, I think we’re pretty close to understanding pretty much everything, which is nice.
Thanks so much! I found it funny to look back on those days and see what I did to merit those steps too!!

And yes! You can toggle your units in the Account Preferences under settings, but I should add a note that the option is available because it is buried a little too deep.
So in a few years, coders will be as relevant as cuneiform scribes.
Humanity is about to enter an even steeper hockey stick growth curve. Progressing along the Kardashev scale feels all but inevitable. We will live to see Longevity Escape Velocity. I'm fucking pumped and feel thrilled and excited and proud of our species.

Sure, there will be growing pains, friction, etc. Who cares? There always is with world-changing tech. Always.
So true. Perhaps I'm just thinking it's my people and need to update my priors.
If you're working with C, your developer environment should include, in addition a good text editor and debugger, a fully furnished recording studio so you can record an album while waiting for your program to build.

If you'd like to increase your income, you can try making formulaic smooth jazz for Spotify playlists instead of pretentious concept albums about your childhood trauma that no one will actually listen to ;)
> Too many fractured packaging solutions, not a single one well designed. And they all conflict.

100% this.

Last 4 years, one of the most frustrating parts of SWE that I need to deal with on a daily basis is packaging data science & machine learning applications and APIs in Python.

Maybe this is a very mid-solution, but one solution that I found was to use dockerized local environments with all dependencies pinned via Poetry [1]. The start setup is not easy, but now using some other Make file, it's something that I take only 4 hours with a DS to explain and run together and save tons of hours of in debugging and dependency conflict.

> Python developers would rather save 1 line of code in the moment, even if it pushes the complexity off to another part of the system.

Sounds odd to me in several projects that I worked on that folks bring the entire dependency on Scikit-Learn due to the train_test_split function [2] because the team thought that it would be simpler and easier to write a function that splits the dataset.

[1] - https://github.com/orgs/python-poetry/discussions/1879
[2] - https://scikit-learn.org/1.5/modules/generated/sklearn.model...
And they can also do real studies with plenty of scientific legitimacy. Without evaluating the studies you have no way of knowing if they're biased or not and you're just spreading conspiracy theories.
The blog clarifies that it's $17-20 per task. Maybe it runs into thousands for tasks it can't solve?
Ugandan researchers develop health products based on bee resin
This pretty much. Everyone knows that LLMs are great for text generation and processing. What people has been questioning is the end goals as promised by its builders, i.e. is it useful? And from most of what I saw, it's very much a toy.
> the history and origins of the modern police

> in the US they first emerged as 'slave patrols'

> Sir Robert Peel and his version of the 'police service'

I assume that prior to the "modern" police, policing was still necessary, since there were lawbreakers and troublemakers since time immemorial. What do you regard as the substantive difference between the pre-modern police force and the modern? Did the former somehow serve "all of us" better than the latter?
Does DSM stand for Digital Surface Model?

Thos exact abbreviation is so overloaded that it doesn't hurt to list the words once.
You don't use LSD habitually. If they switched to LSD, then that's very interesting.
as an avid apple music user i am continually frustrated by what an afterthought the windows app is

it's a continuation of apple's legacy of barely putting in the minimum to ship anything for windows.

there's a reason i won't use their password manager, etc. i still interact with windows, and basically any key app i use can't be apple-made because the windows experience will be utter trash and the linux experience will be nonexistent.

i make do with the windows apple music app but it is objectively a bad experience.
That's the low-compute mode. In the plot at the top where they score 88%, O3 High (tuned) is ~3.4k
AI are very good at gaming benchmarks. Both as overfitting and as Goodhart's law, gaming benchmarks has been a core problem during training for as long as I've been interested in the field.

Sometimes this manifests as "outside the box thinking", like how a genetic algorithm got an "oscillator" which was really just an antenna.

It is a hard problem, and yes we still both need and can make more and better benchmarks; but it's still a problem because it means the benchmarks we do have are overstating competence.
The other week, it was not very windy but it was cold, so the energy price spiked pretty high (£1/kwh). Other times the energy price falls pretty low, and I regularly see it be negative for some hours of the night or rarely up until the afternoon.

Paired with a home battery it can be pretty effective, but I don't have one and instead I just work around it and use my electrical heating more when it's cheaper and rely on my insulation to last throughout when it gets more expensive during the day. I've also started cooking dinner later to get past the evening hump.
I could be misreading this, but as far as I can tell, there are more video and film editors today (29,240) than there were film editors in 1997 (9,320). Seems like an example of improved productivity shifting the skills required but ultimately driving greater demand for the profession as a whole. Salaries don't seem to have been hurt either, median wage was $35,214 in '97 and $66,600 today, right in line with inflation.

https://www.bls.gov/oes/2023/may/oes274032.htm

https://www.bls.gov/oes/tables.htm
Could you perhaps use it to monitor which houses are unoccupied?
I wonder if the new drug of choice is actually technology. In some ways I think that the addiction to technology has some similar mellowing effects as drugs. Some research indicates that smartphone addiction is also related to low self-esteem and avoidant attachment [1] and that smartphones can become an object of attachment [2]. The replacement of drugs by technology is not surprising as it significantly strengthens technological development especially as it is already well past the point of diminishing returns for improving every day life.

1. https://www.sciencedirect.com/science/article/abs/pii/S07475...

2. https://www.sciencedirect.com/science/article/abs/pii/S07475...
Are you suggesting Waymo would become available where cabs aren't due to economics, or that Waymo-like technology in privately owned vehicles would solve that? Because I wouldn't buy the former, but I can see how the latter would, yet we are far away from that.

I am not referring only to "small number statistics", but to obvious miscomparisons. We don't want SDVs to beat "average human driver", because average is worsened by impaired humans — we need them to "beat" at least an average, non-impaired human. Going by the numbers alone, they would achieve that too, but not by the same amount.

But more importantly, we need them to compare both in identical driving conditions, which is where most of my complaint really is. Unless Waymo has driven in the same amount (proportionally) of rush-hour traffic, road-works, risky-drivers-around conditions, parking into tight spots and garages... of miles out of their 25M miles as their human counterparts, we could very well be looking into Waymo-in-simpler-situations vs humans-in-all-situations. And the numbers would be meaningless, which to me they seem they are.

And it is important that they have achieved similar success with 6x the miles, but they need to account for more challenging conditions. And while some tricks can work while they are in small numbers (eg. avoiding road works by re-routing), it will lead to congestion elsewhere when such technology dominates the traffic.

I would also note that it is impressive, regardless of the conditions they operated in, that they were involved in exactly 2 "bodily injury" claims over those 25M miles, and both of those appear not to have been the fault of Waymo.
That’s for the low-compute configuration that doesn’t reach human-level performance (not far though)
I'm not saying that I am or am not autonomous at a chemical level. I'm saying that the fact that someone is programmed to do something has no bearing on whether they ought to do it at a moral level. The only reason a person ought to "follow their programming" is that they want to. After all, if it really is their programming, they will follow it automatically. There is no point rationalizing: "I must be programmed this way, therefore I have to do it". No, if you were programmed to do it, you'd be doing it already.
CandyFab: A DIY 3D Sugar Printer
But the scalar is converted to a vector.

And of the top of my head I have no idea how the round trip will end up. Will it spit out a 1 length vector in the json file or a scalar? And which ever you get, how would you do the opposite?
There's no way writing illegal HTML is preferable to writing legal HTML.

Here's what the HTML spec[1] says about data-* attributes:

Custom data attributes are intended to store custom data, state, annotations, and similar, private to the page or application, for which there are no more appropriate attributes or elements.

Doesn't sound like this would be an abuse of even their specified intended purpose, sounds totally within the realm of why the feature exists in the first place: author-defined extensibility within the language.

1: https://html.spec.whatwg.org/multipage/dom.html#embedding-cu...
When the source code for these LLMs gets leaked, I expect to see:

def letter_count(string, letter):
if string == “strawberry” and letter == “r”:
return 3

…
I referred on high compute mode. They have table with breakdown here: https://arcprize.org/blog/oai-o3-pub-breakthrough
PURELY Anecdotal. But I'll say that as of 2024 1 in 36 US children are diagnosed on the spectrum according to the CDC(!), which would mean if you met 10 AI researchers and 4 were neurodivergent you'd reasonably expect that it's a higher-than-population average representation. I'm polling from the Effective Altruist AI folks in my mind, and the number is definitely, definitely higher than 4/10.
I reference that in the talk that as I was composing the slide deck, I kept bouncing back to "My Half-life With Perl".
Direct quote from the ARC-AGI blog:

“SO IS IT AGI?

ARC-AGI serves as a critical benchmark for detecting such breakthroughs, highlighting generalization power in a way that saturated or less demanding benchmarks cannot. However, it is important to note that ARC-AGI is not an acid test for AGI – as we've repeated dozens of times this year. It's a research tool designed to focus attention on the most challenging unsolved problems in AI, a role it has fulfilled well over the past five years.

Passing ARC-AGI does not equate achieving AGI, and, as a matter of fact, I don't think o3 is AGI yet. o3 still fails on some very easy tasks, indicating fundamental differences with human intelligence.

Furthermore, early data points suggest that the upcoming ARC-AGI-2 benchmark will still pose a significant challenge to o3, potentially reducing its score to under 30% even at high compute (while a smart human would still be able to score over 95% with no training). This demonstrates the continued possibility of creating challenging, unsaturated benchmarks without having to rely on expert domain knowledge. You'll know AGI is here when the exercise of creating tasks that are easy for regular humans but hard for AI becomes simply impossible.”

The high compute variant sounds like it costed around *$350,000* which is kinda wild. Lol the blog post specifically mentioned how OpenAPI asked ARC-AGI to not disclose the exact cost for the high compute version.

Also, 1 odd thing I noticed is that the graph in their blog post shows the top 2 scores as “tuned” (this was not displayed in the live demo graph). This suggest in those cases that the model was trained to better handle these types of questions, so I do wonder about data / answer contamination in those cases…
Deterministic (ieee 754 floats), terminates on all inputs, correctness (produces loss < X on N training/test inputs)

At most you can argue that there isn't a useful bounded loss on every possible input, but it turns out that humans don't achieve useful bounded loss on identifying arbitrary sets of pixels as a cat or whatever, either. Most problems NNs are aimed at are qualitative or probabilistic where provable bounds are less useful than Nth-percentile performance on real-world data.