skysight-inc/HackerNews huggingface dataset:
I noticed a similar phenomenon in my work on JoyCaption when I began teaching it VQA. JoyCaption was trained on about 800k image-caption pairs, and built from so400m and Llama 3.1 8B Instruct. There's no VQA data in its training.

As an experiment, I hand built a VQA dataset of ~600 examples, which is a vanishingly small number compared to even rudimentary VQA datasets (which tend to be about 10k examples or more). However, I ensured that the dataset was broad and highly varied, and that the queries aggressively exercised both visual and textual understanding.

With only 600 training examples, I finetuned the base JoyCaption model in a handful of minutes and to my surprise, not only did it gain VQA abilities, it's able to generalize quite far outside of its training set. Even for concepts not in the original 800k caption data.

My hypothesis is that if the training data is varied enough, it forces the model to generalize. It isn't given enough examples of any given type of task to learn specialized circuitry for them, so its only option is to learn a broadly generalized set of circuitry. The data keeps it on its toes, so to speak.

Of course, this leans heavily on Llama's existing instruction (text-based) tuning, so it's starting off on good footing there. The surprising bit is being able to generalize so well to a new domain (vision) with so little data.

One caveat is that this model is highly unstable, and the accuracy of its responses is much worse than the accuracy of the base model. It's able to handle all of the tasks I've tested on it, but often requires a few retries to get it right.

Building these datasets is also tedious and intensive. I've yet to successfully train existing AIs to generate useful user queries/instructions/questions, either through prompting or finetuning. So it has to all be done by hand. And every answer was either written by me, or generated by an existing VLM and then edited by me to ensure perfect accuracy and adherence to the request. Since the queries are complex and challenging, this makes the work of writing those answers similarly challenging and time consuming.

As an aside: this training also seems to have broken Llama's alignment. I've had it be remarkably sassy in its responses, and it's much better at simulating more normal human responses.
Europe 'not in the AI race today,' French President Macron says
It's not a "ChatGPT world."

You can thrive just fine by entirely ignoring it and all the snake oil vendors living in it.

4 years and all they have to show for it is absurdly powerful video cards, sub 90% accuracy where it matters, and the only application is "chat bot."

It's a fad. Wake up everyone.
Also - at least in my experience - doing a PhD makes a person more aware of the boundaries of knowledge, and therefore generally pretty skeptical, and capable of being usefully critical, about developments in their field.
Free Software Foundation to auction original GNU drawing, Amiga 3000UX, more
Will check it out, never heard of krill.
"Math for dummies" book writers don't argue that mathematicians are stupid/incompetent because they do not spend enough time on the basics.

It has also nothing to do with teaching people to count, read, or the scientific method. Every. Single. Software I use is bloated, I am unaware of any software solely consuming that it should, nothing is close to the theoretical limit, this is not a knowledge issue. If you have such software in mind feel free.

Casey continuously says that the problem with software is that developers do not understand performance, and so that the problem will be solved once they do. I am not overly familiar with his paid course, but he did stuff before that. He has essentially the same opinion as Jonathan Blow.

The course being paywalled isn't really an argument for either of us, on his side it is most likely a compromise, just because this isn't the grand plan to convince millions of developers doesn't mean he doesn't intent for it to help his cause.

Casey believing the problem at scale to be cultural isn't some guess, I actually asked him: https://x.com/cmuratori/status/1687138791356833793

> that this isn't his goal makes me think you're just looking for some reason to shit on the guy.

You can consider it a hyperbole if you want, but essentially what I am saying is that he wants to put the burden on the developers, without really changing the underlying structure.

I am not shitting on him for the sake of it. I do really like his (and Jonathan) observations, and I will continue to watch them, I just find it unfortunate that both waste their time on solution that will not affect anything at scale (one with a custom language, the other with specialized course)
Akkio | Fully Remote | Full-time | Senior Web and Data Engineers

Use Akkio to help media agencies build & deploy AutoML pipelines, using Generative AI for data exploration and cleansing, and other marketing-specific feature sets

* Senior web full-stack role; 150k-210k w/ equity. This is really a principal role just Akkio only has 2 job titles (currently). Looking for an experienced candidate who's run projects, guided architecture, lived through framework upgrades and large code refactors, and wants to build a great customer experience. https://www.akkio.com/jobs/senior-frontend-engineer

* Senior data engineer role; 140k-180k w/ equity. Looking for a candidate who's a data engineer and wants to grow as a (or into a) software engineer. Be the first data engineer on the team, and help us build a repeatable client onboarding process. SQL is a must and python & dbt are bonuses. https://www.akkio.com/jobs/senior-data-engineer

All candidates must be authorized to work in the US and have overlap with a continental US timezone
Can’t wait until my inactive instagram account starts posting AI photos of my kids!
My issue with this content on HN isn't that the conversation is sometimes garbage, which it is, but that it's overwhelmingly people repeating the same falsehoods that might, at best, have a kernel of truth, but have been blown out of proportion to the point of just being not-true. There is very little interest in actually taking a step backwards, challenging beliefs and the propaganda fed to us by corporate news channels owned by billionaires, and trying to objectively evaluate information without "so and so is literally worse than hitler" knee-jerk reactions. If people could actually steel-man (I hate that phrase) actions and have nuanced views, that would be interesting, but it's basically only anti-whatever people butting heads with any opinion that challenges their narrative at all.
Honestly I spend ten times as much effort figuring out people's sloppy notebooks or pandas stuff than when they just use DBT and SQL. And 90% of the time SQL is all they needed.
> Coristine wrote impressive, profitable tech.

Can you clarify what you meant? From reading the article I gathered that his attempts to start a business didn’t produce anything and his attempt to join someone else’s company resulted quickly in him getting fired for leaking private info to a competitor.

That last point is extremely alarming for someone who was just given access to core government data. Any adversaries looking for an insider to corrupt are definitely taking note.
>As far as I’m informed, particularly Sentinelese don’t even have a constant fire to enjoy that tasty fish I couldn’t even imagine.

Actually they apparently do have a constant fire if they are anything like the related groups living on neighboring islands.

From the link describing technologies available in the region [0] please see the part about fire. If you follow the link back to other chapters fire is also mentioned so that it becomes apparent that it is an important thing in their culture. One link somewhere had an entry that described them as preferring to remain in their camps at night and being afraid of the dark.

Anyway, enjoy the chapters in that book if you have. There's a lot there.

[0]https://web.archive.org/web/20070715023903/http://www.andama...
Computer classes in HS don't really cover that anymore. It gets worse the less relevant file systems are to non-techies. Documents are just a thing search for these days. People also learn and retain learning of what they practice, you would have to get them to use file systems, and then get them to continue using file systems for that information to stick.
Answer is obvious. Because teenagers tend to be impressionable and unscrupulous.
Shader compilers mostly use LLVM even though runtime is a constraint, if the pattern is common enough it’s definitely easy to match (it’s just two intrinsics after all) meaning you can do it for cheap in instcombine which you’re going to be running anyway
> From the perspective of the owners of this data, the US citizens and others that live in the country

Did you say the cattle owns the ranch? Or you mean the cattle owns the feed?

No, the cattle owns nothing, you own nothing.

As for data being secure or not secure - how do you know any of this is true? Because journalists are good faith arbiters of truth without any conflicts of interest or personal bias?
Right, and phrased just like that, it wouldn't have been as objectionable. As I said before, the problem is in the specificity and the direct linking to the conversation. I still take issue with the word 'sabotage' being used here, since the person in question didn't do anything except express objections and an intent not to cooperate. Since this was in a context where that person's cooperation is not needed, I'm not sure he sabotaged anything.
There are different variations of Omega 3 fatty acids. For instance, Avocados is rich in Omega 3 ALA which is considered not as effective as EPA and DHA.

Fish is the only source of EPA and DHA.
Also (mis)characterizes a grown ass man as a kid
> Large language models are both powerful tools, and mindless—even dangerous—bullshit machines.

Yes, but so is the average person. Do you cover the similarities/parallels to common human behavior patterns in your course? It stands out to me as a major blind spot in a lot of the discourse about LLMs, down to willing acceptance of humans intuiting what someone else meant when the words themselves were fundamentally ambiguous, which is extremely akin to a hallucination chosen from the listener's language model.
He never planned on reneging. It’s a negotiation tactic. It didn’t work but it was worth trying. Turns out it was a bargain all along.
> We really don’t know what data is being accessed.

> As a tax payer I am appalled that this data is not already public and broadcasted live.

How are you mad it's not public if you don't know what it is? Sure there is data in computers of the Treasury department that should not be public - individuals' social security numbers, personal financial information, etc.
I actually forgot that o3-mini was available now. I was using o1 numbers.
I am big fan of "cost monitoring".

In my previous company I had a good setup for costs monitoring - including release to release comparisons, drill downs, statistics, etc.

After each release I looked at this data. It saved a lot of $, by simple fixes like "why we are calling this API twice?".

It also quite some issues that weren't strictly customer related, but weren't apparent from other type of data (you will always have some "unknown unknowns" in your monitoring, and costs data seem to be pretty wide net to catch some of those)
I actually use both, flatpaks for GUI apps and Nix for various CLI tools, setting up my Deck like I described in the article was triggered by me being too lazy to check my local game server's IP on the server itself and wanted to use nmap for that.

Long story short, it would be faster to go check the computer physically. But it was more fun this way, even though I didn't have the time to play the game in the end.
For Elon and all the neo Nazis who were banned from Twitter, Elon's takeover of the platform worked out great. For others, like trans people who were just living their online lives in a community they formed over years, Elon unleashed a barrage of hate and toxicity that forced them off the platform entirely.

The same will be true in our country. What Elon's doing now will work out great for him and neo Nazis, not so great for people that Elon and neo Nazis hates.
In the same way that an atomic bomb is “just” a better bomb.

I keep telling parents that Meta et al are spending the inflation-adjusted equivalent of the Manhattan project — not to defeat Japan — but to addict their child.
>[...] Falcon Shores, had received negative feedback from customers and would therefore not be marketed commercially. [...] As a result, Intel decided not to develop another generation of Gaudi beyond the existing Gaudi 3. This effectively marks the failure of Habana Labs as another entry in Intel’s long history of unsuccessful acquisitions. [...] Willenz, considered a genius in the semiconductor world, has a long history of successful exits.

The article is saying that Intel failed to lead the startup to developing a successful product by taking steps, not detailed, that the founder may have taken if he had still owned it.
"I don't think stupid social media activity should ruin a kid's life" is incredibly dishonest and Vance should be held to account for this incredibly dishonest statement.

The phrasing is intended to create the impression that the posts were made years ago, by some angry teenager, and it's not relevant to the person they are today. It's a way of downplaying the acts, creating distance between the person today and the acts at some unspecified point in the past.

But we know these timeline details. Elez is not a "kid" now, he's 25. These posts were not made when he was 13, they were made last year when he was, I suppose, 24 going on 25.

There are two conflicting perspectives being promoted by Musk, Vance, etc which IMO are in direct logical conflict:

1) This person's actions last year (going up to December 2024! Just 2 months ago!) are the actions of an irresponsible child and we shouldn't hold them accountable for those actions because they're not responsible enough to be held accountable for them.

2) This person is responsible enough right now to be operating at the highest levels of government.

He can't be both. So which is he, really?
Do you get any traffic? Does it feel worth the extra time compared to just doing local notes?
Did it _sound_ like you though? It doesn't sound remotely like me.
Nice to know, thanks for delivering the refs. It lost to LV during COVID, but bounced back afterwards, which makes sense.

I've never been to Macau before although I've been to HK a few times. The only time I've seen a Chinese casino was in Manilla (near T3 of the airport), and I'm almost positive that one at least, was related to money laundering.
> Unless you have a good reason why you need an (asymmetric) signature, you want a MAC.

Is "I want the server/validating side to be safe even against server-side attackers with read-only permissions" not a good reason? Because that's one thing that asymmetric signatures provide out of the box compared to MACs.
> The thing thats wild about Tenochtitlan, as the story goes, is that the Aztec people discovered it themselves

Considering that the Aztecs were a recent conquering group, the southern extremity of their ethnicity, that isn't surprising at all, whether or not it's true.
As all the intelligence agencies see DOGE coming their way to look into how they spend money, I think we will see many of those stories in the coming weeks.
I realized I’m treading in extremely hostile waters here, but the stories I hear from folks working in DOGE are closer to “I spend 8am to 2am with the leaders of department X going through all contracts and outflows and identifying what is important versus wasteful given a target of saving $X million per day, and there are some great people in this department who really know what’s been going on and it’s been great to make a difference”

Versus whatever the media is reporting
This person was fired from a trivial teenage script kid job after two months because he couldn’t resist sharing their internal information.

Only a few years later, he was thrust into the core information systems of the United States right next to people with security clearance.

Targets like this are a dream come true for foreign adversaries looking for someone to corrupt.

Who knows how much compromising content his old peers already have on him. The chat logs revealed they’re already thinking about how much access he has to valuable secrets.
Back in 2019 I looked at what Habana was doing and had a conversation with their CTO. My impression was they had competent technical execution and a good understanding of some of the areas where other chip efforts have stumbled (software stack especially). I expressed at the time that I hoped they would remain independent, and if they sold not to Intel, but of course I don't begrudge the team cashing out for the right price.
Its interesting how PR works (I'm being earnest) . A library nobody uses for a language almost none of us will ever use (developed by the US government and never adopted for any project for any use case except where required by US contracting requirements, and even then almost always given an exception to not use it) is the top story on HN. Well done.

Please note: I'm not saying Ada is bad, it is a very interesting language and well ahead of it's time. I'm just saying it's not popular or in widespread use when compared to almost any other computer language you can list (which is just an objective fact), so it is interesting to me that this made it to #1. Please try to keep that in mind.
Really? I am curious how this could be disruptive in any meaningful sense. Whose feelings could possibly be hurt? It just feels like it would be getting offended from a course on libraries because the course talks about how sometimes the book is checked out.
I have long suspected that there is some sort of deeper truth here. It’s not really about Java. If you squint hard enough, a C program has the stack as its nursery, and the heap as a singular old generation. The stack is even arena allocated, of sorts!

This is of course a bit hand-wavy, I haven’t had the time to truly try and investigate this in a more rigorous way.
* Larry Sanger, https://en.wikipedia.org/wiki/Larry_Sanger
From Wikipedia:

>Statute law also places USAID under "the direct authority and policy guidance of the Secretary of State".[4]
That's fine.

I would also argue self-marketing is important when you have lazy or bad managers.
The Recombobulation Area (2023)
Yup, and it's always "impossible" to add doors, when Tokyo added them over the course of a decade with no problems and significantly more complicated through-running schemes.
Yes. I don't know many accountants who are familiar with polynomials let alone what a DAG is, etc. I am sure there are graph concepts they use by other names.

> Light SQL skills tend to be the upper end of technical accounting

This would be the main point that would need correction if I am wrong.
> So to me this argument sounds the same as "how can young kids think they can program like experienced engineers".

This is about a specific person who has a history of bad behavior, not a generic discussion on the abilities of young people.
I don't understand what your comment means in context of doge? I'm not american so something may be lost on me.
What kind of undergraduate trains 70 B models?
Northern Spain, horrible humidity usually 80-100% max and low of 40-50% max. Company that’s did the installation is a startup https://sunthalpy.com/en/. I was worried humidity would be too high but after the building mass dried out it’s stable around 42-48% humidity no matter what the external humidity is.
Don't forget the overhead created by PBMs and when insurance companies also own the PBM and the drugstore
Imho, the acqusition of Altera was much bigger deal and they also ruined it few years ago. So there is an obvious pattern here.
I'd rather my tax dollars go to Iraqi Seasame Streeet than to Musk's private companies.
Empire of the Son (1999)
> Note: This PDF only works in Chromium-based browsers.
Or indeed that they are a hostile adversary to the US who have achieved some successes adversarial to the US.

I feel like from the perspective of the US, if we frame this conflict/battle for control of US services and computer systems, we needn't say 'the US is a hostile adversary'. It's fair to frame it as 'the US is the US, and the people seizing control of the systems against the interests of the US are hostile adversaries of the US'.

The specifics of who they're working for, how, why etc. can still be up for speculation or further discovery, but we needn't frame it as 'perhaps the US is actually the enemy and Musk's people are actually the liberators'.
Upvoting but,
now I am even more confused.
I agree in principle, but these are the dynamics of every intense polarized issue and I don't think there's much we can do about it other than nibble around the margins. For example, we try to downweight comments that are primarily name-calling or flaming, in the hope of giving more oxygen to posts that are reflective, find something new to say, and so on.

At bottom, it seems like this is just how mass psychology works—it's what you get when the inputs are (1) human nature, and (2) modern media. It stresses me out too, but I have to remind myself not to fight battles we can't win. That's a recipe for burnout and worse.
Where there is smoke, there is fire. And Trump has been boasting about hacking the election, if some Twitter screenshots are to be believed..

This looks a bit thin and a bit far-fetched, but, then again, it might be the beginning of some proof.

If there was fraud, it's hard to believe they managed to cover all their tracks. So let's archive and save the possible clues we can find, and maybe, one day, we will have an answer.
Follow-up: "How is Elez both a child who shouldn't be held responsible for his actions from as recently as 2 months ago, but also the right person to be trusted with extensive access to government systems?"
> “so and so is literally worse than hitler"

Can you give citations for where you’ve seen these sorts of statements?

However bad Musk is, I’ve yet to see anyone saying he is “literally worse than Hitler”
Nvidia GPUs have been used to train DNNs since around 2011 (the paper on how to do it was written in 2010 I think?). Nvidia was also used heavily to mine crypto currency until recently.
>but anyone running a mirror could hypothetically replace the package with another (potentially malicious) package, leading users to install malicious tooling.

I thought all packages were cryptographically signed, and that the package manager would compare the hashes of artifacts downloaded from mirrors to the hashes listed in the package index (which is also signed). This is not an attack that needs reproducible builds to mitigate.
The more advanced AI gets and the more power that is at stake, the more these tech CEOs are going to drop their nice-guy acts and reveal their true intentions. The drama is going to get much worse over the coming years.
Apologies. I responded to the wrong comment.
The Elite Lawyers Working for Musk's DOGE Include Former Supreme Court Clerks