skysight-inc/HackerNews huggingface dataset:
Okay, that argument makes no sense to me. I thought the whole point of VC is that money is cheaper than time to market? So OpenAI didn't microoptimize their training code, sure, but they didn't need to. All the innovation of R1 is that they managed to match OpenAI's tech demo from like a year ago using considerably worse hardware by microoptimizing the hell out of it. And that's cool, full credit to them, it's a mighty impressive model. But they did it like that because they had to. It's very impressive given their constraints, but it doesn't actually advance the field.
New VPN Backdoor
You are doing things the right way; never doubt yourself in that regard: money isn't everything.
another analogy would be: aliens abducting a bunch of humans and recreating the Stanford Prison Experiment and write up on human society based on that, which ends-up reshaping alien culture.
I thought Nvidia is selling shovels
Thats because Youtube doesnt want to broadcast copyright work in any way as a courtesy for rights holders' trade groups that have asked, not because of regulatory or legal consequences though.
You can't distill from GPT-4 because Open AI conceals the probabilities (and has for a couple years now-- since before gpt4), presumably to prevent that. You can fine tune against output though. I might guess that they used something like openorca or some other public data set that includes gpt4 output as part of their initial fine tuning.
> OpenAI is selling shovels.

I think the author argues that OpenAI is not the only one selling shovels, and their shovels won't be always better that others'.
>Then you have to malloc the struct to be the sizeof the struct + whatever size you want the array to be.

Ultra pedantic, but you actually do not need to alloc struct+size; you want something like:

// A flexible array member may have lower alignment requirements than the struct
// overall - in that case, it can overlap with the trailing padding of the rest
// of the struct, and a naive sizeof(base) + sizeof(flex) * count calculation
// will not take into account that overlap, and allocate more than is required.
#define SIZEOF_FLEX(type, member, count) MAX(sizeof(type), offsetof(type, member[count]))

I'm sure there's a more elegant way to calculate this, but I am no macro master.
> My pebble watch would call an app on my phone, in turn the app would make a request to the webserver and the webserver would then make a query to the wifi socket to toggle it

When you ask your programmer husband to turn on the light
> why unify the software and make it easy for the consumer

I honestly believe that selling them as separate products is easier. Both for the company who can focus in on the advertising, and for 99% of the customers who can go straight to their hobby.

That being said, it does look like the very first watch on their website is specifically in its own multi-sport category.
I have Qt, but not numpy or pandas. My executable is 40MB (still big).
A botched deploy that I didn't notice ended up crashing the server, which then failed to recover when the systemd unit tried to restart it (it couldn't bind the port and ran out of retries quickly) overnight, so that's why that was failing. It's back up now and I'll put a fix in today.
NVDA trade was always a short-term thing

NVDA has been going up for the last 10 years (with 2022 being the only exception).

AI today is better than anyone could hope for, and I don’t see any reasons to not expect further advances.
Web Spam
The interesting part is that distillations based on reinforcement learning based models are performing so well. That brings the cost down dramatically to do certain tasks.
DeepSeek has demonstrated that there is no technical moat. Model training costs are plummeting, and the margins for APIs will just get slimmer. Plus model capabilities are plateauing. Once model improvement slows down enough, seems to me like the battle is to be fought in the application layer. Whoever can make the killer app will capture the market.
Nvidia is selling shovels. OpenAI is renting out mining crews
Hardware is hard. Great to see!
If you liked this, there's a game on steam: "Desktop dungeons". It's a more refined version and more puzzles, character classes etc https://store.steampowered.com/app/226620/Desktop_Dungeons/
The low hanging fruit thing is 100% correct. Anyone reading papers saw it everywhere, on every dimension. And it's not to say the authors didn't see it either, they did - they just had to get something out now. I'd guess folks in semi conductors saw the same things for ages.
Probably possible is nothing compared to already implemented. How long will it take to apply those concepts to other chips? Will they also be made available to the degree DeepSeek has been? By the time those alternatives are implemented how much further improvement will be made on Nvidia chips? Worst case scenario someone implements and open sources these optimizations for a competitor's chip basically immediately in which case the competitive landscape remains unchanged, for all other scenarios this is a first mover advantage for Nvidia.
I cared tiny bit. I even went out and bought a phone so that I could "prove I was a real person" or whatever to try to make a FB account. Account creation failed, my IP was banned, and I just blocked every FB domain and haven't looked back.
Mickey Mouse animated the shovels with the big spell book, and now they're marching around and need shovels of their own...
Context: This is another LLM tarpit, intended to poison datasets. I found this website a while ago, but forgot and couldn't find it. I found it again after it showed up in my autocomplete bar.
I can speak to this - there is no meaningful decompression effect across an insane set of tested data at Google and elsewhere. Zopfli was invented prior to brotli

Zopfli is easiest to think of as something that just tries harder than gzip to find matches and better encodings.
Much harder.

decompression speed is linear either way.

It's easiest to think of decompression as a linear time vm executor[1], where the bytecoded instructions are basically

go back <distance> bytes, output the next <length> bytes you see, then output character <c>

(outputting literal data is the instruction <0,0,{character to output}>)

Assuming you did not output a file larger than the original uncompressed file (why would you bother?), you will, worst case, process N bytes during decompression, where N is the size of the original input file.

The practical decompression speed is driven by cache behavior, but it thrashes the cache no matter what.

In practice, reduction of size vs gzip occurs by either finding larger runs, or encodings that are smaller than the existing ones.

After all, if you want the compressed file to shrink, you need output less instructions somehow, or make more of the instructions identical (so they can be represented in less bits by later huffman coding).

In practice, this has almost exclusively positive effects on decompression speed - either the vm has less things to process (which is faster), or more of the things it does look the same (which has better cache behavior).

[1] this is one way archive formats will sometimes choose to deal with multiple compression method support - encode them all to the same kind of bytecode (usually some form of copy + literal instruction set), and then decoding is the same for all of them. ~all compression algorithms output some bytecode like the above on their own already, so it's not a lot of work.
This doesn't help you support other archive formats, but if you want to have a bunch of per-file compression options that you pick from based on what works best, this enables you to still only have to have one decoder.
TSMC has a fab starting up in Phoenix this year.

https://spectrum.ieee.org/tsmc-arizona
It's that OpenAI is investing tens of billions of dollars in shovels and others, like deepseek, are open sourcing equivalently good shovels.

The vertical specific companies, though, are harder to clone as the invest in the product offering around/on top of AI
Early models had a transreflective displays, newer models sadly don't.
Agree completely. I would hate to have seen what would have happened if IBM could legally prevent the clean room reimplementation of their bios.
Google Maps to Rename 'Gulf of Mexico' to 'Gulf of America' for US Users
And none of their forces would have been so drastically depleted without science.
All my customers are internal, but there's still usually a support ticket layer between the developer and the customer. I told all my customers, for the apps I own, just send me an email. No need to go through all that. They're thrilled and 6 years in there's been no issues.
I’d say Nvidia is selling shovel factories (training hardware), OpenAI is renting shovels (trained models as a service), and DeepSeek gave everyone a shovel for free.

But Nvidia is also selling steroids (inference hardware) that everyone will need to use their new free shovels.

This analogy may have gotten out of hand.
No one says that this is a one-size-fits-all solution, but for some use cases (small tools that are intimately connected to the rest of the codebase, even reuse some internal code/libraries) it's probably helpful...
Claude has access to an analysis frame which takes javascript which it can use for calculations.
Correct - it is just looking for matches harder, and encoding harder.
I would love to use discord at work
Only if you’re moving the goal posts every other week.
I guess coming up with a truly original question is tougher that it seems. Any ideas?
Qwen or Llama?
"Boost voices" is a cool feature a lot of apps have, but what is really needed is a "compress voices" feature. So many podcasters speak loudly 75% of the time, but then trail off randomly or almost whisper. Then you turn it up and they're projecting loudly again and blow your ears out. It's especially annoying in the car trying to compete with road noise.
When you go onto running track that is covered in ice in January, you get to really appreciate those middle distance spikes.
AI isn't some all knowing superbeing or oracle.
And its not likely to become that anytime soon.

Its a program for predicting what we want from a highly flawed data set.

Garbage in, garbage out.
Unsurprisingly many are worried some people will abuse the garbage coming out. Much less hail it as The Truth from the oracle. Especially if it matches their preexisting biases and used to justify societies discrimination.
I use node-ts. Why? I have access to every library I will need from any provider or for any task like phone number validation.

Node is fast enough, easy to develop, deploy, and scale. Anything that is slow can be ported to Go.

It is easy to find solutions to my immediate problems using LLMs.

I’m just using express and my data layer consists of neo4j and qdrant. All code is single responsibility and I use layered architecture. Easy to test and feed in to AI.

I used to work in rails, mostly to port existing code to Go or node. I found it way too messy and complicated, and our codebase was awful. I am in the minority though as I know many love rails.
Conversely, can you name one computing thing that used to be hard when it was first created that is still hard in the same way today after generations of software/hardware improvements?
> It gives us 50x better engagement than email and 8x better response times to customers.

Does it mean that it forces the customers to send 50 messages instead of a single mail message?

> However, developers hate email.

Always feels awkward when there are general statements about the group you belong to, which are certainly false at least for you, and possibly for most others you know in that group.

If anything, I would expect developers to dislike a web chat, as tech-savvy people generally seem to prefer more lightweight and customizable options.

> That context helps Railway Engineers deliver a truly first class support experience.

Much of the post reads like a rather annoying advertisement.

I was curious why it was a problem to support thousands of customers in the first place, and looks like the issues were in combining conversations over different communication channels, and that a single overloaded person used to create those Slack chats.
it doesn't drastically alter the images, in my experience. More like changing the trim on a dress or the shape of drapes. The structure and composition of the nearby images are similar.

random seed

https://imgur.com/a/ySOUKSM

variation seed

https://imgur.com/a/GSo0Sjm

sorry i did the HN thing (i didn't show my work):

> A neon abyss with a sports car in the foreground

>Steps: 20, Sampler: DPM++ 2M Karras, CFG scale: 7, Seed: 1496589915, Size: 512x512, Model hash: c35782bad8, Model: realisticVisionV13_v13, Variation seed: 1496589915, Variation seed strength: 0.1, Version: 1.6.0

\
the first image is the same except the seeds were random (the main seed is one of the first 4 though)
Now I need a new abbreviation for the Quaternion Fourier Transform (QFT)...
The bitter lesson was never about hardware scaling being the only ingredient. It was about favouring generalist approaches that can scale with your hardware budget over carefully handcrafted bespoke solutions that conserve the "cheap" resource.

I'm not seeing anyone at OpenAI abandon the static weights model and yet they have audacity to claim that they just need to scale more?
> What's going on is you're not able to see how alphas apply to human society. You're not able to jump the intellectual gap to identify, "hey if packs of animals have alphas, what's the human equivalent?"

I literally just pointed out that if you are defining alpha to mean "leader" then it's meaningless to then claim that leaders are alphas. That was the comment.
Thanks, added to https://phabricator.wikimedia.org/T341665#10499534
I wonder how thinly veiled those decisions can be and still fly under a court's radar [0].

[0] https://www.smbc-comics.com/comic/algo?ht-comment-id=1201119...
variation seeds are nearby, this is what i call the latent space, see my reply that has two imgur links to your sibling comment-er
Fab ulous.

Art of the deal, Xi must have agreed to wait until 2028.

Next, tax free repriation of that $200B Apple has buried in Ireland to fund those fabs.
Nah, don't kid yourself. Tech lik€ this is NOT fine. You're a douche if you deploy this. It may be technically interesting but just a dick move to use it.
This will probably sound like an ad, and is probably not super HN-friendly (given it can be more fun to just hack a custom tool together), but we just use Pylon for this and was surprised OP didn't do the same
That doesn't make them profitable though. They spend billions.
My Pebble was not very good. The display glitched all the time, the connector to load the watch was fidgety and the display too dark. I hope the mechanical construction will be better for the new ones
Something worth noting is that ChatGPT currently is the killer app -- DeepSeek's current chart-topping app notwithstanding (not clear if viral blip or long-term trend).
The only thing that I have been using AI for was to translate a localization file. And it was pretty good at that.
Is there an acronym for edge/local/offline? ELO could be confused with something AI already dominates at. As someone working in the edge/local/offline space it’s interesting to hear these together though. Offline is local but local often isn’t offline :)
The state of things with some projects I've touched is "We have a giant CI thing that does a bunch of things. It is really very large. It might or might not be broken, but we work around it and it's fine."

I think some of the euphoria around tracking tooling in the repo is "yes, now I can run a command in the repo and it's as if I spun up a docker container with the CI locally, but it's just regular software running on my machine!" This is a huge improvement if you're used to the minutes-or-hours-long CI cycle being your only interaction with the "real environment."

The reductio ad absurdum that you describe is basically "a snapshot of the definitions of all the container images in our CI pipeline." It's not a ridiculous example, it's how many large projects run.
Is it actually clear this is an authority the president has? Basically usurping Congress' control of the purse?
Yes, this is exactly what I’m saying.

Apple officially supports third party trackers, who’s manufactures are issued, by apple as a part of their MFI programs, keys with which these third party devices must use to sign their pairing requests to the users apple account.

Perhaps these $5 devices do indeed include legitimate keys from apple to use from this, perhaps they have copied one from another device.
Corporations are required by law to have Presidents and Chairmen. That is the legal construct.

They are not required to have CEOs who therefore sit on shakier legal ground.
VMUM: A new fast non-cryptographic hash function
DeepSeek Web/API Degraded Performance
This is crazy. Why would Spain or Colombia have to see Gulf of USA together with the actual name?
> Can you guess what the next step will be?

H.266 32K encoding being slow on cpu
Many of the left’s ideas look just as silly to the right, as some of the right’s ideas look to you.

It’s double standard to insist that your ideological positions should be respected but others shouldn’t.
https://imgur.com/a/PpYGnOz
unsure about other UI, but:
you can usually set a seed, and also see the seed of an image you've generated. so generate/load an image you like so you have the seed. Lock the seed. Find the variation seed setting. lock that (on automatic1111's webUI it automatically locks to the main seed) - now adjust the variation strength. If you're doing small images you can make this small, because the variations will be very minor. I set 0.1 - which i use with larger images if i am looking for a specific color smear or something, but once i narrow it down i reduce this 0.05 or below. When you click an image in a UI it ought load all the details into the configurable parts, including the variation seed / subseed, which means you can just keep exploring around individual variations' spaces, too. expanding the strength a bit if you get stuck in local minima (or boring images), and reducing the strength to get the image you want to rescale to publish or whatever.
Living with an Attraction to Children
Those neurons aren't language models though. They're not encoding petabytes of human knowledge.
>"we westerners are terrified of what that would mean for the rest of the world."

I suspect "we westerners" think of "we westerners" and do not give a flying fuck about "the rest of the world". Well, as long as they keep trading exclusively in our currency etc. etc.
When you say ChatGPT, do you mean 4o, o1, o1 pro, or…?
I thought the distillations were SFT only?
You can also test your professor's answers. I don't just walk around going "Oh, Claude was right", I'm literally using what I just learned and am generating correct results. I'm not learning facts like dates, or subject things, I'm learning laws, equations, theories, proofs, etc. (Like how to apply Euler's totient or his extended theories on factorization... there's only one "right answer").

Also, you method for attesting your professors accuracy is inherently flawed. That little piece of paper on their wall doesn't correlate with how accurate they are; it doesn't mean zero, but it isn't foolproof. Hate to break it to you, but even heroes are fallible.
yes, Fortran forbids referring to the same memory location by multiple names.
Bullish on the prospects for small players, then.
Google uses the official place names of the user’s country.

If the governments of Spain or Columbia want to opine on what it should be called, I’m sure Google would adopt it for their citizens
There are two kinds of creativity at play here. One is mashing together combinations of learned things - it’s kinda like shuffling a deck of cards where basically every shuffle gets you a deck that has never been seen and won’t be seen again, but it’s still the same 52 cards every time. The other kind is going outside of the box and inventing truly new, unseen/untrained concepts. This one is hard, but I don’t think it’s impossible - the <think> slop stirring the learned concepts with a bit of randomness should make progress here.
Including considering that it can't be made much better, that the hallucinations are a fundamental trait that cannot be eliminated, that this will all come tumbling down in a year or three. You seem to want to consider every possible positive future if we just work harder or longer at it, while ignoring the most likely outcomes that are nearer term and far from positive.
>Then you’ve done a shitty job building your network.

Even better! I've been in a position to see "network effects" over and over and over again at the highest levels.

I'm telling you an uncomfortable truth: Job hop.

>I had several C-level folks reach out with roles.

See, this is how I know we're speaking past each other. You're acting as if this means something. It doesn't. Until you can even being to accept this is just a placebo effect it's unlikely you'll accept the effort was wasted.

Something something can't convince a man he was fooled.

Job hop. Get more money. Retire.
right, the problem for scipy developers I believe is that not enough of them know fortran, whereas C knowledge is necessary to hack on CPython native extensions.
That's why CUDA never went anywhere. /s ;-)

(Oh, that's SIMT. Carry on then.)
I use -F (--onefile).

It's certainly not fast to start, but in my case, it's not a quick one-and-done type thing, so I don't mind too much
Microsoft is in contention to buy TikTok
And the minute you mention it, it is "whataboutism". And it is of course very very bad and is the opposite of their noble hypocrisy.
"Apparently throwing money at senators is a literal no-brainer"
i posted 2 replies to your sibling comments: 1 with a demo of what i mean with 2 batches of 4 with completely random and then latent space "random" seeds; and then a second comment with a single imgur link that shows the only setting i touched and an explanation of how i use it.

I apologize if this isn't what "exploring latent space" means but /shrug that's how i use it and i'm the only one i know that knows anything about any of this.

edit to add: i get frustrated pretty easily on HN because it's hard to tell who's blowing smoke and who is actually earnest or knows what they're talking about (either or is fine). I end up typing a whole lot into this box about how these tools work, how i use them, the limitations, unexpected features...
DeepSeek's popularity should be a wake-up call, Trump says
According to the tweet, not the full context yet.
If you search on r/localllama, there are people who have improvised builds with eg 8x GPUs. Takes multiple power supplies and server mainboards. And some let the GPUs sit openly on wooden racks - not sure that’s good for longevity?

BTW a Mac wouldn’t be able to run a model with 120GB requirements, 8GB for the rest is likely too tight a fit.
BRB, becoming thought leader in this space.
Many people hide their racist views to Chinese people under the guise of criticizing the Chinese government.
It's clear that this is an authority that the president does not possess. The President does not have unilateral authority to impound funds. Congress has the power of the purse.

It's clear, but political power only exists if it's used. If congress grants this power to the executive, they render themselves all but irrelevant. They'd be a rather expensive and unattractive claque.