skysight-inc/HackerNews huggingface dataset:
Seems like a solid paper from a skim through it. My rough summary:

The popular large scale diffusion models like StableDiffusion are CNN based at their heart, with attention layers sprinkled throughout. This paper builds on recent research exploring whether competitive image diffusion models can be built out of purely transformers, no CNN layers.

In this paper they build a similar U-Net like structure, but out of transformer layers, to improve efficiency compared to a straight Transformer. They also use local attention when the resolution is high to save on computational cost, but regular global attention in the middle to maintain global coherence.

Based on ablation studies this allows them to maintain or slightly improve FID score compared to Transformer-only diffusion models that don't do U-net like structures, but at 1/10th the computation cost. An incredible feat for sure.

There is a variety of details: RoPE positional encoding, GEGELU activations, RMSNorm, learnable skip connections, learnable cosine-sim attention, neighborhood attention for the local attention, etc.

The biggest gains in FID occur when the authors use "soft-min-snr" as the loss function; FID drops from 41 to 28!

Lots of ablation study was done across all their changes (see Table 1).

Training is otherwise completely standard AdamW, 5e-4, 0.01, 256 batch, constant LR, 400k steps for most experiments at 128x128 resolution.

So yeah, overall seems like solid work that combines a great mixture of techniques and pushes Transformer based diffusion forward.

If scaled up I'm not sure it would be "revolutionary" in terms of FID compared to SDXL or DALLE3, mostly because SD and DALLE already use attention obviating the scaling issue, and lots of tricks like diffusion based VAEs. But it's likely to provide a nice incremental improvement in FID, since in general Transformers perform better than CNNs unless the CNNs are _heavily_ tuned.

And being pixel based rather than latent based has many advantages.
I feel like this is all beside the point, though.

Game and story mechanics can't be copyrighted. Art—including character design—can be copyrighted. And that is where I think Palworld might have a problem, because at least to me, many of the models look very similar.
If you ask people to write a program, maybe 5% of them write in Python. But if you ask them to give you two programs, then that's only 0.25%. Ask for seven programs and if they give you seven Python programs, they're one in a billion, the rarest of the rare.
> Waymo is already there, in at least 2 cities

I find it odd that a self-driving system only works in 2 cities. Is the model overfitted to only know some specific locations? How does that work?

Like, I can understand it struggling in snow or heavy rain. I can understand it struggling if the lines on the road are faded. But given a well-marked intersection in one city, and another well-marked intersection in another, why would it fail in one?
Tried, (more or less) failed, and gave up (because it was costing too much, basically). Search for "Armadillo Aerospace".
Tesla is now moving into making their cars cheaper, with exceptional results. That's leveraging your first mover advantage: compete where others can't, because your manufacturing process is mature.
Pretty much every other index and amd laptop suffers with poor battery life. I get about 4-5 hours on the chromeos variant of this laptop.
these are interesting hacks, glad you let people know about this possibility.
East Solano Homes, Jobs, and Clean Energy Initiative
The conclusion is still pretty spot on. The company known (to Boeing) for shoddy work does a warranty repair as a follow-up for a failed warranty repair, and while Boeing QA caught the first repair going wrong it didn't catch the second repair going wrong because those bolts weren't tagged as having been touched.

Still sounds like a clear case of an unbelievable amount of bad quality from Spirit, and Boeing not pressing the issue until something finally slips through the cracks
If you don't need the modular GPU, and are considering a 14 inch anyways, then why is the FW 13 not your reference machine anyways? But yeah, it sounds like the FM16 probably isn't the product for your needs.
It's harder because there are no unifying theories. The ones that exist are seriously lacking.
I find it odd that the author spends so little time discussing cultural differences. He mentions it briefly, and certainly it sounds like he doesn't have enough data on multicultural responses... but that's even more reason to not jump straight to evolutionary biology.
Anyone got any hints for what is the modern day (2024 and onward) equivalent of obtaining passive income or something with an autonomous or semi-autonomous Perl script?

I mean, why isn't it easy for someone that knows computer programming to earn a humble five or three dollars a day with a Python script running 24/7 on a Raspberry Pi single board computer? Is outlier independent video game development really the best we can do, for an escape program that wants to get you away from the standard and disappointing career?

I promise I would invest my seed capital returns from the Python and Raspberry Pi combo back into the startup and not blow it on unnecessary purchases!
"Most of big tech's innovation was just doing this: skirting laws and agreements and cutting people out of the gains."

Interesting cuz the vast majority of any tech innovation is cutting people out and using fast and reliable machines to do work instead...
I'll always have some sympathy for Netflix because they were effectively first.

I remember waiting patiently for Netflix to arrive in Australia, and then as soon as it did arrive, a flood of competitors decided to "me too" into the party. They were too afraid to be first, so I've stuck with Netflix out of respect for their blazing the trail.

The competitors such as Disney and Paramount have caused the enshittification by fracturing the offerings; walling off their IP into their own individual gardens rather than licensing it out.

Ideally there would be multiple Netflix equivalents, with slightly differing value propositions, but with significant overlap in content licensed from the likes of Disney and Paramount.

That's not the present we've found ourselves in though. It's an interesting outcome of how "the market" works.

I feel like I'm an apologist for Netflix, and so I must be to some extent, but Netflix are reacting to the market it finds itself in, in order to remain viable.
IIRC they disabled it again because the ONTs they have deployed have a firmware bug.
cross-attention doesn't need to involve NATTEN. there's no neighbourhood involved because it's not self-attention. so you can do it the stable-diffusion way: after self-attention, run torch sdp with Q=image and K=V=text.

I tried adding "stable-diffusion-style" cross-attn to HDiT, text-conditioning on small class-conditional datasets (oxford flowers), embedding the class labels as text prompts with Phi-1.5. trained it for a few minutes, and the images were relevant to the prompts, so it seemed to be working fine.

but if instead of a text condition you have a single-token condition (class label) then yeah the adanorm would be a simpler way.
Weird how so many streams end at the Massachusetts state line.

Not the dev's fault of course.

I've noticed a similar difference of how rock formations are recorded at state line boundaries on USGS maps.

Dealing with different datasets from different bureaucracies is an intractable problem.
I think someone maintains a spreadsheet of these that I came across on reddit. I'll come back and post it here later if I can dig it up.
You’re ignorant of energy markets and the cost of fast charging but make confident statements. Fix one or both of those
There's a lot of movies available to "rent" or buy for a couple dollars, but more people pay for bundles than a la cart.
You’re also never increasing the size of those slices right? So it’s better memory wise by a bit and maybe faster? I last used Go a while ago, but I recall the capacity was the length of the underlying array? Internally it may even reuse the same arrays for slices maybe, since they’re not changing size each loop iteration.

Edit: weird, this was supposed to be an update to a previous comment I made, but this is a different comment now
I’ve had multiple GE appliances fail early on. And you can find plenty of people online saying the same.

YMMV.
This is exactly why I miss the old, neighborhood, mom-and-pop DVD-rental store. The place near my apartment back in the early-2000s pretty much never removed anything from the shelves, so you could find almost any movie ever made. You just had to wipe the dust off some of them.
Modern QGIS is very good. As a former professional turned casual home user, it covers my all requirements personally, but on the other hand there is certainly room for other options in the industry.

On the other topic of online offerings: Putting performance aside, a significant business objection to online GIS - especially regarding large or long term projects - is in the notion that it transfers (some) custody, security, continuity, redundancy of, not just your work, but also your tools, to a 3rd party, making your access subject to the ongoing wellbeing of that 3rd party enterprise.

i.e. My business requires certainty that, should the need arise, I will definitely be able to access the entire functionality over all working files, 5+ years from now, regardless of what happens to 'FancyMapsWeb Inc.' over the intervening years.
Although TFA doesn't explicitly say the bolts were there to begin with, the bigger issue is that repairs were required on this door, the repair team lied about what they did, which bypassed a QA check that would have likely caught the missing bolts.

Given the awful (criminal?) behavior of the repair team, it seems reasonable to assume the bolts were initially present and they just forgot to put them back - rather than that they were missing from the start.
I understand, that wasn't really the point I was making. I don't know of a single systems language that has zero cost async abstractions. The author is making an impossible, nonsense ask.
I read 'they were never bolted' as 'upon delivery of the aircraft, the bolts holding in the plug were not installed' in order to differentiate from the case of 'the bolts loosened during use of the aircraft after delivery to customer'.

But I can see how we could read to different statements from the parent.
There's definitely an audience for Framework. But for a laptop/mini-pc user who likes to keep their tech for 7+ years and usually opt for no special graphics. A mini-pc works great for me. Lot of them have good Linux compatibility too. ~70% of the cost is the CPU/motherboard which cannot be swapped. I don't care much about specific ports etc. As long as I can extend RAM and SSD, that's enough customization. So a framework feels overkill.
Related question: I've seen news reports that the plane had experienced three recent pressurization issues (cabin pressure warnings). Does anyone know what kind of warning this was? Was it:

- too low pressure, meaning that the door might have been leaking before it blew out.

- too high pressure, meaning that the door had extra force on it.
A QA/SOP-based company either has a culture where nobody would dare violate SOP or it doesn’t.
Their store is full of very nearly junk releases. How do they distinguish between a lot of experience, and a lot of experience with junk?
I wrote a Swift library to experiment with this architecture using SQLite.

https://github.com/gerdemb/SQLiteChangesetSync

The library works at the database-level and stores databases modifications as binary change sets in a separate table that models a graph similar to a git repository. Capturing modifications is as simple as wrapping the transaction with a handler provided by the library. The graph of database modifications is stored locally on each device, but can easily by synced with an online repository.

The library detects conflicts, and provides a handler to the application for conflict resolution.
Is OLED really that interesting? I've watched OLED tv's and in rooms with any sunlight the dark parts become unusable. I've also seen reviews for OLED computer monitors, where people are annoyed that the screen will auto-dim at inopportune times.
Porque no los dos? That's a false dichotomy.
Game Changer: Bitcoin ETF Debuts
It's minimalistic, as far as is possible in a vehicle. The best part is no part, the even better part is one you never have to think about. I don't have to turn my car on or off, don't have to change the oil, don't have to think about headlights or wipers, don't have to fiddle with climate control. The car is designed around being driven and nothing else.
I launched https://www.builtatlightspeed.com/ in early 2023.

I’ve been involved in the Jamstack, static site generator, template ecosystem for many years. Built At Lightspeed is a template marketplace focused on ssgs and “modern frameworks”

Sales have been entirely from Affiliate sales, mostly via the Lemon Squeezy affiliate program. Its doing about $400usd/month. I recently launched sponsors and the initial interest has been good.

Tailwind and Nextjs are the most popular categories and best sellers. Tailwind (like Bootstrap before it) has a vibrant commercial template ecosystem. I’m seeing a huge uptick in interest in “full stack” boilerplates that have hefty price tags of $100-$400 and I plan to focus on this area more. No code templates for Framer have also exploded.

The site itself relies on Algolia to drive the faceted search results and filters and overall I’ve been happy with it. It’s a bit expensive and the older release of its react hooks library had a lot of edge cases with nextjs, but it’s been improving.

This year I will continue to refine and curate the results, focusing more on content quality and classification the extending the inventory. I recently bumped it from 4000 results to 20000 as an experiment, and this was just by easing back some of the quality filters.
What is ableist in that comment?
How about all of the people who wouldn't be able to access the Internet because their country doesn't have enough v4 address. Or who's internet connection is better/faster because they're no longer behind a CG-NAT. (Think mobile carriers, developing countries, China, India, etc)
I just want a 4K Originals Plan with 1 screen.

Features:

- Only Netflix Original content (in 4K)
- 1 screen, since password sharing isn’t allowed anyways
- No ads
- No WWE
- No smartphone games
- No licensed content (which seems to be mostly 1080p anyways), since I can watch that elsewhere

I will offer $14/mo, at most.

Why should I be forced to pay for a bunch of stuff I don’t want or can’t use?

This is why I don’t have a Netflix subscription.

I subscribed for one month back in December to see how good/bad it was, and I was not impressed at all for $23/mo. The licensed content almost exclusively being 1080p just added insult to injury.
> We need to recognize that, at least for some SUVs, there are genuine, non-overcompensating use cases.

For the things I think of as SUVs, I don't think there is any legitimate use case to be honest.

Big SUVs often have less interior room than a sedan or station wagon so interior room is not a use case. They have way less cargo capacity than a pickup so that's not a use case either. They fit less people than a van, so fail again. They are top-heavy and not nimble, another fail. I don't understand the point of SUVs.

I definitely would not support any kind of SUV ban simply because I don't believe in bans, to each their own, but just make a SUV-license require a lot more training which will discourage most soccer-moms/dads from wanting one.

You say Subaru Outback though. I would have never called that a SUV. It's a wagon. I do see the Subaru website calls it a SUV, which I find weird. I guess the definition of SUV has broadened to mean just about anything.
Ever since HBO merged with Discovery, the content library has become garbage. It’s all reality shows, real housewives, tons of low effort content. HBO used to be the spot for edgy/racy content, great movies and really great shows.
A company hired me 10 years ago to build a new CRM system alongside their large ecosystem of existing web apps. There was only one other developer, the lead developer that had built all the other web apps. I built the CRM system in six months. Three months later the lead developer died and I became solo developer for all the apps. I'm still there solo to this day.
Where I used to work, we had a “tech lead” who used to demand ICs to come up with story points.

When the actual engineers were blank about how much something costs, they had to sit through a 90 minute meeting of group-costing.

Naturally the team delivered very little despite being quite skilled. But luckily the blame fell on the lead and not on the ICs as it usually does.
Any movie ever made in the US, that is…
I was aware of the reputation, but just can't seem to get it to show up in real life. Darndest thing...
Same; a good ML focused discord would be great. Training ViTs all day is lonely work. I'm mostly locked into skimming the "Research" channels of image generation discords. LAION used to be decent with a good amount of interesting discussion, but it seems to have devolved into toxicity in the last year.
Unicycling is fedora-like because you're going out of your way to do something that's less efficient. You know it's going to provoke a reaction because it's unusual. It's different than something like a guy with no legs because he didn't chose to have no legs. If you just love unicycling keep your chin up fight the good fight believe in yourself, but don't imply you're "under attack" because people go "huh that's weird I have to say something let's try gentle humor". The people with pithy comebacks in this comment section are doing it correctly.
I would assume that they have known Elon Musk is a fraud longer than the general public, and want to position themselves in the market before Tesla inevitably collapses.
Most of those owners are bleeding out, so to stanch the flow they are licensing their content to other companies like...netflix.

It'll end up with a little oligarchy of a small number of streamers and then quality will plummet and ads will be unavoidable.
Leaving San Francisco [video]
Seems great for debugging waterway topologies.

Some things I noticed after a few minutes:

- A lot of smaller rivers system and tributaries seem not to be connected all the way through as seeing smaller disconnected systems with shorter total lengths.

- small rivers that and at the shore geometry of larger rivers but are not connected to the main centerline

- some streams are disconnected by other waterbodies where they should not be, as there seems to be little consensus on how to connect waterways through lakes and other waterbodies, having an unnamed waterway along the centerline connect through the named lake seems to be a good compromise to not mess up rendering but helps with linking up topologies.

https://help.openstreetmap.org/questions/52843/does-the-rive...
18 years of energy storage tops CAES Compressed Air Energy Storage, which is less lossy than batteries and ultracapacitors, and probably even molten salt, and maybe gravitational energy storage too?

Though, you could do CAES with captured CO2 and it would be less of an accelerant than standard compressed air. How many CO2 fire extinguishers can be filled and shipped off-site per day?

Can CO2 can be made into QA'd [graphene] air filters for [onsite] [flue] capture?
What a fantastic site.

I was surprised to see that India appears to have a denser web of powerlines covering more of its area than the US and was wondering if this was a difference in data, but no, Wikipedia confirms:

> on average there is at least one HV line within a distance of 8.15 km) over the entire area of the country. This represents a total of almost 20% more HV transmission lines than that of the United States (322,000 km (200,000 mi) of 230 kV and above). However the Indian grid transmits far less electricity.

https://en.wikipedia.org/wiki/Electricity_sector_in_India#El...
I am curious actually! In general about your experiments, but also about integrating this detection algorithm to wider systems. Did you run any autogpt-like experiments with the AI generated text as a critique? My use case is a bit different (decision-making), so I play with relative plausibility instead of writing style. But I haven't found convincing ways of "converging" quite yet, i.e. benchmarks that don't rely solely on LLMs themselves to give their output.
Netflix produced some interesting original shows. Most of them got canceled after a single season, on a cliff-hanger. That got frustrating, so we stopped watching Netflix original shows. Then we stopped watching Netflix. Then we canceled Netflix.
the FFHQ-1024 examples shouldn't be blurry. you can download the originals from the project page[0] — click any image in the teaser, or download our 50k samples.

the ImageNet-256 examples also aren't typically blurry (but they are 256x256 so your viewer may be bicubic scaling them or something). the ImageNet dataset _can_ have blurry, compressed or low resolution training samples, which can afflict some classes more than others, and we learn to produce samples like the training set.

[0] https://crowsonkb.github.io/hourglass-diffusion-transformers...
Amazon already did, while simultaneously introducing a new tier for $3 more per month. Next, expect ad-supported plans to show progressively more ads, and the cost of others' ad-free plans to rise.
Adam Savage's one day builds – OnePlus phone exploded case [video]
> Spinning up an entire automotive engineering R&D division seems like a very expensive way to generate patents.

What's the alternative? Real patents usually come from real work, rather than thought experiments.
I think it's quite possible, though by no means certain, DEI is a main reason they are having these issues. See the last post in the Twitter thread about their supplier Spirit Aerosystems.

The argument about cost cutting sounds less convincing to me. Compromising on critical safety will only save cost in the short term. But both Boeing and their suppliers have more incentive to optimize long term cost. They are not in this business for a short period of time.
I didn't say they are merely speculating; that's a pretty normal thing to do. I said they are "latching on to this theory and making speculations to support it." In other words, they are starting with the conclusion, and making guesses to support that conclusion.

You incorrectly stated that's a tradition in archaeology, as if that would make any difference. It's not how theories are meant to be formed from evidence, regardless of whether or not you think it's a tradition in archaeology (which it isn't.)
Apologies, I misread your comment. But can you elaborate on your statement that tree-shaking (more commonly referred to as dead-code-elimination) is no longer required?
eBay to slash about 1,000 roles, or approximately 9% of full-time employees
In my experience Youtube and Netflix are the only apps that really got the basics of video streaming right.
What’s the ratio of testers:developers and how much do testers make? Not everyone on a this kind of a project is making even low end software developer salaries, and not every RSU vests which is a big part of why they are so popular.

I’ve heard people quote hundreds of people working on the Vision Pro which is already a lot of people for Apple. The company only recently broke 150k employees globally and a large fraction of that are working retail at their stores. Now split the remainder across iPhone, Mac, iPad, App Store, Apple TV, Air Pods, Watch, marketing, this car project, back end infrastructure etc and ~2,000 people on Vision Pro for 5+ years just doesn’t line up.
There is no algorithm for truth.