skysight-inc/HackerNews huggingface dataset:
Show HN: Hotshot – 4 Person Team Builds a State of the Art Video Model
Hi HN! We're proud to share Hotshot, a large-scale diffusion transformer model for text-to-video generation that we built with just a 4-person team. You can try it today in beta at https://hotshot.co, with 2 free generations per day.

The model generates 5 seconds of 720p video from text prompts. It excels at prompt alignment, and consistency. It also excels at generating people, animals, and nature.

In blind tests with 100 users, Hotshot generations were preferred to Runway ML 60% of the time. Hotshot generations were preferred to Luma 80% of the time. Overall, users preferred Hotshot's results to other publicly available text-to-video models ~70% of the time.

We built this model from scratch with a 4 person team in just 4 months. It is trained on 600 million video clips and 1 billion images. It uses a custom-trained video captioner for better temporal understanding and a custom autoencoder for efficient long sequence training.

We've detailed more technical aspects of the journey in a blog post: https://hotshot.co/release

Some technical highlights include A. scaling to thousands of GPUs, tackling infrastructure and optimization challenges. B. developing custom kernels and data parallelism techniques. C. Creating a Watchdog system to detect and respond to GPU process hangs. D. Optimizing data streaming and compression for efficient training.

We believe that this model is just the beginning. In the next 12 months, entire YouTube videos will be AI generated by creators. Text to video models like this one lay the foundation for this and much more. Control over every aspect of generations, longer durations, higher resolutions, real time interactivity, and more modalities (like audio!) are just around the corner.

We're here to answer any questions about the model, our training process, or our plans for the future. We're also always looking for talented individuals to join our team!

We'd love for you to try our 2 free generations per day and let us know what you think. We're excited to see what the HN community will create with it!
Imagus (never heard of it before) is apparently not on Safari while this one is only for Safari.
Synchronization of bowhead whales
There's multiple ways to boot, including USB/ISO: https://netboot.xyz/docs/category/booting-methods

Generally speaking, if you have iPXE already compiled and flashed onto your NIC, then you can follow these instructions: https://netboot.xyz/docs/booting/ipxe

DHCP is only needed for getting an IP address. You can use the Docker image with the proper DHCP parameters to load it automatically when using PXE/iPXE: https://netboot.xyz/docs/docker
Take that up with the author!
So the equivalent of these balloons in oceanography are called ARGO floats, which similarly cannot be driven laterally but can control their own depth like a submarine. So far millions of timeseries have been collected across the world ocean using these floats.

https://argo.ucsd.edu/

One difference though is that the ARGO floats are unfortunately not recycled, and just wash up on various beaches. (I'm curious whether you think you can realistically collect many of these mini balloons?)

If you do want to control the lateral position of fleets of sensors, oceanographers also now have "gliders", which are basically small powered drone submarines. These are used by a few groups, but most of the gliders in the world are operated by the US Navy, who launch them out of torpedo tubes to survey local ocean conditions (which is badass).

https://oceanservice.noaa.gov/facts/ocean-gliders.html

The recorded measurements present an interesting data assimilation challenge - they record data along 3D trajectories (4D including time), sampling jagged and twisting lines through the 4D space. But we normally prefer to think of weather/ocean data as gridded, so you need to interpolate the trajectory data onto the grid, whilst keeping the result physically-consistent. Oceanographers use systems like ECCO for ocean state estimation, which effectively find the "ocean of best fit" to various data sources.

https://www.ecco-group.org/

Interestingly ECCO uses an auto-differentiable form of the governing equations for the ocean flow to ensure that updates stay physically consistent. This works by using a differentiable ocean fluid model called [MITgcm](https://github.com/MITgcm/MITgcm) to perform runs which match experimental data as closely as possible, and minimizing a loss function through gradient descent. The gradient is of a loss function (error) with respect to model input parameters + forcings, which is calculated by running MITgcm in adjoint mode - i.e. automatic differentation. Therefore this approach is sort of ML before it was cool (they were doing all this well before the new batch of AI weather models). See slides 9-18 of this deck for a nice explanation

https://firebasestorage.googleapis.com/v0/b/firescript-577a2...

The trajectory data is also interesting because it's sort of tabular, but also you often want to query it in an array-like 4D space. You could also call it a "ragged" array. We have nice open-source tools for gridded (non-ragged) arrays (e.g. xarray and zarr, and the pangeo.io project) but I think we could provide scientists with better tools for trajectory-like data in general. If that seems relevant to you I would love to chat.

P.S: Sorceror seems awesome, and I applaud you for working on something hard-tech & climate-tech!
I am hoping that "AI", via providing multiple direct experiences, will tend to make commonplace the knowledge that just because something syntactically looks like scholarship, it isn't necessarily so semantically.
I live alone, so I get bored of being alone. When my girlfriend is over, I still want to meet other people. Before my divorce, I wanted to meet other people and not just be around my spouse all day.
I'd argue its from attention seeking from lonely people online. Being a rage troll is the quickest way to get some kind of interaction, and being online means theres less consequences for it
Building Infrastructure Control Planes in Ruby
Android TV too! They've besmirched the Nvidia Shield homepage with ads.
Triptych Proposals: Putting the "hyper" back in hypertext
I can’t decide if I want to hear the Douglas Adams interview, his passing still makes me sad.
There are a lot of webcrawlers where the chief feature is turning the website into markdown, I don't quite understand what they are doing for me thats useful since I can just do something like `markdownify(my_html)` or whatever, all this to say is that I wouldn't find this useful, but also clearly people think this is a useful feature as part of an LLM pipeline.
Good point

The examples I picked weren't fiction. Which weakens the argument.

But, not sure we can say they aren't 'Art'.

How about 'Things Fall Apart" by Chinua Achebe.

That is fiction, and painful. And is moving in a way that makes you want to maybe do something to improve the world.

That was more what I was trying to get at.

Art can't all just be angels playing harps.
Revigator did prevent illnesses like arthritis by killing you with cancer before you can develop them.
Thank you so much for the detailed answer. One more question if it is okay - Is there a structured course that you can recommend, from a university? I understand that things are moving fast, but it would be nice to hear from someone who has the knowledge/expertise and gone through the learning phase themselves. I read through a bunch of course descriptions from a handful of leading universities, most of them seem to be interested in riding the hype train by selling certifications to management people for easy money, kinda confusing and disappointing.

Thank you again
>Humble reminder of how easy R is to use.

I had to learn R for a statistics course. This was a long time ago. But coming from a programming background I never found any other mainstream language as hard to grok as R.

Has this become better? Is it just me that doesn't get it?
eBay enrolled me in it automatically. I'm in the US. International sales get shipped to an intermediary (mine have all been in Chicago) and payments go through on the normal schedule. Once I had a package to Bolivia go missing and eBay covered it. I imagine it works similarly elsewhere. No need to fill out customs forms or complicated shipping.

I regularly buy from Japan and China on eBay with no problems. I've also bought from Germany, Spain, Slovenia, Czech Republic, UK, and Canada. Again with no problems beyond ordinary.
The sublime object of ideology (2008)
+1. I'd go as far to say that multi-repo probably needs as much, if not more effort to properly keep functioning, but all that effort is better "hidden" so people assume monorepos are more work.

With a monorepo, it's common to have a team focused on tooling and maintaining the monorepo. The structure of the codebase lends itself to that

With a multirepo codebase, it's usually up tu different teams to do the work associated with "multirepo issues"— orchestrate releases, handle dependencies, dev environment setup, etc. So all that effort just kinda gets "tucked away" as overhead that each team assumes, and isn't quite as visible
I came across Bert Hubert during covid because of his incredible work on this article: https://berthub.eu/articles/posts/reverse-engineering-source...

Long before Bert was writing articles on the source code of mRNA vaccines, he helped build PowerDNS. He talks about that in a three part series starting here: https://berthub.eu/articles/posts/history-of-powerdns-1999-2...

A fascinating individual...

https://fosstodon.org/@bert_hubert

https://github.com/berthubert

https://berthub.eu/
Maybe you are right. Being a public company is a net negative for space.
So wordy. I still don't know what it is he had a view on.

> Three days prior to that, on March 22nd, I was sufficiently convinced that there was an unacknowledged geographically distributed coronavirus outbreak to pre-register that conclusion.

Is.... is it possible he's being intentionally nebulous to distract from his failing? Or do I just lack the reading comprehension abilities?
Do you have some examples? I was not aware that this was a thing.
And are we talking about sentences fully served, or before that time?
I wrote one such proxy, though mine is not open source: I found relatively easy working with zones and records, and a well-designed test suite helps building confidence that a key for an "account" A cannot read or write into "account" B.

I'm putting "account" between quotes because it isn't a PowerDNS concept, there is just a lonely varchar column in the 'domains' table where one can store some account-related information. To handle TSIG keys I had to extend PowerDNS's data model to represent the association between a TSIG key and an "account".
Despite risks more women are finding ways to leave Afghanistan
1. Wind speed/direction, air pressure, temperature, humidity, and solar irradiance. We are considering doing atmospheric composition as well, there are a couple of partners that are interested in GHGs, VOCs, water vapor, etc. We have the weight budget to do it, but we haven't flown any production payloads with those sensors yet.

2. The US National Weather Service actually has a commercial data buy program called MESONET [0], where they buy weather data from both academic and commercial partners. We're in the process of becoming one of their commercial partners now. Once we are, a single balloon will pay for itself in a matter of days with the data it can collect, which will let us scale up the number of systems we have deployed. The data we collect right now also lets us build niche weather forecast products like the stratospheric wind forecast mentioned in the post. Once we have enough balloons up, we can start producing useful weather forecast products at a regional and then global scale.

[0]: https://nationalmesonet.us/
I just had anecdotal success with it last week and the atlantic, but before that it has been very hit and miss.
I use Tailscale for private access to services that run on my home computers when I am out and and about. It is a breath of fresh air Compared to other software and hardware VPNs I've had the misfortune of knowing (like the time I tried to run OpenVPN software on an AWS instance that was too small to save money and it went crazy swapping and ran up a $300/month bill)
It's like people expect NASA to be infallible.
JavaScript weakmaps should be iterable
Roughly from memory
iPXE is a bootable image that acts similar to a PXE BIOS, so you boot to that image like a regular disk.
It acts like a bios by for example hooking your interrupts for storage reads.

In order to find where the image is, you need some kind of discovery mechanism. This is where DHCP comes in. Remember this is all happening before you have an OS, so it has to be very bare bones
I read these stories about using LLMs and I always wonder if it's survivor bias. Like I believe your experience. I've also had impressive results. But also a lot of times the ai gets lost and doesn't know what to do. So I'm willing to see it as a developer tool, but it's hard to see it become more general purpose in the next 6 months time frame people have been promising for the last two years.
Was it flagged as Compromised Site on Google Ads or actually blocked in Chrome (Google Safe Search)?
This looks promising! One of the important aspects of protocol buffers, avro etc is how they deal with evolving schemas and backwards/forward compatibility. I don't see anything in the docs addressing that. Is it possible for old services to handle new payloads / new services to handle old payloads or do senders and receivers need to be rewritten each time the schema changes?
You are correct. Technically it is a zoning problem. But such zoning only became feasible after cars went mainstream. There are many self perpetuating elements of exclusionary zoning and car dependency.
Thanks, I think you're right. I might try a subdomain and if that doesn't work a separate domain altogether, although I would have thought if I link through to the main site surely they'd still block it.. but we'll see
Really?

They're both about 60. Since they're both fit enough to be astronauts, I think we can say their life expectancy should be at least 85. Perhaps substantially longer with some medical advancements or age reversal.

Look at what SpaceX is working on these days (Starship), consider that AI & robotics will likely accelerate progress, and I would say that you can definitely expect affordable and perhaps even relatively comfortable space travel within their lifetimes.
If this is all it's doing then you could also just use this extension: https://requestly.com/

Create a rule to replace user agent with "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

I just tried it and seems to work.
People can vote for things all day but that doesn’t mean anything could be implemented that would guarantee the end of school shootings. We’re talking about a country with estimated an estimated half billion guns in circulation and plenty of those undocumented.
> it was common to work for half a day in a coffee shop.

It was always unfair to expect a coffee shop to operate an
office for the price of the profit margin on 3 coffees, a sandwich and a muffin.
a little bit of each right now, depending on what the customer wants
AI accurately diagnoses genetic condition from facial photographs
Which docs? The netboot.xyz ones?
> Independent variables are not correlated

But it's important to remember that dependent variables can also be not correlated. That is no correlation does not imply independence.

Consider this trivial case:

X ~ Uniform(-1,1)

Y = X^2

Cor(X,Y) = 0

Despite the fact that Y's value is absolutely determined by the value of X.
Isn't this whole thread really dissing on the article about Texas Chainsaw Massacre, that the article is snobbery.

And this guy is saying 'no, you're being a snob for not giving it a chance'.

And now you are saying 'you saying people being snobs makes you a snob'.

So, guess, everyone is full of 'snobbery' on this one.
It seems weird to me that the response to identifying a part of the language that’s hard for people to use and correctly understand is to assert that we just need to not be afraid of it harder.
Why would you ever trust something like this that will helpfully pull images from the internet? I'm sure whomever is running it today is perfectly honest and none of their computers have been compromised, but there's no reason to expect it to stay that way, is there?

Firewalling the application so that only local images are available seems like the only safe way to use this.
> My point is that perfect word prediction does require intelligence and therefore being a word predictor does not, on its own, rule out being intelligent.

No, it doesn't. It requires a large dataset of observed documents to use as training data and the resulting neural network of nodes can then, fairly reliably, function as a word predictor as long as the word you want it to predict is a word that would be commonly found within the documents. Basically, if you wanted to create an LLM that would write, for example, house assessments, you could train it on millions of house assessments as written by human house assessors, and be reasonably confident that you could pull that off.

However, what you now have is a neural network that can reliably generate a document that would pass probably a fair number of glances from people who see them regularly as that document, but that doesn't accomplish anything. It can't assess a house, for example, which is the purpose of that document. If you generated an assessment with this LLM and presented it as it applied to your house, even if after a number of attempts you got the bedroom and bathroom count correct, it would likely make references to features your home lacks, get technical details wrong like the electrical service it has, or even make references to faults the house doesn't actually have, or worse still, fail to take into account ones it does.

That is intelligence, that is what ChatGPT does not and will never have, and that's why this technology is already hitting a wall. It doesn't do anything. It can make reams and reams of bullshit for you (and in our current sad state of the Internet, that's a surprisingly appealing technology to many!) but that's fundamentally just not that valuable as a technology.
"but that's space we could be putting more apartments! who cares if they need a car to get anywhere, we rent more parking spaces that way." - apartment manager somewhere, probably
Excellent idea. Two additional reasons: (1) many parents would want veto power on what kids spent their time on and are exposed to, including video games; and (2) you could suggest quietly buying the game through the parents, to avoid complicating the kids' relationship with getting stuff.

Some other, more expensive, activities (e.g., tennis lessons together, when the family of one of the BFFs isn't affluent) are harder for more people to do this, but video games are relatively inexpensive.
This is the policy at my kid’s school. In fact if a student is caught with a phone then the phone is confiscated and only the parent can pick it up from the office.
Brainrot Stimulation Extension in VSCode
in your later comment you mention alignment, but the reason is that there's an enormous market discontinuity between doing the "super-duper right thing" and doing the profitable thing ... due to network effect(s).

we see competition in cloud/IaaS providers because they actually need to build datacenters and networks and so there's some price floor, but when it comes to "antivirus" CrowdStrike was able to corner the market basically, and downstream from them not a lot of organizations/clients/costumers can justify having actual independent hot-spare backups (or having special procedures for updating CS signatures by only allowing it to phone home on a test env first)

the cultural symptoms you describe in so much detail are basically the froth (the economic inefficiencies afforded) on top of all the actual economic activity that's sloshing around various cost-benefit optimum points.

and it's very hard to move away from this, because in general IT is standardized enough that any business that needs some kind of IT-as-a-service will be basically forced to pick based on cost, and will basically pick whatever others in their sector pick -- and even if there are multiple providers the will usually converge on the same technology (because it's software) -- thus this minimizes the financial risk for clients/customers/downstream, even if the actual global/systemic risk increases.
Just learn from kids on Twitter - take a screenshot, print it, put a strong emphasis with your marker, take a picture and upload it back as jpeg.

Just kidding.

Note that detailed descriptions of those elements bring better differentiation.
Fun(-ish) fact: Although it's strongly associated with and was popularized by Japan, the term "NEET" came from Britain.
> six times stronger than titanium

But if you bend it too far, it snaps.
Two parties is the mathematical equilibrium of every first-past-the-post system.

Only way to have more parties is to adopt something like a proportional parliamentary system. Which will never happen because you'd have to change the constitution.
I'm using this on some USB flash drive because save me to have few USBs with different Linux distros. Everything is downloaded from the internet and this make USB few megabytes only.
I mentioned it in another comment, but the most trivial example is:

X ~ Unif(-1,1)

Y = X^2

In this case X and Y have a correlation of 0.
Software isn’t an industry. NASA has amazing processes to diagram software before a line of code is written.
Excellent presentation, thank you!

The machinery is ironically beautiful to look at!

How did this compare to its approximate contemporary in the USSR ?
Using a rake would arguably be illegal, because

The leaf blower must be powered by electricity or another energy source that does not produce harmful air pollution.

excludes most humans as an energy source.

But that doesn't matter, because

"Wildlife" means any species of animal, including […] insects.

The leaf blower must be operated in a manner that does not disturb wildlife.

excludes almost all practical means of leaf movement at scale.
I feel this already spelled out in my previous post, and I feel strongly that you're not arguing in good faith here by calling my position impossible, but I'm content to try once more if only for readers. I can't stop you from replying but I won't be responding further to you.

James Bond movies typically treat all his enemies more or less the same. The only scene I can think of where someone actually explodes frames it as a pretty horrific affair. Characters in the movie and viewers alike are expected to have an uncomfortable reaction when the violence is extreme.

MIB doesn't do that. When a non-human is killed, whether or not they're even a hostile enemy (and they aren't always), there is no level of violence and gore that's off-limits. And it's a goddamn childrens' comedy. Do you think the movie would be the same if the aliens were replaced with humans? Or human-looking "elves"?
R is my least favorite language to use, thanks to the uni courses that force it

https://github.com/ReeceGoding/Frustration-One-Year-With-R
There’s lots to like about Hyundai-group EVs but I wish to god they didn’t have so many design embellishments meant to loudly announce ‘EV’. They look like toys with all the decals, textures, flares, and unnecessary bits.
netboot.xyz is neat. As it makes use of iPXE I would like to speak out a token of appreciation for those working on that project. It's such an essential building block in DC's around the globe that many are not aware of.
It's plausible that it's being naively flagged as something like phishing/misrepresentation of the ".com" site using that name.
Taislcale. Mullvad addon when needed. Goodbye every other pseudo VPN.