skysight-inc/HackerNews huggingface dataset:
They mention they have some measures to "compensate for non-representative sampling in the dataset"

> we are reweighting the Nexar data sample, which is sampled from a non-representative set of locations, so that it matches the locations where different demographic groups actually live. For example, to calculate the police deployment levels that Asian residents of New York City experience, we reweight the original data sample to upsample neighborhoods with larger Asian populations.

and

> For example, if vehicles are prohibited from driving near protest areas, which also have larger police presences, we will not have images of large police presences near protests. It is not possible to correct for this bias with the data we have because 1) the true distribution may differ from the Nexar sampling distribution along unobservable dimensions which we cannot reweight along and 2) we may simply have no Nexar images in some regions of the true distribution (e.g. if all vehicles are banned near protests). A second potential bias is that police vehicles represent only a subset of overall police activity: for example, they do not capture officers on foot. We return to both these points below.

Not sure whether you meant this by "explicitly" but I guess the answer is that they didn't correct for it.
The context of the discussion was accommodating feeling during meetings, right?

Well that's absolutely not the place for it.

If your little fee fees get hurt you keep it to yourself and focus on the task at hand. Then after the task is complete you either pull the offender aside to address the problem or you bring it to a superior to be addressed. It in no way should have any bearing on the work at hand.

This is basics of work place decorum, right?
This does not seem legal. Stealing an access token to bypass access controls is illegal and I suspect these people didn't get permission to just scrape anything they want.
It's worse than that. Back then being gay wasn't even legal, much less gay marriage.
Hashtags coupled with the algorithm are super important to network effects and getting tweets out there beyond just your followers. Connecting community beyond just some follows is important to network spread and also discoverability.

Threads has no discoverability. And endless crap/unrelated accounts being forced on you with no clear way to say you're not interested in them? (why would Mute be the solution to that?) It's DOA.

Fastest growing means little when the accounts were already there.
As Argentinian I should tag this as clickbait
> That doesn't seem so bad to me. I have always preferred personal device whenever possible. Why not cut out the ewaste?

Sounds horrible to me. Work and personal are always completely separate.
And I'm sure if they posted it anyway, those owners would be findable or reanimated pretty quick :)
TBF Linux put OpenSolaris on life support, with RedHat's help.

Oracle just pulled the plug.
He is a great guy , i helped debugging ZFSMount problems with him - which causes LXD Container restarts to fail. It was just solved in previous release ( usual suspect , it is because of snap. ) . I would like to contribute on his new opensource projects.
Aha, I misunderstood — I'd thought you were thinking of rendering multiple small SVGs.

Good point, although decimation for sparklines shouldn't be that difficult: I've done completely stupid decimation (recursively split stopping whenever linear fit is close enough) for live GPS traces and (because people are only using them qualitatively) no one ever complained.
Totally this. I wish schools taught relationship dynamics, family issues, basic finance, etc. rather than useless maths and archaic grammar. I never learned that stuff from my parents and spent decades learning it the hard way.
Lima: A nice way to run Linux VMs on Mac
> That doesn't seem so bad to me. I have always preferred personal device whenever possible. Why not cut out the ewaste?

Because it externalizes their costs to employees and creates a bidirectional privacy nightmare (company data is exposed to programs running on a personal machine, and personal data is exposed to company programs - worse if they have any sort of management software but iffy even if not).
Show HN: Endless – Learn anything with personalized AI and blocks
I built Endless Academy because I was frustrated by not having the right vocabulary to search Google/ask ChatGPT when learning new topics.

Endless (https://www.endless.academy) will build a course for you, on any topic. You can customize what's taught and the teaching style. It's an efficient way to learn something enough to start using it.

There are a LOT of projects like this. Endless is different in important ways:

- It's block-based, like Notion. You can use this to customize the teaching style, by adding video, exercise, or other blocks.
- Courses are dynamic. You can add new blocks to an existing course, and even edit the course.
- AI chat blocks let you get help. I think chat should be integrated into the flow of the course, not separated into a different window. This lets you have multiple chats going, and preserve the context in each one.
- Steer how the AI develops the course by editing the outline.

Endless works by leveraging multiple AI models:

- Endless looks up information from high-quality educational resources (you can see the sources)
- It uses that information to prompt an LLM to write the learning blocks
- If necessary, it uses other models and services to post-process each block (for example, to find a video)

The backend is FastAPI, and the frontend is SvelteKit. Some learnings:

- I wanted the interface to feel dynamic, with information from the LLM streaming in realtime. This meant I had to rip everything apart halfway through and make the backend mostly async (a paradigm I hadn't used before).
- SvelteKit is fantastic - everything being plain Javascript/HTML makes creating components fast. I only ran into a couple of issues where the magic made it hard to understand errors. That said, there are so many off the shelf React components that overall productivity may not have been that different.
- I used TipTap for the block editor, and I mostly like it. My main issue is handling state across multiple TipTap instances interspersed with Svelte components. The "correct" way seems to be using nodeviews and a single TipTap instance, but that trades off data model flexibility (since TipTap imposes its own schema).
- I did not use Langchain/LlamaIndex/etc. In production, the need for reliability and observability meant that I just wrote my own light wrappers instead.
Compare a barbell squat to a bodyweight pistol squat. What does a beginner hitting failure look like with either? For the pistol squat you can’t get up and just maybe fall over 1 foot onto your yoga mat, or just use your other leg to balance and stand. The barbell back squat failure is absolutely ugly in comparison. You are down and can’t get up, maybe you try and push anyway with your back vs legs, thats a lot of weight supported by an out of form spine now, ooff. Knowing how and when to safely bail and drop weight out of an olympic lift is not something any beginner would just naturally know to do.
Only about 2-3% of men report being gay in western countries today. “Over ten percent” is a much larger number.
Please don't cross into personal attack, regardless of how wrong another comment is or you feel it is.

https://news.ycombinator.com/newsguidelines.html
Circa 1980 there was a panic over color movies fading that was spearheaded by people like Richard Scorsese who saw it as a huge cultural loss, but a major factor was that home video could turn movies like the old Wizard of Oz into gold.

At the time they tried bad preservation idea such as dividing the colors up into separate reels before they realized even relatively fugitive dyes would hold up for centuries if you keep them in a dry freezer.
Ask HN: Which LLM products do you pay for (excluding ChatGPT)?
For me:

For LLMs specifically - ChatGPT, and GPT-4 via the API and the playground.

I’d like to find more tools to use.

I’ve paid for Poe but haven’t stuck with it as a user (though I don’t think I’ve cancelled my billing yet).

Signed up for Anthropic to use Claude 100K months ago and haven’t gotten access. Used it via Poe and it was cool but I wish it had GPT-4’s intelligence.

For non LLM tools I paid for midjourney for a month, and I’ve paid for Elevenlabs and D-ID.

Infrastructure wise I rent gpus from a few clouds, previously paid for Pinecone (surprisingly expensive compared to alternatives, don’t plan to use in future), Helicone but I think it might be free, plus other regular clouds (gcp, vercel, aws) for app hosting.
that should be the HN motto!
I know there are many people who find this appalling and wish that companies did more to re-release their older titles, but I've frankly just accepted that emulation will be the best and perhaps only way to play a majority of these titles. Unlike movies, where you simply need a method to playback a video and audio stream, getting interactive media to continue working isn't trivial, especially since it needs to run exactly as it did before (otherwise what's the point). I wish rather than taking the effort to port the game themselves, they'd be more receptive to fan preservation efforts, although some companies are more friendly towards this than others. It's a bit of a self fulfilling prophecy. The more people ask for older titles to be re-released, the more developers realize there's a market for it, so rather than release the source or future-compatible files, they instead will port the game to their latest system once a decade to resell it.
Starting from the premise that users are morons instead of “users are busy and distracted” is problematic.

There’s a degree of user hostility here that seems likely to distract users from the task at hand, and if busyness/distractedness is the actual issue, adding a new level of distraction on top (now start thinking about the color of the daytime sky, a task that is wholly unrelated to the outcome), seems likely to backfire at best, and will piss off the rest of the customers by degrading user experience at worst.

I think there’s a balance to be found by adding enough friction while using that friction to orient the user towards the realization you want them to have (“this is permanent”), and sky puzzles only add friction.
I feel like TV/Movies are generally more available in Amazon for rent at least. Not great to be required to pay the same prices as we did in the past. For example the original TMNT is 3.99 to watch (rent) and $13 to buy. It seems to me like it should be $1 or free on some subscription network and $3 to "cloud own" permanently.
Mechanics tend to bring their own tools.
In relatively gravity is not a force like Electromagneticism etc. Instead, space time is curved and as a result the object itself is travelling in a straight, in accelerated line and only looks like it is accelerating to an observer outside of the curved space.

So relativity has no gravitons and instead curves space.

In quantum physics the opposite is true: space is flat, and gravity is like other forces, the result of particle exchange.

This is one way that the two systems are incompatible.

Again, happy to be corrected...
Yeah, I'm old enough to remember when the only way to see an old movie was if it showed up on TV or in a repertory theatre, if there was one nearby. And if a TV show wasn't in syndicated reruns, it just didn't exist.
It’s actually infuriating. This video game generation has offered very little major releases. However it’s still worth being apart of for the great collected editions.
But the amount of games, many that were of major importance that are simply gone.
What's up with the way you write the letter s? Is it a catch-all for apostrophes? I haven't seen anyone do that before, just curious.
Idk, my kid thought it was super cool seeing I could blink LEDs with programming.

No thanks on the Fiction. If I am going to waste time, I'm going to play minecraft with my kid.
As the poster I replied to pointed out, the lawnmower only cares about making money.
> If everyone is allowed to steal books

Nothing was stolen- just copied.
I think that companies are always trying to make the most profit per unit sold. Inflation may have provided a stimulus that led to the companies being able to increase their prices, even beyond the increase in costs, but the inflation had to already be there for this to happen. I don't think it's really abuse; they are free to charge whatever they want.
It's like you didn't even read the very next sentence.
> pages not shareable, unless you use some sort of filesystem optimised for that.

btrfs on the host would have support for deduplication of identical pages in the disk images. It's true that a CPU-costly scan would be needed to identify new shared pages, if for example, two VM's are both updated to the latest distro release.
To be fair, so was Red Hat's statement which started all this.
> Mix tapes were also great gifts.

I recognize, in hindsight only, that every woman I'd dated seriously has received a mix tape from me. Well, in the old days it was a mix tape. These days it's more likely to be a CD or a thumb drive. But it's the same thing in the end.

I think it's a way of revealing a more intimate part of myself. Kind of "you should know who I am, and here is an important part of that" kind of thing.
It used to be that search and address were two different fields in the browser UI. That helped - if typed in the address bar, you were probably looking for something in an address [so if you typed potato, it could search for a url in your local history with the word potato], and not for something in a web page.

Then Google realized you could combine the two; this makes it less likely you will use a competing search, gives you more places to show ads (as more things qualify as search) and most importantly - legitimizes tracking every page you open - as you did a web search for the URL!

Unfortunately, Chrome owns the web, and Mozilla copies everything they do. Especially when they are FF's main source of income.

IMO, the old system was more accurate and more private. The search bar is for web searches.
That's absurd, like saying "You can walk a mile and improve faster than running a marathon" is absurd. To anyone who isn't out of shape to the point of immobility, body weight squats are barely exertion.
> In one viral TikTok video, Brit Levy, Meta's former diversity, equity, and inclusion policy analyst, said she had to "basically fight to find work"

The only surprising thing here is that people who work in the DEI space have deluded themselves into thinking there's that much work to do.
Why don’t you just restore it? It’s naive to think that something will not happen (or drive you crazy) if there’s a set of preventive measures. Think how much respect and loyalty you could earn by reversing the irreversible, especially if you play it like “usually we can’t but in your case I’ll assign a system administrator to see if it’s possible to restore it from backups”. You can even describe this exact conversation in help/FAQ — none of these folks read them and if it gets viral they couldn’t blame you for trickery.
You approach scalability problems by identifying bottlenecks through measurements, and then you redesign the problem areas to solve the problem. This might be changing an inefficient algorithm, add caching, partitioning a database or whatever the problem calls for. Most likely the majority of code will be unaffected by these changes.

If an engineer propose that the only way to solve scalability problems is to rewrite everything from the ground up, it just tell you they haven't been able to identify the root cause of the problem. The rewrite will probably end up having he same problem.
There are multiple links in this thread showing how the media lied multiple times in the past, a whole documentary interviewing defectors who want to go back and telling how the South Korean Intelligence Service coerce and pay people to speak against the NK regime, but you probably didn't bother to open a single link and read about it.

You talk about science, yet, every anti-NK article sent in this thread are extremely poorly written and lack evidence to their claims. How is that "science"? Unless you are claiming that "science is when it matches my beliefs".
You said transcode to H.265. And they dont transcode to H.265 or HEVC. ( Apart from some edge case of 360 degree video )

And your original claims of YouTube using 2.5Mbps and 4Mbps. Go and find me clip with those bitrate?
> We chose to be RHEL compatible because we did not want to fragment the Linux community.

ROFL, oh is that why?? :-D
Years ago I wrote a genetic program to maximize stock market gains, and as primitives I used the indicators and signals from TA-Lib. The Hilbert Transform Phasor was the clear winner, though the returns were too meagre for me to continue with the project.
How to Tech Lead and Survive
> that would make your storage medium a potential biohazard

generally no. If you're worried about random DNA being a biohazard there are way worse things to worry about, like how your immune system uses random stretches of biologically primed dna to create antibody diversity.

The real reasons why it's terrible is that write speed is atrocious and read speed is bad (on the order of 2-3x that of amazon glacier's robotic tape handlers, with WAY MORE expensive robots, and way more expensive cost to read -- you're bulk polluting rivers in china to make the reagents).

The only use case I can think of is deep generational archival (like the svalbard seed bank, but for information). Where cost to store by volume is at a premium, and where you'd like to have many many many copies, and you don't mind the cost to read because you won't be reading it but for every 10 or so years, if even.

Store your logs in DNA. You're never going to read them anyways.
For electronics or manufacturing I can recommend inventree. https://inventree.org/

It can even do things like defining projects that are made of sub-components that are made of parts you may or may not have on stock (and if you added a prize for each of the parts it will spit out a total cost). It can handle prize brackets etc.

For a most basic system or hobbyist needs this might be total overkill tho.

Why not start an excel sheet with everything you have and put an location next to the thing? The major work with such systems tends to be first entry and then keeping things up to date, so starting on a small subset of things and trying it out would be a wise way to go about it.
The UI overall here is incredibly welcoming. It presents everything it's going to do with straightforward controls and smart UI labeling. Kudos.
who even has access to their high school report card? I suppose maybe I could contact my high school? But I didn't keep a copy of my own grades for more than a week maybe even in school.
If something is not legally available then copyright law ought to make it eligible for free distribution. The authors nor the rights owners certainly don't see the content making money anymore (or they'd be selling it) and thus they can't lose money (that they never meant to charge in the first place).

Copyright, as originally envisioned, should be a temporary privilege instead of a de facto ghost racket for perpetual extortion.
"If you make something idiot-proof, someone will just make a better idiot."

I think there's a literal psychological disease in American culture, where if you fuck up, then someone else was to blame for not preventing you from doing it. I think we just need less of that (not more of that) to force people to understand that they need to be considering the effects of their actions before they do them.
AWS is so strangely inconsistent about this. In some places it is "delete", others "permanently delete", and others still it is the name of the resource. Thinking about it more, keeping the user on their toes like that makes it less likely to fat-finger a deletion, I suppose.
Construction workers (and mechanics and most other jobs where you're using standard tools) do require you to provide your own tools, that's why you'll often see Snap-On trucks touring around garages. Obviously for bigger, specialized equipment like a jackhammer or an excavator, they provide them, but I think a laptop is much closer to a set of tools in this analogy.
You are incorrect. One of the biggest rights in copyright is the ability to basically refuse distribution entirely. You cannot have a copy of a copyrighted work without the authors permission. To do otherwise is a violation of the copyright owners right to be in control of who can access their work.
I am not a sociologist, but I do have a number of subordinates. I have people with domestic violence issues, people who cannot work late due to child custody handover times and even restraining orders between divorcing partners who both work at the same company. The single people seem to be more stable, the confirmed bachelors even more so.
Can someone do Fritter next please so I have a decent android Twitter client?
I think it's more about potential TAM than the current product. The hypothesis is probably that there will eventually be a winner in each vertical, and that $$ can mint the winner.
What a dumb conspiracy. Like they just picked what? 1 in 20 or so of their Instagram accounts to get this "shadow account"? Or could it be exactly what the app says when you encounter that, that the follow request will be sent when that user opens a threads account?
> because the parameters are too fuzzy.

This just advocates for a system that more accurately captures uncertainty in the models. Which, would technically make the results replicable but reduce their impact. At least in the short term. Impact in the long term is harder to determine.

Though, I really think A LOT of fields need to be far more honest about their levels of uncertainty and any ones that aren't (especially empirically based ones) are bordering snake oil territory.
I used to freelance HW/Firmware development for a small company that retrofitted old machine tools with modern motion controllers. There is a surprisingly large industry out there ready to repair or retrofit whatever old controls are on your old machines.
random 1080p only upload https://www.youtube.com/watch?v=CxN56ns8tbM "Junk or Jewel? The 1974 VW Thing Charity Car Purchase." Mustie1

137 mp4 1920x1080 30 │ 1.59GiB 2686k dash │ avc1.640028 2686k video only 1080p, mp4_dash
270 mp4 1920x1080 30 │ ~ 2.86GiB 4707k m3u8 │ avc1.640028 4707k video only
248 webm 1920x1080 30 │ 801.49MiB 1320k dash │ vp9 1320k video only 1080p, webm_dash
614 mp4 1920x1080 30 │ ~ 2.13GiB 3514k m3u8 │ vp09.00.40.08 3514k video only
616 mp4 1920x1080 30 │ ~ 3.52GiB 5789k m3u8 │ vp09.00.40.08 5789k video only

without magic beans only dash 137 and 248 available. ~5-6Mbit 1080 is what Normal Twitch streams are at.

Checked 4K one https://www.youtube.com/watch?v=pUm5B-5uQik "FIRST WIN IN THE SW20!!! MR2 Championship Brands Hatch 2023" DannyDC2

299 mp4 1920x1080 60 │ 2.34GiB 5047k dash │ avc1.64002a 5047k video only 1080p60, mp4_dash
312 mp4 1920x1080 60 │ ~ 3.68GiB 7756k m3u8 │ avc1.64002A 7756k video only
303 webm 1920x1080 60 │ 1.62GiB 3508k dash │ vp9 3508k video only 1080p60, webm_dash
617 mp4 1920x1080 60 │ ~ 2.86GiB 6027k m3u8 │ vp09.00.41.08 6027k video only
308 webm 2560x1440 60 │ 5.17GiB 11168k dash │ vp9 11168k video only 1440p60, webm_dash
623 mp4 2560x1440 60 │ ~ 6.72GiB 14169k m3u8 │ vp09.00.50.08 14169k video only
315 webm 3840x2160 60 │ 11.55GiB 24964k dash │ vp9 24964k video only 2160p60, webm_dash
628 mp4 3840x2160 60 │ ~ 13.42GiB 28319k m3u8 │ vp09.00.51.08 28319k video only

Now this is somewhat more interesting. IOS API unlocks higher bitrate m3u8 tracks for all resolutions, even 4K goes from 25 to 28Mbit.
Ok, sure, they also produce extra h264 files at various resolutions and quality levels. Transcoding can't invent quality that wasn't there in the input, so I don't see how that changes anything. That 2.5mbit/s upload they accept is therefore the ceiling.
React as a part of an Ember app: how we modernized October’s front-end