skysight-inc/HackerNews huggingface dataset:
There is a big practicality problem I see with this algorithm. The thresh defined in the paper relies on the length of the stream. It seems to me that in a scenario where you have a big enough data set to desire a solution that doesn't just store every unique value you don't know the length. I did not make it through all the proofs but I believe they use the fact that the defined threshold has the length in it to prove error bounds. If I were to use this in a scenario where I need to know error bounds i would probably ballpark the length of my stream to estimate error bounds and then use the algorithm with a ballpark threshold depending on my systems memory.

Another practical thing is the "exception" if nothing is removed on line 6 in the original algorithm. This also seems needed for the proof but you would not want in production, though the chance of hitting it should be vanishingly small so maybe worth the gamble?

Here is my faithful interpretation of the algorithm. And then a re-interpretation with some "practical" improvements that almost certainly make the provability of the correctness impossible.

func CountUnique(scanner *bufio.Scanner, epsilon float64, delta float64, m int) int {

X := make(map[string]bool)
p := 1.0
thresh := int(math.Ceil((12 / (epsilon * epsilon)) \* math.Log(8*float64(m)/delta)))

for scanner.Scan() {
a := scanner.Text()
delete(X, a)
if rand.Float64() < p {
X[a] = true
}

if len(X) == thresh {
for key := range X {
if rand.Float64() < 0.5 {
delete(X, key)
}
}
p /= 2
if len(X) == thresh {
panic("Error")
}
}
}

return int(float64(len(X)) / p)

}

func CountUnique2(scanner *bufio.Scanner, thresh int) int {

//threshold passed in, based on system memory / estimates
X := make(map[string]bool)
p := 1.0

for scanner.Scan() {
a := scanner.Text()
delete(X, a)
if rand.Float64() < p {
X[a] = true
}

if len(X) >= thresh { // >= instead of == and remove the panic below
for key := range X {
if rand.Float64() < 0.5 {
delete(X, key)
}
}
p /= 2
}
}

return int(float64(len(X)) / p)

}

I tested it with Shakespeare's work. The actual unique word count is 71,595. With the second algorithm it is interesting to play with the threshold. Here are some examples.

threshold 1000
Mean Absolute Error: 2150.44
Root Mean Squared Error: 2758.33
Standard Deviation: 2732.61

threshold 2000
Mean Absolute Error: 1723.72
Root Mean Squared Error: 2212.74
Standard Deviation: 2199.39

threshold 10000
Mean Absolute Error: 442.76
Root Mean Squared Error: 556.74
Standard Deviation: 555.53

threshold 50000
Mean Absolute Error: 217.28
Root Mean Squared Error: 267.39
Standard Deviation: 262.84
Related:

Jan Leike's OpenAI departure statement

https://news.ycombinator.com/item?id=40391412
More cores = more caches?
If you live in the US you are wealthy by world standards. Most people reading this live in a country where they can say the same. if "their wiring has an 0.1% chance of going wrong" implies you have wiring in the first place - which is not a given. If you have wiring you should make it safe, it doesn't cost much more to do it right. "if their bedroom has a window" - if you live where the climate is tropical you care.
Sandboxes, Games, and Play
TLDR:
The short answer is: it is legal to scrape LinkedIn properly. However, scraping LinkedIn a certain way could be illegal.

Scraping data from public LinkedIn profiles? Ok.
Scraping data from LinkedIn profiles with fake logged-in accounts? Not ok.
Yeah, I have no clue why this is interesting. Of course changing a constant to a wrong number causes weird behaviour or errors. How else could it be? And the weird behaviour does not seem to be special in any way. What am I missing?
There are C compilers that run in 64k of RAM. Let's not overstate the complexity here.
It's not inconsistent. There are two things in a declaration: a type (here int) and an expression (here *x). If you add commas you can have multiple of the latter. That's it. Stop thinking of the star as part of the type, it isn't. Leave it with the expression to the right, and thinks make sense .

It's why I always cringe when I see

int* x;

as opposed to

int *x;

There is a reason why K&R do it that way.
Bitonic sort runs in 0m2.035s. Transpiled to c and compiled it takes 0m0.425s.

that sum example, transpiled to C and compiled takes 1m12.704s, so it looks like it's just the VM case that is having serious issues of some description!
Is this a Chrome thing? My Firefox on Windows doesn't autoplay the videos for me.
These people have been getting away with it because of the relatively continual appreciation during that time.

When the worm turns, and it will turn, these people are in for a surprise and world of hurt. I saw it in the 80s and in the early 2000s and will see it again.
I would be the one in the sample who did not find the charts confusing.

The two separate graphs are much more difficult to compare - you can't see which elements compare to the same year so lose a lot of information.

The information in the chart is if there is a change in one time series is there a change in the other. - that is probably all you can infer as without error bars you can't see if the differences are material. (ie I know they are different scales so when they cross they obviously aren't the same.) If so there might be a correlation which might be worth looking into remembering correlation does not equal causation (so the example in the link are just laughable)

The prioritisation just shows nothing.

The scatterplot shows nothing

The indexed chart does make sense and in this case I would agree would be better.
https://www.linkedin.com/feed/update/urn:li:share:7006059900...
Yes indeed. It’s still good to celebrate when you reach a particularly good state during the process. Just don’t overconstrain the set of potential good states ahead of time, because the process might take you somewhere else.
It's almost impossible these days to have type E plugs with only the hole for ground and no springy pins on the side. So type E plugs are totally interoperable with both type E and type F sockets.
I addressed the same in a previous 'lora' post on HN. For me the name is already reserved for the radio telecommunication meaning. Nothing going to change that.
Ask HN: Should we stop posting X links on HN?
Just of today, i see a lot of postings on HN with linking to X/Twitter. Obviously X decided to not present the content.

just like here:

https://news.ycombinator.com/item?id=40392157

If you want to see how Prince of Persia animations have been done, you'll see nothing.

By now, i saw quite a few entries on HN that will lead into the literal nothing.

I dont have a twitter/X account. And i don't think it won't change anything, if I make one, because the HN URL is already not the proper one...
Hamilton Khaki or Tissot Gentleman are great all-around watches.
OpenAI finalized a deal to use Reddit content – Reddit Stock is Soaring
Portals allow weird stuff (non linear geometry) in a BSP level. I thought Doom had petals.
A new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die and a new generation grows up that is familiar with it ...

An important scientific innovation rarely makes its way by gradually winning over and converting its opponents: it rarely happens that Saul becomes Paul. What does happen is that its opponents gradually die out, and that the growing generation is familiarized with the ideas from the beginning: another instance of the fact that the future lies with the youth.

— Max Planck, Scientific autobiography, 1950
The fact they can trigger antibodies on a stable portion of the virus is impressive. Near the end, it sounds like a multi pronged approach is needed to deal with variations. I’m not an immunologist, but it was pretty light. If they are in trials does that indicate they have a white paper?
No reason the transmission protocol and the application/ui protocol need to be coupled in their level of abstraction. You could send the same data plus just enough bytes to know which data goes with which stream, then a terminal app could see a content stream and a control stream. I'm not spec-ing out a concrete protocol design here, just mentioning it is a fundamental assumption that leads to much of the (lack of) ergonomics in the current approach. Namely the interleaving of control characters and display characters. Any additional functionality we want needing to be squeezed down into that representation makes doing so cumbersome.
It's kind of amazing that they're able to take drawing of a scene someone imagined and then create (bad) 3d models. Imagine if in the future an artist could sketch a couple of images from a scene and then get an accurate 3D model?

Or if a 2D artist could sketch a couple of poses and automatically get a well structured 3D model and textures?

I think there's been a lot of concern in the industry about the impact AI and similar tools will have on artists, but it seems like it's possible to imagine a future where machine learning based systems work more directly with an artist rather than rendering based on language etc.,

I don't know how I feel about all the moral arguments about AI training etc.,. I think to me more concerning is how it could impact people more so than how it was trained. Even if a perfectly "ethically" trained model learned to produce perfect art and artists became a niche field, I think it could still be a bad outcome for civilization as a whole because I think there's value in humans producing art, and in having a society where it's (at least somewhat) of a sustainable field.

Otoh, I think it's amazing that people can produce the kinds of images using image models, so I'm not sure. Ideally we'd be able to support people in what they want without needing their to be a market for it, but the world's not ready for that.
Here's another example of a "non-euclidean" engine/game, which in my opinion is more authentically non-euclidian: https://youtu.be/tl40xidKF-4
Same in Greece both for renting and selling. People got rich just because they had some old apartment from the 80s which was worth 100k 5 years ago but they can now sell it 200-250-300k. And here we also have lots of foreigners buying houses at extraordinary prices. Situation is bad in cities, but way worse in the touristic destinations.
This essay describes operations on finite sets that mimic the operations of adding, multiplying, and exponentiating counting numbers and uses these operations to explain why discrete mathematicians and computer scientists take 0^0 to equal the number of functions from the empty set to itself, which is 1.
How will you know the generated model actually represents everything that can be in the API if you don't have a schema?
3 x 3 seemed like a pretty bad example to show how they parallelize.
There's no "turning around". You're in a place with a problem. The utility is not capable of wishing that away.
we should all thank G-d similar people have been generally in charge of bioengineering and nuclear development labs else we'd have... err nothing. We'd have pretty much nothing at all.
This seems like a huge pain to track if I’m being honest
Just pinged my isp router in Kathmandu for 30 seconds, 172-174ms return. It’s on AS4007.

From my router in Dhaka pining a router on airtel in India, 36-38ms

Routers in the real would give very stable ping responses, no matter where they are based.
More like ”journey is all there is”.
This behavior changed before, and it'll probably change again.
https://youtu.be/y6ADuQOXMmA?si=G-5eVxRrNnEolJrO this American does not quite agree with you.
Part of the problem is that Doom isn't truly 3D, it's a 2D universe with hacks to make it look 3D.

So in the final presentation, you're seeing a facsimile of a universe where the value of Pi has only changed in two out of three spatial dimensions.
> but for whatever reason they don't seem to want to focus on this issue

printing money funds the cancerous growth of government, so there's no way a major party can focus on that when it causes the monetization of shelter (and other hard, scarce assets)
That’s not a real issue tho. Like ever imo.

Niche content will yield niche audiences. As long as you have thoughtful consistent interaction between at least two people that is what matters.
The connected scatter plot is so cursed... talk about hard to interpret!

The only conclusion that's hard to argue with here is zero-indexing plots, but that's not exactly a new finding.
I do have CO2 monitors and they agree.

PM I have something that shows air quality and it shows 0 and high at the same time as the Qingping
They just migrated to X today, just wait until this is fixed. I don't think it's worth posting about it.

Now, since this post is on the frontpage, I'll ask a better question: should we stop posting paywalled articles on HN? (I'm in favor, I wish more people were in favor.)
Didn’t HN use to have actual polls? Anyway my vote for this is no
Some were and some weren't. Which currencies appreciated significantly against USD in this period?

Come to think of it, the UK didn't. It borrowed instead. Why didn't GBP massively increase against USD?
Unless...

If the technology became ubiquitous, in theory you as the streaming provider could save significant money on data transport fees by offloading an expected and approved AI upresolution workload to your customers.

They would pay for it with electricity and hardware expenses, which would far outstrip your transport costs, but we live in a proto-capitalist hellscape where saving $0.000001 an hour is worth slitting your grandmothers throat for, so it's not beyond the pale to assume someone has done this math.
I would prefer that as I also don't have a twitter account and don't intend to get one. But obviously that's just me.
One of my favourite LEGO MOCs ("My Own Creation" although this one isn't my creation) I've seen has been Iggy Pop and Tom Waits from the movie Coffee and Cigarettes:

https://bricknerd.com/home/cigarettes-and-coffee-man-thats-a...

https://singersincinema.wordpress.com/wp-content/uploads/201...

There's some plans out there for fantastically detailed models with thousands of pieces, for instance The Sulaco from the movie Aliens: https://www.reddit.com/r/LV426/comments/vs6b1x/as_promisedth... (that one is definitely a lottery-win purchase!)
the one over at https://news.ycombinator.com/item?id=40391887 doesn't work, either. tried to rewrite twitter.com as x.com, but nope
I disagree that the two are fundamentally at odds. If your goal is specifically to be a millionaire by 30, yeah, you're bound to be unhappy if you aren't near that by 29. But on the other hand, if you're more open minded about the flexibility of your goals, it can be a lot less painful. You just need the self-confidence that even if things don't go as expected, you're capable of finding another way or of changing the goal to something else that you find to give you similar or greater value.

I am a very harshly self-critical person in all my pursuits. Ordinarily it'd probably be pretty unhealthy, but I've always had a confidence in regards to technical pursuits (learning a new skill etc) that I could eventually figure them out, which has allowed me to reframe harsher criticism into stronger motivation. I didn't have this confidence regarding other things, which used to cause me a lot of stress and fears about being a 'failure'. Lately I've been building up this confidence for those things too, reframing being a 'failure' from someone who hasn't been able to achieve their core goals to someone who has given up on trying to achieve or change their core goals.
Then credit card payment processing/PayPal would have been weaponized earlier, and the result would be the same.

It's App Store. Centralized censorship through App Store destroyed the Internet.
+ The DEA has essentially nothing to do with this topic.

+ 52,000 guns is approximately how many guns Americans buy in any given day.

+ The market impact of government agencies selling old guns exists but is minuscule.
Thinking out loud about 2nd-gen email
„Can be heard“ is not the problem we’re trying to fix, and no reasonable amount of engineering can fix that . Maybe if you converted everything to maglev and limited speeds to 20mph.
Read old.reddit.com/r/apple to witness the zealotry - incitement topics include:

* Discussion of iPad not supporting desktop workloads like macOS despite costing as much as a MBP

* Discussion of the Apple mouse

* Discussion of EU regulation

* Discussion of the monopolistic nature of App stores and fees
Sometimes the obvious questions are met with a lot of silence.

I don't think I can be the only one who has had a conversation with GPT about something obscure they might know but there isn't much about online, and it either can't find anything... or finds it, and more.
Ok, so.. next question: how does it help now? I would like to see Prince of Persia jumping's doing. But I cant. It would be interesting, if I'm the only one that can't even access it..
Actually many countries heavily tax all of them - labour, dividends, and capital gains. Especially Nordics, Benelux, France, Germany. Sometimes I wonder what's the point even of working and investing in countries like France, Belgium, or Denmark... yeah everything is so tidy, clean, and nice but you'll never afford any of it through employment.
I think they aren't the full answer, no matter how much they're scaled up. But they may be one essential element of a working solution, and perhaps one or two brilliant insights away. I also think that some of the money being invested into the LLM craze will be directed into the search for those other brilliant insights.
In what sense is the Duke Nukem thing "an example of this"? The duke thing is an internally consistent programmed behaviour, this is... just random errors caused by a random change in the source code. Duke is maybe non-euclidean geometry, or something. This doom pi thing is... nothing to do with geometry. More an example of "garbage in, garbage out" maybe.
Does this university press release name-check Cell but not link to the article? A bit frustrating.
that does sound something that Musk would brag about, yes
Same story as Shoreham Long Island

https://en.wikipedia.org/wiki/Shoreham_Nuclear_Power_Plant

Built and powered up, but never used..

"...the state taking over the plant and then attaching a 3 percent surcharge to Long Island electric bills for 30 years to pay off the $6 billion price tag"

"Had the Shoreham Nuclear Power Station gone into operation as planned, it would have prevented the emission of an estimated three million tons of carbon dioxide per year"
And my children are not only my offspring, but everyone I come into memetic contact with.
> Besides compliance costs, operational complexity, impact on small businesses, inconsistent implementation across EU Member States, and extraterritorial reach and global compliance challenges...

In my experience the compliance cost really isn't that big for the vast majority of businesses. Where it does get trickier is if you're collecting a lot of data relative to the size of your customer base e.g. facebook, google etc. and in those cases I think some extra eyeballs on how data is handled is sensible.

Pretty much everything GDPR gets you to do is good practice, so if as a business you can't comply then imo your business is on shaky ground. For example:

- Right to be informed -> have a privacy policy which explains what data you collect, what it's used for, how long you keep it, when you delete it and so on.

- Right of access - > have a mechanism for providing users with a copy of their data.

- Right of rectification -> have a process where you can update customer data.

[1]

> There’s no law against being oblivious to breaches.

Im not sure where you got this idea from. One of the seven key principles of GDPR is "Integrity and confidentiality (security)" or more explicitly "You must ensure that you have appropriate security measures in place to protect the personal data you hold." [2] Being oblivious to breaches clearly goes against this.

> Also, it forces even non-EU platforms with zero domestic presence to risk being blocked due to not complying with rules that don’t even apply to them.

GDPR applies to the resident who's data you are processing, so if as a business you wan to deal with those customers you need to deal with those laws. Seems reasonable enough to me.

[1] https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-re...

[2] https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-re...
cut off immigration and stop printing money, and then housing will be available for people in the US
> For programs which pertain to the domain where C should be considered on its merits, if you try to write them in Rust, you may as well start each module with an unsafe block.

This is often said, but does not reflect reality. At this point, we have tons of bare-metal and OS-level Rust code existing in the world, and it still has very little unsafe overall.
Instead of half-working all day I prefer to work for half a day

Parkinson law: "Work expands so as to fill the time available for its completion"

Horstman’a corollary: "Work contracts to fit in the time we give it"

I used to give myself only 5 hours of work a day in given hours. My productivity was surprisingly better than with full 8 hours, my stress was lower, and I had so much free time.

I really should get back to doing that
Let me clarify: I am not going to waste my time reading the rambling of someone drunk on the AI kool aid.

> profoundly impacted human society,

So far there are fears, well founded fears but any impact is yet to be measured and "profound" has certainly not happened yet.

> driving significant advancements in multiple sectors.

ROTLFMAO. There's nothing more to be said. What is happening is asshole corporate owners destroying their own companies by firing competent workers and replacing them with a bullshit printer. Not quite sure how that's an "advancement".
GMAFIA at work again. When will MS be brought down from their high horse?
From TFA:

> The argument, in short, is to re-legalize single-stair apartment buildings, also known as “point-access blocks”—a typology that was once commonplace and remains so in much of the world, including the European Union, where fireproof single-stair designs are allowed. If combined with zoning reform, such code reform would enable attractive, light-filled multifamily housing to be built cost-effectively on countless urban sites that would otherwise be developed as single-family homes.
[dupe]

Discussion: https://news.ycombinator.com/item?id=40383029
Problem is, only people with an excess of time on their hands can participate, which is totally undemocratic. Just because a bunch of boomers are retired and have nothing better to do doesn't mean they represent the will of constituents. People with jobs, children, school, etc are effectively not able to participate, which is why we have elections where these things should be decided
The upscaling costs are astronomical. My PC jumps from ~150 watts or so just viewing a video to ~400 with this running on my 3090.

That's ~250 watts/hr just to watch a video in slightly higher resolution.
It's pretty telling that the German nuclear scientists themselves were somewhat relieved that the US developed the bomb before them:

https://ghdi.ghi-dc.org/sub_document.cfm?document_id=2320
Guess you haven't been on there lately? I signed up for a new account and was pushed hate speech within an hour of being online. Not to mention Musk sounds more like Hitler every day.

Sorry if you love him, he's not great, you should read his posts. They are insane.
When most of the work is to figure out what the other party wants and what can I take, productivity and motivation practically go down to zero.

I need to get into some lower level programming job or a tool programming job.
Show HN: I built a feedback tool that wipes confusion and brings action
Hey guys,

A feedback tool that translates client feedback into clear dev insights! No more confusion, just action!

Thanks,
If you find this useful (or have any feature requests), please let me know below!