skysight-inc/HackerNews huggingface dataset:
I've been needing something to do this (easily) for more than a year.. nice to see this tool make it simple and easy.
I popped in a url and it quickly showed 75 pics, I clicked select all and download - then got nothing (after a quick spin circle).

(using firefox, did disable ublock origin, still no download) -

Love getting the visual of the 75 pics with the basic details on size! Would love some extra info with a click perhaps showing the url it came from. (currently wondering if the 75 pics at 210x158 are just the thumbnails and I actually need a scraper to traverse further to get the bigger size for the next web site..

I've been considering some of the scraping tools out there.. but not sure I want to spend the time learning something only to have it not work the way I need.. see this particular site has a weird (hosting?) issue - where pics will 404 on some albums.. then if you go back and reload the page manually some minutes later - they appear - then you can click to download..

So I really need something to show me urls of pics that were in the html code but 404 - so I can go back and get them.
Being an asshole is often not illegal. The law would be incredibly suffocating if we tried to legislate away everything unpleasant. Also, different subcultures or social classes have different norms; it would be hard to define one model of nice behavior for everyone.

Usually, there is a social punishment for being an asshole. You are not legally required to be nice to people, but the natural punishment is that the nice people will avoid you, you won't get invited to nice parties, etc. The "karmic punishment" for assholes is that they can only associate with other assholes, because everyone else tries to avoid them. Also, unless they are physically very strong, they probably get punched a lot, as a natural reaction.

There are situations, such as online journalism, where the usual mechanisms punishing the assholes do not apply, and it can even become a source of income.
This is not the answer. People are just as likely to be biased as police, and when this system is known, it can be used by malevolent citizens to influence where police go, not just in racial ways either.
I can't even get personalized life insurance, so I think there's little chance of this working. At my height and weight, I'm considered "overweight" BMI, and they charge me for it. But I'm at 12-14% bodyfat with a 30" waist. I have diet logs to prove how healthy I eat, and training logs to prove how much I workout.

I can't even find a life-insurance insurer that will measure my waist to add context to my BMI despite the clear predictive information that contains and I get penalized for having more lean body-mass despite the fact that it is also predictive of longevity.
Do any Linux/glibc or Linux/musl systems support static PIE binaries, yet? Without static PIE support you don't benefit from ASLR (at least not fully). This 2018 article seems like a good breakdown of the issues: https://www.leviathansecurity.com/blog/aslr-protection-for-s...

OpenBSD has supported static PIE since 2015; not just supported, but all system static binaries (e.g. /bin and /sbin) are built as static PIEs, and I believe PIE is the default behavior when using `cc -static`. The reasons for the switch and the required toolchain changes are summarized in this presentation: https://www.openbsd.org/papers/asiabsdcon2015-pie-slides.pdf

Also, simply checking the "static PIE" box isn't the end of the story. There are different ways to accomplish it, and some are better than others in terms of ASLR, W^X, and other exploit mitigations. It's been a couple of years since I last looked into and had a hold on all the issues simultaneously[1], but the basic takeaway is that dynamic linking in system toolchains and system runtimes is far more mature than static linking.

[1] static PIE issues are a nexus of exploit mitigation techniques, so if you want to deep dive into exploit mitigation or even just linking issues then chasing the static PIE rabbit is a good approach.
It's not just about phds. Undergraduate education is significantly compromised because universities literally focus on customer service metrics, and are directed by the business school.

At prestigious institutions this is literally a revolving door with mckinsey which can be followed through key appointments but I was using the word to make a more abstract illusion.
You might be right, although I don't think it's nearly so certain. Why wouldn't each niche community just become an even greater echo chamber when they are decentralized and don't have to follow the same community guidelines? Seems to me, you'd be looking at a lot of communities like /r/thedonald.
Well better tools wouldn't have helped that, since most of the them just expose the underlying low-level DB types. Until databases support a proper type-system that doesn't just describe memory layout that kind of bug will always be an issue.
Interesting. Following that line of reasoning, I wonder how that played out with Chelsea Manning's court martial.
Back to the preventive vs reactive. If you legalize all drugs, sell the harsh drugs in a controlled setting, the existing black markets would be destroyed. This argument will continue to be a circle, if we are saying "x people arrested" but "y shouldnt be a crime in the first place" "well y has to be illegal, look how much x we have."

All of the money put into cops, lawyers, prosecution, sentencing, prison, parole, etc could be put into tackling the consequences of legal use.

All of the money currently flowing into the black market, into gangs, into crime and violence causers, would try up.
A New Standard Deal
You're being very selective. Federal prison only accounts for 22.3% of drug offending inmates[0]. Specifically in jails -- where 74% of occupants are not currently charged -- possession accounts for 56% of drug related offenses. Drugs accounts for 21% of occupants, (23% of convictions, 25.5% of non-convicted). In state prisons possession accounts for 25.5% of drug related offenses and 3.5% of the total state prison.

Jails, County, State, and Federal prisons are all different. It would definitely make sense that the more serious convictions, especially with harder drugs, goes to federal. That's kinda the point of federal...

[0] https://www.prisonpolicy.org/reports/pie2020.html
> There is no way to stop them from tracking your phone location

Is airplane mode or turning your phone off effective? I've heard stated before that they are not, but I don't understand the technical details.
Questions: History of Ifconfig
I'm writing an article on the development history of ifconfig, and some remnants of earlier protocols that remain in the command defaults. Specifically, in BSD and Linux, we've found that there are some defaults in the subnet mask parameters that can bite an admin if they don't know about them.

These defaults derive from the old classful network address system of the late 80s-early 90s. I'm trying to understand why those behaviors haven't been removed since classful networks went away. I think I understand in the case of Linux: Classful networks ended in 1993, and support for net-tools in Linux ended in 2001.

I've seen hints though that development for net-tools continues to the present in BSD. So my questions are...

1) Is net-tools/ifconfig still in development for BSD?
2) If not, then when did it end?
3) If so, then do you have any idea why it's still using defaults based on classful networks?
I had to reboot to do the update from 10.15.4 to 10.15.5

And cannot remember the last time any one of the 100+ windows 10 machines I administer had a forced reboot.
Sad to hear, but unsurprising. The MS store near us looked nice yet was always a ghost town. They're just not as sexy as an Apple store, though they've done a great job with the latest versions of Windows and the XBox is fairly popular.
The median household income in Middlesex is over $100K (that's where Harvard is located, right next to MIT). Incarcerations were also flat in Martha's Vineyard, but so what?

My priors say Middlesex wouldn't show increased rates of incarceration regardless of the amount of policing, the passage of three-strikes laws, the passage of the Clinton crime bill, etc. due to the demographics of the area. What do your prior's say?

Universality (to me) means "more criminals were incarcerated everywhere we expected them to be (based on demographics) and regardless of changes in local policies or funding, because there was a nationwide push to increase incarceration rates in the 90s." Do you mean something else by "universality"? Maybe we just disagree over definitions or something.
Possibly in terms of feel. They really ran a pile of crap on a 486DX100 in comparison. The RISC OS machines of the early 1990s had a similar feel to a modern PC on the performance front with every-day tasks.
Driving a Responsible Digital Ecosystem in These Polarized Times
Haha. Honestly I thought this was some PL research paper. That was lot of information (which is good). It might be worthwhile to point out on the blog which DIP this was. Thanks.
This is the same virtue signaling bullshit that’s gotten us no where on this issue for 40 years. You’re neighbours don’t care that you compost. This is a global crisis, not a chance for you to tell us all how great you are.
There is even a shout out to HN in that article!

> I worried that readers would not trust this arrangement [affiliate links] when I first started. But in practice it hasn't been a big issue. In fact, readers ask me which links to click to ensure I get my commission. Honestly, negativity about my business model is more likely to come from a community like Hacker News than it is from my readers.
GC is like malloc() but automated and done on multiple threads.

With how low the pause times are with Java's new collectors (categorically not longer than malloc()), the only faster alternative is not allocating at all. Which you can do in many languages.

I agree your point the memory allocation and GC is expensive, but that's something you see in any language when allocating. It's not unique to the GC. You either pay the price with GC or malloc()/free(). Its the same price but one is much easier to deal with than the other.

If pause times lower than 10ms are important you could write your app in Rust which makes it much easier to systematically avoid allocations using borrowing.

I guess my point is that the new collectors make Java memory management roughly comparable to C, and if you care so much about performance that allocation costs are important, you should just use a language like Rust where its easy to avoid allocation completely. The performance gap between allocating in C vs Java is, for practical purposes, gone.
A randomized clinical study involving thousands of patients is not good enough to assert this?
I don't know, I was just pointing out the fact that people in federal prison are not there for smoking weed on the porch. I don't have the numbers handy, but I would guess that a vast majority of the marijuana arrests in your article result in a fine or probation at the very most.

Which I happen to agree is a waste of resources and probably does more harm than good by getting people started "in the system".
That's a good point. I did address the other levels here: https://news.ycombinator.com/item?id=23655174 but it was harder to find more of a breakdown in the data.
Extract.pics is a small side project and the result of a few inconveniences. In the past months I have been working on the redesign of two news websites, so I needed a lot of images while creating the cencepts/mockups. I encountered a few problems, that I wanted to solve with this project:

- I didn't want to download just a few images and reuse them everywhere. That makes the design feel a lot less "real" and a lot less interesting. I'm also to lazy to download lots of images manually.

- Some of the images were set with background-image in CSS, what makes it more tedious to find and actually download them.

Yes, all the images used on a site are visible in the browser dev-tools. But you don't really have a preview or an easy way of finding the image you want. And you still need to download them all individually.

It might be good to know that extract.pics executes javascript and scrolls down for a few seconds before extracting all the images.

Hopefully this is useful for someone else out there.
Better than I could have said it
Same old same old, this drives me nuts on so many open source project websites. I wonder how many good libraries languish in obscurity because of the lack of something simple like an elevator pitch on their landing page, or worse there is one but it's an overload of incomprehensible-to-outsiders jargon.
Last time I tried to create e-mail address via Tor, ProtonMail worked flawlessly. No phone number required. They even have .onion domain available exclusively via Tor.

But other e-mail providers like GMail and Hotmail won't like Tor and ask user to provide phone number, you are partially right. So solution is simply not to use these e-mail providers.
Maybe you would get something out of 3blue1brown's series on linear algebra [1]. It will give you an intuitive, geometric interpretation for concepts such as a vector, a basis, an eigenvalue, a linear transformation, etc.

As for why you would want to know these things, well, linear algebra is finding applications all over the place these days. Everything from computer graphics to machine learning is jam-packed with linear algebra. And I'm not just talking about basic concepts such as matrix-vector multiplication. The singular value decomposition has applications in discrete optimization, image compression, the PageRank algorithm [2], computer vision [3], and machine learning [2] [4].

Having said that, you may find it very difficult to understand something like SVD without a firm grounding in the topic of vector spaces, linear transformations, spanning, linear (in)dependence, subspaces, eigenvalues, eigenvectors, diagonalization, and determinants. This is why SVD is one of the last things you learn in a linear algebra course (indeed, it's not covered until lecture 29 of Gilbert Strang's course).

Ultimately, it all depends on how relevant these things are to you. I would assume (hope) that because you clicked on this HN discussion that you're interested in learning linear algebra because you think it might be useful to you.

[1] https://www.youtube.com/watch?v=fNk_zzaMoSs&list=PLZHQObOWTQ...

[2] http://www.cs.cornell.edu/courses/cs4850/2010sp/Course%20Not...

[3] http://cs.rkmvu.ac.in/~sghosh/public_html/nitw_igga/talk.pdf

[4] https://medium.com/@jonathan_hui/machine-learning-singular-v...
But you're not paying them more to be a cop. For the good cop they get paid a little more, they buy the insurance with the money, nothing really changes.

For the bad cop they get paid a little more and pay a lot more for the insurance, so that it eats too much of their salary and they have to quit and find another job.

The people who are in it for honor and duty aren't going to be the ones paying the higher premiums, right?
Except for anyone playing Hack or Dwarf Fortress or any other ascii based game it's not a joke, it's reality.
that’s the first I’ve heard of that area called “the triangle.” mind sharing what it’s significant for and what kind of person would fit? I’ve considered moving to the SE for better weather and job opportunities as a new grad.
Did you read the article. Minneapolis, for close to 50 years, has been an example of how to do low income housing better than everyone else. Policy within the last decade has eroded this gain. It has gotten worse since these policies have rolled back.

Is it perfect? No. Does low income housing alone prevent police from fracturing families and communities by enforcing drug law? No.
> Obviously we aren't doing that here

IDK. one year olds were added to CalGang database. People were added to the CalGang with no supporting evidence. The database was used to direct police resources and also for background checks for job applicants.

So, you're entered into the database as a one year old (or a ten year old, or a 30 year old but for no good reason). Now you can't get a job. Predictably, you turn to whatever petty crime to survive, like selling loose cigarettes or dealing small amounts of pot. And, since there's increased police attention on you, you're definitely caught.

Taking away people's ability to make a living legally, and then arresting them for turning to crime to survive, sounds pretty equivalent to just arresting them for precrime in the first place.
Just be glad they don't call HN a 'deep dark message board where notorious hackers and the Silicon Valley elite come to discuss politics and religion on a global scale' or 'some weeb hacker site'
In this case, the journalism isn't the thing that changed. It was also possible to dox someone 100 years ago. But unless it was an important person, people would read the paper and quickly forget it.

With search engines, if someone is doxed once, you can find it years later when you search their name. The same behavior now has more serious consequences.
Another option essentially is to move certain functions away from police, such as traffic enforcement (use more cameras and non-armed officers who need not be police) certain kinds of house calls like for the mentally ill to be done by social workers, and such. The police can be reserved for violent, life-or-death situations.
In the pursuit of making sure people are fearful you would encourage using the term "ground glass" when discussing the lungs of an asymptomatic case? Because if you had ground glass in your lungs you would absolutely feel it, and it would feel like ground glass. You would cough and spit blood.

Are they asymptomatic or do they have ground glass in their lungs? It can't be both.

It's not ok to fear monger like that.
This was a great writeup! I loved start to finish view, that didn't get bogged down in technical details.
Not sure about the hyped email providers (hey etc.), but I switched to Fastmail earlier this year.

Beyond the control part (own domain, not sharing data with Google etc.), I love how snappy it is. Gmail bloat didn't bother me this much until I started using Fastmail (still Gsuite for work).

I've paid for a couple years already, just to lock myself down. I'm happy so far ~3 months in.
I interpreted it, and explained so, as "brandishment", which is the legal term of art for exactly that act of displaying a weapon in a threatening way. I submit that if you meant something different, you're the one who needs to clarify.
Well, in 1995 it was developed by Cinematronics and published by Maxis. In 2020, who knows. Probably Disney.
The difference is looking at federal prisons vs arrests and other prisons. Federal is for more egregious crimes, so it would make sense that less of them are for pot and more for harsher drugs.

It is difficult, but we have to try to be aware of the biases in the data we have. I should have mentioned in my first post that those were just federal stats. But I try to break down more in another comment state and jails, specifically about possession statistics.
https://en.wikipedia.org/wiki/Research_Triangle
I don't know of any cases specifically from protests. And this time most of the cop riots seemed far more focused on cracking skulls than surveillance - it seemed more about defending their egos against status attacks than more carefully planned oppression.

But there have been many cases of cops forcing or attempting to force phone unlocks, and more where they coerce unlocking by lying about the law. Which is perfectly legal - the cliche about cops being being paid to lie is perfectly accurate, if not a full explication of their duties.

Feelings of safety are pretty individual. Apps that access personal data of importance don't live on my phone that leaves the house.
Yea but you're ignoring biases in the data that are difficult or impossible to disentangle from the underlying effects. What happens when you see an area with 50% higher violent crime rate? Is that because there are a large number of crimes? Or is it because it's a neighborhood that is disproportionately targeted by police? How do you even attempt to control for that?

It's not that Bayesian stats can't help or can't offer insights, it's that it can easily reinforce underlying societal biases, and then it's harder to question because "it's science" and no one has to take any responsibility for its effects.
Certain relatively more "pure" sciences have a very bad habit of making people feel bad about leaving -- or people who are in those fields going through a lot of "departure guilt" placed on themselves.

I have learned that this is not because they have some objectively better life (or prestige) in academia, but rather because most people within the field don't know what the real world is outside and subject themselves to a hostage-like mentality.

The sad thing is that everyone leaves academia at some point (practically speaking, except for the few lifelong people who get to the very top -- and that is like hitting the lottery, so why bet on it). If you're sure to leave, why contribute to giving people angst about leaving? Why feel guilt over something that is an unavoidable part of the path?

These fields should more actively show students and researchers that there is life / jobs outside of the field and what you can do with your degree and education. The field I am pretty sure will only become better because of it. It will not be like you turned traitor to it and are worthy of only being talked about in hushed tones as "someone who left".
Did Amazon internally dog-food it before it went public? Maybe that's the confusion.
Did you ever read the original story? I very much recommend doing so.
I’ve heard that one of the biggest shocks for new owl handlers is seeing a wet owl. Owls compact to a stick when wet. All of that bulk is just feathers.

In the case of the owl it’s acoustic insulation (deadly quiet) but there’s a reason we make feather down coats. That stuff works very well.
I agree, both sides are negligent. The only place you can go for real news is first and foremost the raw data. And second, Twitter.
My point is dismissing drugs from the equation is dumb when it makes up almost half the convictions.
Predictive policing does nothing more than sending policing resources where crime is more likely based on statistical models.

It does not racially discriminate and it is not racist. It does not harm anyone.

I feel that this is posturing and shooting the messenger. If crime is statistically higher in "black neighbourhoods" the issue will not be solved by pretending it isn't.

If the technology does not work then of course there is no point spending more money on it. So, does it work or not? Here this feels political, not pragmatical.
Variadic tuples are a pretty big type system feature and will make some typing/library maintainers very happy.
Is it possible to put the decoder into a feedback loop and search among multiple possible encodings that minimize the residual errors? Similar to trellis optimization in video codecs. http://akuvian.org/src/x264/trellis.txt
I think the "retail demand" for phones is closely connected to phone repairs. Unlike a computer, a phone is carried around every day and has a much higher chance to break. Customers depend heavily on it, so they are not willing to send phones to repair centers and wait weeks for a return.
Advancements in the Objective-C runtime, WWDC 2020
No. I pay Fastmail each month because I like the various domain tools they have.

A $100 a year for the features that HEY offers isn't worth it to me. I don't have most of the problems that they wrote code for.