skysight-inc/HackerNews huggingface dataset:
>. Running an offline dedup will then go back and reintegrate the new files with the dupes on the snapshots.

Running a dedupe based on file rather than block would do the same thing. You don't gain much if anything in your example using btrfs.
I'm certain this type of data is tracked on most devices. In an optimistic outlook it drives a better customer experience because AMZN can capture trends in data to discover things like "oh people change the page forward too frequently accidentally" and track down root causes. In a pessimistic sense it can help target you based on how long you spend reading specific content and which content you highlight as a reader.

Generally every product I am aware of tracks interaction based data such as where someone clicks or taps and what context they are in. Consider things like `utm` parameters which suffix most links people click to determine the context they clicked on something and what they clicked on.

I do not see this as sinister. I imagine somewhere in settings one can turn this feature off but I don't know for sure.

* Disclaimer: I am currently employed at a subsidiary of Amazon. These views are my own.
As a specific example, Etsy recently (2017) converted back into a normal corporation from a B Corp: https://qz.com/work/1146365/etsy-made-mistakes-from-which-ot...
Well, I stand corrected then.
In Forth, not just new words - everything (except the stacks, I think) - as if in C you could redefine not only every reserved word but every symbol - (, ), +, *, ->, %, &, [,],{,},# = etc etc. Also there are 'defining words' (akin to typedef, struct, enum etc) and you can define new defining words... And so turn Forth into any other language you wanted, if you were crazy enough..
Empirical study of Amdahl’s law on multicore processors
8 percent is not insignificant IMHO. Appreciate the legwork to post this.
i couldn't find a screenshot, but I would really be curious to see it in action

EDIT: found some at http://androwish.org/index.html/wiki?name=Example+Scripts
Thanks for the explanation. I didn't realize md didn't use the parity checks unless there's a URE.

Is it correct to say that ZFS parity is used to reconcile on each read even without UREs, but with md parity is only used when there are UREs? If that's true, it makes much more sense why ZFS is considered the right choice.

Also, do you know if adding luks in the mix changes that?

My data goes md->lvm->luks->ext4 and I hadn't considered which part of that is supposed to catch the error if it wasn't a URE.

It makes sense that md would update parity if there was no URE. It also makes sense that LVM wouldn't know or care about data integrity.

I would think luks would require data integrity to work properly, but I'm not sure what happens if there is bitrot in a luks block.

I'm also surprised ext4 doen't have checksumming, but apparently it's only for able to checksum for metadata and it's disabled by default: https://serverfault.com/questions/456319/how-to-get-checksum...

Dm-integrity sounds worth a look, but https://raid.wiki.kernel.org/index.php/Dm-integrity doesn't inspire much confidence.
ML as a language name has a historical etymology, but its not really now any more of an abbreviation than KFC is, its just a name.
Opinionated Coding Guidelines and Best Practices in Python
I used magic mushrooms back in the 70's, not knowing that they would someday be used to treat severe depression. Mine was debilitating so I had to drop out of college. Magic mushrooms really helped me put my life back together.
I think you are missing the fundamental purpose behind game engines. Game and graphics programming is really hard, and at times unapproachable to a lot of people. Moreover, in the real world, even experts prefer to use game engines just due to the fact that it is almost guaranteed that a raw renderer you write yourself is not going to be as good and optimized as a game egnine's renderer.

Using game engines may not suffice to your use case, but for a lot of people that's the best way to develop games. This argument is similar to using a systems level language vs a higher level language.

I myself prefer game frameworks over either raw graphics APIs and game engines, since it provides me with my preferred level of control while meeting my particular needs. I can see where you come from, if your goal is to learn and highlight that in your resume, writing and experimenting against the graphics APIs are likely the best bet. But for a lot of people, their main goal differs from yours, which is to... make a game.
Ironically, I used Rdio while working in engineering at Apple, and miss it too.
In contract law you have to reach mutual assent so if you’ve never read a contract but they signed it with your signature it would be thrown out in court and probably grounds for a tort suit if nothing else
I’m not sure there is enough play in demand elasticity to affect significant change relative to the amount of load difference you see. Furthermore the peaks are highly weather sensitive. Would love to be proven wrong though.
Bit of a bad look that I can't search the docs using typesense.
If you read his reply / notes to the sec, he states how he was able to place orders without being front run. He asked developers to amend sierra chart. As a result, if placing a large contract order, rather than see price tick away from it he got instant fills.
Ive zero doubt this is why he was fingered. Taking from the hf funds.. who think they have some right to impose a defacto tobin tax on transactions and justify it by calling themselves "liquidity providers!" He is guilty of spoofing, but the flood is caused by bots, or when they stop playing. He mentions his networth was constructed mostly over 50 days. On ' normal days ' you have to contend with smaller ranges where entries are key and those sort of intant fills are a massive advantage. Of course since he documented it the cat got out of the bag, many that had used this method were super annoyed!
Bitmex seems to be the new wild west these days, all those techniques are used and more with 0 accountability
I was with you up until this part.

other countries haven't

Ummm... you do realize that most big pharma companies are European, right? Bayer is German, GSK is British, etc...
To TCL's defense, no, I was making a generic claim. TCL was a wonderful language to work with and no sleight was intended.
I've seen the movie and not read the book, and I took away two things:

1. Derivatives can be riskier than the underlying asset.

2. Ratings agencies will lie if it makes a big client happy.

I don't think either 1 or 2 is controversial. And put together, those two truths will lead us right back to 2008.
I wonder why no one has tried to build an AI around TOS and other contracts. It could be trained on 1000s of documents and learn what clauses people want to be made aware of, and/or provide a score from 0-10 on how bad it would be to sign it.

To head off the objections: no, it would never be perfect. Yes, there is some risk. But it could be way better for 99% of the population that doesn't read anything they sign.
> At least on HN I still know what NLP stands for…

Neuro-Linguistic Programming?
What is a public benefit corporation legally? What kind of tax forms do they fill out?
All limited liability partnerships have a field of business registered (however broad or vague, but it has to have at least one; some jurisdictions also standardise those fields of business) and you usually need supermajority to split, merge and/or change the registered field and/or name. Or do you mean PBC charter can limit further than business licensure requirements?
Also, sustainability of a web server doesn't mean that much if you don't consider the net impact in the world. It seems to me that you could have a web server require substantially more power and still be a net benefit if it actually influences many users to consume less in their daily lives.

What is the marginal cost of the web traffic it creates and replaces? Would tuning the software and data payloads be more impactful than worrying about the server wattage?

What is the marginal cost of other user activities which it influences? Not just the website operator, but the user behaviors happening as a result of their relationship with the service? Do they stop using other less efficient services or just increase their overall footprint? Could it reduce their consumption of energy and material goods? Change their diet or travel habits...?
I have yet to get told a personalized email address to this day. I want to make a shift to a personalized email domain, but I have yet to go through with it. I want a domain thats easily memorable and easy for almost anybody to type out.
Title case is inherently misleading and, therefore, should not be used.
The over-summarized version is: IPSec is extensible and it's rather tedious to get every implementation to interoperate securely with every other implementation simultaneously (and in the correctly secure way).

While using IPSec between supported devices, in an ideally configured setup, yield slight but real benefits with respect to attack resistance, a practical comparison of the difficulty involved and possible configuration mistakes makes other solutions more robust and less likely to be used incorrectly.

This discussion covers most of the high level points, however it doesn't consider that Wireguard being adopted in 2020 and not 1995 means we've got 25 more years of public cryptography research and far more relevant defaults to include as the base of the standard.

https://crypto.stackexchange.com/questions/202/should-we-mac...

The answer here also provides some of the pitfalls of IPSec being more of a 'build your own crypto setup' than an off the shelf drop in solution.

https://crypto.stackexchange.com/questions/56354/ipsec-vs-ss...
> if we believe Snowden

You don't have to believe him.

Google engineers have admitted in print that their inter-DC links were not encrypted.

Marissa Mayer admitted in print that she allowed the government to install a linux kernel module to sniff email traffic for keywords, among other things.
He's an impressive beast.
I fail to see how a carbon tax "only slows a net loss". Are you implying that economy is a zero sum game and that investment does not yield results?
Raindrop bookmark service adds full text search and permanent page archival
Ive done it for 5ish years, the advantages are huge and absolute.

#1) no impossible to reproduce bugs

Any one off bugs you find a are instantly replayable, often times things that you think are bugs were actually just misclicks. Since issues you open in eg github are timestamped (and commits) you can go back to the video and see what happened

#2) You can now quantify what's wasting your time in numbers

By randomly sampling hundreds of hours of video I can say 60% (60%!) of my development time was spent on premature optimization. With this data I have now effectively doubled my programming productivity. An added bonus is now you know exactly how long everything took to complete in hours (837h for current project)

#3) Helps you stay on task

At the end of the day i tell myself what i need to do tommorow in a very short 5 minute video and suddenly its really easy to jump in.

In short, I highly recommend it, and theres really very little reason not to do it.
Had a similar experience with hypothyroidism as a kid. "he's just lazy" those worthless fuck physicians said...
I wouldn't class this as political problems. Is Facebook having a gazillion developers on their app a political problem, or necessary given what they want it to do? How is replicating that for each platform a good solution, in any sense (political or technical)?

Tech companies core competencies are the service or product that they provide. Making it N times for N platforms is a hurdle that doesn't improve on the core, it's a cost of the fragmented market. I'm arguing that it makes perfect sense both technically and politically to focus your vast majority of developers on your core, and only having specialized platform teams were necessary as a cost of doing business. How is developers re-implementing every UI screen and feature across iOS and Android helping Shopify customers sell more merch?
Companies invest in growth areas. Mobile experiences are driven largely by interactive native elements using the latest platform specific API.
And then people would complain that there were 1200 apps in the app store that did the same thing, and most of them badly.
There have been numerous threads here on HN about this: donating to people to support open source development does not match up with what companies usually do, so it runs into all sorts of corporate friction. Whereas a monthly or annual support contract is the sort of thing that companies do all the time, and at low dollar amounts it might not require much approval at all.

Unfortunately it is up to open source developers themselves to set their business model, and many don't seem to like (or want to do the work of) setting up overtly commercial relationships like support contracts.
Google Play Music happens to be absolutely perfect for my usage (including the ability to upload my own tracks AND stream them). I'm extremely annoyed they are killing it off as I've tried everything else and it just doesn't work for me. The replacement YouTube Music is... abysmal. Well IMO anyway.

Only pointing this out because it speaks to your point. I think you're spot-on that APIs and embracing 3rd-party clients are the way forward. Not just for music, but any service where the primary UI challenge is making everyone happy (hint: a lot of services). I'd instantly support and switch to a service like GPM that put APIs first, assuming all the same back end functionality and catalog was available. Even if the "official" client didn't suit my needs.
Absolute vs relative improvements, vs cost of attainment, are two different questions. The largest overall reductions, and increases in life expectancy, come from very basic interventions.

The problem w/ efficiency measures generally is that there's progress to some theoretical maximum, and it comes with diminishing returns.

Breaking down life expectancy gains by demographics, the've moved more for men than women (since 1920, far more the reverse before), largely due to workplace risk, violence, and military service), and the poor/minorities rather than wealthy/majority (access, preventive care, environment, violence, stress).

The upper bound's moved little. Exceptional longevity is profoundly correlated geographically with poor recordkeeping.

See:

The difference in gains by age, here for England and Wales beginning 1700, through2013, w/ all ages from 1850: https://ourworldindata.org/uploads/2013/05/Life-expectancy-b...

Note that whilst at-birth increases (1850) from about 40 to 80, a 40 year old gains only 67 - 82 or so (15 years). It's early-life mortality that's changed most.

Similar US trends: https://lh5.googleusercontent.com/qtYQp1x-ZF9iXc-zVh7Kg2xJBX...

By gender/race, 1970-2010, US:
https://www.cdc.gov/nchs/images/databriefs/101-150/db125_fig...

An unusual presentation, showing mortality by age in 1950 vs. 2015. Note the double factor: reduced infant/early childhood mortality, and somewhat reduced adult mortality: https://siepr.stanford.edu/sites/default/files/styles/page-w...

Discussion: http://conversableeconomist.blogspot.com/2018/04/inequality-...

Geographic distribution: https://localtvwtkr.files.wordpress.com/2017/05/s078658261-3...

There are also hidden costs: mortality is selective pressure, and we've lifted much of that for about 5 generations. I have concerns. (I'll also note this generally impacts the wealthy more than poor, within and between countries.)
I m a web fanatic and use only the browser. My other apps are dropbox and skype , a decibel meter and strava, so things that cant exist on the web anyway. I use multiple gmail accounts so webmail is better

Since most content apps use browser links at some point it doesn’t even make sense to e.g. have a twitter app

Now, i wish we could have a better api than web push notifications though
The issues in the article mostly apply to packages with (some) extensions.

Matplotlib? Pandas? Those are not typical except for the datascience crowd.

For your regular web stack? It works fine. And yes, installing the apk will save time in a lot of occasions.
OneSignal (YC S11) is hiring a back-end dev to help process 4B daily requests
I first thought it's about R-Studio[1] the recovery software. Then I tried the main page and I had doubts. Only after I hovered over the "Products" it says "RStudio - The premier IDE for R" (ok, it also says something in the page title but that's not fully shown in any current browser, and there's a "RStudio Server Pro - Take control of your R code" on the first page, but I did not make the connection)

[1] https://www.r-studio.com/
Are you keeping a write-up of your progress anywhere? Would love to see how this turns out.
Yeah, Apple Music is optimized for people with large music libraries where search is the only reasonable path especially on a small screen.
I misread the title and was confused about how these could be both spears and not spears at the same time.
I'll just note that there is a false dichotomy here, because it is impossible to separate government funding and policy from most pharma and biomedical developments. They continue to do much of the heavy lifting, and there is no model really for doing it at all privately.
Is there are way to get involved in something like that? It sounds so fascinating.
* Ad company
To this day, I don't understand why Google made Go instead of working off of SML. While the go ecosystem is better due to the millions of man-hours poured into it, the language is inferior in every way.

To elaborate, CML is better than golang's channels and isn't broken (requiring mutexes over channels to avoid breaking qualifies as broken). SML syntax is simpler to learn, but still offers much more powerful abstractions with pattern matching. SML uses options instead of null pointer exceptions. Hindley-Milner types are clearly superior to Golang's type system (especially things like empty interface). SML has had generics for almost 25 years now while go languishes. SML has immutable data structures and they are the default for almost everything. Golang has implicit types, but SML's implicit types are much better -- especially structurally-typed records. SML's modules are amazing and simply have no comparison in go. Finally, SuccessorML is doing work toward adding a few new features to the language (for example, module type classes), but the language has an actual specification that anyone can implement (and many have) rather than the implementation effectively being the spec.
I'm looking for an internship in July-August. I've built a lot of model planes younger and what you're doing seems amazing! Is there any way we could talk further?
> I'm calling it Unearth...

Why not call it Digg?
For those like me who have no idea what "wheels" is in this context, I think it is referring to https://github.com/pypa/wheel

This looks like some sort of binary Python packaging thingy. I think @dkarp is saying that there exists pre-existing binary builds for glibc for many things, but not for musl libc so they are forced to be built explicitly when using pip to manage Python dependencies.

I could not figure out where this repository of binary packages is or who maintains it. Any corrections would be appreciated.
AI isnt a solution to turing problems.
OK, but before it can become policy, some official or officials have to make it so.

Those officials then have to get reelected.

That's usually easier when your opponents can't make legitimate-sounding claims that the policies you've instituted led to a bombing.
> Google engineers have admitted in print that their inter-DC links were not encrypted.

Didn't Google qua Google, not mere engineers, do that by publicly announcing that they were upgrading security by encrypting them in the wake of the Snowden leaks?
That app has gotten worse and worse every year. I get that they need to cater to Apple Music subscribers: fine. Why can't there be a setting to turn off all the Apple Music stuff for nonsubscribers? And for people like myself that really really hate the app, why lock down the APIs to make third party music apps shit as well? It's just so frustrating, the music app really has been terrible since somewhere around iOS 8.
From Idaho to Mars
Looking at you Microsoft Partner center docs... just give me the dashboard!
isn't hot temperature more likely to kill bacterias?
I have issues with my wireless signal just crapping out from out of nowhere from time to time. Usually in specific spots in my home. I setup a repeater (thinking a mesh network might be the better choice, but this was a much cheaper temporary solution) but it still sometimes happens. The ethernet is fine on the other hand.

I run OpenHAB and Pi-Hole all on a RPi3 on ethernet, no issues so far.
But if you're losing (undefined amount of money) on 49.25% of the trades....
> A hash of the password could be part of the key

Except when it's not (and the full password is used instead).
> Apple's customers have plowed tons of $$$ to "own" their libraries, and Apple is doing the right thing to bring them along.

This is why I stuck with Apple Music. I was hearing rumors that they'd eliminate music purchases in which case I was going to dump them.
Google to shut down non-profit platform One Today
As a technology professional in the social sector, I wanted to share an email that I received just a few minutes ago. It looks like Google will be shutting down the One Today platform, a social hub for non-profit organizations to share and promote fundraising initiatives.

"Hello,

We have an important update to share with you.

We launched Google One Today seven years ago to help people donate to causes they care about. In the last few years, we have seen donors choose other products to fundraise for their favorite nonprofits.

As a result, we will shut down One Today on February 6th, 2020.

New nonprofits will no longer be able to sign up for One Today. The Google One Today app will be turned off, and any open projects will be deleted. We will ensure that 100% of funds donated on One Today prior to February 6th are disbursed to the relevant nonprofits.

If you have any questions, please feel free to contact the One Today team.

Thank you for your donations and partnership.

The Google One Today team"

https://onetoday.google.com/
Lyft plans restructuring, job cuts
I think it'd be cheaper to ask the people you spoke with to learn some new communication skills, instead of firing and hiring an entire department. Like, whoa dude. That's waaaay too much paperwork
I wish someone would make a router with a subscription service for blocking these connections that in no way benefit me. Throw a nice cpu in the router, make it L7. Charge me 5 bucks a month, I'll pay it so long as you never once challenge my trust in you, future router OS provider.

I can't manage this per device. Some, I don't want to, and most, I can't. Let's move the bandaid from the fingers to the wrist. Sell me a privacy aware router that sends 30% of my packets to 0.0.0.0.

Yes, yes it will be another page from the arm's race. Yes, websites will stop rendering content for not letting the tracking get through. I don't care, I live a year at a time and that is how this race is run. We won't win it, but we can die before we finish.
Its true that tons of news sites ask for permission just to spam you, or outright sell notifications to advertisers. I think the web notif channel has already been abused beyond repair. It may be time to redo the concept from scratch

Killer feature for email: add an email header that turns an email to notification. Then email apps would push the notification to the user, bypassing apple’s block. Websites already have the user’s email, so no need for more subscriptions. If gmail implemented this, it might push for adoption