skysight-inc/HackerNews huggingface dataset:
(employee/founder here)

Anything under 64K is perfectly reasonable to store in a CockroachDB column. Between 64K and maybe 1M is trending towards trouble. Values greater than this are going to go through CockroachDB like a goat through a python.

Why is this the case? For starters, at the level of RocksDB, values greater than 64K are not jammed into SSTables (to avoid constantly rewriting them during compactions of the LSM tree). Instead, individual files are created. Also, CockroachDB has quite a lot of write amplification, which is generally OK for structured relational data, but becomes progressively more terrible for large blobs. Write amplification comes from the Raft log, as well as RocksDB's write-ahead log.

What we really need is an integrated storage system for immutable blobs, something we're taking very seriously. Roughly half of the original team which built Colossus at Google are working on CockroachDB, so there's some knowledge of how to go about building such a system.

While we're not sure where it would fall on our roadmap, the idea is that large blob values would be efficiently replicated and maintained through a separate subsystem. The blob column itself would just contain a pointer to the blob. The value in tight integration (a single CockroachDB cluster providing both OLTP SQL database as well as a distributed blob store) would be one deployment & admin console, and transactionally consistent blob column values (e.g. no fighting s3 eventual consistency).
Remember the U2 fiasco, when Apple decided to break into your computer and push their new album through iTunes? It seems like whenever Apple decides to take control of your files, shit happens.

Back in the day, I tried to use iTunes for a while when I bought my iPod. One of the first things that it asked me was to take control of my music, as it would reorganize it by itself. I agreed, but tested it first with a small sample. When I saw the mess it had done to the way I organized my music, specially with the files' names, I backed out of the auto-organize option and preached heavily against it to everyone I knew.

I learned my lesson: never let whatever service control your files. And always, ALWAYS have backup. Remember: The answer to life, the universe and how many backups you should keep of your stuff is 42.
How do you plan on making your service's pricing competitive? Amazon's current spot market instances are ~30 cents per hour, which is twenty times cheaper.
The book example is not very helpful for a few reasons.

Firstly, the authors of books do get paid—writing books is not a pure tax imposed by academia.

Secondly, books are not typically at the frontier of scientific knowledge (these days). They're interesting and helpful, but accessing them is not a necessity for keeping up to date. Put simply, books do not have a monopoly on knowledge.

Finally, and most importantly, books are not funded by the public. Research is. If the public is paying for something, they should have access to it.
raises hand

To be clear, I'm not saying that such people do not exist. I'm saying that there's no effective way to estimate their number.
Generate CoreOS cloud-config with Terraform
Microsoft has this habit of being first in a market, technology and then either ignoring it or releasing a shitty solution. I'm not an Apple guy. Use both windows PC and phone.

So I'm not being biased against Microsoft when I say that the best bet we've got to seeing this tech in an actual product is for Apple to (invent it) release it first.
You're welcome! Thanks for reposting to keep the info active. One thing to add to that:

https://www.facebook.com/sci.hub.org

Their original domain was sci-hub.org, which got shut down a while back. Occasionally they post updated information to the facebook page.

Also, @fuxy. You can change your /etc/hosts file on a linux or BSD box to include the line:

31.184.194.81 sci-hub.io

That will override the DNS and go straight to the site.

Windows has a similar file located here (at least for win7):

C:\Windows\System32\drivers\etc\hosts

A perfectly reasonable location for a hosts file.
You can still read his work for entertainment value or to see the data analysis. That's the value of his work -- it's not just blind punditry.

I'm also interested in seeing which serious journalists predicted Trump's success and when they predicted it.

The problem, which Silver has written about extensively, is that polls are not always very predictive. In some places and for certain types of elections, they have massive margins of error that make them essentially useless.

That's why people looking at real facts and data got this election so wrong: the country changed, and looking at the history of the country didn't tell us what the country is like now. It doesn't mean those people were wrong -- it just shows one of the limitations of science, which is a discipline that, by definition, applies data of the past in an effort to predict the future.
If you compare similar earthquakes California might see 1,000 deaths to a quake which would kill 100,000 people in less prepared areas. IMO, they simply hit diminishing returns where an extra million can save more lives dealing with other problems.
Misleading title. Crucial bit from TFA: "Starting June 1, 2016 all apps submitted to the App Store must support IPv6-only networking."
A Small Town Judge Who Sees a Quarter of the Nation’s Patent Cases
A complaint I've heard before is that this works fine for most modern music, but the Artist/Album/Track layout doesn't apply to a lot of classical collections.

In which case you can just turn off the folder organization, but there's not an easy way to undo it once iTunes has gone and dicked it up.
That is terrible, truly terrible. If given a blank slate to work with and dealt with all over again, what would be a better way of dealing with the liability? More monetary compensation? Or something else?
Rebol ?
Protecting against Identity Theft
IBM has been at it for a long time. It has been notorious for earning through licensing of it's patents
http://www.ipwatchdog.com/2012/01/11/ibms-formula-for-succes...
While putting limits to this practice is good for the consumer, I think they should also have a threshold to bring on frivolous lawsuits against these companies. Death by a million microcuts.
I don't think slavery was about making people feel bad if they didn't work outside your "agreed working hours", unless you mean whipping or beating them until they feel really bad.

A more nuanced discussion of what you seem to be trying to get at can be found at http://disciplinedminds.tripod.com/. But please don't use the slave analogy unless we're really extracting economic goods out of a working group by force.
SoftRAM – software scam for Win 3.1 and 95 that sold 700,000 copies
There's a trivial fix to the whole system: free the employees. As long as employees are completely tied to their employer wages will be lower. What else do you expect?

Forcing employers to pay a higher salary is a half-measure. I imagine they'd still prefer H1B's over locals for one simple reasons: you hire a H1B employee and they're gonna stick around for a few years. Even if the job sucks. It's worth to pay a bit more and significantly reduce turnover.

I'd love to see actual turnover stats of H1B employees versus American employees. I think it's a huge driving factor in hiring decisions, especially at giants like Facebook or Google.
People commenting here need to work on their reading comprehension. Apple is not dropping support for IPv4. They are simply requiring that all apps also support IPv6. The headline is confusing because of "only." But it's way different than if it read "iOS supporting only IPv6" as some comments seem to be implying. The change is that when a network is IPv6 only, apps must function properly, whereas previously Apple tolerated apps that only worked on IPv4. A better headline might be "Apple bans apps that only support IPv4." (*Edited, guess it's not so easy to write the headline. :) )
We don't require everything that we consume to be completely safe. Most foods are choking hazards.
In my limited experience, any kind of negotiation where the parties have a weak or a bit of an adversarial relationship, will probably degenerate into this kind of shin-kicking and posturing about walking away on both sides.
noticed that too, maybe he's dyslexic?
Thank you for a detailed account on how to prevent and clean up identit theft.
I'm in the Wright is a liar/con-artist camp but the items on that list apply to most "normal" people (including myself).
> That means these journals offer something of value to them.

Prestige, obviously.

The other services are marginally valuable. Honestly, I wish a big foundation would agree to simply underwrite any such costs (to remove these as an objection).

The whole value of publishers is in their accumulated brand value. A brand value which they did not build themselves but instead gathered from decades of harvesting public resources.
I think that the acceptance of failure in certain domains is a problem of system design. Why shouldn't doctor, pilots, ship's captains, train conductors etc be held accountable (blamed) for mistakes? I don't agree with your statement that air travel is designed around the acceptance of failure meaning that pilots aren't culpable for their mistakes. Watch a NTSB hearing into a pilots failures, and there's plenty of blame assigned when appropriate. Doctors and other medical professionals should be similarly scrutinized and ostracized when they perform poorly.
I too lack the courage to out myself as satoshi nakamoto!
If you read Maciej's comments and interpret them as "entitled to what's mine" you are obviously unfamiliar with the general vein of his work. In support of my opinion I expect the man himself to reply refuting this completely, stating no, it is in fact about the money.

If anything I'd expect that he (and a lot of other people) are disappointed with not seeing what he was going to do with the cash, not the loss of the money itself.

If funding is rocket fuel, I was excited to see what could be done with it in the hands of a proven SV-venture arsonist.
Have there been any studies done on how one may affect/trigger the other?
Off the top of my head, if you write a custom MiddlewareChain class that exposed its own management port, you could inspect and modify the state of the chain at any time, checkboxes to disable middleware, change endpoints, insert debug middleware, etc.

I like this... definitely worth thinking about. Thanks, all!
Confluence works pretty well for us.
trivial but handy bookmarklet link for scihub:

javascript:window.location='http://sci-hub.bz/'+window.location
There seem to be two orthogonal considerations:

1. Are the changes consistent with the roadmap.

2. The code is not production quality.

The first is out of your control. The second is entirely within your control. The idea that someone else should do something about it is really the question of etiquette. An offer to improve the code quality yourself should accompany the pull request.

Good luck.
Zombie servers will kill you
So, like... Is this a thing now?

I guess... I'll be the new Satoshi?
Sugar is generally recognised as unsafe, addictive and unhealthy. Tens of millions of people suffer from it.
Early Bitcoin developers worked directly with Satoshi Nakamoto on his identity
>It baffles me that some people believe most non-American employees are just "cheap labor".

It is not a "belief" because they are cheaper. Everytime this topic comes up, a bunch of Ph.D's are shocked, SHOCKED! to learn that there are companies abusing the system and to learn that Infosys, Wipro and Tata are the leading H1-B Sponsors with an average salary of ~$73,000

http://www.myvisajobs.com/Reports/2015-H1B-Visa-Sponsor.aspx
Any tips for a mere mortal who looks at Angular and finds it incomprehensible? React? Vue.js? Or just stick to good ole Rails/Python for now?
What about people who are motivated by the prospect of academic achievement?
No need to remove it. If you don't want to discuss it, don't. Personally speaking, this is the first time I've seen it, and I'm on here a lot. I'm sure there are others who haven't seen it before either.
I know of folks who end up many kids to maximize on the welfare per kid. Can you really trust all parents? I've seen some abuse of welfare in my days in Australia.
JS is a fantastic language for teaching the basics of programming - introducing variables, flow control, etc.

The problem is that as soon as you go beyond "write a series of statements and run them" and in to actually trying to write something interesting and fun with a little abstraction or actual software design then JS very quickly stops being a good choice. You can quickly hit synchronicity problems, weird scoping issues, data typing difficulties. Those are things that could easily frustrate an interested person.

A hour or two of JS as an introduction followed by learning a BASIC variant is probably a really good bet.
Yo Dang,

I don't think this brouhaha is worth it. Let the community send one of theirs in there. If he takes the money and bails (I doubt) the community takes the blame and deals with it.

If he takes the money and does a gimmick (I suspect) the community will also deal with it.

Remember, this is an EXPERIMENT. It is theoretically not to work. It is similar to the "come with no idea" thig YC did years back

I didn't vote for Pinboard [1] however, truing to justify the silencing of 700+ votes will be hard.

You and Kelvin, take a deep breath and let the EXPERIMENT run its course.

[1] https://news.ycombinator.com/item?id=11618930
I am curious what's there to stop a kid from starting a Jupyter notebook (or even Mathematica with all the FullSnakeCaseNames) and firing away? Sure it isn't complex at least wrt. the basics (pun intended)?
Yeah, I recommend against this particular example :)
I did have some, they began slightly later than I've got hold of a PC.

I do think that some school lessons contributed their share. I just don't think that sitting behind a desk for two hours per week, for ten years, is necessary or desired. After a few years I did not need much "training wheels" and could continue to increase proficiency regardless.
I like how you organised the sections, similar idea, different approach :)

Wish you luck with this!
This is unlikely to work - developers in general can't cope with managing SSL certificates. They won't know what to do with them or handle them securely.

You need full integrity verification, with a secure store and whitebox crypto keys to make such a scheme secure.
You hit the nail on the head - and as someone who works in the telecom industry (and an early advocate of IPv6) I'm pleased to see it.
http://lmgtfy.com/?q=Wage+slave
Tangentially related: my day job involves cleaning up patent data, and IBM can't spell its own name consistently: there are thousands of unique variations of IBM as an assignee name, far dominating all other US and european patent holders.
No. Why would it defeat the purpose of having a finite quantity?
Also very possible there's a bit of selection bias, since it wouldn't be surprising to discover that YC cross referenced the Apply HN apps with the YC/YCF apps and the act of doing that alone would be a source of bias.
It's kinda crazy that it has taken so long for someone to actually take an initiative and attempt to make the authentication more secure.

I wonder if this is a custom built solution or if Teller.io is using something like HashiCorps Vault to do the whole SSL cert dance.

Either way, this looks promising.
Who sets the quota? And how do we ensure the quota isn't lobbied to be resized to the point where it allows cheap labor?
Apple fundamentally does not understand software. A shame, as the software, really, was their original special sauce with the Mac 128k and beyond.

Today, however, the company really doesn't understand how to make, maintain, or market software. It sees software as a way to spread their control of their hardware further into your life. It's going to be the death of Apple, mark my words.
It's amazing to me how everyone is drinking the koolaid here on him being a fraud. I really don't think Gavin got duped. And I'm pretty sure they had enough private email discussions over the years that there were things they discussed/shared privately over those years that could be used as a reference point for Gavin to be sure he was talking to the same person. People are more willing to believe that Gavin was hacked or suddenly forgot how bitcoin worked.

I understand the technical proofs put forth have been spurious. I wouldn't be surprised if Craig had an under-qualified underlying who didn't really understand what they were doing who was responsible for some of that. People are forgetting the human part of this equation though. His interviews with the BBC don't strike me at all as someone looking to cash in. I think he is a bit of narcissist and wants to claim some credit for inventing bitcoin, but I also see a very deep fear of being in the public eye that comes through as well. Perhaps because he has done quite a few things he's not proud of and doesn't want to have people publicizing those. But the idea that he's a scammer looking to cash in here just play doesn't out at all. What's the end game? Where's the pile of money he's after? People aren't thinking through the motivations here thoroughly enough. He's risking quite a lot by doing this with the absolute certainty that he would be found out if he was a fraud. You could say maybe he's an idiot and doesn't understand that. No one could watch that interview though and believe the man isn't intelligent though. Why talk about the negotiations with Australian tax authorities when those authorities could very easily come and say that he was lying. None of this makes any sense from the scam angle. There has to be something else going on here.
Or "Apple bans apps that support only IPv4."

"Apple bans apps that support IPv4 only." could be interpreted as banning apps that support IPv4. Although that'd be reaching.

Want to hear my rant about "No smoking allowed" when it should be "Smoking not allowed"?
I agree with your complaints about QBasic but I disagree a bit about JavaScript. You are totally right that the environment being right there in the browser is great. But if you press F12 right now you'll find an amazing complex dialog box -- as a professional you just implicitly skip over that complexity. And JavaScript is a significantly more difficult language than QBasic even if it's one of the simpler professional languages.

When I taught my daughter about programming I actually installed an old copy of Visual Basic 6.0 and it was really good for that. You draw the UI and the interact it with it mostly procedurally. She created a small useful application out of it. It's kind of crazy that in 2016 all our programming environments are more complicated than VB6.
Ha! Who didn't hack the gorilla throwing bananas? :)

I learned to programm with BASIC [0] before on a Spectrum ZX clone, however that GORILLA.BAS [1] was a good programming lesson. I remember even now, after 25 years, figuring out the algorithms and the parameters of the flying banana.

[0] https://en.wikipedia.org/wiki/Sinclair_BASIC
[1] http://www.jefflewis.net/archive/programming/gorilla.bas
I thought client certificates were being phased out, didn't Chrome just remove the <keygen> html tag?
It already is forced -- see: ESLint.
Very cool. It looks like you can also use `every()` instead of `bool_and()` - and also note that you can provide any boolean value to these, so you can do something like `every(column = 'value')...`
The "And goodbye" was a little ominous.
I gathered the target group are developers. Devs should be capable of dealing with this if they want higher security.
"atomized glycerine" drawn over a hot metal element. It's that heated element that biochemists find worrisome. We regularly use hot metal elements ("catalysts") in the lab to "activate" (typically to generate free radicals) small molecules along a synthetic pathway. If you draw glycerine, or any glycol, over a heated element you will generate products like formaldehyde. Inhaled formaldehyde is a health hazard; often associated with cancer. The flavorings are often aldehydes and ketones and are even more likely to generate free radicals, which are implicated to an even greater degree with triggering cancers. The real social health concern with vaping vs smoking is while we have a hundred years worth of statistical data on smoking - we only are just now guessing at the "well, it's better than smoking" conclusion with vaping.
Well, this list is "willful violators". I'm pretty sure the body shops that "abuse" the system are well within the letter of the law. I don't approve of what they do, but if it's legal then it's legal. Blame the politicians, blame the government. If you don't like it, change the law, change the system. As long as it's legal and a profitable business they will keep on doing what they're doing.
I hate homework.
I am a frustrated mobile phone touchscreen user, feeling like the phone never quite knows what I want to do. This is the first time I've felt a touchscreen might actually be able to help me be more productive, rather than a roadblock.
Hah! I actually do have a huge tub of whey protein powder at my desk. But it's Nitro Tech, not Optimum Nutrition. Oh well, there goes my shot at alpha dominance. :-(
Does anyone know why each application would be so costly? That amount seems ridiculously large to me.
It's representative of the equivocation being used by the anti-tobacco lobby to expand to a device that doesn't involve tobacco. The ultimate inversion of the tobacco industry helping them would be surprising to me if I weren't familiar with their efforts to keep Swedish snus out of the EU (where it is illegal.)

edit: "The widespread use of snus by Swedish men (estimated at 30% of Swedish male ex-smokers), displacing tobacco smoking and other varieties of snuff, is thought to be responsible for the incidence of tobacco-related mortality in men being significantly lower in Sweden than any other European country. In contrast, since women traditionally are less likely to use snus, their rate of tobacco-related deaths in Sweden can be compared to that of other European countries."

https://en.wikipedia.org/wiki/Snus#Health_consequences
You beat me to it! I was about to post this one from the same site:
https://www.psychologytoday.com/conditions/narcissistic-pers...

(click on "Symptoms")
Why a Logging Framework Should Not Log
Sorry but its name!
I remember reading something about this on NYTimes before. Didn't realize it was so long ago: https://news.ycombinator.com/item?id=10483024
The H1B visa requires a minimum pay as it is right now. However, what some companies do when they sponsor a foreign worker for H1B is to hire the person part time on paper and thus being able to pay a lower wage, but still in practice requiring him or her to work full time. This is an anecdote I heard but I know it occurs. For many people, having the chance to come to the U.S. is like winning the lottery, and they will not report their employer.
Ha. In my opinion, you and others are treating the brain doing statistics like religious people treat the existence of God. Absolutely any evidence can be interpreted as support for the hypothesis if you just tell the right story about it.

I'm not even saying the hypothesis is necessarily false. However I will never trust the results of people who become so attached to an idea that they focus entirely on confirming it rather than rigorously testing whether it actually reflects reality.
Not quite 100% the same, but Python + QML comes pretty close, or once support for composite templates finally lands Python + GTK3.
TypeScript is fantastic. Maybe it will be the undoing of Angular2 but I doubt it. The Angular2 team chose TypeScript because writing large applications using the limitations of ES5 is extremely difficult. TypeScript makes the task manageable and compiles back into ES5 (or whatever you want). The tooling is lightweight and freely available. Give it a try!