skysight-inc/HackerNews huggingface dataset:
Or maybe it's what is repeated here so often: don't let the perfect be the enemy of the good.

Perhaps it really is cheaper to have a few outages than it is to built the sort of systems that never go down. Every "nine" you add gets more and more expensive.

Or perhaps the systems are so complex that it's just impossible for them to be fully reliable, and this is just one of the costs of having the ability to fly anywhere in the world, cheaply and at the drop of a hat, and to have it work 99% of the time.
Government shouldn't be able to accuse a firm of something, then demand the firm spend money assembling data to prove the governments case.

Direct quote of you.

This is exactly what the government is allowed to do. This is exactly how an audit works when they think they've found something.

The government needs the information to determine whether the company is in compliance. The company has the information. How else would you solve this, besides the government having the power to compel production of the information?
serious question: where would you rather put it? new information develops every day, and I'm not sure where you'd post such information.

though I agree, tumblr isn't exactly my first thought. :P
> striking the side of the pot liberates electrons that bond with the albumin and make the protein stiffer

Have a source? I'm curious if one can "cook" an egg by submersing it in cold water through which a current is run.
Thanks for saying this. Threads like this baffle me, make me sad and wonder if its time to just stop visiting this site.

If you don’t mind being bullied, harassed, or threatened, that’s great, but it harms people. Whether you think it should or shouldn’t is irrelevant. Personally I don’t know anyone who has experienced it that wasn’t harmed. YikYak specifically was also horrific for Professors. (& of course, it also had disparate impact on women and people of color). So, either you don’t actually believe it does harm or you don’t care.

Please don’t @ me about free speech or censorship; not only is it irrelevant to startups because they are businesses & not the government, but moderation & boundaries are what make communities endure.

We make choices about what we build & what behavior it will enable. Choosing to permit or even encourage such behavior is not a matter of principles—it’s a choice of who can and cannot participate, which, as YikYak, Secret 4Chan etc show, directly correlates to the viability of the product as a business.
Ask HN: How do you safefly handle real-time user photo-upload capability?
I don't mean technically, (well partially with security) I mean the legal content aspect ie nudity.

Sure you can pass your photos to human examiners that go through hundreds of photos and click on the ones that have nudes but have the ability to have it work 24/7 real time...

NEURAL NET! Throw that in there, ML

I'm scared for this, aside from the security aspect ie. checking the integrity of files if they have anything in them besides a photo itself, no malicious script/code.

Yet it seems so prevalent everywhere there is photo-upload with near-instant processing (displayed on site).

So this question isn't too much on the technical aspect of file upload but the filtering inappropriate content part and server security.

edit: I'm going to look for existing resources (IT COSTS MONEY?!!!)

looking at this Cloud Vision api by Google right now
https://cloud.google.com/blog/big-data/2016/08/filtering-inappropriate-content-with-the-cloud-vision-api
I started a habit of writing 1,000 words every single day with the intention of improving my writing. I've written at least 1,000 words every single day for the past 291 days (okay, I missed one day at day 264). The writing has been in a private journal, not on public blog, although I've published hundreds of thousands of words to my blog over the past 15 years, just not much in the past few years.

I'd say the greatest insight that I've had from writing 1,000 words every single day for nearly the past year has been that simply writing 1,000 words every single day is not enough to foster real improvement. The habit definitely helps you overcome the initial resistance that you might feel towards getting started, and if you're not already good at typing or transferring thoughts in your head into words on the screen, I'm sure it helps with that too, but there comes a point at which, if you actually want to continue growing and becoming a better writer, you need a goal other than "write every day".

For me, the act of writing something that I intend to publish, to share with others, forces me to work on the writing, to tweak it, to think about how it can be made better, to question its clarity, to question the value of what I'm sharing. If what I'm intending to share contains a story, then knowing that it's going to be shared forces me to work on storycraft, to think about how someone else is going to interpret what I wrote. None of that happens naturally when you write privately, when your only goal is to see the word counter pass 1,000.

I've found that the greatest advancements in my own writing have come when I was blogging regularly (comparing posts from one year to another makes this very obvious). Whenever I've stopped blogging regularly for long periods of time, I find that my writing stops improving, even if the overall amount of writing I'm doing on a regular basis doesn't change that much (e.g., Slack messages, comments like these, etc.).

I'm not saying that you cannot improve as a writer when you write privately, just that improvement requires working toward specific goals that you know will challenge you to improve. Write a haiku. Write a short story. Look up from your laptop, find an object, and then try to write 1,000 words describing that object in as fine detail as possible. Do the same thing with an emotion that you've felt. And if you can, share what you write. Even if others don't give you feedback, the very knowledge that somebody, somewhere, will likely be judging your writing will cause you to subconsciously work a little harder to write better, to rewrite and to edit (which is the work that actually produces good writing).
I wouldn't. IBM have made it a strategic goal to move their staff to "low cost locations" and are even now getting rid of staff in higher cost locations.

for example https://www.theregister.co.uk/2017/05/26/ibm_asks_contractor... doesn't sound like a company I'd want to trust.
This is one of the taboo subjects of our times. It's ok to be a jihadi and post your stuff, but to criticize the jihadi culture and expose its inner workings is not ok since it implies moral judgment. We can't have any of that.
It's a nice strike against software patents though, probably every programmer interested in data structures goes through a whole series of these independent inventions.

To award a patent to someone just because they thought of it first is ridiculous.
Wow are you for real? The amount of passive aggressive-ness in the post is through the roof. I am not sure I can get into a conversation with someone who can only thinking of attacking people.
Pretty convenient that IBM's size lets them remain trusted for things that would disqualify random companies for a given outcome. Why pay so much more for the same problem?

What is the conversation that makes this happen? "Yeah, let's go with IBM. The same problems might crop up, but they're a larger company."
They hire the IT staff. Not the management, HR, etc.
Weird thing I have been seeing on Reddit is comment upvotes being off-by-one periodically on page refreshes. Reload, you get 3. Reload again, you get 4. Again, you get 3. Seems like a replication issue?
Just starting this process on a side project. Currently reaching out to advertisers I think would be a good fit. Too bad there's not a more premium google ad sense for niche verticals.
But if we don't believe in any statistics what else is to debate?

That's the point I was bringing up, that there seems to me much conjecture and not much facts being brought up by Anti-Aadhaar lobby.

I think enrollment started in 2011 - so it's 6 years to get 99% coverage.

I don't think it's fair to bring in other statistics into this, because in this case all they have to do a SQL COUNT to get the number of enrolled. It's what they were supposed to do after all.

> In addition, such programs do well in areas of good communication, and are weaker in more remote areas and those with weaker educational systems. Which is not an India-specific issue. And it is those hard-to-count people who need the program the most. Also those people are in areas where the local officials are typically the most mendacious (which is why they are hard to reach)... you see the problem.

It's totally not like that. Sorry to say, but your comment sounds like you have never been to these areas, and are just conjecturing mentally. Please have a look at the enrolment infrastructure UIDAI specifically built to get to universal coverage. It's actually a good case study for other countries to learn from.

EDIT: don't care at all about downvotes.
This is subject- and field-specific. Years ago someone pointed me at http://people.ischool.berkeley.edu/~pam/papers/goodwriting.h... on legal writing, which contains two excellent first points: "1) Have a point" and "2) Get to the point".

Technical writing is a genre all its own.
But they don't have to be a part of Yik Yak, etc. If you walk into a bar and people insult you, don't go to that bar. You also ought not be demanding that the bar be shut down either. Go somewhere else.
Brook vs Spence Live Stream Free
https://voat.co/v/news/1893996
I wonder how many people have reinvented Bayesian inference without knowing it.
People upvote persuasive writing. Which matters, to me, as a writer.
Slightly OT; but I wish reddit would use traditional forum style replies to push threads up, instead of the positive feedback loop of votes with opinions that agree with majority getting upvotes giving views which give proportionally more upvotes
I'd say there are several locations in the UK with quite low costs (definitely massively lower than SE England).

For example Glasgow. Average residential prices are 23% of London, that's a lot cheaper and there's a good level of skilled workforce there.
Not only finding, but retaining. When there are very few women, organizations get... interesting. If women are pushed out of those organizations before there's a critical mass to have change happen, then hiring a few women here or there doesn't really help. If anything it just makes the women crazy.

The more balanced your team is, the more balanced your team culture is, and therefore the better chance you will have of retaining good people and the good balance.
The Scalaz vs Cats issue (and seeing what happens to them over time as a 'community judgement' on whether the CoC decision was correct, as in the article) is muddied further by the fact that Cats is different on a technical level too (it's not just a fork of Scalaz).

Cats is more approachable than Scalaz. Whilst you could ostensibly see it as an extension of their CoC principles, I think Cats mostly just benefits from being much, much newer and so has more freedom and power of hindsight.
I believe they are using cassandra to store the upvotes
Show HN: Track when and what you play on Steam
> Weird thing I have been seeing on Reddit is comment upvotes being off-by-one periodically on page refreshes. Reload, you get 3. Reload again, you get 4. Reload, you get 3. Seems like a replication issue?

This is done on purpose [1], to prevent bots from calculating exact post/comment scores.

1. https://www.reddit.com/wiki/faq#wiki_how_is_a_comment.27s_sc...
> My guess is that some point there will be an antitrust case featuring the "algorithm defense," which basically says: "Hey, I just set up the smart learning algorithm and let it run. How could I know that it would interact with other smart learning algorithms in a way that led to collusion?" And the antitrust authorities (or other law enforcement) will need to argue that when a guy named Bob sets up and signs off on an algorithm, Bob needs to be personally responsible for what that algorithm does.

How do you guys think this is going to be handled? It seems very complicated, because how are we even going to know which algorithm is at fault, or even IF any can be conclusively determined to be at fault?

Furthermore, is he talking about Bob the implementer or Bob the approver? In many organizations the people actually writing the code are not the same people who determined the specs and asked for it. Bob the implementer may have been given a limited spec that is followed, unknowing there is potential that an outside influence can manipulate the results. At that point who holds the responsibility?

Maybe it's just me, but recently I have noticed increased discussion regarding ethics in tech. It seems like there is growing awareness that all the focus on "how" to do something has eclipsed the fundamental question of "if" we should do it. This isn't to say we should just shy away from learning algorithms and complex systems, but maybe we should be put more of an effort to discuss the outcomes and how we agree to handle them before charging full steam ahead into uncharted territory.
Why shouldn't the university offer some form of protection? Even if it's the form of blocking the app?

The police clearly don't give a shit. Someone has to do something. What are universities doing with all that money they get from tuition?
> The phishing email is designed to trick the recipient into clicking on the ‘Change Password’ button. Clicking on this link would direct the victim’s web browser to a link hosted on the URL shortening service Tiny.cc

Truly amazing hacking skills we see here.
If I can't believe that they are following the law, my data is already public. I remember there was a debate sometime back where income tax info was needed to decide whether you qualify for certain subsidies or not and there was no way to get the income tax data even for the govt (different dept).

Income tax aadhar linkage should not be optional in the same way paying taxes isn't (in my opinion). I mean only 10-2000000 above with more than 1000000 rs income (declared). That's just disgusting.
Very interesting article

> Finally, and most critically, there is complete price transparency because everybody can see the prices everyone else charges just by looking at those big signs. If we take away any one of those facts, the whole thing will generally fall apart on its own. For example, if firms could somehow secretly discount and steal market share from their rivals, they have a significant incentive to do that and so on. ...

This is why many big retailers use consumers as a watchdog, typically with offers like "we guarantee you the lowest price, if you find cheaper elsewhere, we'll give you back the difference times 2!". That way consumers think the retailer is having their back and protecting them when actually they prevent other retailers from lowering prices by keeping the market share. Consumers should not tolerate that bullshit and go with the lowest retailer in the first place and realize that they're being used to rat on the cheaper retailer... but there's a good incentive to get the difference * 2.
That's a very strong statement. There's domains where machine learning tends to have better predictive performance than (Bayesian) statistics, but the converse is true in many other domains.

I would summarize it as Bayesian methods work best in areas where there's often not enough data, there exists significant expert knowledge, and you can properly specify a model. And yes, they do quantify uncertainty.
I would link my own profile but I don't play enough to have interesting data, so here is a friend's profile:

https://steametrics.us/profiles/76561198074712603
That's vote fuzzing you're seeing. It's to prevent people (read: bots) from being able to tell if they are shadowbanned.
I will give you a free advice:

Most Aadhar criticism comes from and is supported by

People who have lost money due to due to direct benefit scheme.

Those people accumulated lots of money over years by producing fake bills, extra names in the ration cards.

Aadhar card started to roll out in 2011 itself, How many of these privacy freaks had raise the voice and if they did, were they supported ?

No.

Only after Aadhar started saving money for the poor, hence the money started drying out of pockets of those corrupt officials and contractors, does this activism against Aadhar has been supported.

Who are those people who were OK with Aadhar for 4 years, but are not OK now?

Now that Aadhar will be used for some more direct to benefit transfer scmehes, will you see more activists and more noise.

Think.

I will give you a hint.

How do you think does a 9 to 5 government employee is able to accommodate wealth to send his son to one of ivy leavgue schools or enroll him in a music class or send him to costly coaching classes or send him to top schools.

Where did that money came form?

Won't those sons oppose Aadhar whose dads tool bribe to accumulate wealth to make sure the son gets educated/skilled.

A lot of people thrive and plan their yearly budget based on bribe amount not salary amount?

Would not those people oppose Aadhar?
AlphaGo’s Designers Explore New AI After Winning Big in China
Are you really confused? Leaving the law & federal funding requirements aside, Universities seek to have successful graduates & thus it is in their best interest to provide an environment that equips their students to learn. Being harassed undermines these goals, so regardless of the law, it is in their best interest to prevent such disruptions.

I'm not sure I understand the bird analogy. Is the point that Universities can't control birds? Well, Universities can & do already actually demand that their students not harass other students as a condition of their attendance.
I am the top ranked woman (in terms of karma) on HN. I was one of the top 3 students of my graduating high school class and one of the best high school students in my entire state. I was the state alternate for a gifted enrichment program one summer. That means only two students in the state outperformed me and I would have gone had one of them been unable to participate for some reason. I won a National Merit Scholarship based on having the highest SAT score in my graduating class.

Any time I try to tell people that I kick ass at anything at all, even just as an excellent mom, it is a total fucking beat down. It simply isn't okay for a woman to admit she is that good at anything at all. Ever. For any damn reason.

This means if you are a highly competent woman and you want to survive in this world, you learn to shut the fuck up about it. It also means that you are routinely denied the same opportunities as the men who are, in fact, allowed to say "Yup, I am that damn good" without it being a total fucking beat down.

Furthermore, breaking into a male dominated field tends to be a shit show where a woman has to put up with endless harassment by men who would hit that because Oh My God, It's a Girl! And she is interested in the same thing I am!!! The price of admission is just vastly higher than for men. You need far more than to just be as technically competent as the guys. You also need to be incredibly savvy about handling the endless social BS, incredibly thick skinned and so on. And then you still need to not brag lest it turn into a shit show and beat down for that reason.
Global unit system prospect is looking good for the long term I think, we only have a handful of them, if only the US could get its game together on this one it'd be a done deal…

We still have way too many electrical plugs plus combos for voltage/frequency, also a pain. Just had to buy a new hair clipper this morning because my European one didn't like the US mains.

It seems the stuff that involves direct human interactions is the worst, like having around two hundred different currencies. This one is fairly stupid in hindsight, since there is very little cultural value there. But language, the one thing that we use the most to interact with one another, tops everything with thousands of non-compatible variations… sigh.
It might be conceivable on smaller subreddits, but on the big ones it would basically just drown everything into a sea of low-quality threads. I got the feeling that the vast majority of threads never ever make it to the "front page" of their subreddit.
Invite Your Neighbors Over for a Barbecue This Weekend
There is no evidence that is the case. In fact, the linked article says:

'I assume he has been suspended because Tumblr thinks Chris is spreading jihadi propaganda'

Which would be Tumblr doing the exact opposite of what you say they do.
I'm not a lawyer so don't trust my take on what's safe to say to the cops.

I feel like I saw a recent exception to this, but even if I didn't:

1998 is pre-9/11, pre-TSA, pre- the large riots of the 2000s and 2010s like ferguson and occupy. It's pre-snowden, pre-aaron swartz. It's pre-iphone which means its pre every case about recording cops in public. It's pre stop and frisk.

Criminal justice has changed a lot since 1998.
Update: no I was wrong. OpenVPN v2.3.x has two connections, a control channel and data channel. That TLS-DHE-RSA-WITH-AES-256-GCM-SHA384 (defined by `tls-cipher` setting) is a control channel, and data channel doesn't support GCM.

Anyway, 2.4 is out already.
Really good, short book that you will learn a lot from and can apply the next day when writing emails.

HBR Guide to Better Business Writing

https://www.amazon.com/HBR-Guide-Better-Business-Writing/dp/...

Also, in general all "HBR Guide to _____" books are awesome.
I love the article on hyperloglog! It is really quite good to read even if you're not interested in algorithms. I always liked number theory and I think that it's very interesting that you can guess how many uniques there are by counting how long your longest run of zeroes in a hash is.

I suppose this could be broken by injecting in a unique visitor id that would hash to something with an absurd amount of zeroes? That's assuming that the user has control over their user id and that I'm understanding the algorithm correctly.
And the IBM Phoenix payroll system disaster in Canada.

But hey at least Canadian government managers/executives got performance bonuses.
Published January 31, 2008
I have no idea, it's just that if this was my job, I'd probably think long and hard about it and likely wouldn't come up with tumblr. This guy seems to be a serious academic:

http://www.belfercenter.org/person/christopher-anzalone

Maybe at an academic institution would be best. Tumblr seems like an obviously iffy choice with a high risk of the work being misidentified/misinterpreted and then tossed out.
man this image from that article is like a piece of art haha

https://ichef-1.bbci.co.uk/news/624/cpsprodpb/D8FD/productio...

and this guy is apparently able to read the matrix

https://ichef-1.bbci.co.uk/news/624/cpsprodpb/9B2E/productio...
> For example, when learning a new language

That's a good point, because I think this "ability to speak multiple languages" will become commoditized too through technology. You already see pieces of technology that enable you to communicate in realtime (although clunky and not accessible enough at the moment)

I agree that "realtime" aspect would be the last wall that will stand to distinguish humans from machines, that is, until humans can find ways to inject circuits into the brain (which is already being explored by multiple entrepreneurs and scientists)
I picture executives thinking of IT like rolling a big stone once it's moving get rid of the pushers.