skysight-inc/HackerNews huggingface dataset:
>Well the difference is pretty clear between your case and the rest. Developers scraping a website isn't going anywhere. A business reliant on scraped data is making money off of it. That will lend you in precarious situation more.

Developers presumably scrape websites because the data is of some value to them, frequently commercial value. Google's entire value proposition is based on scraped data, and it's one of the most valuable companies on the planet. The way the data is used is not necessarily relevant to whether the act of scraping a web page violates the law or not -- several more basic hurdles involving access, like the CFAA and potential breach of contract depending on whether the facts of the case are such that the court holds the ToS enforceable, have to be overcome before the matter of whether one is entitled to utilize the data obtained becomes the hinge.

>My criticism was that you mixed in service providers and tool providers that enable businesses to make money off scraped data-the vendor cannot be held responsible for misbehaving clients, the best it can do is cut them out when requested by external parties.

3Taps is one of the most prominent such cases and it was just the type of tool that you're claiming wouldn't be held accountable. 3Taps's actual client was PadMapper, but since 3Taps was the entity actually performing the scrape, they were the party that was liable for these activities.

The lesson we've learned from 3Taps is that scraping tools might be OK if they strictly observe any hint that a target site doesn't want the attention and cease immediately, but there's really no guarantee either way.

Most people won't sue if you adhere to a C&D, not because they couldn't do so and win, but because it's much cheaper to send a C&D and leave it at that, as long as that settles the issue moving forward. Litigation is very slow and expensive.
Never be afraid to share your idea with the public. People don't care enough to steal it from you, and those that would steal it wont have the industry knowledge or contacts to launch it successfully.

See my blog post on using strangers to vet ideas: http://jeremyaboyd.com/validating-your-ideas-on-strangers/
You shouldn't be on AWS in the first place if everything you do can fit on a single server.

Use the right tool for the job.
> This is probably not a view shared by many here, but if math problems were to be communicated in more natural ways, far more people would be interested in the sciences.

To the mathematician, this is the most natural way. Sparse, simple, down to business. Providing extra information can be confusing (if I tell you some random facts, you might be worried that your answers aren't using them at all) and the last thing you want to read on the exam is a page of problem motivation.

I think you are asking for too much out of a post like this. These problems are really constructed just to test you. The techniques you use to solve them will be important ones that they want to see that you have mastered, but the problems themselves are not really that meaningful.
> Berkley decided to throw them away rather than remedy this, in a rather short sighted move reminiscent of cutting off one's nose to spite their face.

UC Berkeley assessed the cost of captioning those videos to ADA standards at higher than $1,000,000. Berkeley is currently running a $110 million deficit after making $60 million in budget cuts. Last month, President Trump tweeted a threat to strip the college of all federal funds, and while that's unlikely their state and federal support is certainly not going expand.

So no, they aren't cutting off their nose to spite their face. They're broke, and couldn't accommodate the lawsuit's demands without major cuts somewhere else.
Note that none of of these are consequentalist arguments, though. A consequentialist argument would focus on the relative amounts of suffering, not on the beneficiaries or agents of it.
I'm a bit confused...what actually happened at Berkeley that warranted this?
Apparently, if you have Taiwanese ancestry and a relative who owns property there, you can apply for dual citizenship. Once you have that you are covered under their national healthcare system. You still have to fly there to get treatment, but if you have predictable medical expenses doing so makes economic sense given our current fucked-up system.

Also, Taiwan's national healthcare system is modeled on the US's Medicare system, it just covers the entire country.
> Berkley [sic] decided to throw them away rather than remedy this, in a rather short sighted move reminiscent of cutting off one's nose to spite their face.

It's much more likely that the cost of making the lectures ADA-compliant was prohibitive. Universities aren't corporations who can appeal to equities holders/markets for funds when a need presents itself. So they did what they could ... a warning, well in advance, that the content would have to be withdrawn from public display, with the expectation that someone not subject to the ADA requirements would copy the lectures.

In the future, such content will be created already ADA-compliant, but many of these lectures predate the ADA and were created in good faith. It would have been a shame to lose them, especially when you consider that current and future computer resources can provide on-the-fly subtitles (and translations) for those who want or need them.
> If you want to show people cool little examples, Mathematica is clean and fast, but you can't build anything serious with it.

Mathematica, which is a serious project, is largely written in Mathematica. Wolfram|Alpha, another large project, is built in Mathematica. Outside the company, https://emeraldcloudlab.com/ for example has built their platform on Mathematica.

> And by "serious", I guess I mean something with few enough constraints to have an identity of its own, rather than being "a thing you can do with Mathematica."

For research, a "thing you can do with Mathematica" is often what you want. But other than that you can put things you build in the cloud via APIFunctions (similar to AWS Lambda functions), or call out to them via wolframscript, or talk to kernels directly via MathLink or LibraryLink, or over sockets via ChannelListen.

> Another limitation is the data input. Someone needs to rethink it seriously.

That's vague, but I imagine you mean importers. Certain built-in importers aren't as good as they should be, like CSV and XLS are memory hogs and die on relatively small amounts of data (at least they used to, I haven't checked recently). The HDF5 importer is now pretty good, and for large datasets it's a good choice for scientific computing anyway.

> Programming languages/platforms are network goods. IMHO, Mathematica has tried to swim against this fact and has failed.

No arguments there. I think it would be great if we could open source at least parts of it, because no doubt new life would be breathed into cobwebby parts of the codebase and various pet peeves fixed. But Mathematica still dominates the computer algebra space despite being closed source, and probably will continue to do so for a while.
Misguided Policy: Following venture capital into clean technology (2011)
This was discussed in previous threads, Youtube captioning is not (yet) good enough to meet the courts standard.
Predators are in a sense moral agents - assuming you accept that maintaining equilibrium of the system in which they exist is good - because without predators prey invariably destroy their habitats.
Keras is dying. Tensorflow-Slim is contains nearly all its features and is included in Tensorflow from Google.
Setup a github repo where people can contribute subtitles for the single classes.
Yeah it looks more like the math component of an engineering exam. If people look at this and think "oh cool, I can do well in this, I will become a mathematician," will be in for a rude shock when they take Grad School Real Analysis 1.
Awesome work. I actually built a chrome extension yesterday to fix the log work experience in JIRA because of its horrible ＵＸ. Funny to see someone else with a desire to hack together a chrome extension to get the experience they want. DO even implemented a change in response! Thats just awesome. Their UX is pretty decent IMO but it does miss the mark in some areas. Its funny working in software we know how painful it can be to get changes like that all the way into production, yet isnt it amazing the speed at which you can move when you are free from any constraints and dont have to worry about any backend stuff or frameworks... just bolt something on the front and boom.
how much is tuition at uc berkely again? why was hiring students to caption the videos not an option?
EU Parliament states Virtual Currencies cannot be anonymous
Aren't we neglecting people with deafblindness? Hearing-enabled and deaf people should be blocked from accessing all online courses until the videos are translated into braille.
Requiring publicly funded materials to be accessible seems like a good thing. But there must be better ways to enforce it than taking down existing material that doesn't qualify. Not that I can immediately come up with one.
Auto-generated captions are nearly useless for more technical topics. No one is advocating for sign language translation, but to comply with the ADA they would need to be manually Closed Captioned. 20,000 videos would be prohibitively expensive to pay for people to caption these, so they decided to take them down instead.

I think it's a shame, but if they had just captioned them as they released them, it wouldn't have been such a burden to do all 20,000 at once.
How to Detect SSH Attempts by Chuck Norris
No new apk on apkmirror.com, no pending update on the German play store. If they deployed a dogfooding version, it didn't rollout world-wide.
Node.js: tighter integration with Chrome DevTools
Offline mode is only available if your already logged in.
The FAQ section "Mining LBC" leaves something to be desired,
failing to ask the obvious

What proof-of-work algorithm does LBRY use?
Hi, I am the creator of the comics-strips 'cmd meltdown'.
Let me know if you have question or a funny command-line experience to share. Also suggestions for future strips are welcome too ;)
Interested in being our first mobile developer? Sift Science is hiring
Berkeley's initial estimate for captioning came to more than a million dollar, yeah. And the college is running a major deficit already, so you're exactly right - they didn't really have a choice even if they wanted to do captioning.
Same with Emacs keyboard macros. I use them very often to do similar things to many lines. Usually they involve some combination of search to move the cursor, word-based movement, cut and paste, and insertion. It's such a great feeling to define a one off macro in a few seconds and then rip through a whole file!
Ask HN: Why is Facebook's data worth that much? How is it used?
I understand the basic idea yet I am curious as to why this data is so important and meaningful. Better ad targeting is one thing but what else?
I think spaCy uses perceptrons (essentially a shallow neural network) so it should be faster. Accuracy is pretty similar with SyntaxNet at least on the training data but I'm guessing SyntaxNet works better on long range dependencies.

I wonder if the spaCy update will go deep :)
Why not mirror on YT itself by a third party, maybe outside of the USA and keeping the license?
Yeah, it's a bit like a scientific atheist version of finding God on your death bed. Really hoping that the singularity comes about before you kick the bucket, because then maybe it's not the end.
1) Whoever does own the storage locker can consent to search (or be compelled to allow search through legal process), and you can't complain because you don't have a property interest in it.

2) Google is like a storage locker where the managers rifle through the contents and tell you what crap you might want to buy based on what you keep in your locker.
This is correct. On HTTP-only sites I'm not redirected but this site does seem to have HTTPS, just not properly configured for modern browsers.
Is there any evidence that suggests this might be the case?
Isn't this like demolishing a building because it's impractical to add a wheelchair ramp to the entrance?
How is society improved by making a law optional?
I did read the whole paper ;)
It's a chicken and egg problem. To get a lot of incoming links you need to be popular. To become popular (via search engines, at least) you need a lot of incoming links. This heavily penalizes smaller websites and rewards incumbent players on the web who have dedicated marketing teams that can afford to spend several hours a day on social network promotions and viral campaigns.
Melinda Gates: The Tech Industry Needs to Fix Its Gender Problem–Now
Yes, JPEG encoding has a ton of flexibility. You rearrange each block of pixels using the discrete cosine transform, which tends to pack more significant values towards one corner, and then you have lots of freedom over how to quantize those values. See https://en.wikipedia.org/wiki/JPEG#Quantization

On top of that, you could tweak the quantized values themselves to make them more compressible.
How do I have control over wild animal population? Hunting?

Is the implication that hunting a wild bird whose individual suffering I have ascertained is somehow a preferable alternative to picking a box from the shelf that says chikn nuggets instead of one which says chicken nuggets?

Or am I to believe that all wild animals suffer equivalently because of some hand wavey quantification of an academic in some no name journal?
Kurzweil has a fantastically vague definition: the point after which things are so different we can't presently comprehend the magnitude of change.
I think a good option at that time would have been starting a campaign to get volunteers that would put in the transcription effort. Maybe this is still possible.
If there is no penalty for not making them available for the deaf, why would any institution pay for captioning?

UCB wasn't ordered to take them down. UCB was ordered to make them accessible, and chose to take them down rather than spend the money.
Building local Internet infrastructure for disadvantaged communities
Thank you for the detailed response.

It's really funny, I like windows 10 a lot, for me it's the best Linux distribution, but there are a few of these little things...

To reply to some of your points to clean up possible misunderstandings:

> If you initiate a Copy and then change focus, the dialog will not steal focus. Perhaps that's what you're experiencing?

No, I drag or Ctrl-C/V file between two explorer windows and a new window icon appears on a taskbar with progress indication (by a backgound color fill), but the progress window is not visible until I click on that icon or Alt-tab to it. There are some complains and workarounds about this on the web.

> That notification sits in the tray until you manually dismiss it.

That is the cause of the problem for me. The notice is mostly invisible (no dialogs), until 7 days later "You have 15 minutes to pack up your things"...

> If you've installed a driver directly from the Vendor, Windows will not supersede that install with the Windows Update Version

It absolutely does. I manually install 341.81, everything works. Then, some weeks later bam, black screen, driver crashed. And a notification that driver was updated. Same way touchpad driver keeps updating after I manually reinstall it.

> > Randomly resets file associations.

See search results for "An App Default was Reset"

Since the amount of side-effects from the combinations of installed 3rd party software (antiviruses, ugh) is so huge, I'm constantly amazed they keep everything working and backwards compatible as much as they do. But some of this new stuff, eh.
It's not. And I'd really like to know if many deaf folks would really feel like this properly serves their interests.
If you have closed captions, that should not be an issue, because letters map to braille characters.
Show HN: Send Vintage Telegrams via Text
Introducing Teletype!

WHAT’S THE PITCH? — Text like Winston Churchill with reproductions of vintage telegrams.

WHAT IS IT? — Teletype is an iMessage extension that lets you send and compose authentic-looking virtual telegrams by text.

WHERE CAN I TRY IT OUT? — Grab a copy for free on the Apple app store https://itunes.apple.com/us/app/teletype-send-instant-telegr...

WHERE CAN I LEARN MORE? — I made a website here: http://www.teletype.website. I also made an intro video https://www.youtube.com/watch?v=bg2V5tshsLI wherein I make a total fool of myself pretending to be an old-fashioned radio announcer. Enjoy!

WHY WOULD ANYONE USE THIS? — From vinyl records to Moleskine® notebooks, people are falling back in love with vintage / analog tech. Surely I’m not the only one who thinks telegrams are cool? Maybe?

I HATE IT/LOVE IT AND WANT TO TELL YOU HOW TO MAKE IT BETTER — Please! Any and all formative feedback is very much welcome and greatly appreciated =) Thanks!!
The paper assumes that people are vegetarians because they believe farm animals have worse lives than wild animals... which is a heftily false assumption to begin with.
I have used lots of blogging software: WP, jekyll, ghost, & more.

I prefer ghost.

In the end, as someone else said, this decision & later maintenance is the easy part. Writing is the hard part.

If you run wordpress, you will deal with a hack sooner or later. I would only use it if you require functionality that exists in plugins that you can't or don't want to replicate for your platform.
Exactly, you're not allowed to take public money (largely tax money from everyone) and use it to benefit a specific group. The laws were clear before Berkeley made the videos, so they should have been able to estimate the cost ahead of time. Instead they ignored they law and decided that discriminating against hearing-impaired people whose tax money helped pay for the videos was fine.
2 months ? That's cheap. Make it a year.
The advertisement industry moves an insane amount of money. People pay up to several dollars for a single potential customer ending up on their website(s).
I do like Kurzweil but I don't know if we can even identify a singularity. It will just seem normal, like now. One could say financially, the big world banks are so far ahead of us, there's no going back, but life seems the same, AI is already making decisions for financial transactions and for even recruiting people (as I've made some of this), but life seems the same. I think our zeitgeist moves along gently so we don't notice things. The only thing that will be certain is Kurzweil's frequency of saying "exponential" will only increase exponentially as he gets older.
Soviet anti-alcohol posters
The question is not "would you use the service" but "would you consider the service private?" How does being free bear on whether it's private?
Did YOU read the paper?
Great writeup. The "user_id" one really hit home for me. @ Userify (ssh key management for on-prem and cloud) we currently have hotspots where some companies integrate the userify shim and put 'change_me' (or similar) in their API ID fields. Apparently, sometimes they don't always update it before putting into production... so we get lots and lots of "Change Me" attempted logins! It's not just one company, but dozens.

Fortunately, we cache everything (including failures) with Redis, so the actual cost is tiny at most, but if you are not caching failures as well as successes, this can result in unexpected and really hard to track down cost spikes. (disclaimer: AWS cert SA, AWS partner)

Segment's trick to detect and record when throttling, and using that as a template for "bad keys" (which presumably are manually validated as well) seems like a great idea as well, but I'd suggest first caching even failure calls on logins if possible, as that probably would have mitigated the need to ever hit dynamo.

PS the name 'project benjamin' for the cost cutting efforts.. pure genius.
Caveat: I know little about this area, so my question may be rooted in naivete.

Q: Why are you operating as a nonprofit? I would be willing to pay a reasonable management fee to you in exchange for the assurance that my money will likely have a greater social impact. If you were able to charge management fees, wouldn't that give you a greater ability to grow and attract talent?
I'm not sure I understand your changes. We're talking about searching for a relatively unknown person, so I'd assume we're talking about a rare search term. This is not like asking for who searched about "wire fraud".

> >from a particular designer store should be "from a specific location of a particular global discount store"

Sure, fair enough, my point was simply that it was a rare thing and pretty identifiable.

> (images, once acquired, last forever; there's nothing saying the image was acquired in the time window of the subpoena)

I'm sorry, I don't understand this sentence.
I've been lucky to have insurance since my first job out of college. I've been lucky to have good health and have maybe visited the doctor five times in the past five years.

Still, even in this best-case scenario, I've had three instances where I had to fight my insurance or the care provider over whether or not they'll pay.

Case 1: I didn't use my insurance provider's confusing clinic finder correctly (I entered the wrong group number) and was billed for being out of network.

Case 2: The clinic didn't submit my insurance information to a lab testing vendor, and I was hit with a $900 bill for a simple blood test.

Case 3: My employer accidentally canceled my insurance when I was promoted to a new role. I received a $1200 bill for doctor's visit.

Point being, this is the experience in a best-case scenario. I can't see a better healthcare experience in the US that doesn't involve taking the insurance and medical billing industries out of the picture.

Even if we don't go single payer for another three decades, I'd still like to see price uniformity/transparency laws enacted that ensure medical providers charge clearly advertised rates.

It's absurd that I can walk into a doctor's office, and not a single person will be able to tell me what I'm about to pay up-front. It could by anything from a $30 copay, to $1000+.
> You're assuming good faith from prosecutors

No, I'm not. Access to and competence of defense counsel is actually more relevant to the degree of effect that the available adversarial process has on the outcome of plea deals that avoid (some part of) that process, but even with imperfect access to and competence of counsel the fact that some share of cases do go to trial and prosecutors can't certainly predict in advance which cases will be in that set means that the protections in the adversarial process create incentives that influence behavior in the process that precedes arrest and charging.

(This contrasts sharply with, e.g., the foreign intelligence surveillance warrant process, where the warrants do not feed into an adversarial process even in principle, and thus there is far less constraint on government misconduct even with a judicial warrant process.
I've already done, and continue to support them at least once every year :)
I'm working on a similar thing (http://getoptimage.com). While Guetzli is still visually better and a bit smaller in file size, it's terribly slow and requires a lot of memory. But it's a great experiment. So much knowledge has been put into it.

I believe using a full blown FFT and complex IQA metrics is too much. I have great results with custom quantization matrices, Mozjpeg trellis quantization, and a modification of PSNR-HVS-M, and there's still a lot of room for improvement.
The United States had the Monroe doctrine, so arming with weapons was an offensive state policy.
Why not just crowd source this process, I'd be happy to help...