skysight-inc/HackerNews huggingface dataset:
This is beautiful. It captures the spirit of wizardry and wonder that brought me to programming in the first place, juxtaposed against the reality of interviewing at "top" tech companies where the interviewers more often than not have only a fraction of my experience, and seem to have followed the type of curated success-seeking golden path that used to be reserved for finance.
But if they do that, they can't plug their new hip blockchain in the process! /s
The sorted stochastic matrix shows that C contradicts your assumption that it's not possible to switch from a new language to an old one. Or, at least, it shows that portions of new language code are occasionally rewritten in C.
Sure, but math papers are not written for general audience; they're written for mathematicians.

Elucidation that would be useful for the general public is very difficult or impossible to write in such a way that it wouldn't be extraneous distracting fluff for mathematicians. It would also make most papers dozens of times longer.

I'm not exaggerating here: I think you could probably state and prove the results from basic one-variable calculus (assuming as axioms some basic properties of the field of real numbers) in 10-20 pages in such a way that mathematicians would understand it, whereas beginner calculus textbooks are regularly over 1000 pages long. A hypothetical research mathematician who didn't know calculus would find the 20-page version way easier to understand than a slog through Stewart's 1300-page book.

What you want is undergraduate-level textbooks, not research papers. Good textbooks do contain all the stuff you want: examples, calculations, motivation, etc. I can recommend some if you are interested in a particular field.
Thank you. This looks like a book I should read.
It's not just about the Berkeley videos, but about what sort of rules and standards we have. We don't ban speech that is bad for society for the same sort of reasons. We've decided that we having rules and spending the time, money, and effort necessary to include the deaf and disabled. If you carve out an exception for free class lecture videos for Berkeley, it makes it more difficult to enforce these rules in all the circumstances that we want.
Get a library card. A bookshelf full of books that you aren't going to ever re-read or share is just decoration.
It's not just deaf people. It's people with hearing impairment, or with visual impairment, or with manual disability. The complainants in this case were people with hearing impairment, but the DoJ expanded the scope.

You're right that YT can auto-caption some video. The DoJ looked at the accuracy of a selection of video, and found it was rather low. That inaccuracy, coupled with the lack of reasonable adjustments for people with visual impairment or manual disability means that YTs auto-captioning isn't enough to make a video accessible.
The popular vote would disagree with this sentiment in regards to voting for this administration....

If the will of the people was a consideration then we would see a more balanced proposal without such severe cuts to agencies and programs that Trump associates with "liberals". Abolishing the NEA or destroying the ability of the EPA to regulate pollution is pure political ideology. Reducing the ability of our government to study climate change isn't based upon scientific fact - it's done because it doesn't fit within the worldview of our current administration.
Also I never, ever understood Austrian toilets. Why? Why? Who makes a flat-bottomed toilet?
There is very little scope to disobey a direct order from the president. Disobeying the order and committing treason will only briefly delay the execution of the order as it's passed down to the next in line fallback.

Specifically where nuclear strikes are concerned, a lot of planning has gone into maximising the probability of compliance. Missile combat crew carry a sidearm to threaten their counterpart with death if they refuse to act on an authenticated launch order. They wear 4 point harnesses during launch sequence, primarily as a psychological device to prevent them from getting up and walking away mid sequence if their conscience gets the better of them, etc.

If trump or any other president said launch, there would be a launch.
> Doesn't YouTube have a CC feature designed to make videos accessible for the hearing impaired or just so hearing people can watch them with the sound off?

From a previous discussion, they are not of good enough quality: https://news.ycombinator.com/item?id=13769549
i saw an excellent magenta/orange vest that was trying to address this.
Scrapinghub has several proactive/preventative restrictions on the sites they'll allow users to access because they're trying to avoid such liability. They've been successful up to this point and that's great. That doesn't mean that what they're doing is not a legal grey area.

For scraping-related activities, Scrapinghub would probably be the party sued, as was the case in 3Taps, though the clients could probably also be legitimately sued for various things, most obviously copyright infringement.

Again, I'm really not sure what you're getting at here. Yes, it's a great idea to check with a lawyer and assess your potential legal exposure. That's why lawyers exist! You can then ask them questions, as Scrapinghub surely has, about how to minimize that potential legal exposure. You definitely SHOULD do that, especially since scraping is more or less illegal in the United States.

Courts frequently use an analogy to private physical property to address the matter of accessing a web site. Running a business based on scraping until someone sends you a C&D is roughly the same as running a business based on trespassing on private property until someone serves you with a no-trespass order.

Maybe it will work out fine, and most of the time, as long as you leave the property promptly upon request, you probably won't have an issue just because there's no benefit in dragging the matter out further. But that doesn't mean there isn't legal risk involved in running such a business, nor does it mean that you won't be liable for damages incurred whilst trespassing.

In such a case, questions about whether the borders of the property were clearly delineated, whether "No Trespassing" signs were posted, whether a reasonable person would've understood they weren't allowed to be there or not, etc., would be asked to determine the existence and/or extent of the trespasser's liability.

In the same manner, there is substantial risk involved in running a business whose primary function is to scrape websites, and the same types of questions would be (are) asked in a court case related to network access. People deserve to be informed of that.

That's not FUD, it's just the law. If you don't like it, well, most people who know what they're talking about don't either, but that doesn't change the law. Saying "$Party_X hasn't been sued over it!" also doesn't change the law or make the process any less legally risky.

If you find this arrangement unsettling or absurd, as you obviously do, I would suggest that you direct your energies/attention to your local representatives, the EFF, and other types of political activism that may help rectify the situation rather than accusing HN commenters of spreading FUD.

When you do something illegal, you probably won't get sued for it, because it costs a ton of money to sue someone and it's not likely that you're annoying anyone enough to justify that. This is especially the case if you back off at the first sign of annoyance. That's as much as we can say for your angle.

If you're comfortable basing a business on that, be my guest.
You're seeing an example right here, unless you think that university lectures are a bad thing.
>How is society improved by taking them down?

First of all, I agree with you. I think most others do as well.

The problem is, we can look at a case like this and say, "Obviously we shouldn't lose access to this." Then there's a next time, and a next time, and a next time. And eventually the deaf are at a measurable informational disadvantage to those who can hear. That's why these laws exist.

So, everyone should take a step back and figure out a reasonable solution. I hope that's the reason for the judgment.
Didn't youtube have an auto subtitle supported by speech recognition?
It... it really doesn't, and this article makes that fact quite plain. Foucault's philosophies are nuggets of well-worn common sense extrapolated out into billowing collections of unnecessary text.

I wonder if anyone has done the kind deed of whittling his most oft-cited gaseous emanations down to their core common sense origins. That'd save a lot of time for those of us not interested in a career in academia.
AFAIK offline mode only works if you have successfully completed a non-offline transaction within the last 24 hours.
This is definitely a game changer!

It's a very interesting research carried out by Google's research team and I believe this will be especially beneficial for future speech translation algorithms that would bring us a whole new, fresh experience with the way we converse with Alexa, Google Home, Siri, and many more.

If you need to install TensorFlow onto your Windows 10 computer then here's a great guide which I have followed quiet a few times. :)

http://saintlad.com/install-tensorflow-on-windows/
Exactly this. I am using dedicated servers everywhere, I would pay easily 10-20x more for the same if I would use AWS instead.
Are there any statues in the US (where DDG is based) that would compel them to keep logs? I find it hard to believe there are not.
> Berkeley removed the videos because of a lawsuit brought by two students from another university under the Americans with Disabilities Act.

Wait, what happened? How does removing the videos help Americans with Disabilities?
According to the docs on offline mode if the card is declined for any reason you as the merchant is on the hook. And those payments will attempt to process when their service is restored .
And UCB is also a really really poor university which cannot afford to make them accessible, right?

BTW this would be a good crowdsourcing project.
There have to be speech to text applications targeted at automatic captioning... they don't need 100% accuracy to help a lot of people, just block curse words.

Was the court conclusion so onerous that autocaptioning wouldn't meet the requirements unless they actually paid a proofreader to check over everything by hand? This seems like software that would cost $100 at most.
> doesn't meet my open criteria

With the leaps and bounds being made in ml these days it can't be long before magnitudes better open source voice recognition becomes available. I gave Sphinx a try but it was horribly disappointing.

For me, the combination of google voice (offline) and Ivona voice (Amy) is pretty damn good for my android/python/arduino based home AI.
Are you going to spend time writing these captions?
While writing a french blog about Python, it took us 3 years and 500 articles to start showing up on the top results. And we cover metaclasses, packaging, generators, etc. All the stuff you can't find elsewhere.

Being new in town is suspicious to google. Raising honestly to the top takes a lot of time and effort, unless you have incredible promotion habilities and/or deep SEO knowledge.
The Dynamo incident highlights an important lesson when using consistently hashed distributed data stores: make sure the actual distribution of hash keys mirrors the expected distribution. (though to their credit, someone writing an automated test using a hard-coded key was beyond their control).

Incidents like this are generally why rate limits exist, which they don't currently have [0], but perhaps they'll consider a burst limiter in place to dissuade automated tests but not organic human load spikes.

Unfortunately there doesn't seem to be an easy way to fix the per-user ID write bottleneck, short of adding a rate limit to the API – which would push backpressure from Dynamo to the Segment API consumer. Round-robin partitioning of values would fix the write bottleneck, but has heavy read costs because you have to query all partitions. They undoubtedly performed such analysis and found that it didn't fit their desired tradeoffs :)

Great post, very informative. Thanks for sharing! Also, love the slight irony of loading AWS log data into an AWS product (Redshift) to find cost centers.

[0]: https://segment.com/docs/sources/server/http/#rate-limits
It is and it isn't.

I moved around a little and ended up settling in a rural area of my own country. It's where I want to be.

And I think that's what being a digital nomad is about: living where you want to live.

Traveling is fun, but for me, and probably most people, it gets old and I just want to be home. I can fulfill my mind's "travel requirements" with a trip or two per year, as it turns out. No need to live on the road.

I'm more productive with a steady routine, anyway.
The consequence of which was forcing an organization to choose between spending an enormous amount of money, or making a previously free resource unavailable. How is this a good thing?

> If there is no penalty for not making them available for the deaf, why would any institution pay for captioning?

Do you realize the insanity of that kind of logic? If there is no penalty for not curing HIV, how can McDonald's sell hamburgers? Where does it end?
"Moral agents" are usually taken to be those beings that can make moral judgements. Wikipedia says: 'Moral agency is an individual's ability to make moral judgments based on some notion of right and wrong and to be held accountable for these actions. A moral agent is "a being who is capable of acting with reference to right and wrong."' (https://en.wikipedia.org/wiki/Moral_agency)
I think maybe both Elon Musk and Ray are looking at it wrong. The ideas behind neural lace/neocortex has an implicit human-centric bias. In some ways this is similar to how a hundred years ago some people thought earth to be the center of the universe.

AI is coming on a vastly different 'hardware platform'. There is little reason to believe that it will be limited by cognitive constraints implicit to the human form. Extrapolating the rate of growth in processing power makes it extremely likely to surpass human scale processing very soon.

What both these things imply is that AI has little to gain by 'tieing' itself down to humans through a neural lace or the neocortex.
Easy, the rule should be for newly posted content. Most rules aren't retroactive for obvious reasons.
Oh, you meant "multiple of the identity matrix" when you said "diagonal matrix"?
I believe it was explicitly ruled in the courts that Youtube's automated captions were not up to the standard required by the ADA. Not sure where I read that, but it was probably on HN somewhere.
If your service has higher SLA requirements than your providers contractually committed to, you're doing something wrong.
Here's amazing way to optimize your AWS bill don't use it. Compared to dedicated you overpaid millions than you spent non-trivial developer time/money to get the number down but you are still overpaying. At 5K/month AWS might make sense (although debatable) at your level of spend it's a really bad idea. At this level an ops team of 2 1 on-site 1 remote (diff time zone) would give you way more flexibility and a ver low bill.
Also this from a couple days ago: https://news.ycombinator.com/item?id=13867016. And I seem to recall others.

Edit: Yep

https://news.ycombinator.com/item?id=13768856

https://news.ycombinator.com/item?id=13815764
When was HTTP ever good enough?
> why not just serve the videos over https with html 5 like tons of other sites are doing?

Because then they are being provided by one entity.

The LBRY protocol provides a completely decentralized network for discovering, distributing, and publishing all types of content and information, from books to movies.
How? Their budget is being cut significantly more than NASA's.
Me too. I always borrow my books, but I don't want to sell them. I will try to keep them. I'm always returning to books I've read when I need some advice.
Out of interest, I tried to work out how much it would cost. A couple of companies offering subtitling services offer basic subtitling for $1/min, and closed captioning (which I think you need for accessibility?) at $5/min. Assuming 1 hour lectures, that's either $1.2 million or $6 million, though you might be able to negotiate a better rate for a big job.

CC includes description of relevant non-verbal sounds, but it's not clear to me why the price difference is so big.
I'd expect it to still save >20%. Lepton uses arithmetic encoding instead of Huffman (-10%), and predicts each 8x8 block based on its neighbors (-20%). Guetzli shouldn't interfere with either of these.
Why ? any source from founders ?
It could be I'm on windows and maybe you are not, but it's common for me to see different styles of scrollbars in different applications.
It's been 6 years since Guile 2.0, when Guile went from being an interpreter only to having a VM and AOT compiler.
Comparing Objects by Value. Part 1. Beginning
That's the point of the paper, though, right? The paper compels them to explain why they find it okay to dismiss the idea as absurd, if they want to consider themselves as being ethically consistent regarding animal suffering.
1.7 miles is a very long distance when you are lost and wandering.
I wonder what kind of legal footing they would have had if they open-sourced the closed captioning and had it crowd-sourced
It will be royally annoyed, wherein it will re-write itself, therefore buying humanity a week or so. Good luck!
>How is this a good thing?

If I'm deaf, I know that you have no advantage over me merely because you can hear. I think that's "good". The laws are in place to protect minorities.
Couldn't agree more with you.
For those not familiar, there are braille displays.

https://en.wikipedia.org/wiki/Refreshable_braille_display
> In the future, such content will be created already ADA-compliant, but many of these lectures predate the ADA and were created in good faith.

The ADA is nearly 30 years old. The videos are 10 years old or so.

Berkeley had policies in place to ensure content was accessible, and it had help for creators to make sure content was accessible.

The people who created this content were responsible for self-certification. They signed documents saying they were aware of Berkeley policy, and aware of the help available to make content accessible, and they also signed to say that the content was accessible.
This is the whole point of the article - while artists likely had it better in the old situation, from an outside perspective, increased supply == more creation == cultural boom in quantity; ever-increasing standards + larger pool of candidates competing for attention == cultural boom in quality.

Saying that this is killing culture is like saying "nobody ever goes there, it's too crowded". Yes, the growth in supply is killing art as a job, but that's more a sign of a general transformation of all non-horrible jobs towards something that's not paid; as long as the planet has more than enough people who are willing and able to do that thing for free, it won't be a valid source of income except for rare exceptions.
These are videos they're voluntarily uploading for the benefit of non-students, why should they have to make them accessible? If it was an issue where one of their own students needed the videos then that would be different, but these are non-UCB students.
It could be if our workload was relatively stable and there were spare engineering cycles to undertake a migration and all that this entailed. Neither of these is the case.

Much of what allowed us to implement these savings quickly with a small team was the flexibility afforded by cloud infrastructure. Poor decisions are easy to reverse, but in a bare metal world you better be damn sure what you're doing, which slows down the decision-making process and seriously complicates experimentation. The number of people who know how to build out datacenters at the scale of thousands of machines is vanishingly small.

We'd also need to replace IaaS services like ECS, ELB, ElastiCache, RDS, and DynamoDB. There are certainly off-the-shelf replacements, but we'd need to build-out the expertise within our teams to operate these systems. We're talking roughly a dozen or so engineers working full time for many, many months to get these systems in place from scratch, on top of the even larger effort to design and build out datacenters. I'd much rather plow those cycles into efforts like expanding to multiple regions and improving reliability of internal services. That's a much better return on investment for our customers.

Right now we're in the sweet spot for the cloud. We're way too big to run on trivial amounts of hardware, growing at a rate that makes it difficult to stay ahead of demand in a datacenter-centric world, and too small to justify investing in a scalable hardware build-out.
OK sorry!
Can you lower our bill now? :)
As an aside, 2+2 isn't that hard to explain. "2" is just our name for 1 + 1. So 2 + 2 is 2 + (1 + 1). By associativity of addition, this is (2 + 1) + 1 or ((1 + 1) + 1) + 1. And "4" is just our name for that last value.
It's everything that's wrong with regulation. Even the logic of punishment rather than reward is flawed (you train humans with positive feedback/reinforcement, the negative kind works comparatively worse or not at all).

Edit: I understand the downvotes, relatively (e.g. as seen by Californians relatively to the US in general). Just know that I speak from France, a country where regulation has gone way, way overboard insofar as it cripples the economy moreso than it protects individuals, by ultimately preventing any reform/change/disruption whatsoever in many, many sectors. There's such a thing as "balance" and "intelligence in regulating". On a general level I very much advocate for a strict body of regulation; I just think it should be as minimal, solid, logical and simple (intelligible) as possible. Which is very much not the case in my country.
Thanks for pointing that out - AMF is indeed one of the charities that our fund will support. GiveWell staff cost-effectiveness estimates vary widely[0], you can play around with their model, put in your own parameters and then see what figures you end up with.

To answer your second point, the state of evidence in the effective animal activism community is indeed poor. Our fund is likely to support programs which have a good track record or seem like promising bets. We don't want to be limited to projects which have rigorous data to support their activities, but we will encourage new projects to test their approaches, and collect data in order to prove their impact. The Animal Welfare Fund is managed by Lewis Bollard, Farm Animal Welfare Program Officer at the Open Philanthropy Project, Lewis has made grants in the past to organizations working on corporate cage-free campaigns, and clean meat initiatives. Some of these initiatives are inherently more speculative but have high expected value. You can read more about Lewis' grant history and his reasoning behind the grants on the Animal Welfare Fund page[1].
In terms of new research, Animal Charity Evaluators has created an Animal Advocacy Research Fund[2] which funds research into social and behavioural intervention cost-effectiveness. They've made a few small grants, and are looking to scale up this year. We're excited to see the animal welfare community become more evidence-based, though we also want to make sure we fund the activities that are most likely to help animals, given what we know right now.

[0] http://www.givewell.org/how-we-work/our-criteria/cost-effect...
[1] https://app.effectivealtruism.org/funds/animal-welfare
[2] http://researchfund.animalcharityevaluators.org/