skysight-inc/HackerNews huggingface dataset:
Edit: Skip this and go read paulmd's comment, it's far superior: https://news.ycombinator.com/item?id=13886276

One reason for film's superiority as an archival medium is that you can hold a piece of film up to the light and see what it contains, whereas to see a digital archive you need to invent all the technology that leads up to decoding that particular file type.

Disclaimer: I'm not a film archivist, but my partner is, so this is mostly second-hand knowledge backed up with quick google searches.

There have been several different major types of film used throughout the year.

Nitrate film was used from the late 1800s up until about the 1950s. It's highly flammable, and nowadays there are very few cinemas which are equipped to screen it. You need a very secure projection booth which can be well sealed in case of fire. It also burns without needing air, as it produces oxygen as part of it's reaction, which means that it's extremely difficult to douse with water. As it ages, the combustion temperature also lowers, and badly stored films may spontaneously combust. Despite all that, a properly preserved nitrate film looks phenomenal when projected.

That was replaced with acetate film, initially known as "safety stock". It was initially thought to be pretty stable, but within a few years the decay (known as "vinegaring" due to the smell) started to set in. As with nitrate, proper storage can slow down the decay dramatically. This was used from the 50s until the 80s/90s.

So there are these two historic film stocks, which were used in the production, archival, and distribution of every film for most of the last century, and they're both not fit for long term purpose.

In the 80s, a more stable polyester film started to be used. This is the best film archival method available to my knowledge. It's shelf stable, and has proven itself in lab tests. This is what people are comparing digital archives to.

Apart from the glib example at the beginning, I'm not going to try to argue the relative virtues of preserving the content of a film on film vs digital. However, the field appears to have a general acknowledgement of the importance of the medium of creation. So a digitally shot film would probably be preserved digitally (as well as possible) alongside any other medium.
I was going to type 10% of this, but you nailed it perfectly. "I'm doing a startup" is often a trap that allows you to justify not properly supporting yourself.

Get a job, do it well, and make your startup work in the extra hours. If you can't find the time, you're not meant to be starting anything up.
Yes, thanks!

It is better in written form. Two tips: always review it after writing and use Grammarly (https://www.grammarly.com/).
Sure, but I believe in a progressive tax structure, so allowing wealthier folk to contribute even more to their retirement isn't anywhere near my top concern.

The amount of money you need to live on decreases relative to your income, as your income goes up. A wealthy person doesn't contribute 30%+ of their monthly income to housing, typically, nor could they come anywhere near spending that amount on food. But a poor family of 4 certainly could.
I'm pretty sure that modern cultivars of staple crops like corn, wheat, rice, and potatoes produce more calories per hectare than heirloom variants. Not everything gets optimized for water content and shelf-life.
at what might be the same grand total cost

But that isn't what has really happened. For the most part "we" are paying much less for the processed and industrial foods.
Interested in experimental and computational methods? Join us at CMEM 2017:
Test Dynamics, 0.2.8 released
One of the main reasons why I visit HN is real life experience & philosophy stories like that. Thanks!
My understanding is that flavor is only part of the equation here. The more important thing in a lot of cases is yield of fruit -- most plants that evolved naturally will not produce the amount of fruit needed for agriculture, just because that's a huge waste of energy. You find varieties that do produce an abundance of fruit, and those are the ones that you start cultivating.

Given that constraint, there aren't a lot of ways to jump; very few high-yield banana varieties are available, and none of them really sweet except for the Dwarf Cavendish and Grand Nain cultivars. Agricultural researchers are constantly trying to grow new bananas from seed (which is the easiest way to pursue genetic diversity) but I'm not aware of any new sweet and productive cultivars that have arisen in recent times.
Given how many areas NLP can be applied to, I can only imagine all of these future internal project proposals where someone has to explain to some C-suite exec how they are going to revolutionize the business with Parsey McParseface. Or better yet, when they have to budget a big upgrade to the "DRAGNN based ParseySaurus". Fun times ahead.
They're not even remotely comparable. Tangential speed x where r=several thousand light years results in SUBSTANTIALLY less centripetal acceleration than the same tangential speed where r=a few AU.
Almost always if one wants to optimize...
And even if you had reached 700 readers with your 5-cent pamphlet, it would have cost you $50 to print the 1000-copy run, and you'd be $15 in the hole. Whereas you posted to Medium for free, with no editor or publisher in the way. You're out very little, and presumably your stuff is still out there for more people to find. Not true with your pamphlet in 1910.
What is your opinion on starting out with government contractors?
I would love (and pay for) something like this for aws. Their website is a mess.
Ask HN: Where are all the Gigster Freelancers?
I'd love to chat with some of you.
See also: spaCy, which is an open-source NLP framework that has some integration with Keras as well: https://news.ycombinator.com/item?id=13874787

...and apparently will release a major version update today. Ouch.
Vegas Jets Showgirl Air Hostess Competition
Well, when's the last time you peeled a banana and where confronted with a mass of unpalatable seeds?

We eat a specific mutated banana from a plant that can only be cloned to get more banana plants.

This isn't out of the ordinary from things we eat. Take the navel orange, or seedless almost anything; lots of different types of apples aren't grown from seed anymore - a cutting is made from a tree, and attached to a different species of apple tree.
There should be two incentives. One is the monoculture risk mentioned earlier. The second is that a viable alternative might be developed that is more appealing than the current product.
Right! We're still mostly locked into the newspaper model of "articles" for factual reporting, despite its complete arbitrariness on the web.

I'd love to see journalists experiment with perhaps a more wiki-like model of reporting, where you have one page for a certain topic which gets updated (new stuff at the top or otherwise readily visible).
Oh yeah and i forgot - I FUCKING HATE eurocoins, always need to be aware of that crap and trying to get rid off it, since you cant use card everywhere. These eurocoins seem like some third world country which cant afford plastic banknotes. Good old eastern Asia where I could live just with banknotes and online payments.
I'm unfamiliar with that phrase, but I'll say:

I went back in the 80's to see my uncle, after my grandparents died. The house was falling down around him, but the rest of the neighborhood was in a similar state (still poor, still all black). When I knocked, a girl on a stoop across the street told me "the white man that rides the bicycle" wouldn't be back for a while. So I hung around. Because I was there during the week, instead of the weekend, it felt different. But, I was a lot older, too. I still felt at home, though.

A few years later the church across the screen bought my uncle's house and made it a parking lot. It was a good deal for them, since the house had been condemned by then. I haven't been back to my home city, but I did look at the street on google street view. Made me sad.
Perhaps the best way to counter that is advance the technology such that people can cheaply make changes to themselves.

If genetics is just fashion I expect you'd see quite a jump in diversity.
If I understood the article correctly, the title is misleading.

The cops were not granted an entire raw database of all google searches by person. Instead, they were granted "'any/all user or subscriber information' of anyone in Edina who'd looked up that name between December 1, 2016, and January 7" which is IMHO a much less serious breach of privacy.

You could retort that collecting these users' "name(s), address(es), telephone number(s), dates of birth, social security numbers, email addresses, payment information, account information, IP addresses, and MAC addresses" is a serious breach of privacy, but I believe those are all available to law enforcement (save the internet-specific info).
I use Elixir and Hound because it has a nice clean API that's not difficult to mess around with. It's really straightforward.

https://github.com/HashNuke/hound
Interesting, is there a variant which uses chrome? This would also eliminate most scraping protections.
>That's really the core problem with digital in a lot of respects - the bits are what they are, you can't go back and try again when technology is better.

Heh. I've been digitizing a couple handfuls of old VHS tapes that have nostalgia or sentimental value to myself or a friend of mine. You really forget just how poor video from a few decades back was compared to what's available today.
Tom Jennings is going to love this. He collected these device test images from wxvax7.esa.lanl.gov:

http://worldpowersystems.com/J/wxvax7.esa.lanl.gov/index.htm...

"In the late 1990's LANL (Los Alamos National Laboratory) had a public web server running on what later turned out to be a classified machine. I don't think any security breach occurred, but one day the machine simply disappeared. I wrote to the webmaster (back when you could do such a thing) who told me an audit discovered this alarming state and it was shut down.

Luckily I'm a packrat and occasionally use 'wget' to snarf down the contents of a website. This is one of those times. The images aren't anything exclusive, just a good set directly from the horse's mouth..."

Tom has a thing for cold war nuclear and computing machinery. He also created FidoNet and Homocore.

http://worldpowersystems.com/Projects/index.html

https://en.wikipedia.org/wiki/Tom_Jennings
Still FUD. Plus, making equity deals without consulting a lawyer is a bad idea regardless of your corporate structure.
What is the truth anymore? Who do you trust to provide the truth?
You could move. Oh, what's that, Marin is really great and a lot better than taking the tax cut and moving to rural Nevada?

Exactly.
Even though you can't draw any meaningful conclusions from this, I think this is a great effort. The results are weird in the sense that the results in the scenarios don't resemble our current outcomes. A couple of comments on that:

1) Models are hard to get right. You need to find the right balance between simplifications and reality. The results indicate something is not calibrated or functioning the same as our current state.

2) Models are intended to be simplifications. We draw meaningful results from very simple models (e.g. supply and demand) but without modeling the complex interactions it's hard to say what impact could a certain policy have on the system. Agent-based models are a way to do this and the computing power available is allowing us to experiment with this.

Re: #1. We may find that modeling and seeing outcomes similar to our own is very hard to get to. This may be due to model specification, or it could be that given the rules that govern our own interactions and intentions, our current state may be the one we just chanced upon.

This is a hard challenge to tackle but I'm glad that the authors have published this and shared their code. Don't expect to have prescriptive solutions from it anytime soon though.
>> into supporting a system in which drivers are underpaid and every customer has to individually think about how they can make up for that.

By using Uber and knowing they are underpaying, aren't you contributing as well?
Is writting a particularly representative example of cultural production? Back in the 40's only a quarter of the adult population even had a high school degree, now nearly everyone who has the temperament and interest to write can be trained. Thanks to the internet, a nearly infinite pool of writers have the opportunity for self expression, which they clearly value. At the same time, the economic value of undifferentiated writting approaches zero.

Contrast this with our current "golden age of television"--while costs are going down and quality is going up for viewers, the genuinely scarce and economically valuable skilled people who can make quality TV are being paid more. Overall the median salary for an artist today is higher than that of the average worker. You can believe that there are social issues that need to be overcome to improve the lives of people who work in and out of the arts, but it's hard to say that artists generally are living in "the worst of times"

And, of course, historically a large number of writers (those who weren't aristocratic dilettantes) had day jobs totally unrelated to writting. T.S. Eliot famously continuing to work in the sub-sub-basement of a bank for 3 years after publishing The Waste Land.
4 UX controversies that just won’t die
If you're tight on money, many good books can be had used. I recently got a copy of Tanenbaum's Distributed Systems book for a third of the cover price.
I'm not saying they shouldn't get a living wage before tips, they should. In fact, if we got rid of the minimum wage exceptions for servers, we would immediately revert tipping to what it was intended to be, incentive for good service.

What's dismaying is how many people in this thread don't even want to have to think about how the person driving them is a human being, often just trying to make ends meet.
Panels Are Shit
I have to wonder if the advent of renewable energy and vertical farming could eventually make these concerns extinct. I have a dream of a future world where human population stabilizes (as it seems to be doing), and vertical farming allows us to utilize far less land area (and maybe sea) for sustenance. Closed-system farms seem like they could be much more robust against pests and pathogens.
> But you're never forced to use them.

Use wartremover, then you are. Or just never write "null" (or check for it in code review). Yes ideally it just wouldn't be there, but it's really not hard to avoid it.

> The Scala compiler will never tell you "You can't write a.foo() because a may be null".

But you'll never get yourself into a position where a may be null (unless a came from a Java library, but that exact same problem can happen in exactly the same way in Kotlin). If you need to represent absence you'll use Option, and the compiler won't let you write a.foo() if a is an Option.

> No, it's not. The Kotlin compiler will not let such values enter Kotlin code until you've told it precisely whether that type is nullable or not.

No it doesn't. It lets you silently treat a type returned from a Java library as non-nullable.
Here's the thing about Wired: I can't read it.
Not quite. https://www.law360.com/articles/757906/qvc-website-crash-sui...

Basically, all damage claims are null because QVC & Resultly never entered into a mutual agreement. You can write whatever the fuck you want in your ToS but it's not law binding.

> Judge Beetlestone also rejected QVC’s claims that Resultly violated the Computer Fraud and Abuse Act by knowingly and intentionally harming the retailer when Resultly caused the shopping network's website to crash, reasoning that the tech company and QVC both could only earn money if the site was operational.

I see you are back on the FUD train surrounding web scraping but there's only very specific case where your fears materialize: "When you receive C&D from said website, do not continue scraping". Such was the case for Craigslist vs 3Taps.

Please do not cite legal resources and grossly twist realities to spread FUD. If you don't want to be web scraped, simply do not put it online.
> That said, our public schools suck, we invest nothing in research, we don't provide healthcare until your old, and our interstate highways were built 70 years ago, and state and local governments handle needed construction now, yet they take the smallest percentage of our taxes. Some states like Nevada don't even charge state income tax.

Don't forget we build highways with the wrong material which causes a cheaper initial cost and higher future cost. (Concrete rather than asphalt)
During competitions I sometimes watch two twitch streams in two different tabs, turning just the sound on and off depending on which one is more interesting. (I had up to four open at the same time.)
> The super advantage of Lisp (including Scheme): Its format for defining data is the same as for writing code, making macros a natural part of the syntax: You can change your source code just like you’d change any other list (or rather tree) data type.

I've heard this repeatedly over the years, but the explanation unfortunately always stops right there. Could you please give an example of why you'd want to change your source code programatically? It's always assumed that the reader implicitly knows why this is a good and important thing. Perhaps a practical example showing

(A) how this would work,

(B) what the benefit is, and

(C) how the added work in reasoning is worth that benefit.

Note: I personally like the parentheses, as they group everything together so simply.
I'm also concerned that for some blogs, a single post might appear several times in Google's estimated search results (due to crawling the same blog under different hostnames or the same post under different paths, or because of syndication or posts to link aggregators). So maybe some individual posts reflecting particular teams' decisions are reflected 5, 10, or 100 times in the Google result count.
Thanks. Somehow I hadn't heard about this yet.
Why (and how) we revamped our equity program
I have used Selenium for this with quite a bit of success, or as others have mentioned, just figure out where the API endpoints are with fiddler and pull the data directly from the source.

Sometimes this can be a PITA though, for example Tableau obfuscates the JSON they send back, so it's easier to use Selenium to wait ten seconds and then scrape the resulting HTML.
Dave Ramsey is extremely anti-debt.

With the exception of buying your house. But then only if you 20% down and 15-yr mortgage.

And, let's face it, for the demographic he is targeting that's great advice. Most got into their situation due to poor handling of debt.

However, the vast majority of other financial advisers in the world, and economists, agree that with good management debt can be very beneficial. Dave Ramsey is not the Financial God. He has a very simplified, easy-to-follow program designed for a specific set of individuals. And, honestly, the majority of people would do well to follow it to the letter. But that doesn't mean EVERYONE should for EVERY situation.
if I understand it correctly that means that most people who move away from swift move to Objective C, but people moving away from Objective C also move to C# and Java.
If Uber charged more, they would never have gotten a foothold. One of the big selling points was its price.
Pretty sure Sea Ice is the same, it was supposed to be gone a long time ago (at least during the summer months). If you say anything about it though people collectively lose their shit.
Putting aside the hysteria of the impending extinction of the Cavendish (which so far seems to be at a stalemate), this situation is not unique to bananas.

Pretty much all fruit trees used in agriculture are produced by cloning; generally speaking producing excess fruit is not a productive mutation for a plant, especially when the fruit is high calorie. So to a good approximation, fruit trees grown from seed are extremely unlikely to bear enough fruit to be useful.

Sweet bananas are the example used here, but pretty much all fruit trees share this. There's essentially one (two if you count Dwarf Cavendish) sweet banana -- all sweet bananas you find in a store will be clones of one of those two. Same for avocados -- exactly two genetically identical sources of avocados (at commercial scale; a wild avocado tree will produce some small number of avocados every couple of years). Apples have a much greater variety of cultivars, but every Red Delicious you eat comes from a tree that is a genetic clone of all the others.

There's a danger from monocultures in agriculture in general, but at least for plants grown from seed, there's some natural genetic variety that might yield resistance from large-scale blights. Fruit trees are much more vulnerable to this sort of problem.
Frankly, I think it's a good thing if an article saying "X is doomed within ten years" keeps resurfacing year after year, long after its own deadline has passed. Maybe people will notice that that sort of reporting tends to be nonsense.
> And the systems we have in place still have human beings involved

While I agree very strongly[1] wist the rest of that comment, it is very important to require some human involvement.

This isn't theoretical. Without Stanislav Petrov's good judgment[2] that the automated warning about an incoming missile attack was a false alarm, WW3 might have started in 1983.

[1] How strongly? My username is a reference to a fictional drug in Schismatrix that forces the user to adapt to a new perspective/mode-of-thought. Tech only increases, so our need to learn how to live together also becomes increasingly urgent.

[2] https://en.wikipedia.org/wiki/1983_Soviet_nuclear_false_alar...
One thing I find really frustrating is that Ceylon didn't take advantage of its union types to represent checked exceptions that way :(
Wat? "programs not showing up in start menu windows 10" is a perfectly good Google search. It will lead you to a ton of MS reps denying there's anything wrong with Windows.

If you mess around you'll probably find this one:

http://www.gizmodo.co.uk/2015/07/windows-10-start-menu-break...

Funny that I couldn't reach the actual bug report anymore with that search. There are places where MS claims they increased the limit on the number of items on the start menu from 512 to 2048, but the problem was with 100 when I saw it.
Research on collective recall: Facebook, fake news and friends warp your memory
Debian aren't the only ones that do that however patching 3rd party software doesn't make it "Debian's user land".

Debian also runs a lot of software written by Redhat (eg systemd) but that doesn't make it a distribution of Redhat. Ubuntu ships a lot of in house software as well (eg Unity) but that doesn't mean ArchLinux with the Unity DE turns Arch into a distribution of Ubuntu.

What you're doing is akin to classifying groups of web browsers by the websites the user visits rather than by the rendering engines they're built on.
McDonald's Tweet Blasts President Trump, and Is Quickly Deleted
Something I always felt 20 years ago when doing my physics degree, and now 20 years later when no measurable progress has been made down the road of unification feels even more appropriate:

General Relativity and Quantum Mechanics are two astonishingly successful theories. They don't really have any massive gaps waiting to be filled. The belief that there must be a way to unify them always seems to me to stem from the human desire for tidiness, not any sound epistemological reasoning about how physical laws behave.

We want the theories to be unifiable because we're human. Sadly the universe doesn't much seem to care what we want.