skysight-inc/HackerNews huggingface dataset:
> I have this diffuse idea in my head that most possible images do not occur in the real world and that there are way more degrees of freedom into direction that just don't occur in the real world but this idea is just too diffuse so that I am currently unable to pin and write down.

Yes! You're on the right track! The number of degrees of freedom of images of pixels and textures is HUGE. There is not enough data to practically learn directly from those images. So the deep networks are starved for data -- even with the big datasets they are trained on. (It's only thanks to the way they are set up they do well when tested on very similar images, like sharp hi-res photos. But they fail to generalize to other kinds of images.)

So how can you reasonable reduce these degrees of freedom?

It turns out that the continuity of reality itself provides a powerful constraint that can reduce the degrees of freedom. See, when a ball rolls along, this physical event is not just a collection of textures to be memorized. It's an ordered sequence of textures that vary in a consistent and regular way because of many learnable physical constraints (like lighting).

So, it turns out you can reduce the dimensionality by making a particular kind of large recurrent neural net learn to predict the future in video. Our very preliminary testing shows it works shockingly well.
Being Korean I recognize the progeny of your name ;). Thanks for the nice anecdote, and I really enjoy your writing style. Do you have other writing/channels elsewhere?
"Adversarial examples are just one way to prove that deep learning fail at generalization"

Do you know what proof is? Adversarial examples demonstrate that there is one esoteric failure mode of current deep learning models, one that for all we know is present in human vision (we can't take derivatives with respect to the parameters of our own neurons). It will likely be solved in the next few years. At a minimum you start training on adversarially generated examples.

This response is absolute hyperbole and clearly devoid of any factual knowledge of the nature of deep conv nets and their properties.
I feel sad that someone would think this. I don't blame you for writing it, many people are ignorant of not too distant software, but still bothers me somehow.
He didn't write about doing something really bad, did he?
This is a huge deal with drugs that can cost $10k per vial.

The manufacturers have no incentive to test for longer periods: it would just mean less revenue and more risk. And as I've mentioned before, physicians are very conservative and don't like stepping outside what other people do even if the basic research is there.

For example, the ability to pool leftover amounts of Yervoy (ipilimumab) among patients could save thousands of dollars each. The research so far shows that cancer drug Yervoy remains sterile, stable and effective for at least a month [1] but the manufacturer's guidelines say to use immediately after opening and throw away the rest. (Ironically the independent researchers couldn't afford to do a larger study because the vials were so expensive in the first place!)

It also limits how the drugs are delivered. For example, IL-2 (as a cancer immunotherapy) might be safer, more effective and more convenient as a single continuous infusion over a few weeks [2]. But the guidelines say to use immediately and throw away the excess.

It also limits research into what I think is the most promising near-term approach to cancer: intra-tumoral immunotherapy (with frequent low doses of e.g. ipi, nivo, IL-2 into lesions). Unfortunately this is way too expensive if you have to throw away 99% of a vial for each injection.

[1] https://www.ncbi.nlm.nih.gov/m/pubmed/26922168/

[2] https://www.ncbi.nlm.nih.gov/m/pubmed/10996039/
One of the most memorable experiences of my life was building a small 2D RPG named Dungeon Of Despair from the book "Game Scripting Mastery" https://books.google.ca/books/about/Game_Scripting_Mastery.h... by Alex Varanese.

The game teaches you to build a simple game for Win32 from scratch. The graphics would be pretty dated now, but the scripting system for enemy AI and quests is a Turing-complete programming language. I learned more from that book than from my compiler course in university.
The point of the parent comment is that they don't fully attempt them. They put forth just enough time and money investment to make a big PR splash and get a proof of concept out the door, then slowly back away from things.
Just what the world needs, less power efficiency.
I agree, but I recently bought a gtx1060, which meant I had to update to the latest drivers, which unfortunately don't support the other card I have in that machine (I forget what model, it's either a gt520 or a gt210). I only wanted to use that other card to connect extra monitors.

You can't run two Nvidia cards off different driver versions.

Anyway, the gtx1060 supports four monitors by itself which is enough but I needed to buy some cables.

Nvidia drivers are super bloated though.
Your comment is the saddest thing.
Thanks, I didnt see that button on the site.
Show HN: Lifoo – a fresh take on Forth in the spirit of Common Lisp
Completely agree.

I have near unlimited respect for Linus. He has an allergy to bullshit. He does not mince words when preventing any kind bad code or needless complexity from entering the kernel.

The same things that make some people consider him an "asshole" are the same things that make him so effective.
Yes, middle management in big corporations often has very complex politics. I rather enjoy getting things done in spite of that, and manipulating the politics in favor of advancing an agenda that will benefit the organization. It wears me out, which is why I usually leave after about five years for a new playing field. (I have never had an interest in advancing to the executive level, where the politics are not at all to my taste.)

>>With your experience, you might be fine business analyst on customers projects. Talking with customers, dealing with their politics and then turning all that into consistent set of requirements. That last part is something you would have to learn.

This is a great suggestion, and I have had similar thoughts in the past. What would be the best way to go about learning how to create a consistent set of requirements? Actually work on a few software projects writing code, or something different?
I have read that water bottle contains expiry date, it is not for the water but to the plastic bottle which will start leaching chemicals after the expiry. I guess it is the same case here.
Necroposting here, but that's an extremely interesting comparison. Would you be able to elaborate?
There's a plugin for IntelliJ: https://intellij-rust.github.io/
I'm sure the answer is to dismantle the suburbs and force everyone into hirise apartments in cities, that we also will refuse to build.
Seems like the CIA was tasked with gathering intel on presidential candidates of a major European nation.

What exactly is a revelation here?
Embarrassing how? Embarrassing to who?
Uber is doing it with self driving cars.

Amazon does it with both their in house labels (ex: AmazonBasics) and delivery service.
As someone who lives in a giant spread out city (Houston) I have attempted to bus in from the suburbs on occasion and it was fun, but hardly a reasonable everyday occurrence. Our city is just too spread out. I've visited NYC and it's large as well but everything is so compacted together you don't have to go far from a train station to get where you want to go.
Inflate the stock price with "moonshots". Slowly kill off the moonshots and inflate the stock price with "fiscal responsibility".
What does size have to do with anything? This is a discussion of density. It's a foregone conclusion in discussions like this that the proposed changes probably won't apply to places like Wyoming, but that's not the kind of environment that most Americans live in.
False equivalence fallacy. Every country has roads, but Tokyo-style roads are a hell of a lot cheaper to build and maintain than American roads, where every city is a maze of six-lane highways intersecting ten-lane highways.
"So what features are those networks actually learning? What are thy looking for? They can not be much like features used by humans because the features used by humans are robust against such adversarial noise."

There are two issues with this - first, we know that the lower feature detectors of neural nets closely mimic the feature detection of the human visual cortex. Secondly, the features could be the same while there could be technical imperfections with the later stages of current neural nets.
Accidentally quadratic: real life algorithm degenerescence bugs
> Driving is a choice, and provided that drivers pay all the costs associated with making that choice, there’s little reason to object to that.

I mean, kind of. I'm not sure where the author lives, but in Houston, I don't have much of a choice. I already pay tolls and taxes, gas prices and my car note. I live as close to work as is affordable, and still have to drive. There's no bus route from my apartment and I'm not about to ride my bike on I-10. I ask this next question in seriousness, because I'd love to change my habits without moving to a more expensive city with good public transportation: what are my options here? I'd rather not be "disinsentivized" from doing something I have no choice but to do.
I feel like this is a chicken and egg problem. Without the transportation infrastructure you can't get the population/business density, but without the population density you can't justify the infrastructure. Houston could probably build decent rail transportation to get you where you needed to go, but it won't happen. I live in a city like yours, our public transportation is atrocious. It takes at least an hour to get anywhere.
Welcome to the era of transhumanism
> at the cost of the new battery.

Lol, the person who I did it for (this was a while ago) was told $150 to replace the battery in her old iphone. I bought a battery on ebay for $5, delivered from China, including the tools I needed, and did it for her.

It was nerve wracking, quite delicate and fiddly and easy to break something. The first time I forgot to reconnect the tiny microphone flex cable so I had to open it up again to reconnect it, but I got there in the end. She was very happy but I wouldn't do it again for someone.

TLDR: quoted $150 at Apple store, did it for $5 and about 30 minutes of hassle. Apple is a planned obsolescence scam.
I flew on Emirates a few months ago and not only did they indeed have seat-back screens, they also had a really nice selection of movies. Lots of choices, including a number of 'sets' like the entire Star Wars series, the entire LOTR collection, etc. Nothing can really make a 14 hour flight good, but I was pretty satisfied with the quality of the hardware and content on the Emirates plane.
There's 288 Linux distributions currently listed on DistroWatch, multiple DE, package managers, and yet, Windows is still dominating on desktop.

Having an open source clone of Windows makes perfect sense. Imagine if, after all those years, this project received more support from the open source community. Today we would have a free and open source OS that would be able to run Windows drivers and the Win32 apps people want to use. Adobe's stuff, AutoCAD, AbletonLive, games, MS Office, etc.

In the end, the average person doesn't care about operating systems. What they care about is their apps.
> And in doing so, they're willing to watch their world burn.

This is an interesting note to end on. Do you think what is happening now, which I see as the least bit of accountability being seen for the first time in a chronically corrupt system, is people "watch(ing) their world burn"? This is something our country desperately needs to rise above the legacy of dictatorship and corporate profiteering.
Training on adversarial examples doesn't solve the fundamental problem, it merely tries to plug the holes. But in such high dimensional spaces there are many many holes to be plugged. :)

Agreed the failure mode may seem esoteric, but note that OpenAI is making a big deal about them.

A non-esoteric way to demonstrate the lack of generalization is to feed a deep conv network real world images (from outside the dataset). Grab a camera and upload your own photo. Roboticists who try to use deep conv nets as real world vision systems see these failures all the time.
>If we could go back and rename Windows Hitler would anyone be using it???

Intensely hyperbolic but... you're not wrong. "Cockroach" is an awful name for a database and I have a hard time envisioning "seen-it-all" enterprise IT managers taking it seriously.
Microsoft Azure IP Advantage: A closer look at the ‘patent pick’
"Welcome to Java …"

Maybe in giant non-tech company legacy systems, or written by Indian off shore teams.

These days with Java 8 there is almost none of that bull shit.
Photographer captures nature through surveillance webcams
How much are rural drivers subsidized compared to their city counterparts? Yes they have more road for fewer people, but a lot of the road is of much lower quality and it will suffer from less driving related deterioration.
I understand why you could have that mentality though, you can't be blamed for it. I hope sometime you would be able to visit the USA with that knowledge and get a better experience!
ReactOS is one of the most impressive software endeavors I've ever seen, both from the scope of the task and the progress that's actually been made, especially from such a small core group of developers.

Many of the comments here are saying they're surprised it's still alive, or that it's sad someone would work on it, or that it should have more features. You're all missing the point.
Why? It is not just about the cost. It is about over a million people dying every year. It is about pollution. It is about noise. It is about ugly roads taking up huge amounts of space. It is about entire cities messed up because of urban sprawl.
> You're engaging in a variant of the "lump of labor" fallacy.

No, I am not.

You are missing the entire point. Nearly every article or mention of immigration includes some variant of the equivalent to (paraphrasing):

"Without immigrants our entrepreneurship suffers greatly".

I reject this with passion. We have amazing people already in the country, both native and existing legal immigrants. If we closed all immigration today (not proposing this is a good idea) we would have no problem at all maintaining a rate of innovation that challenges most other nations.

We have excellent people already in the country. We don't need to use this lie to justify the need for immigration. There are a number of very compelling and valid reasons for which immigration is important and should be encouraged. The above-paraphrased fear-mongering claim isn't one of them.
Wasn't that a thing on Silicon Valley (the TV show)?
Hey another Houstonian! My thoughts exactly.
Part of "lowering the rent" in the city involves preventing people from paying for cars whether they use them or not.

That "free parking" in the street is not free, it comes at a real cost in real estate value and road maintenance. Likewise policies that require a certain amount of parking per unit or square foot also makes people pay for cars whether they use them or not.

Making buses or trains share the road with cars instead of giving them dedicated lanes with signal pre-emption, also makes non-drivers pay for cars.
Let's be brutally honest - most of the successful businesses are about selling harmful (mostly in the long run - people should be myopic, not entirely dumb) bullshit.

And you have to possess certain qualities to succeed in that, which BTW work the best when you are not seeing part 1 as something bad at all.

This WILL make your social life a kind of hell - and you deserve it. People are not dumb customers, though not always able to articulate that (ie from shame, halo effect etc)
Zuckerberg’s manifesto says: “it’s really, really… really complicated”
A good question, but in other situations, we don't object to middle-class people being required to pay the full cost of things they pretty much must buy. Food and water are mandatory to live, and in the 21st century US, electricity, phone, and Internet are all but mandatory to live a normal life. Yet nobody objects to ordinary citizens having to pay water or power or phone bills, rather than the bulk of the cost being subsidized from tax revenues.
FYI, @OpenAI:

"At OpenAI, we think adversarial examples are a good aspect of security to work on because they represent a concrete problem in AI safety that can be addressed in the short term."

https://openai.com/blog/adversarial-example-research/

Hardly proof that deep learning is fundamentally flawed.

Regarding real world issues, these issues come up when you don't separate training and test (and real world) sets properly. My worries would be with implementation.
Operating systems are cool.

Just about every popular general purpose operating system is some variation on UNIX. That is sad, just like it would be sad if JavaScript, TypeScript and Coffescript were the only popular programming languages. The only difference in scenarios is that the OS is much more significant and critical than the programming language.

Windows is fundamentally different from Linux and UNIX. ReactOS is a clean room reimplementation of that, bringing NT's many excellent ideas to the open source community. That is a good thing, even if you never get to use it. Don't forget that, just like in every other part of life, different != bad.
Really nothing fascinating to it. Very generic privileged and spoiled child (as my sibling poster pointed out), and none too bright. Look at the sheer amount of extra-legal maneuvering by the mother to get her into a decent college.
> it seems that an idea where your infrastructure is out of reach or particularly vulnerable seems like a bad idea.

Is it better to have your infrastructure where someone with a shovel, or a fishing boats dragging its anchor can cause catastrophic damage?
How did Europe become the richest part of the world?
Perhaps: "My neck beard hurts"??? The guy had an honest question, no point in shunning him.
Diversity should mean a mixture of people with different views and experience. Too often it it means hiring an expensive diversity consultant to avoid a public shame shakedown.
I think this is an important point that's worth addressing. It does seem like most successful startups stumble onto their idea, and their mission statement is usually a post-rationalization [1].

The question of "Does it come down to luck or is there a repeatable process?" is critical to YC's success. I think PG and Sam have made great contributions to discovering a repeatable process, but because they're so prestigious now and attract the best startup candidates they can basically just filter for the ones that already have traction.

I'm a huge fan of what Sam's been doing with YC, but this is what I miss the most about PG. PG didn't have any brand to benefit from, so it was critically important that he understand the physics behind successful startups so that he could deterministically understand which ones would be successful or not before they were already obviously successful. YC doesn't have to do that anymore, they can just choose the startups that apply and already have customers and revenue because they get so many applications.

My gut tells me that the next step in developing a repeatable process for successful startups is a better understanding of markets. If you look at all the startups you mentioned (not Google, but Uber, Facebook, Snapchat), they all applied a relatively simple technology to a new market that the founders had a unique perspective on. Uber had unique access to the SF population that's constantly frustrated by transportation options but quickly embraces new tech, Facebook tapped into the market of college students that most VCs and entrepreneurs overlooked because they weren't in college, and Snapchat did the same with an even younger market. I'll add Slack to the list as well: they built an equivalent product to HipChat and Campfire (which were created years before Slack) but targeted the market of non-developers.

1. It's hard to find supporting evidence, but I have never seen or read a mission statement from a company before they were already massively successful.
I've seen it on Air Canada (or Red or Jazz, or whatever it was called that day), and it actually worked quite well. They offered to rent tablets for people who didn't have devices.

I suspect managing the streaming server isn't going to be much more complicated than managing the old wired content sever... On the other hand, not needind kilometers of cables for entertainment, not needing to maintain them, makes a huge difference for the airlines. This is not as simple as pulling a cable in your house, planes have crashed because of fires from bad maintenance/install of cables, including cables for entertainment.
I live about 10 or so miles from work. I live in a hot state. If I rode a bike or walked to work, I would stink and everyone near me would forget about the planet while experiencing their olfactory assault. I'd probably get out of meetings, but I wouldn't make any friends.
> If we can lower rent in the city, automobile usage will go down on its own. This is where the fight should be pointed I believe.

This needs to be repeated, at least 1,000 more times, because it is the real issue we're facing and everyone is ignoring.

You can't expect people to live lifestyles like they're in big cities, when we don't let any of these people live in big cities.

Until that happens, these "punish driver" attempts are nothing more than punishing poor/middle class people simply for being poor/middle class. They already can't afford to live in cities. Taxing them again just makes them even less able to afford cities.
I understand that this is mainly a discussion about density, but the US is super diverse in its population densities. I was just curious because I happen to live in a very rural area, but if you travel 30 minutes you would be in the most densely populated area of my state. Correct me if I'm wrong, but most of these increased fees would be implemented at the state level and could seriously impact those that live close to dense population centers, but have no available transportation other than cars.
We do subsidize those things to an extent though. Farmers get a lot of subsidies and the infrastructure (roads, rail) to deliver the food is part subsidized. Water, electricy and internet infrastructure are often built by government or with government funds (and that's not a bad thing). Are there any private dams?
Humans will quickly learn that these things are fake and just drive over them at full speed, though. It might stop people new to the area, but not the majority of people who live there.
What's wrong with a neck beard?
Very likely, the major reason you live so far from work is that it's illegal to build densely, and it's illegal to build houses, stores, and offices within reasonable walking distance of each other. Of course, most people don't realize that - they just look for houses near their work and don't find any, or the handful they do find are super-expensive, so they live far away and commute. But the underlying reason why these houses are super-expensive or nonexistent is that it's illegal to build more of them.
I agree. I have tremendous respect for the devs of ReactOS.
How about bitnami? They provide Redash virtual machines and installers already?
"Most assholes don't have that level of reflection"

Don't be so sure about that. I'm most certainly an asshole and I am extremely self aware. These two things are not mutually exclusive. Many of my closest friends are also assholes and they damn sure know it. Quite frankly that is in part why we are friends.

I agree the author is reflecting however most of his reflection is denial. If he wants to get anywhere then he needs to accept that he is an asshole. Only then can he either decide he wants to change or decide that he is ok with it.