skysight-inc/HackerNews huggingface dataset:
>If you generalize things enough to mean application of linear algebra, the chain rule and map, then yes that's true. However, the fact is that Neural networks still take a huge amount of skill and experimentation to design new architectures. The more powerful deeplearning becomes, the less skill will be required to do complicated things.

Sort of. Hyperparameter tuning is indeed difficult, but in principle it can be automated and there has been great work on this in the past few years. But I never claimed that it was just plug and play. The point is it's the same underlying technology in speech recognition or self driving cars or face recognition. Even if the number of layers and convolution sizes and learning rates are totally different, the principles are the same.

>The AlphaGo bot was very data inefficient... David Silver points out how they broke correlations by brute forcing millions of games while only keeping one move per game.

This problem was solved in the past with temporal difference learning. Maybe there are technical reasons they didn't do that, I don't know. At the very least they could pick a random move from each game per batch, instead of discarding the rest of the moves. I don't really see how that helps solve anything.

>Recognizing the weaknesses of our models instead of glossing over them is how we get to AI!

There is a huge difference between recognizing weaknesses, and the AI Effect. Where AI solves problem X, and people disregard it "because it can't do Y".
I bookmarked it. Please keep adding to it. You could make it the best bash cheat sheet on the web, if you steal from all the other ones out there. It needs a lot more shortcuts.
> Why is this at the top of HN?

What the ..? Because it's a cool blog post of course! It carefully and clearly explains things the author understands about music (in a much better way than I've seen before), and then clearly and carefully goes on to describe and comment on some things the authors doesn't understand as well.

Basically, it's a Julia Evans blog post but about music instead of system programming. I've never seen a comment like yours on top of an HN thread about any of her posts. What's going on, somehow because this is about music and not programming we need to get all pedantic?
Muslim Scientist's Inventions
Just watched Kevin Mitnick use some of these PDF exploits in front of an audience to root a fully patched Windows system.

If you want to use Adobe Reader you should be using http://www.bromium.com on the endpoints.
Curated design – Awesome Design
They learn just fine during training.
Actually, I think those businesses would have a better go at adjusting.

A lot of stores, coffee shops, and the like are almost completely staffed with part time workers that only work 3-4 days a week anyway, though they might have to have slightly more hourly management. Taxi drivers are often independent contractors.

The bigger issue I would be things like nursing homes, hospitals, and other such things because suddenly you'd need more CNAs and nurses and doctors on staff. It would really need to be planned in a way that gets nursing programs (for example) expanded and folks enrolled in such programs. The businesses would benefit overall, however - Somewhere in sweden they experiemented with 6 hour nursing shifts not so long ago. They found less stress, better care, and less absenteeism among the nursing staff. Short term loss that some planning can help with for what seems like long-term gain.
Is there a reference regarding the number of nodes that can be deployed in the cluster, and are feasible to maintain? From the docs, I gather that "[a]ll DDL/non-stream DML statements are executed in a distributed transaction on all nodes in the cluster and committed via two-phase commit." [1]

Doesn't that get in the way of low latency and availability?

[1] http://enterprise.pipelinedb.com/docs/two-phase.html#two-pha...
I think you're missing the point there. Portia is able to, using just a handful of neurons (~600K), accomplish sophisticated vision tasks, complex planning, online learning and scheduling. Portia and insects in general are much more flexible to changes than our Neural nets. Changing objectives or a slight modification in the rules will often require retraining and a new design but insects can adapt to various lighting, environmental, prey, predator and navigational concerns. From the wiki on portia:

> Laboratory studies show that Portia learns very quickly how to overcome web-building spiders that neither it nor its ancestors would have met in the wild.

We should strive for its kind of energy and hence, computational efficiency in our models. Think for example, what that would mean for prosthetics. I find the overzealous defense of the current state of the art just as frustrating as out of hand dismissals of AI which constantly move goal posts.
The grammar is used to compute the code layout features that CodeBuff learns from: it parses each file and associates spacing and indentation features to trees' contextual features.

Then, when we parse a new file to pretty-print, we parse again with the _same parser_ and the features that were learned are matched to the tree at hand to recover the "right" spacing and indentation features for the given example code.
Seems a bit unfair. Look at cities like London or Zurich. Very high immigrant populations, and the population is comfortable with that.
I barely have any direct experience. I visited Occupy Boston when it was still around and saw their small tent city. I've been to India multiple times and have seen how the very poor live, but I haven't spoken to them. I'm mostly just interested in the topic a lot and have researched it on my own. When I was younger I used to have some homeless friends, but they didn't construct dwellings.
I'd like to elaborate a bit, in the same "for nerds" manner, on where Eevee seems to get lost a bit with scales and notation. He (she? not sure) calls the A minor and C major scales the same, because they contain the same notes. That's not an odd thought, but it's like calling sine and cosine the same because both functions contain the same set of values, in the same order.

The difference is phase. Basically, scales aren't just an ordered set of notes, they also have a starting point. This note, the note the scale is named after, is often the last note of a tune played in that scale, and often the first too (especially for more poppy tunes). So if you play Für Elise in C major, like Eevee suggests, the entire melody will be pitched 3 semitones higher than playing Für Elise in A major. And it'll sound awkward because you're supposed to play it on a minor scale.

Once you understand this, the whole notation thing makes a lot more sense as well.
Box Wholesale
TheCustomBoxes.com specilises in making cardboard boxes. We specialized in making Fresh Custom Made Cardboard Boxes by using offset printing to achieve excellent printing result However, the turn around time is as fast as 10-12 business days to print and ship after the final approval. We have state of the art facility and quality is never compromised regardless if it is the minimum run of 100 units or larger quantities. We don't provide any of the shelf products yet our prices are competitive compare to any other Custom Box Manufaturesrs.https://www.thecustomboxes.com/
I agree with all you have written, but there is a way to zoom in or out without using your other hand: use your lips. "Muaa" zooms out, and "auum" zooms in. This will make public transport journeys more interesting (for the others).
It's top of HN because a lot of people find a physical/technical introduction interesting...
That's planning, not learning.

An instance of learning would be training a spider to play Go, say.
Online History Exhibits – American Institute of Physics
Microsoft's 20-year journey to finally putting Windows Everywhere
I'm not sure ducking out of fishing regulation is good for any marine ecosystems.

If British fishermen weren't getting the best deal out of EU fishing quotas, then it can't have helped that the British representative on the EU Fisheries Committee was one Nigel Farage, who never turned up to represent them, but was still happy to use them for Brexit propaganda.
I can second Stencyl for kids (with assistance). It's a nice system.
V8 Optimization killers
They mention 3 bronze lemmings climbing a pole in Dundee. I found them on Google Streetview: https://goo.gl/maps/pqsWNpqTNPG2
7 strategy games that every developer should study
Survive. Reproduce. Just like the video games nets are already trained to play, there's a pretty clear scoring function. The inputs would be spider sensorium, the outputs would be spider effectors.

I'm kind of waiting for someone to do this already with C elegans by excising their 300 or so neurons and replacing them with a GPU and laser (but I imagine the practical impediments are way higher than I handwavingly imagine).
On the contrary: we have, and for some time have had, an economy capable of providing for all the needs and likely at least most of the wants of every human now living, without requiring 40-hour (or longer!) work weeks from most of them, and the number of required actual workers declines with every passing year.

Yet we have an inherited notion that it is deeply sinful to survive without working hard for it, and equally sinful for many to prosper while few labor. As a result we must endlessly invent placeholder positions for people to fill (all of those second assistant deputy administrative oversight whatever jobs that let people show up and pretend to be useful), lest they have no "work" to do anymore and thus no claim to a share of the production capacity.

We could just as easily switch to some sort of rota for performing the necessary work, and have everyone provided for with a minimum of required labor, but this is seen as an affront to the religiously-held beliefs of people who haven't adjusted to what we're actually capable of nowadays.
Would wine work?
>> The large majority of deployed machine learning algorithms actually can't learn.

Learning algorithms construct a model of data- that's what we call "learning", or "training". The trained model is then used to make decisions, so that's what you would deploy in a production system.

In that sense the deployed systems don't learn any further, yes, but that's because you don't deploy the algorithm per se.

An exception is what is known as "online learning" algorithms, that can continuously update their model as new data becomes available (hance, "online").
However, high margins does not necessary means high profit.

We have plenty of these setups in our weekend markets, and I don't really see them selling these in high numbers. Actually, most of the time, the shops are empty but they are there, every weekend selling the same items.
Many musicians much better than me are surprised at how I can play a song just by hearing it on the radio. My breakthrough came from understanding music was realizing that the real “meaning” of a note lies in its position relative to the tonic note (e,g, I-II-II, etc, also written do-re-mi). Suddenly, almost all of the clutter was removed, and the problem became manageable.

Let's consider the three-note tune “do, re, mi”. If that tune were played in the key of C, it would become C-D-E. If it were played in G, it would become G-A-B. But in either case, it's the same tune but with each frequency increased by the same percentage.

Trying to understand music by understanding the letters is like trying to read in a world where every article has been enciphered into a different “key”: e.g., the word "cab" in “the key of A” (the alphabet we normally use) would be written as "dbc" if the article were written in “the key of B”. In the latter case, you could discern meaning only once you realised that the letter “d” represented the third letter of the alphabet. There's nothing meaningful about a “d” but there is something meaningful about a “4th letter of the alphabet”.

Once you start to “decipher” all music into I, II, III, IV, V, etc., the complexity becomes manageable. You can start to learn to recognize the sound of a III note, or of a VI minor chord. After all, there are only eight notes in the major scale.
Superb game.
Exact opposite for me. I learned do-re-me as a kid and then ever saw it again, until I started reading about music theory recently. Then I saw it a lot - e.g. voice leading rules saying that a voice must start from Do and end on a ti-do step, etc.
A Guide to Caching with NGINX
> It's more than fancy linear regression.

I am not an expert, but it seems to me that "big data algorithms" are actually simpler and require less ingenuity than classical statistics. Just look at a difference between frequentist and bayesian approaches in statistics. In frequentist methods, you need to choose model wisely, you're constrained what you can model, and there are many different models with different assumptions. With bayesian methods, you just represent any distribution somehow and do the calculation on those. Less assumptions for the models, more general models, but at the expense of more computations.
The difference is they did turn down acquisition offers from Apple and Intel, a few years ago.
However they're not doing so well as an independent company atm. Many of the most experienced engineers are getting poached by Apple these days (has some informal no-poaching agreement come to an end?)
> It seems to me that the performance of a static site generation is irrelevant, and thus time spent on this is really wasted effort.

Another consideration is pages which take a long time to render. When I'm writing about code (which is a lot!) I use a literate programming style, so that code snippets on a page can be executed and have their output embedded in the HTML. This ensures that the code I'm discussing actually works as claimed, and keeps everything self-contained; but it can make rendering arbitrarily slow!

At the moment, the longest wait is a few minutes for the graphs on http://chriswarbo.net/blog/2014-07-23-fib.html and the images on http://chriswarbo.net/projects/procedural/cantor.html

As long as the build system is incremental (I use GNU Make) the cost only has to be paid when changing those pages (either their content, or a template), so it doesn't slow down the edit/build cycle for other pages.
Keyboard Firmwares for Atmel AVR and Cortex-M
DIY a 3D Print Talking R2D2 Robot
BTW you can run 16-bit Windows apps in Wine under 64-bit Linux, provided your kernel version is <= 3.13, or >= 3.15 and you disable a security enhancement preventing 16-bit code execution by issuing (from root, possibly in your start-up scripts):

echo 1 > /proc/sys/abi/ldt16

Some 16-bit programs under Wine might also need:

echo 0 > /proc/sys/vm/mmap_min_addr

Edit: not sure about kernel version 3.14.
Popular Let's Encrypt Script 'letsencrypt.sh' Renames to 'Dehydrated'
Yes. I grew up with a ZX Spectrum which I loved dearly, so it pains me to say it, but Sinclair didn't really deserve to be "titans". Their machines were kludges with corners cut, pre-order money taken from the public when they didn't even have a working prototype, and Sir Clive was disdainful of the gaming market which made his machine successful and tried to move away from that instead of embracing it.

Some of the corner-cutting was ingenious (the calculator where the power pulses just often enough for the screen and memory to stay on, allowing a watch battery to be used for a more slimline design) and some of it less so (iirc the same calculator displays 8 digits but is only accurate to 3 significant figures...)
SwiftKey is not in the same league as the others apparently, but I didn't know that much about it.
70 km/h is slow, a fast car can hit over 200 km/h. Doesn't mean that they should be able to do so when sharing the road with a bunch of other cars.

If you want to bike at over 40 km/h then more power to you, but perhaps bike lanes with other, often slower, bikers, aren't the place to it.
One can always lower the brightness of their screen, but they can't easily change the contrast in the font/bg.

Besides, research has shown that plain ole black on white is the best combo for readability.
Does anyone know if this works privately. Or if there is a good way to seed files only between friends?
What is the difference between planning and learning, and would you consider a human that is unable to learn something like general relativity because they are mentally retarded to be unable to learn?
Are you guilty of over-engineering?
The Desire for Success – Gratitude Inspiring Quotes
My 13-year-old brother and sister are on skype constantly. If the computer's open, skype is running in the background.

Skype is also well-known among current chinese college students.

Basically, I think it's unlikely that anyone in their early twenties has never heard of skype.
Of course you can get the data, it's in a SQL database after all. The consultants only made sure to build the system so that they get paid for everything that wasn't explicitly specified (like querying by a parameter):

>It's entirely possible that PETS, which allows for automating intake of evidence, may be so complex in its database configuration that producing the data sought by the bill would require major revisions to the multi-million dollar system. However, the NYPD has also invested heavily in an IBM DB2 data warehouse operation with the help of IBM Professional Services, so in theory they should be able to perform much of the analytics off-line without "crashing" the PETS system—with a little more consulting help.
Creating and Sustaining Process Improvement (2001) [pdf]
For many niche hobbies it's the best place to do them (personal example: netrunner). It's probably the best place in the world for (english-language) theatre. Maybe you're someone who could easily adapt to German; I'm not, which makes London the best option by some way.
Depends on what watchlist you're referring to. Short answer: yes, multiple, but not because of the subject.

What you probably want to ask is 'how big is the watchlist'.
I sort-of-but-not-quite did this when migrating my old dynamic site to static generation: I used my model API to build a list of all the pages and then faked requests by building my own request objects that I called my Sinatra app with.

Made for a quick and dirty way of reusing my old code, and means I can still run the dynamic version for dev/testing.
I took care to point out deployed models. I did not say the models did no learning. In fact, one can draw an analogy from evolution and instinct to offline training/hyperparameter search/architecture tweaks and deployed model.

And, technically, the manner by which most nets are trained, via (minibatched) stochastic gradient descent is online. But the architectures are so ill-adapted to learning continuously and backprop is so data inefficient that retraining on new data is often just better done from scratch (or at best, freezing weights).
Your examples of chairlifts and helicopters are strained because obviously they would fundamentally alter the experience and cause extreme financial burdens, which make for allowable exceptions under the ADA. This is not parallel to the Berkeley case-- from the DOJ letter: "...UC Berkeley has not established that making its online content accessible would result in a fundamental alteration or undue administrative and financial burdens."

This rings true in my mind; obviously adding accessibility features wouldn't fundamentally alter the experience for non-disabled users. And training and employing work-study students to audit and improve the accessibility of the content seems like a low-cost approach that could bring them substantially into compliance. Rather than allowing untrained faculty to self-certify accessibility compliance of their self-maintained content with a checkbox, which is allowed today.

"Freedom of spreading knowledge" certainly doesn't make for a valid set of exceptions. By that logic, as a knowledge-spreading institution, Berkeley wouldn't need to build wheelchair ramps and elevators on its physical campus. I assume you'd agree that that's a settled question.

In some ways and in some cases, online education is already a reasonable substitute for in-classroom education. It seems logical that we begin to push online learning toward making parallel accommodations to what we've already deemed just in the physical world.
>> The inputs would be spider sensorium, the outputs would be spider effectors.

That sounds great on paper. In practice, how do you even begin to collect "spider sensorium"? fMRI?

As to "spider effectors" I'm pretty sure we don't have the tech to do that yet, at least not in spider-scale (excluding Giant Spiders of Doom).

On paper, you can approximate any function with a multi-layer perceptron with enough layers. In practice, "enough" layers may be infinite and you'd need infinite amounts of data infinitely difficult to collect.
5 ways IT students (and everyone else) can improve their presentations
I think Apple would have split up iTunes long ago if it were only a Mac application, but they don't want to distribute a bunch of smaller Windows apps.
It's one of the biggest things I've noticed since moving here (London) 18 months ago from Auckland. NZers aren't exactly known for long-term foresight, but business people in the UK take short-term, reactive thinking to a whole other level - my friends from NZ and AU who work here all have similar experiences too.
Estimote announces the Mirror that turns any TV into a smart beacon system
You might worry too much.

One of the most fascinating conspiracy theories I ever encountered postulates that the dark ages never happened. That is, this vast decline of the Roman Empire and ensuing centuries of neglect and intellectual emptiness (which inspires most contemporary worrying about the decline of great civilisations) was not a real thing at all but rather an artifact of how we've dated historical events.

The theory itself is very large, complicated, and weakened considerably by its original authors attempt to re-build his own completely different historical timeline after spending most of his theory on showing how we really have very little idea of what was going on before about 1000 AD.

But the gist of it is that as you go further and further back, history stops being a coherent timeline of events and starts being a series of snapshots with only rather weak signals used to arrange them and order them. Many of those signals are calibrated against each other, and often evidence that throws doubt on the 'consensus timeline' (as he calls it) is simply discarded, ignored, dismissed as a mistake by the original authors of the material or just written off as a mystery.

Just one example among many: Athens is hardly mentioned in works we believe were written during the dark ages, even in books written by people who travelled in the region. On the few occasions that it merits a mention it's described as if it were a small village of no particular importance. But the history books would have us believe that at this time Athens contained the vast ruins of a once great civilisation. It seems very strange that explorers and travellers who wrote about their adventures in that part of the world somehow just systematically forgot to visit Athens, of all places.

The theory explains this by suggesting that the construction of the great works in Athens have been misdated quite significantly, and the reason these works don't mention things like the Parthenon is because at the time they were written, these things hadn't been built yet. It claims that many of the things we assume are now ancient and separated from our world by centuries of abandonment and decline are actually early medieval in origin.

Anyway, fascinating theory, if only because there's so much potential for hole poking and resultant learning. The debunkings I found on the internet were rather weaker than I had expected and ever since I've been curious as to what exactly was supposed to have created and then ended this mysterious centuries-long "decline".