skysight-inc/HackerNews huggingface dataset:
When it comes to data, trust is key.

Think about it this way: OCZ has on paper SSDs that are simultaneously both faster and cheaper than, say, Intel. But I wouldn't put a OCZ drive into the lowest budged ricer gaming PC I could imagine (let's just say that have a bit of a reputation, to put it lightly), and I should be rightfully fired if I suggested putting one in a server.

Yes, your service might be massively faster, but... at 10-15% cheaper? No way! Not until you've been running for years with a great reputation. Now, if you enter the managed database space and pull a Digital Ocean ($5-$40 pricing vs comparable EC2 at $80-$400 AND better raw performance on top), then you can essentially create a new market niche. That's my suggestion to focus on, because businesses who operate 50TB databases aren't looking to save a few dollars. But people who use DO, need a database to go with it that is both faster and cheaper than AWS.

Honestly, performance ranks pretty low on the things I've found people look for when choosing a managed database service. You can serve a million users per day and average a whopping 12 IOPS, which might just about push a Raspberry Pi with sqlite slightly. Got more than a million users? Congrats, you now officially qualify to throw money at problems, the kind of problems RDS and Amazon loves to solve by injecting money.
Why Digital Assistants Are a Privacy Nightmare
If you can't find a job in your current location, but can find one when moving, then the increase is infinity.

There is a lot to be said for being flexible when it comes to relocation. If I had never left the town I was born in I'd probably be making 1/4th of what I make now.
The problem with SQL DBs is that they just weren't designed for distributed computation to begin with. SQL doesn't take into account CAP theorem - So it lets you write queries which work on a single machine but which cannot scale to multiple machines.

On the other hand, many NoSQL databases like MongoDB and RethinkDB have a query language which was designed to run on both single-machines and distributed infrastructure (in a homogeneous way); the same queries which work on a single machine will also work at scale on multiple machines - No need to rewrite your queries as your app grows.

You CAN scale with SQL but you have to know what queries to avoid (E.g. table joins, nested queries...) but with NoSQL, you don't have to avoid any queries; if it's in the Docs, it's safe to use.

Finally, a major difference between SQL vs NoSQL is the typed vs untyped structure. Most SQL databases were designed in a time when statically typed languages were mainstream; so it made sense for SQL databases to enforce static typing on their data.

On the other hand, NoSQL was designed in a time when dynamically typed languages where popular and gaining more popularity (E.g. Ruby, Python, JavaScript); when using these languages, having to add SQL-specific types to data feels like an unnecessary step. With NoSQL you can still enforce a schema in the application code but your schema logic doesn't have to abide by any type constraints from DB layer - Your schema is the ultimate authority on typing of your DB - If gives you the flexibility to be lazy with type-checking in the areas which are low-importance (where errors are tolerable) and strict where data type consistency is paramount.

Generally, NoSQL DBs impose constraints to query expressiveness in order to free you from architectural constraints.
SQL DBs impose few constraints on query expressiveness but because of this, they add architectural constraints to your system.
Google Keyboard just started doing that to me, and I can't figure out how to turn it off...
>Bitcoin cannot survive a majority attack.

This is true bitcoin cannot survive a majority attack. But the amount of resources needed to form a majority attack would be better used to just mine bitcoin.

Attacking the network for the sake of attacking it would be very expensive and would basically devalue BTC, which I'm assuming would remove any initial incentive.
Bitcoin IDE
Intel has the fastest processors but it doesn't have the best value for the money, in the entry level and mid level consumer market (sub-$300 range).

Concrete example: I recently built a Linux video transcoding machine to reencode H.264 BluRay movies to smaller H.264 files [1]. A $110 AMD FX-8300 is able to reencode an average BluRay movie around 47-50 fps, while you would need to spend more than twice that amount of money to match this performance with Intel (the performance of the FX-8300 at this tasks falls between a $200 Intel i5-4590 and a $250 Xeon E3-1231 v3).

[1] Using: avconv -i input.mkv -threads auto -s hd720 -c:v libx264 -c:a libmp3lame -sn -b:v 1400k -b:a 128k -ac 2 output.mkv
I would guess the discussion ends there because your fellow software engineers (myself included) don't see automation as a bad thing. Algorithms become smarter, processes more efficient, production cheaper and faster, etc. How is this worse? It's not.

Soon truck driving will be automated. This will eliminate millions of jobs. We need to figure out a system that supports people regardless of employment. We need to figure it out by yesterday.

I'm a firm believer that basic income is that system and that automation should fund it.
you totally missed the point, and i have so so so much more that you did to diagree with what you responded to here.
Um, "allegations of rape" does nothing to convince Australians that these people should get to be in Australia. This sounds rather like the issue Germany is having.
Because it's ignorant of basic facts. The median household income in the St. Louis metro area is $55k. It's $79k in the San Francisco metro, which is obviously quite a bit higher.

But you'd need to earn 159k per year in San Francisco to match the spending power of that $55k in St. Louis. And even that wouldn't be nearly enough to reach parity in home purchasing. Housing is 790% more expensive in San Francisco!

I get that it's fun to joke about flyover country, but the numbers are what they are. People simply are not struggling to move out of the house in St. Louis in the same way that they are in the Bay Area, for example.

Which is to say, once again, that there must be other factors at play.

http://www.bestplaces.net/cost-of-living/st.-louis-mo/san-fr...
It's a cool thing this guy did.. It would be interesting to see how small the files are that are generated in this process.. Just low pass filtering the video like somebody else suggested would probably achieve a similarly lossy image.
I guess what I take away from this is that maybe the way we store info in our brains looks kind of like this? Kinda fuzzy versions of the real thing?

Would be interesting if somebody one of these days can actually reconstruct to a high level of fidelity what our brain is "seeing".. I bet it would look kind of like this..
Is this the "Usage logs" option in the settings? That disables sending health data to Pebble servers as well?

Personally, if it were an option, I would like to disable sending health data but still send voice data for transcription. I can understand if you're using Google's voice recognition APIs, but IMO there's no reason the two have to be linked.
> deep into 2017

Are you anticipating major delays? January isn't very deep.
42 – The definitive answer to design, code and everything
He only trained it on Blade Runner, I think. (This is doable because a single movie has a lot of frames.) So all of the other movies should be out of sample.
Uber Rival Gett Receives $300M in Funding from Volkswagen
https://youtu.be/4vXBoTa4AQU
Uncertainty in Medicine
Nothing about this indicates that they've solved the "too expensive" part, unfortunately.
For instance, in Ohio (as "flyover" as it gets :-)) the median household income is $45,749, and the median house sales price is $135,500, or about 3x median income.

In California the median household income is $67,458, and the median house sales price is $405,000, or about 6x median income.

So no, it is not actually true that the lower housing prices in flyover states are offset by lower incomes. Housing in California is proportionally twice as expensive as it is in Ohio.
There is more demand for housing in the coastal states. So the prices are higher. People should react to expensive, high-demand housing in the same way that they react to every other type of high-demand, expensive luxury good.

Which is to say:

If you can't afford to live in a coastal state, then what you need more than anything else is a U-Haul.
I don't think that those two options are mutually exclusive, you can specialize and keep up with the times...I think you kinda need to recognize the direction the times are moving in to keep up though.
It's generally pretty obvious anyways. Perks start drying up and people start getting chastised disproportionately for mildly wasteful actions.
I would be more optimistic here. AM/Eurisko never showed any replicated results outside of one or two toy domains of simple math & the Traveler's game, and there's always been a lot of questions about how much of that much was even AM/Eurisko and how much was Lenat since he refuses to share source code and his followup project Cyc is notorious for not delivering anything. While on the other hand, deep networks have delivered astounding results on a huge variety of domains when implemented in different frameworks by different people around the world often taking quite different deep approaches. A result from AM/Eurisko doesn't mean much. A result from a deep network may be a crack in the dike which is about to explode and solve longstanding challenges like Imagenet.
A good number of people fall asleep while driving anyways. This guy was lucky that his car didn't crash when it happened...
What can be done? Building a new open-sourced layer on top of the current internet, from scratch, that's impervious to snooping and censorship by design?

There are precedents for that kind of thing here and there already, in Bittorrent, Bitcoin, Ethereum, Freenet, TOR... and as [1] said, SMTP.

[1] https://news.ycombinator.com/item?id=11766929
Sanders has described himself as a "socialist" on numerous occasions. In any case, bickering over the validity of different schemes of leftist political ontology was not the point.

The point is that OP's belief that criticizing capitalism is somehow taboo in the US is factually wrong.

Sanders indisputably roundly and frequently criticizes capitalism to anyone who will listen, and he's quite popular as a presidential candidate for exactly that reason.

A lot of leftists, particularly non-American leftists, seem to imagine the US is some sort of Ayn Randian fantasyland where everyone is rabidly pro-capitalist and any views to the contrary are self-censored as a taboo. Sanders' candidacy (among many other data points) amply falsifies this misconception.
The culture war is a great tool for dividing the disempowered and keeping economic issues off the table.
Shall the City Code be amended to repeal City Ordinance No. 20151217-075 relating to Transportation Network Companies; and replace with an ordinance that would repeal and prohibit required fingerprinting, repeal the requirement to identify the vehicle with a distinctive emblem, repeal the prohibition against loading and unloading passengers in a travel lane, and require other regulations for Transportation Network Companies?

Then there are two boxes below that. Next to one it says “For the Ordinance” and on the other, “Against the Ordinance.”

That is extremely interesting, thank you for posting that.
This is about typical for "amateur director meets clueless rich guy" projects. There are lists of movie flops, but they usually only include movies that shipped. Wikipedia has a list of unreleased films.[1] If you read the trades (Variety and The Hollywood Reporter), you can read about many other projects that started production but didn't ship.

[1] https://en.wikipedia.org/wiki/Category:Unreleased_films
What Are People Working on in Coffee Shops?
Apple rehires prominent security pro as encryption fight boils
Nowhere other than in programmers' tools would it be considered an acceptable UI architecture to layer a GUI (usually a turgid dialog box) over a CLI. Moreover the dialog gives no indication whether the inputs are correct or consistent with one another until an unhelpful error is displayed. The components of a toolchain need real APIs and real libraries implementing those APIs, designed for the kind of object-action manipulation that makes desktop productivity software productive: You can't apply the wrong action to the wrong object. The UI simply won't let you.
Alphabet's Eric Schmidt admits he's an iPhone user, but says Samsung is better
A friend's recommendation. The benefits are small but I spend a lot of time reading so the extra cost is tiny amortized.

I read 10x more paper books than eBooks (scanning is impossible on eBooks) but it's really nice to have the Kindle sometimes.
I think having multiple approaches was the key here. Worse case scenario these teams converge, but the true best case scenario is discovery of different methods to solve Google's ambitions.

In some ways, the depth of the search team needs to be replicated by their AI-research groups. As you stated, what is unclear is if the investments will be obviously lucrative (as search has been).
Absolutely. The point of an autoencoder is dimensionality reduction: boil a big set of data down to a few hundred or thousand numbers in a vector which summarizes it. You could treat it either as lossy compression and store just the encoding, or you can treat it as a hybrid format in which the autoencoder lossy encoding is then corrected to lossless by additional bits in the stream.

In practice, even the hyper-efficient compression algorithms used in something like zpaq tend to use only very small shallow predictive neural networks because no one wants to wait days for their data to be compressed or ship around big neural nets as part of their archives, so it's more of an information-theoretic curiosity. Few enough people will even use 'xz'.
How important is Judy in achieving the level of performance you reached?
Reduce the impact of the reporting. Many of the stories I read had a component of "big weekly deposits took a long time because someone would have to fill out a report" or "banks closed my account because they didn't want to fill out the reports" which lead people to do more frequent deposits or split their banking between multiple banks or pay expenses in cash. I don't think the amount triggering reporting is linked to inflation either.

I don't know what's on the form, but of you fill out once a week, there should be a way to be quick about it.
Maseno, just outside of Kisumu.
Hear Hear... these bloody Americans I tell you. Here they are getting ready to elect the Wall Builder and still pointing the finger...
Comics. This is for comics.

Marvel should partner with them.
Step 1: Poor person produces something useful, rather than simply consuming.

Step 2: ???

Step 3: Everyone is homeless?

Could you fill in step 2 for me? I'm not following your logic.
TLS1.2 for SMTP end-to-end is obviously a good thing, but it has its own problems aside from all of the crap we've been piling on top of SMTP for 20+ years (SPF, DKIM, DMARC, TLS1.2, etc) for ISP mail server operational reasons.

At some point that mail has to go into storage somewhere so it can be accessed by a user/client via IMAP, and that's where the subpoena/national security letter/warrant/FISA court request will go. To whatever location the disk storage resides at.
That's an interesting pricing model, thanks for sharing.

I guess the key to drive subscriptions would be to ensure that your data-sources were updated constantly (where appropriate). I know in the past I've struggled to handle updates to things like UK postal-codes, where additions are frequent and omissions lead to errors being presented to clients.
Hah, I got you all beat. I want an entire wall to be a display. I can set it to have wallpaper (!) of any sort. People can hike the continental divide with a gopro on their head, and I can have the wall display be the resulting video. It would be quite awesome!
There is value and demand for both approaches. For the foreseeable futures, we are going to need lots of applied mathematicians to figure out computational models that will eventually put them out of business (same as programmers ;)) Someday, but not anytime soon.
IMHO they compete on performance at that price point by throwing more electricity at the chip.
> Sounds like you're conflating GC with Java's limited type/value system.

Well, yes. It's the JVM that seems to prevent value objects, not Java per se. Since async GC will need RTTI this is going to be more general than just Java (it needs to know, given only memory adress, what the type of the object is, which means it needs at least a pointer in there (these days 8 bytes)). I also don't know any VM that really does a better job.

> In C++ minimum object size is 0 bytes.

C++ minimum object size is 1 byte (since 2 objects can't have the same address).

> Boxed primitives are actual Java objects.

I should have been clearer : I meant classes with fields, as apparently a class with a single int is bigger than a boxed Integer in the JVM.
That particular voiceover is from the theatrical trailer, it wasn't in any of the 125050123.07 versions of the movie. You can see it here:

https://www.youtube.com/watch?v=4lW0F1sccqk
There's also the power cost, depending on how much you're running that... went from an 8350 to an i7-4790K early last year, the power cost difference is pretty significant.
As I understand it, the main result of the paper relies on these 4 assumptions:

- That the dimensionality of the output of the network is smaller than that of the input. That is usually the case in image recognition, where the image is width x height x channels dimensional, while the output is usually a much smaller number of label-wise probabilities. It probably isn't the case when you generate data from some smaller representation, e.g. with autoencoders, image generation, etc.

- That the input data is decorrelated, and that the input data is uncorrelated with the output ground truth. The former can easily be obtained via a whitening transformation in many cases in practice. I am not quite sure about the latter.

- That whether a connection in the network is activated or not is random with the same probability of success across the network. Active means the ReLU activation function has output greater than 0. Many people initialize weights in the network with some 0-mean random variable and some constant bias, in which case that assumption should hold true at the beginning of training. Whether that assumption holds throughout training could easily be verified empirically - i.e. by monitoring the network's activation.

- That the network activations are independent of the input, the weights and each other. That's obviously not completely true - the network activations of a given layer are a function of the previous layer's activations and weights, and ultimately of the input in the first layer. With large enough networks, this may hold sufficiently in practice - any single activation should not depend very significantly on any other single variable.

I may have missed something in interpreting the maths, any comment is appreciated. From a practical standpoint, especially for computer vision, these assumptions seem quite reasonable. I am not qualified however to comment on the proof of this result, so I would wait on peer review. Still, it is heartening to see the theory of deep learning finally catching up with practice!
> Overtime and wage increases are not going to help people who don't have jobs

Did you miss this bit, or do you not believe it?

>> Goldman Sachs says this will add 100,000 jobs, as employers try to avoid paying time and a half for overtime.[2]
Stewart Baker's quote from the article is so disingenuous: “This is a Silicon Valley delusion that the government wants to outlaw encryption,”

If you replace "encryption" with "secure encryption", that's absolutely what's being proposed.
Well, maybe 1.5 the salary, but I bet total comp at Google in SF is way more than 1.5x best Ohio employers. But there is also California weather and NY culture that account for part of the cost of living premium. Don't think that has any value ? Great for you, you can live in Decatur. Ilinois.
We should. And replace it with universal basic income.

Also: GP makes an excellent point, which I should have thought of myself.
I don't know about Magazines and newspapers, that feels like it might be underestimating the price for quite a bit, for quite a while.

For much longer battery life on tablets / phones / ireaders however, this could be huge.
Thanks for the background info, very helpful. How has on-prem install gone for you guys ? There was an article on HN yesterday suggesting it was a royal PITA (for ops and support), would be interesting to hear about your experience.

Also FYI, your homepage has a 2015 copyright notice on it. No big deal, but thought you might like to know since it could put off particularly "nit picky" types of customer :)
Build Your Own Video-Rate 2-photon Microscope
Programming in colorForth¹ outside?

¹https://en.wikipedia.org/wiki/ColorForth
I think that (given a supported motherboard) being able to access ECC ram is a bigger thing... AMD on ASUS can do ECC at a price point much better than Xeon. Power usage is another issue though.
Well, then Sanders is wrong. Socialism is state ownership of "the means of production". Socialism is planned economy. Socialism is the USSR. Sanders' criticism of capitalism can be entirely adequately paraphrased as "the safety net is inadequate". Americans (and pretty much all Westerners) are generally uniformly pro-capitalist. A debate over the extent to which the present capitalist system should be regulated is being presented as a debate over whether or not a capitalist system should be practiced at all. It's nonsense. Regulated capitalism is a fait accompli and no one is challenging it because it works.
I assume he's looking for an open-source option for Microsoft Windows. OSX and Linux is largely "solved". The Microsoft stack is less so after TrueCrypt's downfall.
Ah the fun of TECO where it was standard practice to type your name into the buffer and hit 'esc' (start program for TECO) just to see what it would do.
Everyone should try PostgreSQL with hstore (and JSONB now, too!).

This is a key/value store inside an RDBMS that just works, and it works great!

I converted a crappy sloppy super messy 1000+ column main table in a ~800GB database to use hstore, it was, in real world benchmarks, between 7x and 10,000x (yes, really, ten thousand times) faster.

The CEO of the company who had a technical say in everything, and was very proud of his schema "wasn't excited" and it never happened in any production instance.

I've left since then, and the company has made very little advancement, especially when it comes to their database.

Really, just use hstore. Try it out. The syntax is goofy, but... I mean, SQL itself is a little bit goofy, right?
Hie much do you think it costs to live in far parts of Brooklyn? Relatively little. Yet you are 1 hr away from the heart of NYC
I've owned three homes and never taken the mortgage interest deduction. The historical reason is based on 20% down mortgages for less-than-2x-annual-income housing. That's clearly not much the case any longer. Now it's expected by the NAR and the general real estate industrial complex.
Android coming to Raspberry Pi 3
William F Buckley advocated for forcibly tattooing people? I guess he really was a crypto-Nazi after all.
Those of us born in coastal states might have an issue with that. Affluence and gentrification destroy the character of interesting communities. Careless indifference deserves no place here.
This is a really good analysis, and part of a good series. My suggestion: resubmit it following HN's (somewhat hidden) guidelines: emailing hn@ycombinator.com as a notice seems generally to help.