skysight-inc/HackerNews huggingface dataset:
> But this would have been totally disastrous under any type of serious load. Even if I would have simplified the above query to only include three conditions/sorting operations, it would have been disastrous. Why? Because this is not how a database is supposed to be used. A database should query only on one index at a time, which is impossible with these geospatial queries.

> On the database side, I separate the snaps into a few different collections: all snaps, most liked snaps, newest snaps, newest valid snaps and so forth.

Pardon my ignorance, but don't most databases have some method of handling these issues?

(defining multiple indexes for use, having support for geospatial data, having support for like, subsections of the existing dataset, etc?)

I thought that the main goal was to offload the developer's code's logic onto the performant database, as opposed to offloading the database's logic and caching onto the developer's code? is the former not practical?
Much of humanity has no access to what you are talking about. Without torrents and sharing most of humanity will have no experience of Game Of Thrones.
The science of finding the bomb is inherently neutral to how or even whether the bomb should be defused. To stretch the analogy, the science to find a bomb in a kinder garden is the same to find a bomb in the basement of a building about to be demolished.

Or slightly more analogous to climate science: OK, so you've found the bomb. But there are 19 different ways of trying to defuse it and/or limit the impact of it exploding, including just evacuating the area and letting it blow. Bomb-science might tell us something about what either option is likely to result in, but it probably intersects heavily with a lot of other fields in doing so, and there will still be inherently non-scientific trade-offs to be made at the end of the day (do you send in three bomb-technicians with a 70% chance of defusing/30% chance of getting blown up to save a $10m building? Or do you send in a robot with a 60% chance of success? What if it's a $1m building? What if it's a power plant and 100,000 people and a hospital depend on it? etc etc).
Show HN: Pedant: Linting for English texts
I think the person you are replying to will disagree that it is "breaking" the language.
Return of the Pokémon Fatwa in Saudi Arabia
Awesome feedback!

So far, it's the user who would need to decide which document goes to which parser. A routing engine is however on our list and probably be one of the next features to add.

Regarding the stats, I'm not sure yet as we just launched. OCR was however one of the first things early users asked for.

For the 'unpaper' function we are using http://manpages.ubuntu.com/manpages/trusty/man1/unpaper.1.ht...

I would love to discuss things more in detail with you. Could you contact me contact [at] docparser.com please?
Now that's KickAssTorrents is dead, what alternatives are there?
Show HN: Event Alley – Event Management and Booking System
Having to work with unstructured datatypes in Postgres and other RDBMS products was quite hard a few years back, now with hstore and JSONB in Postgres this has gotten much better but it still feels a bit unnatural.
When we started the Raijin database project (http://raijindb.com) one of the goals was to make it possible to treat these extra attributes (that you would shove into JSONB with postgres) as normal "columns" so you can do this:

CREATE TABLE tbl(eventtime datetime);
INSERT INTO tbl {"eventtime":"2016-07-20 10:37:12","foo":"bar","whatever":"xx"};
INSERT INTO tbl {"eventtime":"2016-07-20 10:38:22","foo":"bar2","intfield":42};
SELECT foo, intfield FROM tbl;
--
{"foo":"bar","intfield":null}
{"foo":"bar2","intfield":42}

It won't complain about the missing 'columns'.

Anyway, glad to see that Postgres is steadily making progress in this area.
> I couldn't agree more. Martin Fowler warned us a long time ago : "The first rule of distributed objects : don't distribute them".

Funny that now the same person carries the flag with the symbol of microservices, which are seen as a way to "get rid of architects". That's exactly what Thoughtworks believes in - and you will understand more if you read the first chapters of the book "Building Microservices", or if you join their recent conferences. Just my 2 cents.
Florida police shoot black man lying down with arms in air
That it took that long, yes, I agree. Imagine how pissy the world would be if the US banned any competing internet services that were not headquartered within its borders.
I guess they mean innovation in the business sense rather than the technical sense. I.e., finding new web-based business models.
Not read TFA, but in my country (Western Europe) there's so much talk of how in the future we're going to live off our ideas and innovation, not manufacturing, and there always seems to be this.. underlying... thing that the people who run the factories don't have any ideas of their own. So we're going to sit here and think up brilliant things, and send them off to a land of smoke stacks and cheap labour to be made. And I just don't see how that system could ever be anything other than temporary. After we've outsourced all the dirty work, when would the expertise out there not insource the thinking work and cut me out? I would if I was them.

(And honestly it is very hard to ignore the colonialist undertones of this thinking)
I admire what Tesla has been able to achieve from a technological and a marketing point of view but I wouldn't call their business "fundamentally solid". Tesla stock has been one of the most heavily shorted equities for some time and it's because their balance sheet is a train wreck while their valuation is sky-high. Tesla burns cash at a phenomenal rate and regularly has to take on debt and / or raise new capital through equity offerings in order to stay in business. Of course they have to invest in the future- automobile manufacturing is a highly competitive, extremely capital intensive business and every OEM (Ford, GM, Toyota, Volkswagen,..) has to regularly invest huge sums of money in staying relevant. Tesla is no different in that regard.
PopcornTime is alive and kicking. Actually 2 of them popped up after the demise of the first one.
Normal software libraries also have sharp boundaries with clear interfaces. Why use shitty RPC-over-HTTP? At the very least you can use something sane like Thrift.
Zambra's Engaging 'Multiple Choice' Turns Testing into a Narrative Tool
You have to think forward to understand Musk.

Which would you prefer? Going at 100 km/h with autopilot on today's highways, sharing the road with people without autopilot, or going at 250 km/h with autopilot on a highway where everyone else is also on autopilot?

We will have to follow a likely tortuous path to get from now to then, but I am totally convinced we will get there.
Duplicated posts? I guess this could be merged with https://news.ycombinator.com/item?id=12135840 - both are presently on the front-page :|
I totally see what you're saying; and when I started freelancing I thought the same way. But the longer I played the game, the more I noticed an inverse correlation between the success of freelancers, and their perceived accessibility. It' much like hedge-fund managers, or attorneys, or personal trainers, any other bespoke service provider. The folks with very little information, who are hard to reach, and who will only take a meeting if you're referred by someone in their circle, those are the ones who (in my experience) are making the most money.

It's a bit like perceived scarcity. Building a flashy portfolio website really only says two things: "I have free time on my hands", and "My demand is so low I have to put effort into advertising". Sure, if you're just getting started, that might be the brand you wanna build. But as you gain momentum, having less of a public brand is often better for business than having more.

It's counter-intuitive, I know; and maybe my experience was colored by the freelancers I happened to know at the time. But it convinced me enough that I took down my website while I was freelancing full time, I only put it back up after I quit, (to use as a resume to get full time job.) Removing my online presence did wonders for my business, and that's why I recommend it.
I don't disagree with anything you've said in that post. I just disagree that it should apply to someone else's copy.
Chalk another win up to capitalism. high fives all around
according to my work, anything above 10rps is fine.
> Chinese have not innovated yet in anything in the present day.

Really? Because it seems to me that Facebook Messenger is now copying WeChat.
Blocking Facebook and Google may have been brutalist censorship at first. But as a policy for encouraging innovation it is pure genius.

Will be interesting to see when/if some of the Chinese social networks become popular outside China.
Chinese companies are certainly innovating and they are picking up R&D teams anywhere on the planet.

For example you have Andrew Ng as Chief Scientist at Baidu Research in Silicon Valley even though Baidu pretty much only operates solely in the Chinese market.
> The education teaches you submission and Confucian values, not risk taking and disruption

It's not the education alone that makes people risk averse, but the culture in general in Chinese and South Asians. It's changing for good though.

Also, enough of bashing their government. A good democracy would have been great, but as you said it's working for them and that's what all matters. There are many psuedo democracies across the world where people still live in poverty.
That's what the rest of the industry refer to as autonomous emergency braking with pedestrian detection. It's a few years old now, there's been some vague talk of eventually making it mandatory, and you don't have to automate normal driving in any way to get the safety benefits from it. (In fact, I suspect it's probably better if it's not part of Autopilot, since then there's going to less risk of the driver not paying attention in the first place.)
I see this sort of argument a lot and I don't know how true it is.

Is it /really/ true that the best contributors are so sensitive? In my experience, these days it's actually the worst contributors or those who contribute not at all who are the most sensitive and liable to throw in the towel.

I'm sympathetic to your view but there is another risk that by overmoderating or catering to the most sensitive of contributors, HN will be left with non-interesting content, or controversial opinions will be silenced.
> However the failure of GoChat is not relevant to Pokemon Go.

That part is almost right, but also a little confused.

He built GoSnaps, which is a geo-enabled gallery with: No chat, few messages, few writers, many readers, medium amount of reads, large messages, not time-dependent. (Not even user state.)

Then he contrasts that to the failure of GoChat, which is a geo-enabled chat with: Many-to-many chat, many messages, many writers, many readers, many read operations, small messages, very time-dependent.

The performance profile between these two things is wildly different and the way he's patting himself on the back over what amounts to half knowledge is pretty disgusting.
It's still brutal censorship even now
Switzerland has horrendous data retention laws that just got even worse. Providers and services are forced to keep all user data for 2 years available for the state to access it

So what you gain in privacy vs private entities you lose with regards to the state having complete access to all of your online life.
Yeah, I don't get it either. Even without geospatial features its not too hard to put an index on (lat, lng) and then run a between query for the 4 given coordinates taking the minimum and maximum of those 4 latitudes and longitudes. Need to also sort by likes/abuse reports? Add those to composite (compound) index too.

No need to manage separate collections.
This is awesome. I can't count the number of times I've found an Android function that has almost no documentation. I usually post a question and answer on SO if I work out how it works.

I only wish it were organised a bit more like normal documentation - i.e. into classes and methods. Might make it easier to find things.
That's exactly what I thought. Mentioning those products was useless and they gave way too much about details about that. It felt like the same product placement of the movies.
That's just false, amazon just announced profit for 20015 & q1 20016
Our company migrated to elixir 2 months ago. We have 2M users per server at $20/month.
Sounds likely.
Remind me- is Tesla a for-profit corporation or are they a non-profit organization? Making a profit is sort of the main point, though obviously not the only point. They've been around since 2003 so it's not like they're a scrappy Y-Combinator incubator company.
"Sadly very good drivers die every day and not only because of someone else's mistake."

Indeed, and that may often be because of taking warranted risks. It bothers me that when making comparisons of driving safety people tend to suffer from absence blindness and discount other important things like the death avoidance cases. Let's say you have a bleeding injured person which requires urgent access to a medical facility. Here the driver can take some risks in order to save a life. Or any number of causes that may warrant risk taking. Now, take away the control from that driver and leave it to an autopilot that may compute the driving parameters in order to satisfy minimum pollution, safety (from the manufacturer's judicial liabilities prospective), and whatnot. Heck, I foresee cases when the autopilot won't even approve any movement due to whatever considerations when there may be passengers in risk of loosing their lives if won't reach somewhere soon enough. For now people can take risks, which may be both good and bad. Don't look only at the bad side.
I don't know about the microservices and stuff, but I've got one cumbersome monolith to deal with, and it had started to rot (you know, rely on outdated dependencies that one can't upgrade without significant effort etc etc). Splitting it to a few isolated different systems looked like the only sane choice.

Luckily, I've had to redo one logical part of the monolith anyway, because of some changing business requirements. So I made it a separate independent project, that had used all the modern currently-stable tech (rather than few-years-old one + accumulated baggage of the past architectural mistakes) and it all went quite nicely.

It took me 1.5 weeks (quite busy ones, but meh) to extract all the old code pieces that I've needed, clean them up, update with the new logic, and get the freshly-minted project ready, tested, packaged up and running in production. The only thing I've lost is ability to run cross-db queries (we just have a folder of read-only SQL query snippets to fetch some useful statistics once a week or so), because I put the data in a separate database. I hope, postgres_fdw would work when I'll need it.

Would I've tried to update the whole monolith, it would've taken me months.

So, the next time I'll work on some large-enough part, I'll probably extract it into a fresh project as well. As I see it, I'll end up with a remains of legacy project surrounded by a few small(er) monoliths. And then the legacy piece would be small enough to get cleaned up.

(I don't know about micro- scale and putting every tiny thing into a different microservice, though. I have an impression it requires a lot of extra unwanted cognitive load to manage so seems like an overkill to me.)

So, my point is: software (code) rots over time. Multiple projects (services) allow to update pieces at different pace, which is less stressful on developers.
Huh, thanks! That's completely surprising to me.

Edit: ah ok, a semi-algorithm that just tries all possible programs...
Does healthcare need a fix?
Ahead of Elixir on the chart, to my surprise, pleasantly.
The state-of-art deep learning model, RestNets, is invented by local Chinese team.

China is apparently still in catching-up mode. However, I won't go too far to say Chinese people cannot innovate at all, which we all know is not true.
https://nikolamotor.com/one
Maybe your issue should be with the online store who sold you a bad key? I don't see what microsoft has to do with this.

The police coming to take away a stolen macbook after you buy it from a dodgy site is going to make you mad at apple?
> The education teaches you submission and Confucian values, not risk taking and disruption.

That is extremely stereotypical thinking. This is like saying that American education teaches you to be obedient consumer who thinks he is precious snowflake.

It's different culture and innovation is takes different forms.
New Spaceknow Africa Night Light Index Now on Bloomberg Terminal
Chinese MIG28 drone flying at night with LED lights
Isn't that exactly his point though? That the main innovation with GPL would be unenforceable without copyright.
I wonder if they've been holding out on this until after the Google vs Oracle Android/Java API stuff?

My gut feel is this could fall under the same sort of arguments as they are effectively re-documenting other peoples APIs
Singleton HttpClient? Beware of this serious behaviour and how to fix it
I am new to CNNs/machine learning, but here's my $0.02:
Regardless of which technique you use, it seems that the amount of data required to learn is too high. This article talks about neural networks accessing billions of photographs, a number which is nowhere near the number of photos/objects/whatever a human sees in a lifetime. Which leads me to the conclusion that we aren't extracting much information from the data. These techniques aren't able to calculate how the same object might look under different lighting conditions, different viewing angles, positions, sizes, and so on. Instead, companies just use millions of images to 'encode' the variations into their networks.

Imo there should be a push towards adapting CNNs to calculate/predict how the object might look under different conditions, which might lead to other improvements. This could also be extended to areas other than image recognition.
Wow the report that I published was cited in the letter! Kinda cool!

Two questions:

1. How did Congress get our note?
2. Why is Congress spending time doing this?
Why not start with the assumption that everyone is an activist?

If I am a scientist, an I have a choice of paths to explore but cannot explore them all at the same time, then there are many things which may guide my decision making, including expectations of recognition and better employment. That is personal activism, yes? And that's because several hundred years ago scientists decided that "first to publish" was the best way to couple scientific advancement with the desire for personal advancement.

If I submit a proposal to a funding source, or a rare resource like the HST, I need to convince them that the science I'm doing is worthwhile. That's activism, yes?

Even then, you've left out "passivism", which might not be a word but I think it gives the intent.

If Exxon scientists do research in the 1980s which concludes that fossil fuel use leads to global warming, and decide to not publish, is that activism? For another real-world example, if a scientist wants to study "Untreated Syphilis in the Negro Male", and doesn't tell the participants that penicillin could now treat the disease, and those men end up suffering and dying though the willful passivism of the scientist, who is more interested in the science of what happens than the morality, is that "activism"?

On the flip side, how do I conduct research to test if advertisement for flu shots is an effective way to reduce flu deaths without some sort of "activism"?

I also don't like your use of the term "politics". I prefer "ethics", where politics is an applied form of ethics.

That's why I don't like your majoritarian definition of what "government" means. Ethics can lead someone to break the law, and later even be praised for doing so. See Thoreau's "Civil Disobedience" and the many people who followed that principle. Or even further back in time, and to quote de Tocqueville's "Tyranny of the Majority":

> "If it be admitted that a man possessing absolute power may misuse that power by wronging his adversaries, why should not a majority be liable to the same reproach? Men do not change their characters by uniting with one another; nor does their patience in the presence of obstacles increase with their strength. For my own part, I cannot believe it; the power to do everything, which I should refuse to one of my equals, I will never grant to any number of them."

You correctly point out "we don't have a priestly class to make wise decisions" but you uncoupled that from the military. Even in the military, some orders and laws must not be followed, as Nuremburg Priniciple IV:

> "The fact that a person acted pursuant to order of his Government or of a superior does not relieve him from responsibility under international law, provided a moral choice was in fact possible to him".

An Earth-killing asteroid will lead to genocide as a side-effect. The moral choice, if possible, is to prevent genocide. Even if 51.9% of the U.S. votes to die. One's right to commit suicide does not justify genocide.
10 Tactics to Design Effective Contact-Us Page
They have basically a single source of revenue AFAIK which is selling cars. They sell X amount of cars per year making $Y. They don't turn a profit. Last year they lost close to $1B mostly because of their R&D costs. They need to either sell more cars (assuming that they can make money per additional unit like they say they can) or charge more for the ones they do sell, or both. Fortunately they are expected by investors to follow the Amazon model so they can get away with it for the foreseeable future.
Even with US companies in China following all the rules, the US still is unable to beat Chinese companies. This is the real issue, and it's the US companies fault that they can't be innovative enough to figure out the Chinese market. All I see is a lack of innovation on the part of the US; hell, the great fire wall is innovative.
The only thing I can share is my experience with Thinkpad E130. I've got it for about 3years and I'm really happy about how it's working with Arch Linux. I remember I had a little problem with installing bootloader (EFI), but now everything's fine except SD card reader (but I've read that there is alternative driver to fix this).

It's totally enough for everything I do: web, movies (OK, very high quality happens to be a problem), music, programming, photo/video editing and even games (Half Life 2, Civilization V and Oblivion are level expected to work very well on high details). I don't know how It would manage with full blown KDE/GNOME desktop though (I prefer terminal+tiling WM). If you don't mind small size (I love it) I recommend it. Really the only thing that doesn't work well is that for some reason shutdown works like reboot so you have to turn of using power button, but who cares If you usualy just swith to the sleep mode.
iOS 10 UI Kit for Sketch – Free fully customizable screens
>what’s more revealing is how Chinese firms have taken the best tech and adapted it.

Only felt like skimming the article but it seems that quote is at its base. There's a difference between "adapting" other people's work and "innovation". There is also a difference between manufacturing products and creating the original idea for those products and making them.