skysight-inc/HackerNews huggingface dataset:
Kind of depends on what the 10 GB is. For example, on my project, we started on files that were about 10 GB a day. The old system took 9 hours to enhance the data (add columns from other sources based on simple joins). So we did it with Hadoop on two Solaris boxes (18 virtual cores between them). Same data; 45 minutes. But wait there's more.

We then created a two fraud models that took that 10+ GB file (enhancement added about 10%) and executed within about 30 minutes a piece. But concurrently. All on Hadoop. All on arguably terrible hardware. Folks at Twitter and Facebook had never though about using Solaris.

We've continued this pattern. We've switched tooling from Pig to Cascading because Cascading works in the small (your PC without a cluster) and in the large. It's testable with JUnit in a timely manner (looking at you PigUnit). Now we have some 70 fraud models chewing over anywhere from that 10+ GB daily file set to 3 TB. All this in our little 50 node cluster. All within about 14 hours. Total processed data is about 50 TB a day.

As pointed out earlier, Hadoop provides an efficient, scalable, easy distributed application development platform. Cascading makes life very Unix-like (pipes and filters and aggregators). This coupled with a fully async eventing pipe line for workflows built on RabbitMQ makes for an infinitely expandable fraud detection system.

Since all processors communicate only through events and HDFS, we add new fraud models without necessarily dropping the entire system. New models may arrive daily, conform to a set structure, and are literally self-installed from a zip file within about 1 minute.

We used the same event + Hadoop architecture to add claim line edits. These are different from fraud models in that fraud models calculate multiple complex attributes then apply a heuristic to the claim lines. Edits look at a smaller operation scope. But in cascading this is pipe from HDFS -> filter for interesting claim lines -> buffer for denials -> pipe to HDFS output location.

Simple, scalable, logical, improvable, testable. I've seen all of these. As the community comes out with new tools, we get more options. My team is working on machine learning and graphs. Mahout and Giraph. Hard to do all of this easily with a home grown data processing system.

As always, research your needs. Don't get caught up in the hype of a new trend. Don't be closed minded either.
Huh, what??

Have you listened to Trump? He has stated, in as many words, that we should go into Iraq and "take the oil". He's advocated our involvement in other issues. He's repeatedly suggested the use of nuclear weapons to deal with current conflicts.

How is this not a textbook example of "overseas aggressiveness that ... angers other nations"?
Although it was the CIA=led coup of the democratically elected government that led conditions to go so extreme with the Islamic Republic and Anti-Western sentiments
Yeah I have Basilisk II running MacOS 8.1 that a friend of mine had to recompile because the libraries they used for it are out of date. It has IE 4.0 but the certificates have expired so it won't load most websites. Nobody seems to be targeting the older PowerMacs for Web Browsers and other Internet apps.

I used to use it for safe web browsing because Windows viruses don't infect it and the web browser is so old it won't run the new stuff for the latest version of IE.
Chuwi Hi10 Pro mini review: An affordable Windows 10 2-in-1
Volvo is in a much better position. They're going live with 100 human drivers next year, actual customers, not employees, with drivers not required to have their hands on the wheel.[1] This will be enabled only for well-mapped roads in Gothenburg, but they're not all freeways. Volvo's CEO has publicly taken the position that if there's a crash in auto mode, it's Volvo's fault.

Volvo uses four cameras (one of which is a trifocal 3D unit), four radars, one LIDAR, and 12 ultrasonic sensors. That's a reasonable sensor suite for this. Tesla has one camera, one radar, and some ultrasonic sensors. Not enough.

Volvo is also way ahead on self-driving car commercials.[2]

[1] http://www.volvocars.com/intl/about/our-innovation-brands/in...
[2] https://www.youtube.com/watch?v=bJwKuWz_lkE
> If I'm paying attention and I prevent Autopilot from getting me into an accident, why have it on in the first place?

Because it takes less mental effort to watch for the exception case rather than constantly adjusting speed/heading/etc.

Also something that's rarely mentioned is that in it's current form AP's killer-feature is rush hour traffic. In those situations you're dealing with <20 MPH and tends to be the most mentally taxing.

In my small sample set(~30k AP miles) I've found the mental load for driving long distances and rush hour traffic to be significantly less.
Didn't read it lately but Consilience by W.O Wilson (Nobel Prize winner) is definitely worth a look if you're not too distressed by having your sacred cows butchered.
and if you can hack one machine, you probably can hack many since there is probably many exact same models in circulation
Announcing NativeScript Code Samples
Love it! A few suggestions...

- Set your Fb app to production so people can share on Facebook; currently shows error about dev mode

- Maybe increase the transparency of the tiles; people often like to focus on their home country on a map; would make it easier

- Add help tooltips over the navigation so it's easier to tell what each button does

Thanks for creating this!
This guy "Lucky Keizer" made a 5l v-twin motorbike from a Merlin engine.

http://www.abc.net.au/local/photos/2015/08/19/4296075.htm

I saw it live once, unfortunately he couldn't start it.
I suspect it's a frequent problem.
I upvoted this for the title alone. Classic!
Then you have an ownership loop.
I don't see how it works. Just world certainly does not contradict suicide. A lot of suicide is driven by either mental or physical suffering, and nobody who in not 5 year old doubts that suffering exists in the world, and a lot of it. We certainly hope it won't happen to us, but I don't think anybody denies that it does happen around us.

So while I agree that american culture has misguided attitude on suicide, I don't think your explanation works.
Don't even get me started on memoization...
I've wondered if dolphins speak to each other (assuming that they do) in a serial flow of abstract symbols-- words, like we do, or if they use their sonar to project 3-D 'holograms' of objects and shapes to each other.

Maybe even both. What a wonderful day when we crack the code.
Looks like it still is encountering problems, I get a 403 error from London an ny. Might be cloudflare blocking it?
Lifelogging is dead for now
It's less of 'will they put a bullet in you' and more of 'Iran is the worlds greatest expert in the development and use of IEDs explicitly designed to maim and murder American forces, as in they have engineering staff embedded with insurgent groups teaching new ways of piercing American armored personnel carriers.'
Great ideas - I'll add them to the list and work on them this week. Thank you!
i think you are confusing trademarks and patents
Could be - hopefully OP will elaborate.
Any specific format/information you are interested in? We are using AI heavily on our platform to improve urban living. I would be willing to share to my best knowledge.
Has Wolfram's "new kind of science" led to any predictions of natural phenomena in the 15 years or so since his book appeared? This is usually how we decide if a physical theory is interesting. Generating patterns that look like natural phenomena that we already know about doesn't count.
I regret that I have but one up vote to give
Were you in Iran and saw it in person, or through so source?
> So she worked on freeing fascist aristocrats.

Better fascists than communists.
Think about it, someone who owes $50,000 and is making minimum payments every month is a lot more likely to default on a loan than someone who borrows a few hundred a month once in a while.

If you want to see your real Experian FICO 8 credit score for free you can do so at freecreditreport.com which is a site now owned by Experian. They break down each part of your credit score and grade you on each. (A-F)
Israel has an outsized role in US politics for reasons that have nothing to do with oil. In fact the US ability to maneuver in the Middle East would have been significantly less constrained with oil producing countries if Israel wasn't an ally.

The US was initially a reluctant ally with Israel. The Soviet Union was actively arming Israel's Arab neighbors and fanning the flames of war to win influence with oil producing Arab states. At the same time the US had embargoes on selling arms to Israel because it was reluctant to fan the flames of war and also to antagonize Israel's Arab neighbors.

Unbeknownst to the US Israel had developed a nuclear weapons capability and at the start of the Six Day war Israel felt threatened enough to deploy them. In what must have been an interesting phone call Israel informed the US both of their nuclear weapons capability and that they were going to nuke Cairo. In order to dissuade Israel from this course of action the US promised swift delivery of modern anti-tank weapons and depleted their Western European inventory of these weapons. This helped turn the tide of the conflict and reduce potential of a nuclear exhange in the Middle East.

The result of the Six Day War was that the US committed to keeping Israel at par with its Arab neighbors conventional military capabilities if Israel would keep its nuclear capability in check.

A great writeup of the history is here:

http://www.au.af.mil/au/awc/awcgate/cpc-pubs/farr.htm

This still plays an active role in the US and Israeli relationship and was even a factor in the negotiations over the Iranian nuclear program but the nuances are rarely picked up by the US press.

Israel also plays an outsized role in US politics because it is an influential issue with Jewish voters and also, oddly, Evangelicals. Evangelicals see the establishment of a Jewish State in Israel as a prerequisite to the rapture and the Second Coming of Jesus Christ.

Great article on how the delicate compromises in the Middle East were almost toppled by a cow:

http://www.pbs.org/wgbh/pages/frontline/shows/apocalypse/rea...
I'm not an expert, but the memory required to render the seemingly simplest of interfaces in html/js/css in a browser today seems excessive. Some web sites bring a reasonably powered desktop to its knees. I'm not sure I want this problem on my desktop too. Though I guess this is just one step closer to having METAL. https://www.destroyallsoftware.com/talks/the-birth-and-death...
Flights API
Im starting to build a website for searching flight tickets.
Any recommendation for a good, cheap (or even better, free) API to use?
The review’s author claims that in the decade following it’s publication, neither the book nor Wolfram have made any contribution to the field.
Actually, I have another project (in progress), which is a collection of curated blogposts. The name is http://www.bestprogrammingbooks.com

It's mostly books I like, and books I've read, but it's current revenue comes from Amazon affiliates. I know affiliates are often frowned upon, but I do my best to not recommend anything crap ;)
"Your graphics card does not seem to support WebGL".

I've never failed to run WebGL before. Using chrome on mac.
If tired of Rust, you might try Crystal:

https://crystal-lang.org/

https://github.com/veelenga/awesome-crystal
> To help keep our employees happy (and to be competitive with bigger companies when recruiting), we try to get as close as possible to big-company salaries, we don't expect anything beyond 40 hrs / week, 100% paid health benefits, 401k, 25 paid days off per year, snacks, food, full financial transparency, etc.

These sound reasonable.

Quick question - has anyone you tried to recruit walk away because you mentioned the 40hr/week expectation?
Haha, I totally agree. Reminds me of this: http://www.willa.me/2013/11/the-six-most-common-species-of-c...
> then a new company could make a ton of money by correcting those bad assumptions and giving out loans to people who can't get them otherwise.

This quite literally happens already.
I agree. I got along fine with the Iranians in school. The Saudis were lazy and worthless.
Wouldn't a minimalist implementation just look up shortened URLs in a map and spit out a redirect to the original URL? Seems like that could be done in a few KiB.
If you quintuple the number of Tesla kilometres per year but only triple its safety, you will still have more injuries and fatalities.

For every Tesla that is now able to recognise a truck cutting across a highway and brakes in time to avoid a fatal collision you will have new bizarre scenarios like following behind a truck that dislodges overhead objects, which a human would have avoided but a Tesla's computer didn't see, leading to a human getting crushed by a bridge falling down.

I would also expect a short learning curve for Teslas to acknowledge the emergency stop water curtain signs.

But the short version is yes, SDC will result in more deaths even though they get relatively safer and safer.

https://youtu.be/NoTMC-uxJoo
That wasn't a literalism. Of course I'm aware of the use of IEDs as a contrast to the traditional firefight.

But saying that forces on the ground are the best and most objective at assessing who is in the right and the wrong in these conflicts, who is 'good' and 'bad' is simply farcical, because all of the indoctrination and (indeed necessary) biases ("identify this person/group as bad, as they are a direct threat to my life, even though their overarching motivations may be the most noble") warp their perspective.
"Data and Goliath: The Hidden Battles to Collect Your Data and Control Your World"
It was a bit over the top but I'd recommend reading it anyway.
I explain it the same way I explain the 2003 U.S. invasion of Iraq: a complete farce perpetrated by the government on its people. It's also the same way I will explain the election of Trump to children.
Just to be clear/pedantic:

If I offered you a $100,000 car for $2000, your first instinct would be to see if you could get it cheaper?
That's odd - same sort of configuration as me (Chrome 51 on a pretty old iMac)

Fairly recent version of Chrome I presume? Other WebGL apps still run ok?
It's almost sad to think how history will peg GWB as the best US President in the first quarter of the 21st century.
Here's one I read recently that I thought was very good in it's simple wisdom. http://sethgodin.typepad.com/seths_blog/2016/09/make-somethi...
If only the NSA was that clever.
> The Arabs had great/ancient civilizations too. The whole region is rife with rich history.

Though a lot of the other people surrounding Arabia (Persians, Byzantines in Syria) had great civilizations the Arabs themselves didn't have a much of a civilization. Most of the Islamic civilization comes from Persia after the fall of the Sassanid empire.
Yeah you're sort of out of the loop. The majority of the community believes that "a manual override is necessary every now and then on the path to building autonomous robots"

It's a platform in development, and it's made huge strides in security and governance since the hack.
No not really it would just make the bay area housing bubble burst won't really affect the country
> In my small sample set(~30k AP miles) I've found the mental load for driving long distances and rush hour traffic to be significantly less.

Interesting---how did you measure this?
Incremental steps. They will move past whitelisting in time.

Note that humans use whitelisting too, to the point that they do not notice when a stop sign has been defaced or converted to a "give way".
And this is a pretty damn good classic.
http://sethgodin.typepad.com/seths_blog/2009/06/you-matter.h...
Completely agree---it could also make for a very lucrative consulting business.
>the former is perhaps more tenable when one doesn't live in the world's largest and densest open-air prison

The open air prison is more of a reaction to an already bad situation.

Hamas doesn't want a 2 state solution, actually no Palestinian faction wants a 2 state solution.

The PA wants a Palestinian state clear of all Jews, not Israelis but Jews.

And another state where all of the Palestinian refugees which were not allowed to gain refugee status by the Arab League (hence UNRWA and not the UNHCR) would have the right of return.

Effectively the 2 state solution as it's currently envisioned would mean either a true Aparthide state or no more Jewish state.

You can call Gaza an open air prison, but you also need to remember that about 100,000 rockets and mortars have been fired from it at the Israeli civilian population.

When Egypt and Jordan controlled Gaza and the WB the Palestinian liberation agenda was focused on the territory Israel controlled, now it's shifted towards the territory that have been lost to Israel but by all accounts the end goal has never changed.

Blaming Israel for this entire situation is satirical, they are too blame but their core offense is their existence not any specific action or policy.

If there to be peace it needs to start with normalization of relations, the Palestinians in Jordan and Lebanon have to be given rights under the UN charter for refugees and assimilated, after 10 years of quiet it would be considerably easier to come to an agreement.

However there will be no quite the 2nd intifada started because there was a good chance for peace, 150,000 Palestinians worked in Israel, Israelies conducted business daily in the PA territories, and the Palestinian economy was one of the fastest growing in the world.

This was good for the Palestinians but pretty bad for their leaders like Yaaser Arafat who wasn't even a Palestinian her was an Egytpian of Libyan decent born before Israel has even existed and never set food in Palestine or Israel before 1947.

So Arafat blew the camp David accords in which he was offered more than he was actually expecting and even demanding including Jerusalem to be put on the table and kicked off the entire mess.

For all his flaws Abbas is the first Palestinian leader who was actually born in Palestine.

But for the most part history will remember him as one with Arafat, especially after he said no to even a better offer than the original Camp David one.
Road signs will be more to the left or right, truck will be in front.

Corner case: truck jackknifed across the road immediately under a white listed gantry.
A quick Google search seems to indicate Iraq war deaths at 170k including combatants. www.iraqbodycount.org says 250k.
Credit cards may not be high interest as you may think. Depends.

Some credit cards have promotional low or no interest rates for a year or so. You can then balance transfer to another promotional rate card at the end of the year. Also many issuers (Barclaycard, AMEX, Capital One) have low or no interest rates for active duty military.
Meta: No, too cute.
Just got done watching this, it was painful. Embarrassing behavior by a lot of them, during that Zelda talk scene.Seriously around 15 minutes, of drawn out scenes, with Edmund ranting? Felt like all of the stuff left on the cutting room floor, slapped together to cash in on the success of the first one. Which I thoroughly enjoyed. To each their own I guess.
Of course, this is a good interpretation! Cheers.
I read this as saying: we start braking lightly when detecting an unknown object, applying more braking force as it becomes clearer that this object is a collision risk.

Once enough human or autopilot trips detect the same signal with no collision, whitelist the signal and cease braking-and-monitoring behaviour.

I am probably misinterpreting but that is what makes sense to me.
The Elevator Game
BMW was doing that circa 2011: even brought it to the Top Gear track.

So yeah, there's a precedent :)
I'm going to have to disagree that you are "a paid a little less" at startups. In my experience working for a startup is a 20-30% drop in compensation.

When startups say they are near market, they mean base salaries. They neglect bonuses, stock grants, signing bonuses, stock refreshes, 401K matching. These things add up real quickly. Even worse, I've found that startup salaries usually don't grow as large companies (very few startups do equity refresh, raises, COL increases, etc.)

Compound this 30% difference over a 4 year stint and things start to look bad, esp. when you think of $1m+ home prices left in startup havens like San Francisco & New York. If the majority of startups were in affordable cities, I'd agree that the compensation difference isn't that much, but the bulk of startups are located in places where that 30% drop means a significant change in quality of life.
"Everybody Writes"
Not that I follow all the great advice yet but I aspire to get there someday. I have it on my shelf next to "Elements of Style."
You have no idea what you saw -- clips like that are often propaganda or just crap. Big news sites like Drudge would post fringe nonsense for cheap hits.

When Iraq invaded Kuwait, the NY Times was running stories about babies being tossed from incubators directly lifted from WWI accounts of the Hun.

I was working in a network operations center at the time, listening to radio and seeing CNN 18 hours a day for weeks post 9/11. There were all sorts of bullshit stories, from foiled plots against facilities to whatever else that made it broadcast. People were jumpy and craving information.
No excuse absentee voting is an easier solution, especially when combined with early voting.
The ding is so small you won't notice it until you start having 8+ inquiries.
Ask HN: Strange bug workarounds?
Software bugs are a fact of life and, sadly, many never see a (timely) fix. This can lead to some some unusual workarounds in order to continue using the software.

What are some unusual/quirky/bizarre workarounds to software bugs that have been encountered by the HN crowd?

A recent one I struck was with Google Earth desktop app on Linux. It has a tendency to crash on startup unless your mouse is contained within a small rectangle in the middle of the screen [1].

[1] http://askubuntu.com/questions/642027/google-earth-crashes-when-opened#comment1071599_677717
Maybe, but considering the scrutiny on Tesla right now, I think they'd prefer to launch any new hardware ASAP, irrespective of the marketing benefits of launching it with the 3.
And I'm happy not to have to prove anything to a thirsty rando who assumes we need to repeat some common knowledge best practices in our nascent work-in-progress document (which, btw, we didn't post anywhere for feedback but is simply open source and was randomly shared).

We're a JavaScript consultancy. Clients specifically want us to help them with their tooling, and we need to reference this stuff a lot, that's why we happened to write the webpack stuff down first. This is not a blog post series and there is no implied significance to the ordering so we didn't really "lead off" with one thing or the other.

Anyway, good luck with your prescriptivism and billing your clients for adding "another authentication mechanism […] for non-browser access" (AUTH) – they will love that.
>cat | grep

why
Also note that there are actually several QML for Rust implementations out there, and while I've only done weekend toying at least qml-rust works well.
"The years of lyndon johnson" series by Robert Caro. Though it's a biography, it is really about how power is gained in the US political system. I'm on the third book right now, and I recommend them if you are interested in 20th century american history
Liberals are better than fascists are better than communists are better than anarchists. Such is the order of the world as it is imposed.

tongue-in-cheek
I made the changes you suggested - Facebook "add a share" button is a little hard to grok but I think I fixed it.

Thank you!
@ISIS
For cases that don't use features specific to one format or the other, it should be easy to write a tool that automatically converts between schema formats, FWIW.