skysight-inc/HackerNews huggingface dataset:
Command-line Tools can be 235x Faster than your Hadoop Cluster (2014)
Another way to put this would be "Mac users are accustomed to higher quality software than Windows users."

Of course, either way of putting it would be engaging in lazy stereotypes about both platforms that haven't been accurate for years, if they ever really were; so let's not.
The Surface Pro 3 and on are completely different to use on your lap than the first and second gens.
This and You Only Live Twice are the best Bond songs.
The article is 4 years old. Scale numbers accordingly. 5TB of data today can fit in RAM on a single server.
I don't know, 21PBs seems like a lot to me....
I work 4 days (32 hours) a week, and have done so for years. I don't think my brother has ever worked 5 days a week. In Netherland, many people with kids work one day less, to be with their kids. On most projects I've worked, most team members worked 4 days. I've only once had to reject a job because they insisted on a 5 day work week.

Working less than 5 days is entirely uncontroversial here. In fact, I believe Netherland is world champion part-time work. And personally, I think it makes total sense. If you've got a good job, the extra time is often worth more than the extra money. We need time to enjoy life. Life is more than work.
You might want to check out 'molten music tech' youtube channel. He has tons of info about the surface pro and music making... he puts it through paces and provides a good analysis. Recent videos he looks at the surface book.

Much better to watch people actually using the software rather than just reading reviews...

Surface Book review for music production
https://youtu.be/jqPhTDM-uBg?t=1m21s

surface pro 4
https://youtu.be/NwpebBvLBSI
they are extremely arrogant, too. They said they will be the biggest cloud provider in the world in 5 years (bigger than AWS, Google Cloud or Microsoft Azure)...

I'll eat my hat if they succeed in that! ;-)
That must be a recent change. I interviewed with Amazon a year ago and it was 4 or 5 hours of pretty much nothing but whiteboard coding.

I don't mind, though. I don't understand why people can't do whiteboard code. It's usually super simple stuff yet people get caught up on things like not remembering that for-loops take three parameters. I mean, yes, the compiler will stop you. But just how long have you been doing this job that you can't do THAT one in your sleep?

What I did mind about Amazon was that clearly they were lying to me about the expectations of overtime, as well as the compensation package was ludicrously bad.
I'm in Scotland :-)
My friends started out on Instagram posting simple things about their lives, like a local pond with ducks, or a meal they made at home. Now it's like they only post the really outstanding stuff, adventure/travel or extravagant meals at high end restaurants. And they go crazy with tags, doing the dot dot dot thing followed by a tag block. While the new stuff is cool, I felt they were more relatable and more like friends when they just posted the mundane stuff which honestly makes up 90% of our lives.
Lessons from 1,000 Voice Searches on Google Home
Maybe it's limited because companies are only putting it in workstation class laptops instead of giving consumers a choice.
Yes. I don't really fit in at places where I don't have some kind of personal relationship with my co-workers. We don't stand in front of the whole office and make fun of each other, but when we're at lunch or in private we do play a little. Expecting people to robotically conform to an idealized notion of "professionalism" creates sterile workplaces. You spend enough time with someone and you will eventually become friends with them, co-worker or not.
I don't know of any teams that will not ask you to write code on a whiteboard for an SDE position.
The priciest part should be the SSD, and most people are fine with a small SSD and use the microSD for overflow. I'm similar to you, I just chose a 16GB i7 256GB model SP4 with the Alcántara keyboard, and it came in well under 2K. Super powerful and the price point well beating a comparable Mac was one of the top selling points for me.

I have storage coming out of my ears after years of collecting disks cards servers and clouds so I have no need to buy a larger SSD.

Being forced into a higher bracket would make me look around more. The clearance SP4s are a great deal right now and I'm not regretting my full-price purchase.
well that closes the case then
Random advice from the internet.

It might be useful to reframe it as skills versus roles. A developer can have business analytics skills and a business analyst can have development skills and each are probably better for it. In terms of career, maybe the perfect role is a developer-analyst or an analyst-developer...these are things people do not describe in job solicitations because they are uncommon not because they are unneeded.

Anyway, it is ok to just start learning about what you want to learn about (it can be both new frameworks and business intelligence). There's no college course that guarantees the correct decision will be made at each inflection point in one's life or career.

Good luck
We incubated a bunch of chicks once, and they all died except one. Knowing they don't do well on their own, we had to buy another day old chick and put them together.

Even at two days old, they started fighting. One chick would wait for the other to start to nod off, and then peck it in the eyeball. We had to put one under a colander for a while until they got used to each other.
I struggle with that suggestion. Which probably means you are correct.

However we are seeing technologies like WebAssembly and WebGL which are directly addressing the benefits of desktop applications. What would a desktop application offer over browser based app?
I'd add that the benefits of avoiding bigdata(tm) can extended further into the 5TB+ space if you're happy to run at a bit of a delay.

I.e. If it's ok for the crunching to take 6 hours to produce intermediary aggregates which can then be crunched in less time , you can avoid spark and Hadoop for much longer.
I'm sympathetic to this argument insofar as the seemingly-off-topic post can generate intellectually (rather than just emotionally) stimulating comments. That's why a small number of well-written politics articles should be here. Seems a lot less likely for celebrity deaths. You can never completely predict that in advance, but you have to draw a line somewhere.
I have seen so so so many projects get bogged down by the need to use a "big data" stack.

I think my favorite example, was a team that spent six months trying to build a system to take in files, parse them, and store them. Files came through a little less than one per second, which translated to about 100kb. This translated to about 2.5Gb a day of data. The data only needed to be stored for a year, and could easily be compressed.

They felt the need to setup a cluster, with 1Tb of RAM to handle processing the documents, they had a 25 Kafka instances, etc. It was just insane.

I just pulled out a python script, and combine that with Postgres and within an afternoon I had completed the project (albeit not production ready). This is so typical within companies it makes me gag. They were easily spending $100k a month just on infrastructure, my solution cost ~$400 ($1200 with replication).

The sad part, is that convincing management to use my solution was the hardest part. Basically, I had to explain how my system was more robust, faster, cheaper, etc. Even side-by-side comparisons didn't seem to convince them, they just felt the other solution was better some how... Eventually, I convinced them, after about a month of debates, and an endless stream of proof.
Get revenge by giving left-wing terrorists sinecures in academia and non-profits?
Javascript everywhere!

Developing a web application using javascript and having it served by a javascript platform (node js) makes everything so much easier. From simple code re-use, back-end to front-end, to not having to mentally switch contexts if you are developing back and front end at the same time.
I've been around this loop over the past few months. Something to bear in mind: Hadoop of 2017 is quite different to the Hadoop of 2013.

Our data isn't enormous, by any means - 160G in one particular instance that's being used for proof of concept, it'll add up to 5-20T should it reach production. The catch is that it's 160G in MySQL; it's only 5G or so once it's been boiled down to Parquet files in HDFS. Columnar stores can be a really big win, depending on the shape of your data.

We use Impala for our queries. It's quite good tech; it's much faster at table scans than everything that doesn't describe itself as an in-memory database. That means writing SQL much like you would with Hive, only it runs faster.

I tried out both Citus and Greenplum to give PostgreSQL a fair shot. First problem: PostgreSQL is limited to 1600 columns in a table, and the column limit for a select clause isn't much bigger. We have several times this number of columns in our largest analytic tables. Not the end of the world, you can cobble things together from joins and more special-purpose tables.

Second problem: CitusDB doesn't come OOTB with a column store, and it's far too slow when using a row store. I didn't bother trying to compile the column store extension to use with Citus; the pain ruled itself out. I continued ahead with Greenplum, focusing on columnar storage - row storage is consistently poor.

Third problem: Greenplum is cobbled together from a pile of duct tape, an assembly of scripts and ssh keys to keep the cluster in sync. It does not inspire the same kind of confidence for operational management as HDFS, whether rebalancing the cluster, expanding the cluster, or decommissioning nodes (not supported with Greenplum, AFAICT).

Fourth problem: Impala simply runs faster than the Postgres derivatives, and its lead increases the more data you have. Impala seems to do table scans over twice as fast on identical deployment environments.

Indexes only help when the operation being performed can use the index. As it happens, most analytic queries do full scans, or have predicates that are either not very selective (randomly skipping rows here and there) or are really selective (date bucketing, which maps well to typical Hadoop partitioning strategies). I had some hope that indexes would help for joins; but Greenplum didn't elect to use my indexes, and when I forced their use, it ran slower. The ancient version of Postgres that Greenplum is forked from doesn't help much either, since it can't e.g. use covering indexes to avoid looking back to the table.

If it was my startup, I'd take a risk on something like MonetDB, or look harder at MemSQL, given what I've seen about how data has shrunk with column stores. But from what I've seen and measured, Postgres doesn't really cut it for analytic queries.
Which makes it comparable to the 12" MacBook which is far from a pro device.
This looks useful. I'll have to keep an eye on this.
Anarchy is not the absence of democratic process, more like the opposite.
I assumed you were talking about government because I have never heard of a company "voting."
Not the same thing, but Lunyr is building Wikipedia on blockchain technology: http://lunyr.com
Poland used to have reasonable government. Now we have Trump-lite version.

Just one example environment minister: Jan Szyszko

1. Approves logging near national park on massive scale.

2. Lax regulation for cutting down trees everywhere.

3. Claims it is highly uncertain if global warming is due to human activity.

4. Hunter, shoot to animals a lot while being environment minister.

5. Works hard to protect coal mine industry.
There also isn't a print version of the Independent any more, just the tabloid "I" newspaper.
I'm imagining doing some client side validation and then the server just blindly assumes the content has been validated.
Trees grow back, and so do forests. Let's focus on the plasticization of the oceans instead of the trees which grow in the ground. The Earth is mostly ocean and it's actually a good thing to cut down forests, it creates new opportunities for new organisms to move in and pioneer the land. North Carolina used to be a large portion of prairie called Piedmont. But the dense farming of the NC piedmont resulted in the new growth forests springing up when people moved westward and farms died. Forests grow so quickly we forget that "old growth" is like a hundred year old tree. Deforestation and reforestation is a natural cycle and it's actually not as bad as say a giant miasma of microplastic or a giant toxic algae bloom caused by agricultural run off.
Because 99% of the military's job isn't to protect us. It is to bomb counties that we should be ignoring.
Most of what I do is python, but I've done a fair amount of JS, some PHP, Java and others, as needed.

I have run VMs on this, but 8GB RAM gets tight, so it's not something I do regularly. I do use Microsofts version of Bash on Ubuntu for things where I am more comfortable with standard linux tools.

I use the type cover for almost everything, but I've got a more traditional keyboard hooked up to my dock.

The display is excellent. It's glossy, so direct sunlight is problematic, but otherwise it gets plenty bright and looks very good to me, though I suspect my tolerance for colour inaccuracy is pretty high.
The Physics of Rotational Motion with a Fidget Spinner
Maybe they didn't have to do it, but I bought a Macbook Air in Korea (no official Apple stores there, strangely) and had the body repaired for free at an Apple store in Japan. The repair was minor, so maybe that was why they did it? But it certainly seemed like they were going to take care of whatever problem I had.
Awesome writeup! Another thing that I should probably have mentioned earlier is that the resistors are across D+ and D-, allowing the device to know that it's A) not plugged into anything it should be talking to and B) what the output of the charger is. This get's really entertaining when you start talking about USB C where if the resistor is used incorrectly, you can start doing real damage to device and charger.
Ask HN: How do Software Engineers/Developers deisgn for the web?
I am an Android software engineer starting to work on a side project that requires a web app.

On android, I used to use the gui editor to get the rough GUI (layout, size, proportions) I wanted and then finalized it in xml/java.

I was wondering how I could go about doing so on the web?

I started using React + BlueprintJS to get all the components I needed, but everything looks very ugly without having CSS hacks (or custom styles) all over the place.
Breaking down how an actual trading algorithm works
Ethereum or Ethereum Classic?
I agree but it still on front page. We gotta ask ourselves why.
> Spark is orders of magnitude faster than Hadoop, too.

A comparison between Spark & Hadoop doesn't make much sense though.

Spark is a data-processing engine.

Hadoop these days is a data storage & resource management solution (plus MapReduce v2). Spark often runs on top of Hadoop: Hosted by YARN accessing data from HDFS.
I just don't want good to be the enemy of "even better" :-)
"Fires everywhere" is an excuse that you can hear in 99% of offices around this planet. And it's simply not true. 99% of people don't have "more fires than most people" by definition. That's how it becomes 99 out of hundred.

The only thing one needs to change is this: Don't cover the fire, extinguish it. That means the first fire you handle you stick to. Don't let a second fire take away your attention from the first. Then find the source (e.g. by asking yourself and colleagues "five times why"). Then find a reliable, resilient solution for that cause. Then repeat until the fire is extinguished. Only then take on a second fire.

If you start doing that, well, of course the first few fires will take you a lot more time than any fire took before. But that's the way to reduce the amount of fires.

And the great thing about it: If you work like that it doesn't matter if you extinguish a fire in two hours or in eight hours. Since extinguishing a fire has an iterative payout over the next few dozen years, a small delay of even a few months doesn't harm you in the long run.

The only exception to this rule is paying your bills. If you really, really need to fake a fireless environment in the next two hours to continue surviving (e.g. as a company), then go ahead and cover all of them. But that happens very rarely. Most fires only seem urgent because urgency lets us feel important. And immediately after the urgency you can continue with the actual process of extinguishing fires.
To be fair, the rent on a nice compound in Cambodia is what... 3k a month? Not necessarily much of a cost.
Harvard student raps for senior thesis, software job at Google
Willful ignorance.

its 2017 and yet still the biggest vulnerability of them all is willful ignorance.

People have agendas to fulfill. Can't let the truth get in the way. Haven't found a budget to fit in the truth looks like we will have to do without it for now.

What is the truth?

Well nobody cares about security.

Who knows about the truth?

Mostly everybody

Why doesn't anyone do anything about it?

Trying hard just doesn't cut it anymore as we can see those with influence would rather destroy the entire internet for mass surveillance.

Also don't forget about 2FA
If it's 5G boiled down and your production data is likely to be within two magnitudes, why in the world are you not just reading all of it into RAM and operating on it?
Hive = ten min for a select and 20 for a join! nice
I agree with the sentiment of the article, but why does this site ask for notification permissions? It's a blog - if I want notifications about new posts I'll add your RSS feed to my reader.
The lesson from history is that you can only burn witches for so long before the strategy backfires.

To that effect, I would advise the Left to refrain from doubling down on their doomed crusade and to confine their anti-racism stance to the field of ethics and not science. Because at this point, they are creating highly motivated cadres of reactionaries, like yours truly.
These things are ultimately tools, means to an end. I'm glad MS is thinking of their users rather than adopting new for the sake of new.
In the UK, the big problem is foxes. We have an electric fence and automated coop door closer now. We also have a guy that enjoys shooting and roams the fields round our house shooting them.
Pinterest Brings 'Shazam for Food' Idea from HBO's Silicon Valley to Reality
You're not wrong. I use smart lock and fingerprint on my 5x. I actually would prefer it to require fingerprint when near my watch with password fallback, and require fingerprint+password when away from my watch, but that isn't currently a possible configuration as far as I can tell.
Having a constitution just makes a country "constitutional", it doesn't make it a republic. You're conflating being constitutional with being a republic, they are different things; we are both of those things, but they are unrelated things. We are a republic because we don't have a monarchy, that's all it means. Our minority rights are protected because we're a constitutional government who has protections for those things; that has nothing to do with our being a republic.
https://en.wikipedia.org/wiki/List_of_custom_Android_firmwar...

Replicant is the most "open".

Also, it's not hard to package all the stuff a language needs and put it into an APK. It's just messy and there are a lot of "edge cases" and things to work out (like the problem of interacting with the Platform, you'd need to call into a "Java" interface from your language, you'd need to run your app inside ART/Dalvik, maybe fork - https://stackoverflow.com/questions/39006044/repeatedly-fork... ).

And so if you spend half a year just getting something to run, and on the next Android version Google makes a change, and bamm, you might get left in the cold, because security or whatever.
Not training the employees:

I can provide email filtering, DNS filtering, firewalls and all sorts of technical solutions to security.

It all goes to pot if someone gets click-happy on weird websites or email attachments or falls for the "Your $Company_President need to transfer some funds" email.
I think this interpretation just stems from our insecurity as human beings when it comes to our own brain capacity.

What I think is really going on (and what will actually happen if a "robot takeover" happens) is the computer just does its thing, but because it's so powerful, it's out of reach of any human being's understanding, and people think they are pulling some trick.

Machines can win without using tricks just based on their computing power.

Yesterday I heard one of the commentators say something like "what i liked about alphago today was how effortless it's playing. It's almost like it's just playing happily and not even trying hard, giving away losses happily when it comes to it."

Alphago has no emotion, but just like how human beings look at something that walks like a duck, quacks like a duck and conclude it's a duck, humans interpret everything based on their point of view, thinking "I can actually feel what alphago is feeling, just based on its moves".

Another thing they said was something like "there's a high level player premium", meaning when people play against other people, they can't ignore all the subtle little queues, such as how much time they're taking to come up with a move, whereas Ke Jie has no such thing against alphago because alphago doesn't care. (Whereas Ke Jie does care)

I think if anything, that kind of emotional vulnerability is what will bring human down against machines.
I've got 256GB currently, and I definitely couldn't go smaller, but it only becomes limiting every few months. 8GB RAM on the other hand, is 85% full nearly all the time, so I actively make decisions to work around that.

Enjoy your SP4!
Wrong link or title.
> You can't own human beings, because it violates their fundamental rights. This was true back when slavery was "legal".

There's no such thing as fundamental rights. Those were won by sweat and blood.

Up until the enlightenment and humanist eras there was not even the idea that such a thing as rights even exists. Some inkling of rights existed for royalty in the codes of conduct and such things, but they were freedoms given by right of birth and power of ancestor's sword.

For peasants, no such luck. They were property even though they weren't slaves per se.
Ask HN: Will Bootstrap 4 be released in our lifetime?
Bootstrap 4 has been stuck at Alpha 6 for over six months now. (Title is tongue-in-cheek and a bit of rant.)

Of course, Bootstrap 4 is still in active development, but the documentation is stale and outdated. For example, many classes have been removed or changed since Alpha 6.

Ideally, there'd be more frequent updates or an Alpha 7 so people have an easier time moving to the final version of Bootstrap 4 when it's released.

What's a good HTML/CSS/JS framework in 2017 with plenty of full-featured components and written to use flexbox by default?
Blind trust in open source package managers. Look at the damage the removal of left-pad from npm caused, for example, and imagine what could have happened if the author had malicious intent.
programming by committee?
Driving Headless Chrome with Python
Obvious one but not using HTTPS would be up there.
Pieces at that auction may be worth more specifically because of the auction and the mystique of the times.
Using bad programming languages, honestly. Most security problems boil down to type errors, but it's poor language choice that leads to making those.