skysight-inc/HackerNews huggingface dataset:
How bitcodin uses Google Compute Engine to encode video 100x faster than others
IronMQ v3 is 10x Faster than RabbitMQ
I can't upvote this enough.

The game backend I've been leading uses event sourcing for almost every "object" in our system. It's proven flexible enough to model both normal CRUD style access patterns and other activity feed-like features that may or may not have an aggregate state.

Some huge advantages we've identified:

* Modeling our objects as state changes has resulted in less code and improved readability. The effects of a state change are much more obvious than a series of CRUD-style updates. This is anecdotal of course.

* Audit trail, we have every mutation for every object in our system. We can go back in time and identify bugs and fix them by just overlaying new change events. We can also feed this data into any number analytics systems and create materialized views without having to know in advance what kind of data we wish to collect.

* Optimal performance characteristics for our chosen DBs (Redis+DynamoDB). We use Redis for storing incoming events, and DynamoDB to store our periodic snapshots that compress the aggregate state for an object (and keep the event history). This allows us to keep our Redis space usage bounded, as compressions flush the queue for each object. We optimize for DynamoDB pricing/performance by only needing eventually consistent reads for obtaining a snapshot. We keep our write capacity low because the only writes are when we write a new snapshot -- this happens much less frequently and is allowed to fail since a failure only means we continue using the previous snapshot.

* Consistent point in time snapshots. To obtain a backup of the objects, we simply need to snapshot our Redis databases. If we restore, all objects are consistent because the per-object snapshots we store in DynamoDB are immutable and will always exist with any given state of the Redis data. Another consequence of this architecture is that we can take an old snapshot and "go back in time" to the real state of the data.

* Highly concurrent without need for optimistic or pessimistic locking. Redis is obviously super performant and all we use it for is to push event items to the back of lists. For concurrency and conflicts, we can resolve the state of an object by de-duping events that may be invalid or duplicate from the point-in-time view of the aggregate object when the event was pushed. Obviously this won't work for every type of object state, but in our experience it has been extremely resilient.

A few disadvantages:

* Views on the objects must be eventually consistent and must be materialized externally to the storage of the objects.

* More CPU required to create the aggregate state when getting the object. Hasn't been an issue for us and can be mitigated by the frequency of compaction into snapshots.

* Space usage for snapshots. Eventually long lived objects will have a significant cumulative historical size. It's trivial though to traverse the snapshot history and trim the space usage by simply discarding snapshots after a certain point in time. The object will then be constructed from the last snapshot's aggregate state and events that happen after the purge.
The individual pays the cost. Today Uber drivers get like 80% of the fare. If Uber needed to pay benefits, give vacation time, etc, the pay rate would be much lower. That would all come out of the 80%. Just like how contract programmers bill a higher rate and get no benefits. Calling someone an employee doesn't suddenly create new money.

I can't imagine uber drivers would prefer a lower rate of pay, but hey, I guess that's what all these advocates of making them employees want us to believe.

Or maybe it raises the question, who is driving all this PR anyway? I can't see it as a grassroots thing from Uber drivers.
The Surprising History of Copyright and the Promise of a Post-Copyright World
I personally believe that the majority of CRUD projects actually need Temporal databases. I've come to realize that--in my 12 year career--every project I've worked on was in some way covered by at least one form of government regulation (whether Sarbanes-Oxley or HIPAA) that required the ability to audit change. The problem is, most organizations (at least the ones I've worked for) don't know that they are covered by these sorts of regulations, because most places are sub-100 employee consultoware shops that are just reimplementing ERP for small B2B clients who also don't have much visibility on their regulatory coverage.

That's not even getting in to user requirements. Users almost always eventually want to know what the past data looked like. They always say at the outset of the project that they won't need it, and they always change their mind a year in. And they never understand why you can't "just get it back. You said we had backups."

It's kind of the Wild West out there.
I worked at one of the worlds largest investment companies. Everyone in each group was reviewed and then fit to a bell curve. All compensation, title, and responsibility issues take the bell curve into consideration. This had the effect of making it possible to get fired for being "above average". If you have a group of 5, and they are the best employees in the company (all above average), well, a couple of you will still get, at the least, substandard raises and bonuses or, at the most (generally in times of cutbacks), fired. This is not uncommon for similar companies.
One font vulnerability to rule them all #2: Adobe Reader RCE exploitation
Bright (YC W15) Is Hiring Senior Software Engineers
The Wired article notes that they could install a remote backdoor so they could later effect the car over the network.

There was also this problem:

> But they also found that the car’s infotainment system was using an out-of-date browser, which contained a four-year-old Apple WebKit vulnerability that could potentially let an attacker conduct a fully remote hack to start the car or cut the motor. Theoretically, an attacker could make a malicious web page, and if someone in a Tesla car visited the site, could gain access to the infotainment system.

But you're right it's not like FCA, because this happened:

> The company also engineered the car to handle sudden power loss in a graceful way. If power to the car were cut while the vehicle was in motion, the hand brake would kick in, and the car would lurch to a stop if it was traveling 5 miles per hour or less. It would go into neutral if traveling faster than this. But the driver would still retain control of the steering and brakes and be able to pull the car over. The airbags also would still be fully functional.

Tesla put thought into it. They designed their system with failsafes to minimize risk (to a degree) if the system got hacked. It's not perfect but it's a hell of a lot better than nothing.
How is that applicable here? What political rights are in play here? We're talking about entertainment, about as purely commercial a product as you can get. We're not talking about healthcare or water or food or housing.
I don't know why the fuck you were down-voted.

That said, age is only a small part of the issue. I'm older and there's still a lot more that I don't know than there is that I do know. I don't expect that fact to change in a fundamental way: there will always be far more that I don't know.

The problem is that Silicon Valley people are arrogant and don't listen. They call the rest of the country "the paper belt" and think that regulators are just stupid, without taking time to understand why the regulations exist in the first place.

Also, there are a lot of older, man-child VCs who aren't 20-somethings and ought to know better.

Much of the youth/inexperience image that Silicon Valley wants to project is out of an intention to create plausible deniability when these companies do wrong. (The same with "Aspie chic"; Evan Spiegel is a lot of things, but I don't think that he has Asperger's, and I wish these people would stop using a real disease that they don't have to justify assholish behavior.) In comparison, if you're 55 and your company is at the center of a sexual harassment scandal, you can't use the "I didn't know any better" excuse or the "I was crushing code 20 hours per day, but I'll create a token 'Chief Cultural Officer' position and pretend to have solved this" justification.
The Biggest Question of 'Mr. Robot' Is About Morality, Not Reality-
Now with regular updates, Android’s security model is much better than iOS and Windows 10. Android source code is available for the security community to examine. Open source makes Android a good subject for commercial and academic researchers to test theories and postulate vulnerabilities. Google will pay a bounty for verified vulnerabilities.
> I'd recommend looking here: http://www.xrite.com/online-color-test-challenge

That was surprisingly enjoyable. I have perfect color vision! Finally, all of these years tweaking photos in Lightroom have paid off.
The Case for Controlled Side Effects
paywall
"Fire you for average performance" is a bit of a loaded term and implies a certain unfairness or vindictiveness.

I'd rephrase that to be– do you work in a team with uncommonly high standards? I'd imagine this to be the case at any cutting-edge company. Consider say, the special forces in any military. If you don't meet the grade, or you don't carry your fair share of the weight, you don't get to stay. That's just tha name of the game. I assume that this must be the case at all the exciting companies– Tesla, Google, Apple, Facebook, etc etc.

It's not stressful if the expectations are set in advance, and the precise conditions for firing are clearly stated, and you get the feedback and assistance you need to stay afloat.

I work with a small team that prides itself on being results-oriented, and I love it. As far as I can tell, everybody we hired is hired because they bring their A game.

I'd much prefer this to being a part of a team that "carries" people who don't perform.

Of course, we've all also heard horror stories by now of ridiculous young founders who come up with extreme ideas about productivity, 80-100 hour work weeks and whatnot. Sustainability is important.
really surprised this isn't getting more action on HN. the implications for CS are immense.
At least in my country, there can be pretty big differences between being a temp and being an "independent contractor".

If you work for a temp agency and they send you to a warehouse, you'll have managers/trainers a few steps away, you'll get paid by the hour, and you won't have to spend your own money.

On the other hand, if you're an "independent contractor" for a parcel delivery company you'll be working alone, you'll get paid by the parcel, and you'll be paying for your own vehicle and fuel and whatnot.

The different environments make a big difference in terms of things like whether an employee can make a loss/less than minimum wage, how much it's in their interests to cut corners, and how long it takes for someone to spot if they're struggling and give them help.
Quick Intro to Kubernetes, Google's Container Orchestrator
In practice, many firms eliminate the "average" section of staff and replace with fresh grads who aren't particularly likely to be better than "average" but are cheap.

Rinse and repeat often enough (and preferably with an incentive scheme that justifies average starting pay and ridiculous working hours with the promise of fantastic rewards if you manage not to get fired for the first three years) and bizarrely, you get a reputation for high standards.
Appeals court: warrantless search of cell site location info violates 4th Amd
Absolutely agree - testing is all about risk management, not finding all the bugs! And the right move is often to give up trying to reproduce/find a difficult bug. WRT to inputs:

QA Engineer walks into a bar. Orders a beer. Orders 0 beers. Orders 999999999 beers. Orders a lizard. Orders -1 beers. Orders a sfdeljknesv.

(possible Bill Sempf)
Off-topic - when did sentences and paragraphs become the same thing? I noticed this several times during the last months but may have overlooked it before. Is there something behind that?
https://en.wikipedia.org/wiki/How_to_Win_Friends_and_Influen...
Linux Mint has many usability features similar to Win 7, is free/free, and I've not had any issues with Win games ( wine / etc ) - plus they can learn command line & packages!

worth the time it takes to check it out, imo...
"Elliot’s worldview may not be delusional, but it probably is too simplistic—good vs. evil isn’t necessarily the same as good vs. Evil Corp."
You're right, it looks like most of the Skylake launch boards in Anandtech's review are M.2. Somewhat disappointing. I still suspect M.2 is obsolete in the long run, but seemingly not for this generation of Skylake.

There are at least a couple boards I see with a dedicated PCIE 3.0 x4 slot and U.2 support, but they're the highest end and I'm sure not cheap.

You can connect a 2.5" U.2 drive (Intel 750) to M.2, but it's obviously going to reduce performance to M.2 speeds.
So absurd to refer to wages as bribery!

Structurally identical: "The leaders at [insert startup here] hadn't been able to employ engineers for free, they could only bribe them with high rates of pay"
When effective cultural participation requires keeping up to date with at least some of Hollywood's products, choosing not to view/listen is the same as choosing to be just that much more socially disconnected. See Moxie Marlinspike's presentation about this concept applied to technology:

http://m.youtube.com/watch?v=eG0KrT6pBPk

When one oligopoly owns the vast majority of contemporary popular culture, we, the populace, should be expecting a lot more in return.
Commenting to voice my agreement. Modeling and querying temporal schema in a traditional RDBMS is difficult so most developers don't even try to do it (and, when they do, they do it badly).
Show HN: Shrift – minimal server spec framework based on bash
How to Become a Great Front-End Engineer
It actually sounds quite a bit like the "cell group" system that some popular 'megachurches' use.
Lita – A robot companion for your company's chat room
Since they only investigated 37 languages, isn't this only really evidence that they found a feature that ties 98% (~= (38/39) of languages together? Languages are known for having a few outliers with completely crazy rules.

Also, if two sentences are considered together, the average DLM would be significantly lower for those sentences than for one random sentence of the same length. So I'm not sure what this theory implies other than "the definition of a sentence can be vague".
To be clear: the toxic bit here is the idea that you start with that first. Everything you describe is entirely appropriate when you have a hypothesis in hand, and you are using it as a technique to test it -- but I (strenuously) object to the idea that problems should be debugged by first randomly permuting the codebase.
I'm not sure what to do with that test - what is 'hue order'? Do they mean lightness/darkness, or how much of the dominant color there is?
Yes, I merely meant to illustrate how a business can become profitable simply by stopping expansion. I didn't mean to imply that this 3 second toy model proves it always will, though I guess my phrasing wasn't clear.
The biggest issue seems to be control over the work delivered. All of the Uber for X want their service to be a pleasant experience for the customer which is ~98% guaranteed to hit 5 stars or the local equivalent. This generally requires some degree of operational control over the workers. Aside from the (formidable!) difficulties [+] of actually structuring a business to have operational control, that tilts the relationship very, very heavily from "could possibly be an independent contractor" to "presumptively an employee."

Given that one is going to lose a fight with the IRS or local labor department over classification -- and one will, eventually, if you're doing things like e.g. giving the employees checklists or training them on the "company standard" -- might as well bite the bullet early.

[ + ] Many people employed in startups are young and may, how to put this gently, not have experience giving them an appreciation that members of the class which Stanford sources most engineering grads from are not perfectly representative of all Americans in all ways which matter towards employer/employee relationships.
What went wrong at Quirky? Sources tell a cautionary startupland tale
uh where exactly are you going with this
Sales for a publically traded company. If you don't show growth above average, you will be fired. Unrealistic quotas and complete ignorance of market conditions (quota is the same in a boom or bust) leads to high performance standards. It's a constant high pressure environment and most people quit before they are fired to avoid the shame of a firing.
Also this seems to suggest that honolulu is the 5th most expensive city in north america:
https://www.expatistan.com/cost-of-living/honolulu

I imagine smaller parts of hawaii are even more expensive because they're probably more touristy.
I went to public school, this is basically accurate.

What evidence would convince you anyway? Video footage of the school board twisting their moustaches and laughing as they toast their cleverness?

None of the people involved are doing it deliberately (many of my teachers were obviously mad, even us kids could see it.) Everyone is (more or less) trying to do their best.

I went to Montessori schools at first and then public schools after eight. The difference in educational styles was shocking. Compared to my personal experiences at the former the later were like prison camps. When the class stood up and recited the "times tables" (multiplication) by rote in unison the only thing I could relate it to was the military displays I'd seen on TV! I already knew how multiplication worked from playing with the math blocks (in fact I knew more than simple multiplication) but I didn't realize it until much later. This was just simple parroting, rote training, no insight was transferred to or evoked in the students and, indeed, no one tried.

And the bells! I had never had to do anything routine according to bells in my whole lil life.

That right there should be evidence for you, no? The regimented scurrying from class to class at the bell has no educational purpose and actually harms concentration and learning. The best you can say about it is that it conditions the children to being able to stop and change gears at the sound of a bell. The schools are training machinery, not raising people.

Education is perhaps the single most important human activity (Parenting, Gardening, Mathematics, that's my list.) So it behooves (a word I learned in public school, it wasn't all bad..) us to do the best we can at it. Public schools, at least the ones I attended, were pathetic.

EDIT:

Public school teachers (et. al.) are freaking heroes and deserve so much more than we give them! One good, dedicated person can have a massive positive effect, even in an otherwise poor situation. I want to make that clear. :-)
Is this satire? That's the only way I can explain this comment.
Building a Docker Image with Templating and Initialization Support
Culling the bottom 10% is great when you measure accurately and you have 15% dead weight. But what about when those conditions are not met?
Patching Rails Performance
Max Payne 2 Pc Game Highly Compressed Free Download
I wonder if it'll eventually make sense to have free driverless cars that serve you with ads. That would be interesting.
EFF releases Privacy Badger an addon that algorithmically blocks online trackers
Cool. What is the measure of word dependency? I.e., I'll agree that in

John threw the trash out

"threw" and "out" are dependent on one another. But is that an either/or, or are there degrees? It seems like "threw" and "trash" are also "dependent" in that they don't make independent sense.
Shame they didn't put in enough thought to update a four year old WebKit... or enough thought to isolate a web browser from engine control systems...
I mean TOS, EULAs etc only go so far. If you think they are the word of god - then I'll create a TOS on my site that says for every page view you agree to pay me $X. Then when I sue you to get the money - any judge who isn't taking mind altering drugs should throw it out.

Interestingly enough Apple also had their Safari EULA state that you couldn't install it on a PC [1]. Obviously it was never brought to court - but still I'm sure thousands of people violated the EULA.

My take is yes - someone who operates a website/service can blanket content you upload unless you explicitly state otherwise. So here is a hypothetical question - you own the copyright of the material in question. Reddit makes a copy of your reddit post for their daily feed or something - could you send a DMCA removal request? I'm sure you would say no because of the TOS - but don't you own the original copyright?

> This is the same as those misguided souls posting copyright notices under their Facebook messages.

And from what I read basically Facebook has the ability to use public posts/pictures - which makes total sense (posting the copyright notice only makes you look like a fool). If you don't want them to use it - adjust your privacy settings.

Here is an example of a ridiculous TOS [2].

> Permission is granted to freely print, unmodified, up to 200 copies

How do you know how many I printed? Perhaps I scanned copies - would those be considered prints?

[1] http://www.makeuseof.com/tag/10-ridiculous-eula-clauses-agre...

[2] http://www.templetons.com/brad/copymyths.html
Java 9 Unsafe resolution – Oracle backs down
Inside the Pentagon’s Boot Camp for Cyberwarriors
Personally, I just stay home. I go to local BSides conferences (where a minimum wage worker can reasonably be expected to afford to attend without a premeditated effort to save up) and give talks there.

I don't think I'll ever attend Black Hat. I might attend DEFCON, unless the prices go up much higher. The interests of people who can afford tickets to BH USA are already well served by the security consultants they can afford to hire.

And if I ever do speak at DEFCON, it will be repeating a talk I already gave to the local Bsides event. Communty > Industry.
Not an issue of supply, just regulation. It's significantly more difficult to start a bank today than 5-10 years ago but not impossible. Provisions in Dodd-Frank actually insulate current banks while raising the standards to start a bank.
Also - charters are issued at the state level, but not without the blessing from the Fed/FDIC.
You're right, but there is a large group of people who refuse to believe that employment is a functioning market like any other where a resource is bought and sold according to factors including scarcity, difficulty, and pleasantness. For these people, it is easier to describe employment negotiations in terms of exploitation, 'taking advantage', bribery, and power, than to acknowledge it is essentially the same as a business to business negotiation.
From UI perspective as well as the architectural design behind I would rather recommend Pitivi, as it's based on GStreamer.
Freight Startups Attract Silicon Valley’s Attention
Most lawyer work is bog standard paperwork, and clients pay by the hour. Extra years of experience is not useful. You need a few experienced people, but mostly for their sales and strategy skills.
Lots of info here: http://sgxisca.weebly.com/
Not a whole lot on remote attestation though
True. However, Tesla owners have to accept an 'always on' car, sharing who-know-what with Tesla over its cellular connection. Is there any way to just get OTA updates without giving away personal data (like location) to the company?
Yes, another way to think about this same topic is Append-Only data structures which is why Apache Kafka is popular for this.

Also, the transaction log files that RDBMS are built on, are append-only, and have this same Event Sourcing semantics.