skysight-inc/HackerNews huggingface dataset:
Thanks I missed the link to the tarball in the GIST. Now that I can see the workload I see that it is 100 million keys for the entire cluster of 330 nodes?

That is 8 terabytes (n1-standard-8) of RAM for 18.6 * RF gigabytes of data or am I wrong? The entire thing should fit in the page cache assuming compaction keeps up. There are no deletes so no tombstones. On an overwrite workload I don't know what the space amplification will be and whether you will actually run out of RAM for caching.

90% of people who read a benchmark aren't going to look at it the way I do. They don't have a cost model that says how fast things should be and how much they should cost. I do and when things are fitting in memory I have a different a different set of expectations. If I am looking at the wrong instance type please let me know.

For the workload you described Cassandra shouldn't be doing random IO. I would expect there to be three + N streams of sequential IO. The write ahead log, memtable flushing, compaction output, and N streams reading tables for compaction.

All the write IO can be deferred and rescheduled heavily because fsyncs are infrequent. Reads for compaction are done by background tasks and shouldn't effect foreground latency.

If read ahead is not working for compaction (and killing disk throughput) that may be something that needs to be addressed. Compaction should be requesting IOs large enough to amortize the cost of seeking. Page faults in memory mapped files don't stop read ahead and I think that the kernel will even detect sequential access and double read ahead. For a workload like this with no random reads you could configure the kernel to read ahead 2-4 megabytes and the page cache would probably absorb it fine.

For the workload you described the only fsyncs would be the log (every 10 seconds) and memtable flushes/compaction finishing and that would normally be so infrequent as to not move the needle on overall IO capacity (although obviously it consumes sequential IO). You set trickle fsync so we are still talking about 10 megabyte writes.

Granted there are many things I don't know about Cassandra. I've plumbed a lot of it, but it isn't my day job. Using a 24 gigabyte heap and a 600 megabyte young generation is questionable to me. I think Cassandra can do better, and I also think there are several tools that would do the same job with 10-20x less nodes by exploiting the fact that they never have to do random reads from disk.
(from regular Microsoft employee perspective):
this article does make them seem like that. Usually, in my interactions with Legal Compliance, they make sure everything we do is 100% legal, and prevent us from even coming close to the border of legality. They assume that we programmers don't think about complicated legal matters, so they go over a lot of the projects we work on and make us adhere to very strict privacy compliance that most of our competitors breeze over.
I work for a large financial company. At our shop, we are currently building out an internal cloud infrastructure where we build on too of the OpenStack API to provide users with self service deployment much like AWS.

In order to deploy to production, we mandate a process requiring users to have an existing chef recipe before any production guest can be deployed. We also restrict logins to existing production nodes unless there is an emergency. (This attempts to keep configuration management entropy to a minimum.) all of this works ok, but I think it could be better with Docker.

In a few weeks, I have a chance to present a new idea to senior executives. I'd like to pitch Docker, at least as something to keep an eye on. Any thoughts on what points I should drive home?
That's amazingly naive. Violence comes in more forms than just striking someone.

Democratic governments don't even enter into that frame of reference unless you want to have a governmental system where you elect a personal representative.
It's impossible to imagine how humanity would stop investing in technology or would only invest in technology that would not be related to space travel
There has been a lot of conjecture about what the NSA can and cannot do. This clears a lot of it up.

My favorite part is how he responds to the comments by Dick Cheney.
"Anything you do becomes public" is an inaccurate description of the AGPL. That consultant can keep things private.
The BBC's oddly-worded statement about Apple TV support makes no sense
Internet is falling apart. I think that appreciation for free speech, press and freedom of expression is lower today than it was for a long time of recent history. "They" just push and push on it and we're helpless. Not even constrained by paying it lip service.

Do we still have non-violent ways to counter this and make our voice heard? Because otherwise violent ways become aspired.
Dispatch from TED: Edward Snowden makes his case
"That criticism may be justifiable, for I am mediocre. But the point I have in mind is this: Business and life are built upon successful mediocrity; and victory comes to companies, not through the employment of brilliant men, but through knowing how to get the most out of ordinary folks."

The point of the article. Is this still true? I imagine you do need exceptional people to be able to hit the high notes (10x programmers and all that jazz).

Or am I interpreting this wrong, since the way he's using the word "brilliant" is a bit sarcastic, or at least archaic?
Show HN: Loom – Cluster Provisioning and Management (open source)
Maybe we need to start crowdsourcing scientific research?

Like this?

https://experiment.com/
What, you mean with "hot deployment" of your changes?
Thanks for chiming in. I'm sure that's how legal departments work in most companies, and I didn't mean to suggest otherwise. Yes, just in this case TFA is talking about an isolated situation where my comment happens to be pertinent.
live in the first world, close to good water sourced and read those forums of survival enthiasts. some selected skill sets are always demanded
My e-commerce company started tracking all page visits in the database about a year ago, it's been one of the best decisions we've made.

It's amazing to have all of your data in one database, you can do so much with that data. I can answer virtually any question about how people interact with our sites without needing to closely integrate with 3rd party services.

Sure, if you have thousands of visits a second, you need to put some thought into handling that load, but it's definitely doable and not too hard. Once we get to that point, we'll probably have the page views going to another dedicated databases and use postgres_fdw to handle the queries across the two databases.
This is just on an official level. Years ago, an overseas Hotmail support employee confided that if needed they will snoop in a friend's gf's email account if asked as a favor.
Hopefully they instituted controls to halt this behavior since then.
But... SpaceX is a corporation, so the main point is in fact making money.
> Only the outside of the mail is [scanned], as opening mail would require a warrant.
Agent Attrition Kills Profits
Reducing agent attrition is a challenging and frustrating part of what we do. However, with the ClearView Performance Management Tool, agents are given the ability to view their own stats in real time which allows them to address problems quickly and accurately
A Japanese doctor once told me that asians tend to have slightly curved femurs from a lifetime of sitting on the floor. He told me this as he was treating me for tendonitis of the ankle that I got from sitting in the seiza position too long.
Being free from the tyranny of Eclipse workspaces is, on its own, damn nice.

If you're the type that likes your version control integrated in your IDE, SVN and git feel much more natural in NetBeans than the Team Provider implementations in Eclipse. Eclipse requires navigating to the source control perspective, adding the repository, checking out, and then selecting the option to look for projects which you can open in your workspace.. its not exactly a smooth process. NB is more akin to what you'd do if your terminal was open.

In terms of stability, NB definitely wins there. Never crashes and none of the typing slow downs that used to bug me [what seemed like] all the time in Eclipse.

The one incredibly irritating thing about it is the way it forks processes when running via maven. Start an http server with netty and hit stop, the process is still running. I've taken to doing most of my testing from a terminal, which is a somewhat janky process I've forced myself to get used to.
Wish I had read this before starting. Played for a good hour and got 2048-1024 in bottom row before reading this comment.

Author should add this 4.5 hour estimate as a nice big warning message.
Just when you think Turkey is a 1st world country...
Symantec fires CEO Steve Bennett
I agree completely. Why wouldn't we want to embrace this neo-feudal model where we can enjoy our life with a literal Lord of the Manor controlling our work and living all in one?
"Exam Price: $250"
Nuff said.
Hotspot shield, or any other VPN.
Actually they pushed both SSH and SSL blacklists: https://packages.debian.org/search?keywords=blacklist
Sicilian Space Program launches pastry into the stratosphere
>Elon ... is an engineer

Oh really? Where did he study engineering? When did he take the FE exam?

That's not a term that you can throw around all willy-nilly, especially in the context of hardware. Next, are you about to tell me that the CEO of Ford is also an engineer?
you can use hotspot shield, it's also available in mobile devices.

http://www.hotspotshield.com/
A GPU doesn't work in the way that Microsoft would have you believe it works. By restricting your worldview to Microsoft's predefined notion of what it should be, you'll never know the true extent of what you can do as a graphics programmer.

A secondary reason to avoid DX is because gaming on windows has a high chance of being dead within the next decade. If that seems laughable, think of how laughable it would've sounded for anyone to say that about CDs for music in 2001.
That wouldn't make much sense, seeing as these combinations aren't physically accurate. You don't make an electron neutrino by combining two electrons, for example.
I'm getting depressed by these kind of news. My votes do not seem to change anything and I feel hopeless. I can't find anything meaningful to say and I just want to ignore the whole situation but keeping silent just feels wrong.
Ah. Yeah, I'm aware of that, and 'implausible' is putting it lightly.
The thing that I liked about that top was that it was unfinished solid wood. You should be able to stain it no problem. I used polyurethane to seal the table top and give it a glossy finish.
I'm not certain that assumption is necessarily correct.

Elon Musk seems more focused on affecting meaningful change and driving technology forward. He's using corporations as a vehicle to do that and making money is an incidental side-effect.

If profit was his primary motive, there would have been many other ways to invest his fortune from PayPal which entailed far lower risk and potentially significant gain.
"You have reinvented PHP better, but that's still no justification": http://colinm.org/language_checklist.html
ETERNITY! ETERNITY! ETERNITY!
Imagine if government had the power to flick a switch place perfect earplugs and blinders on every human everywhere for a time for some political agenda.

I wonder how far men would go (short of just killing people) to suppress the right for people to think, in order to suppress some information floating around in the public space.

Would you flick that switch, to power down an entire nation of drones, just to prevent them from finding out that you did something evil?

Take care you NEVER give other men the right to shut down your brain from afar. It WILL be used against you.
I had the same issue; I'm in the market for a simple, sub-$1000 standing desk, and the main thing I was looking for was what the price range would be. Great work on the standing desk, but please add a tiny bit more up-front info outside the video so mobile phone passers-by can get the details quickly :)
Why Our Digital Currency Startup Is Launching In Canada
Sometimes dinosaurs are awesome, though. See the video of the older commentator at Bloomberg interviewing the daffy twit at Newsweek who "outed" Dorian Nakamoto:

http://www.bloomberg.com/video/did-newsweek-uncover-the-wron...

One of those rare videos that's worth putting up with a 30-second ad.
Yeah, like the UK, right?
Surface 2 LTE quick impression
Most of the thread so far.

A bunch of commentary by 1%ers (Which 90% of HN'ers are) commenting on the morals of people a little bit richer than they are.

Except most people in this thread will give nothing on death to charity.
sad to see sites being blocked. Can you use Tor to get around this restriction?
He did say that. He's out of control unfortunately.
> shaders
What?

https://en.wikipedia.org/wiki/Glsl

https://en.wikipedia.org/wiki/Hlsl
I get your perspective (after checking your profile). Is Louis CK counterproductive because he doesn't grab a pitchfork and head to Congress to reform copyright law? No. He sells his videos for $5 and asks you nicely not to copy them.

Some people try to fix the system. Some people try to do good within the system. Some people do both. Don't shit on someone's parade because you don't feel they didn't do enough, otherwise you alienate your allies.
The usual method for calculating these percentages is to calculate a power rating for each team, then to use the log5 formula[1] to arrive at the percentage chance of a team winning.

So, the 1-4% chance of a 16 winning is the result of applying the log5 algorithm to their power ratings.

Also remember that there's only 80 16-vs-1 games in 20 years, and only expanded to 64 teams in 1985, so it's totally possible that there is a 1-4% chance for a 16 to beat a 1 and it just hasn't happened yet.

[1] https://en.wikipedia.org/wiki/Log5
Many people would see this as a good thing.

It's just a big site run by some American company. Amazingly, there are other ways to communicate.
Look at yourself from 100 billion light years away
some can, the majority can't.
Was wondering the same thing about the Aphex Twin. Is that legal?
I value life more than dead matter. Earth has the potential to be a seed, spreading life abundant amongst the stars, until the entire biosphere mass we know today is but a fraction of a percent of the total in the Universe. Or we could get wiped out in the cradle.

It is possible that humanity could be wiped out and Earth could re-roll another species that could do it instead... but once you dispose of the fashionable self-loathing and look at it rationally, it's not a good bet. (But that's a longer post.)

That said, there's also a pure research vs. direct action aspect, again going back to the fact that the tech for a true off-planet space presence will inevitably produce extremely useful technology for those of us still on Earth. It may be easier to see by putting it in the past... no amount of cooking bread and giving it to hungry people would ever have produced refrigeration technology, or the wide dissemination of it. Had people 100 years ago followed the advice of only taking direct actions to prevent poverty, we would, paradoxically, have a lot more of it today. Again... we can not serialize our approach to problems, we have to attack them in parallel.
Are you planning to open source some or all of the code of your site etc.? Was thinking about a similar service in my country (Germany) and that would obviously help a lot.
Does Typed Racket have DrRacket support for instant feedback on errors? (It didn't 4+ years ago when I used Racket.)

Typed Racket also includes more types, like ": Integer [more precisely: Negative-Fixnum]" (from docs), as well as polymorphic data structures and higher-order functions. I don't know if this is a "fundamental difference" but it might mean Facebook's type checker can optimize in certain ways that Racket's cannot.
After playing this for what feels like an hour (and what may have actually been an hour) I'm suddenly noticing square edges a lot more in my surroundings.
Facebook isn't the web. Its a siloed private service. A company the size and reputation of Fluke should have their very own website that they can put messages like that on. Otherwise, they're merely giving facebook revenue by having that many more pageview opportunities to show everybody ads.
What version of Elasticsearch is this guide targeting? I believe there are some fundamental differences between e.g. 0.9 and 1.0 releases if I'm not mistaken.
Then use Twister [1]. Twister is NSA-proof, censorship reistant, and based on the bitcoin protocol.

[1] http://twister.net.co/
Yeah right. When hell freezes over.
This is funny thing you mentioned because my votes never did anything ever. Victory always goes to that other default side. So much for mock democracy.
They need not be destroyed[1] :

Goods that are seized and forfeited as bearing a mark
that is a counterfeit of a registered trademark, piratical
of a registered copyright or imported in violation of
distribution rights agreements are routinely destroyed,
unless the owner of the trademark/copyright gives
permission for other disposition, such as charitable
donations.

Fluke seems like they might be cool with that.

[1] https://help.cbp.gov/app/answers/detail/a_id/105/kw/what%20h...
I didn't notice that, but indeed, comes across as mature for his age. Good for him.
We do have the best men of Congress that money can buy, because the best Money bought them.
Thanks for sharing that - I have a new respect for Jack Daniels after seeing how respectfully they handled that. A model of how these types of issues should be worked out.
if you've worked on a major porn site makes it a plus on your resume. means your code actually scales.
I recall seeing a posting on Craigslist years ago that was for a backend / infrastructure developer for a porn site. The amount of data being handled and the technical challenges were really quite intriguing.

I suspect there are similar front end challenges in the space.

There are definitely companies out there that won't care where you worked. Portfolio, that I can't speak to.
Stoicism cheatsheet
Engineer working on Hack here.

Historically XHP was developed before Hack. It's available as an add-on for PHP but never became a formal part of the PHP language. When Hack was being designed it needed to work well with XHP (as XHP is used a fair amount with Facebook's code base), so over time it made more sense to start thinking of XHP as being one the language features that Hack offers that is not available in stock PHP.
I haven’t done any testing on mobile, but we could add a few platforms to our integration tests to see what the support is like, perhaps! It would be good to test.
Correlate a statistic with enough metrics, and you're guaranteed to find a spurious match sooner or later.
Hey BvS, Rey from One Degree here. We definitely are thinking about open-sourcing the code so that it can be available anywhere/everywhere. We don't have the capacity to do that right now, but stay tuned in the future! Or maybe we should just expand to somewhere in Germany for our next site?? That'd be sweet.
mac book pro 15" screen retina display. No compromises. You want to make great stuff, but good stuff.
Unfortunately, the IntelliJ community edition doesn't support most non-JVM-based languages. This is the main thing holding me back from it -- I mostly program in PHP but I do a fair amount in Python, a little in Ruby, some in Javascript, and recently some in Clojure. To do all this with IntelliJ requires the full commercial "Ultimate Edition."

And just to top it off, from all appearances the free Clojure plugin is being deprecated in favor of the third-party Cursive Clojure, which is free now but "will be a commercial project at a similar price point to PyCharm or RubyMine." Since it's not a JetBrains product, that's more than likely means another $99 on top of the $199 for Ultimate. I like what I've seen of JetBrains' stuff but I don't think I like it enough to shell out that much.
That would still dilute the mark. Fluke had a lot of options and it looks like they took the best one.
Offhand, the major benefits for your use case seem to be:

- Speed and Flexibility: Extremely quick turn around time from development to production; Docker images usually start in under 10s and multiple images can be run concurrently. If a user needs to update their running service(s), they can even have multiple versions running at the same time behind something like HAProxy (which itself could be in another Docker container), allowing real-time migration.

- If your users build their images and test them on their own machines, they can then deploy the same images to your production machines with the knowledge that (barring unusual circumstances) they will have the same exact image and dependencies running there. This means no need to write a recipe, less worries about security, and more freedom for your users to use whatever libs they deem necessary (assuming such freedom is allowed).

- If running images directly is not doable for security reasons, your users could use Dockerfiles [1] which still allow you the benefits of Docker but with the ability to review all commands used to create the image. They can even be built in real-time off of GitHub pushes [2] (disclosure: I'm a co-founder at Quay.io)

[1] http://docs.docker.io/en/latest/reference/builder/
[2] http://blog.devtable.com/2014/03/link-your-quayio-repositori...
Nice! What persuaded you to write this polyfill?
Sergey Brin's Home Page
nothing like a timeless ripple effect on your profile photo ;-)
Amazon has physical warehouses and a supply chain. Hyatt has property and employees all over the world.

Airbnb has a website. The entry barrier to competition is very low. They are not unique at all.
I'm not saying is a bad idea. I think a doctor has to be smart. But that said, I'm not convinced that my doctor need to know all the nuances of Diels-Alder, and pass OrgChem with top grades.

But, thinking further, I do not really understand how the evaluation is done.

What does that A grade really means? It means he has a grasp of what benzene is, or that I can hire him for doing my syntheses?

The system is very broken. I hope one day we'll have some serious D&D-like rules in our instruction:

MD:
Org Chem >8
Surgery >14
Int >16
Char >14

OrgChemist:
Org Chem >18
Surgery >4
Int >15
Char > 3
False: http://www.paulgraham.com/nerds.html

Techies could easily game the system; but that's a boring game for boring people, and in the grand scheme of things does not matter. There are much more important things to spend time on.
I just want to clarify something: I am not calling anyone stupid. Generally the engineers at Facebook are smart, talented, and good at getting things done.
Cryptographic Right Answers (2009)
Something has to be done before this sets an example for other governments. Freedom cannot be taken away from anyone.
Why in the world would/should Fluke give away ~$800,000 worth of product (that sparkfun would make a ton of money off of) because someone decided to violate their trademark and paid the price for it? We're talking about 2,000 vastly inferior multimeters here.

You may or may not agree with the trademark being issued in the first place, but it was, and I don't blame fluke for wanting to protect their brand. They make a really good product. These things are pieces of garbage in comparison.