skysight-inc/HackerNews huggingface dataset:
Not necessarily true. Depending on your use cases, it often still makes sense to use Hadoop. A really common scenario is that you'll implement your 3.5 GB job on one box, then you'll need to schedule it to run hourly. Then you'll need to schedule 3 or 4 to run hourly. Then your boss will want you to join it with some other dataset, and run that too with the other jobs. You'll eventually implement retries, timeouts, caching, partitioning, replication, resource management, etc.

You'll end up with a half assed, homegrown Hadoop implementation, wishing you had just used Hadoop from the beginning.
Delaware [Songwriter] turns pain into profit
That's what I did. I was fresh out of a college nobody's heard of, joined a startup as their first employee and eventually networked my way into a big tech company.

Nearly doubled my salary when I eventually jumped.
Everything in the article sounds like trigger-happy speculation at best. Their equipment was brought down during a fire drill, but reading the article, it doesn't seem like anyone actually says or knows why.

According to people familiar with the system, the
pressure at ING Bank's data center was higher than
expected, and produced a loud sound when rapidly
expelled through tiny holes.

The bank monitored the sound and it was very loud,
a source familiar with the system told us. “It was
as high as their equipment could monitor, over
130dB”.

Sound means vibration, and this is what damaged the
hard drives.

Those are the words of the author, in that last sentence. It's simply journalism at this point. It's not something worth construing as a technical assessment.

They (the staff at Vice) just want to scoop the article, and get Vice into the action. Was it a siren that was too loud? Was it pressure differential, triggering a head crash in a bernoulli box?

Since we're at least two degrees removed from the actual events, and we'll probably never get direct information from a postmortem report, this article, to me, reads as: Data Center Outage in Eastern Europe, Reason Unknown
The Air Force requested the ability for the shuttle to take off from Vandenburg Airforce Base, go into polar orbit, and then land back at Vandenburg at the end of that one orbit. This required that the Shuttle have ~1000nm of cross range (that is that once it deorbits, it needed to deviate from its ballistic path by 1000nm). This required big ass wings (which the shuttle got).

The Airforce also helped drive the payload (weight and dimension) requirements, but I feel that this is secondary to the cross-range requirement.
Well, if Israel also stops claiming its surrounding land.
https://www.youtube.com/watch?v=gACIsz_vSXE
LMAO.

Did I say that analogy is the end of the road?

You are one entertaining dude.
I'd expect the same sorts of sales tactics regardless of the car you were trying to buy.
My nephew likes them because they're one of the few toys he has where he's encouraged to take them apart and put them back together. He can play with them as roughly as he wants. If they break, it's no big deal, just put it back together.
Well, it depends on what you're trying to achieve. There are legitimate reasons to try to achieve the highest possible pay per year, no matter how many hours in the year you have to work in order to get it. In the case of 80000 hours, the goal is to donate as much money to charity as possible, and, if I may put it somewhat crudely, they would prefer you work as much as possible, only stopping work in order to eat and sleep, if that's the way to achieve the highest salary, since the noblest calling in their view is to dump as much money as possible into (the most optimal) third world charities, and 80000 hours has already taken the time to determine which charities maximize third world utility. (Technically, you need to deduct the negative utility to you from working increased hours, but your utility should be the same as a poor person in the third world, so that negative effect is minimal.)
Quite a lot of this goodwill went away after GWB was re-elected. We all thought you made a childish mistake at first (do the downvoters of this comment even remember that campaign? perhaps they were in kindergarten), but the second time.. that was what burned bridges.
You are easy to read.

You admit a small error so that you can feel justified on your larger point. Hard to explain, but it is like reading the body language of a younglin. Sometimes you even know what they are thinking before they do.
Persia is a great ancient civilization - with rich culture, history, and morals. It's sad that most people in America do not make a difference between an Arab and a Persian! Most Persians get seriously offended if people confuse them with the camel herders.
Just sour grapes.

You don't have any magical insight into the industry. You're just drawing conclusions from one data point.

Here are two more data points for you: I've worked at two startups and so far both startups are solid successes.
In any other job or social position, her temperament could have destroyed her life. It seems miraculous that she found her calling.
Language Exchange Slack Community #languageexchange
Remove the scary word "algorithm" and this whole issue seems blown up around something fairly mundane. If the police hand calculated how many crime reports came from each area no one would care.

People are so scared of algorithms. There is now scientific evidence confirming that severe distrust of algorithms is a pervasive human bias. Search for "algorithm aversion". They do trust them when they are believed to be infallible, but as soon as they learn they can make mistakes, they vastly underestimate them. And this is a damn shame, because in almost every case even very simple statistical procedures outperform human "experts".

Worse is this nonsense that algorithms can be "racist". As if a computer can have prejudice or care about anything other than maximizing accuracy. The media loves to fuel this narrative. E.g. the big hoopla when Google's image tagger tagged a black person as a gorilla. They had to remove it and apologize.
> Well, if Israel also stops claiming its surrounding land.

What land belonging to Iran does Israel occupy ? care to explain ? does that justify calls for the extermination of Israel and the Jews ? does that justify holocaust denial ?
You're both right.
You shouldn't need scipy for this. Perhaps you meant 'numpy'?
Her father sounds a little too much like my daughter' father. Leaving him was the easiest thing I ever did -- it just took 13 years to work up the courage to do it.
And yet, look what kind of candidate is still in the race to become president. The American government is voted into office. At least parts of the American people are also partially responsible. I am not saying, they could have known entirely, but the US is involved in the Middle East making it worse and worse since the early nineties, well before 9/11.

Edit: Actually since after WW2, but the Iraq wars started in the nineties.
I believe "it" was a reference to Israel, not Iran. As in, expansion of Israel at cost to Palestinians, not Iranians.
$1 million is practically nothing as far as startup funding goes. Especially in the Bay Area. That's basically a year to find product market fit and raise another round.

No offense but you don't sound like you have enough experience to be commenting on our industry as a whole.
I have the same impression. Unfortunately the Saudis have the oil and that makes them valuable allies. Whereas Iran is basically at war with Israel, which means the US will never be able to be in good terms with them.
Reference the AI effect:

https://en.m.wikipedia.org/wiki/AI_effect
Again, you are cherrypicking any flaw you see and then attacking. For a logically-trained person you are misusing it. Being overly logical can become a negative when it is used to justify your already-held beliefs.

I do not care what you think at this point, this has already blossomed into a 1 vs 1, so anything said will just make both sides more justified in their position.

This is about onlookers. Hacker News is flawed in the same way that elections are flawed. Every user is given the same power of opinion. A losing strategy that will eventually begin to conform to the middle of the pack, condemning any opinions falling too far from the centre.

Apathy, I have to ask you. If you are getting all the votes, all the +1's, all the likes, would you ever think that maybe that is not a good sign?
180g a day is 6-9 times as many grams of carbs allowed in a low-carb diet.
$1 million dollars used to be enough to buy the American Dream and have enough left over to send little Timmy to college. How 'bout them apples?
Agreed - Lego uses better plastics (ABS) and has much tighter tolerances than the imitators. I expect their designers also benefit from having a huge library of parts to draw on.
So much plastic... they should release compostable Lego.
Ironically, it was the Cyrus the Great of the Persian Empire that was responsible for exiled Jews to return to Jerusalem and build the Second Temple:

https://en.wikipedia.org/wiki/Second_Temple#Biblical_narrati...
Our country is just shy of $20 trillion in debt because investors spend their cash on startups like mine and expect the government to write it off on their taxes when it fails.
Completely disagree. Even if you're maximizing for donations, any reasonable analysis would still have to privilege your own well-being as a giver. Lowering your burnout/regression rate from 25% to 5% by giving yourself a higher quality of life seems like one of the best investments you can make.

You don't need to expend wads of cash. But you don't need to be destitute as a software engineer to give effectively.
That's a terrible comparison. The impact of $1 million dollars on a family and the impact of $1 million dollars on a seed-stage startup are totally different. Did you really work in the tech industry? It doesn't sound like you know what you're talking about.
Hey csallen, thanks a lot for sharing -- definitely gives me some ideas. Also, great work on IndieHackers!
And to add onto that, it's insulin the protein that sends the signal for your body to store fat.

...and guess who's the bigger culprit for inducing insulin production. Hint: It's not fat.
The banks have a profit motive for assessing credit risk accurately.

They have a clear incentive to not underestimate prospective borrowers' credit risk (or they'll lose more in defaults than they gain in interest), but the only incentive to not overestimate someone's credit risk is that someone else might offer a loan on better terms. Even if they are aware of flaws in their assessment process that overestimate a borrower's risk, they probably feel safe in the knowledge that everyone else is using that same process and will overestimate risk in the same way. A more accurate credit assessor could profit from this situation ("get your credit reports from us, and you can undercut lenders who rely on the big three"), but the barrier to entry is rather high.
Weird though, isn't it? If the design is not protected, you'd figure somebody would make bricks of the same quality for a lower price.

Business opportunity...?
Musk also isn't on record as calling his customers "dumb fucks," the way Zuckerberg is.
Musk is all about saving humanity, he's apocalyptic. Probably rightly so. Improving also, but not what really drives him.
Circuithub YC Winter'12 batch baby. I make more money at the post office duder.
What about a tractor trailer (like Florida) in the same spot as a white listed traffic sign?
CIS 198 or something else? https://cis198-2016f.github.io/

I am currently "attending" the above mentioned course by following along online. I am enjoying it very much so far. There have been three assignments so far, the first of which was to get rust installed and such. I think it would take most of the HN crowd less than a week to catch up with the course so that they can follow it for the remainder of the semester, even if they have a day job. The most experienced programmers might be able to catch up within just a few hours.

The schedule at https://cis198-2016f.github.io/schedule/ has links to the slides, lecture notes and assignments.
They log everything whether you opt in or not. But as a cell phone user, I feel like I have opted out of all location privacy already.

I'll trade my location privacy for awesome car capabilities.
thanks for the worthy attempt at explanation, but the b-class sci-fi feel of this remains so strong, i cannot help but associate this having to do with Sleestaks and Time Pylons
Yes but you say that as if that isn't the same around the world. I've lived in 3 countries and visited 11+ and it is. Light-skin preference is not a US phenomenon.
I believe you, but I think that misses the point. My takeaway here is that Tesla is just getting started with Autopilot.

Despite the hype, this blog post makes it clear that Autopilot is just a very simple camera based system that requires human monitoring (but is still very useful in my personal experience). Now they are releasing a software update that uses the previously unused radar hardware as well as machine learning to achieve better results. This is exciting because they're going to keep releasing software updates over the air and the software is just going to keep getting better and better.

The fact that the hardware is shitty doesn't concern me. Google's self driving car project depends on a Lidar system that costs $75,000 today. That's almost four times what the average car costs, and it doesn't work in bad weather. Regardless of how good Google's software is it could mean nothing if Tesla acheives a similar or better result using cheap commodity hardware. The hardware will only get better over time at the same price.

Tesla is in a better position to bring full autonomy to market than anyone else, since they control the hardware, the software, have cars in the field etc. For this reason I wouldn't be surprised if Tesla becomes the first company to break a market capitalization of $1 trillion dollars. Computers gaining the ability to move around the world with drones and autononomous driving will have an economic impact bigger than the introduction of the internet. Where we are now is meaningless. What matters is that Musk has stated the goal and we have something in the field today that can be updated iteratively over time until it's perfect (which will be never). We may not be very far along this journey, but we've taken those hardest first steps towards the next big technological revolution that will once again change everything about how humans live, the implications of which we can't even begin to imagine.
What do you mean by "spy"? All the three letter agencies actively recruit on university campuses (as in job fairs). Some of those hired that way will undoubtedly end up in undercover positions.

Outside of official positions, have skills or access they need and either contact them or respond favorably when they contact you.
The reason it's interesting is that the star appears to contain a variety of short-lived isotopes, not just of plutonium: e.g. promethium-145, with a half-life of just under 18 years.

Some as-yet unidentified process is replenishing the star's isotopes. An idea I've seen[1] is that the radiation from its neutron star sibling, invisible to us, is powerful enough to trigger nuclear reactions in the star's ionosphere.

1. "A hypothesis for explaining the origin of Przybylski’s star (HD 101065)" http://link.springer.com/article/10.1007/s11963-008-1005-7
https://www.youtube.com/watch?v=s7RmcdHrYuk
Far as I can tell, the intelligence community is a fork in the road on the career path to diplomat. You study languages, public policy, international relations, etc. You get State Department / vague US gov (National Security Language Institute - Youth) scholarships to fly to the middle east and learn languages over your summers. You do internships in college with State and think tanks. It goes from there. (This is probably more for analysts than field agents).

Of course, actual physical badassery is carried out by special operations divisions of the armed forces - you get there by being a really good soldier, sailor, marine, or airman.

The intelligence services do just have regular job boards, college recruiting, etc. too. And then there's private intelligence firms, which have some overlap with journalism (i.e. Stratfor and Reuters both sell intelligence services in addition to their publications).
"You have a few petabytes of data and your working set is 50 TB. You put it on two machines. All your data is now on these SGI UV 3000s or whatever. "

There's usually a combination of apps that work within the memory of the systems plus huge amount of external storage with a clustered filesystem, RAID, etc. Example supercomputer from SGI below since you brought them up that illustrates how they separate compute, storage, management and so on. Management software is available for most clusters to automate or make easy a lot of what you described in later paragraph. They use one. It was mostly a solved problem over a decade ago with sometimes one or two people running supercomputer centers at various universities.

http://www.nas.nasa.gov/hecc/resources/pleiades.html
This is just a minor annoyance, but the header image of this article, which has been used in other articles [0], is CC-BY 2.0 licensed [1], and yet is not attributed to the original author at all.

(Perhaps even more interesting is that it looks like it's being used to depict a startup company environment, even though it's actually a hostel in Amsterdam during the Wikimedia Foundation's annual international hackathon.)

[0] http://silicon.nyc/code-academies-new-york-coding/
[1] https://commons.wikimedia.org/wiki/File:Wikimedia_Hackathon_...

EDIT: I misread the license. It's CC-BY 2.0, not CC-BY-SA 2.0.
Clearly, US law allows bare breasts as speech.
Elm, JavaScript
Swift, Java
Python
Show HN: Competitive Analysis of Government Vendors
Gawker disobeyed court orders and obtained illegal goods. No one could survive that.
If you're going to believe every rumor you read you'll be convinced of anything. SSD devices are very durable except if they're subjected to repeated and extreme levels of heating/cooling.

Also I'm not sure what datacentres you work in but I've never heard of one being turned off for six months. You can spin down drives when they're not in use, but that's mostly to save energy. An idle SSD uses almost no power, there's no reason to spin it down.
>And "doing things wrong" means not checking the return value of every single syscall you use.

There are people who think not checking every syscall is a good idea?
Funny how the whole agenda for the region is set by Israel and not the US themselves.
True on both points. Thanks.
The positions they need to fill are unique enough that they will find you if you're a candidate.

I was courted pretty heavily by CSIS[1] & the CSE[2] in Canada coming out of school (Waterloo), I assume because of my language profile and degrees in CS & cryptography.

Being recruited for a semi-covert program is a really interesting experience. I still can't (and would not!) talk about most of it, but was really close to signing on.

1: https://www.csis.gc.ca/bts/role-en.php
2: https://www.cse-cst.gc.ca/en/about-apropos
If Israel would stop physically attacking Palestinians, and stop running an apartheid state, this complaint would have some merit.

Measuring every Middle Eastern geo-political question as "But how will this help Israel" is both short-sighted, and will lead you to support gross violations of human rights.
I actually agree with you. I was being a bit facetious - 80000 hours is somewhat infamous for a rigidly utilitarian view of effective charity and for optimizing for monetary means of increasing the effectiveness of said charities. But even they recognize the risk of burnout.
We use Hotjar recordings to see what people see from various regions. It's pretty useful in that we can see how the page loads for users outside of the US. But beyond that, we can see what they interact with on the page.

This seems useful from a very high level, but if someone wants more data points I'm sure they would use something more robust.
Candidates are selected in primaries which represent only a tiny bit of total american voters. So thats it.
Rent is the answer to high upfront cost and low maintenance operations cost.
To be fair, Iran is the largest exporter of religiously inspired terrorism in the world, bar none. No other country has a deep institutional commitment to cultivating and supplying terrorism that can match Iran.

Edit: I'd encourage all the downvotes butt hurt by this truth to learn a little more about the Iranian Revolutionary Guard and the Quuds forces. No other country has a special forces dedicated to cultivating, training and supply in terrorists worldwide (groups like Hamas and Hezbollah are only two examples out of many). We're not talking a one-off phenomena, rather a multi-decade program that has split the world into sectors and has dedicated special forces in each area. This is why you have IRG trying to cultivate Islamic extremism in Venezuela, and bombings of Jewish community centers in Argentina. It's literally not a contest; Iran has been the most skilled and successful sponsor of religious terrorism in the world.
If there was no oil in the region the US wouldn't care and Israel would be a non-factor.

Since there is oil, the US needs reliable partners. Saudi Arabia (totalitarian regime with an abysmal human rights record) and Israel (actively engaging in war crimes and apartheid) are the best America can manage.

Saudi Arabia has more money than they know what to do with, and they're easily placated by selling them advanced weapons. Israel is on a much tighter budget and is more militarily vulnerable so they need a lot more help. That they've pissed off everyone in their immediate environment doesn't help, either.

Sadly, pre-revolution Iran and pre-civil war Lebanon were vibrant, flourishing countries. Then some geo-political meddling went down and here we are, a total mess.
Even if you're very flush it's handy to have the ability to use a credit card for a transaction because your checkbook is at home. Maybe you want to buy something and then sell some stock when you get home to pay for it? Credit is handy when you don't need it. I would imagine :)
Optional but actually semi-mandatory.
You have to manually accept the software update to install it, but there was recently a case reported of someone who was refusing to do this and stay on an old firmware. Over time, Tesla gradually deactivated things like navigation and entertainment systems (if I recall correctly), claiming that they had upgraded their APIs and they were no longer compatible with the owner's firmware. In reality I suspect they are just punishing the owner to coerce them into upgrading their firmware.
Here in Oregon it can be free, as there are ballot dropboxes at public libraries, along with election commission offices if you don't want pay for a stamp.
Seed rounds have certainly exploded over last few years.
> Superfluous income is disposable income

Only if you don't rent a nicer/closer apartment. (OTOH, lower commute times are associated with happiness).
"camel herders". wow.

The Arabs had great/ancient civilizations too. The whole region is rife with rich history.

Anyway, lots of people get offended if you confuse their ethnicity ( eg: korean <=> japanese, china <=> japanese, indian <=> pakistani, thai <=> cambodian ...) Doesn't mean it's rational. Doesn't mean you have license to denigrate either of the groups.

This is just a flavor of racism.