skysight-inc/HackerNews huggingface dataset:
The safest way is to backup the data lake. To rely on external backups is really risky because you're counting on every source to have a proper working backup and a way for you to access it if you need to rebuild the lake. On top of that the time for every team to get their backup to you and to load it back into the lake is another factor.

Really counting on other people/teams to have backups of your data is asking for pain.
> Is the retrying logic smart enough to set up some kind of watch on the values

Yes. It only retries when one of the referenced values is updated.

This does violate the rule "only use mutexes and condition variables", and perhaps the rule added at the end "you can't read the values" (comparing memory without reading from memory seems like quite a trick!).
"economic intelligence" sounds so much nicer than "corporate espionage"
Isn't it a little bit generic?
Could you please make some significant examples?

Thx,

AC
Take a look at its workshop page on Steam. It really does have a nice selection of games. (I think Vassal probably has more wargames though if that is what you are into)
The Price of a Zombie Help Desk
There's no evidence whatsoever that the NSA has given any industrial intelligence to private US companies.

According to this brief article (why we link to TechCrunch instead of WikiLeaks on HN is not clear to me), the leaked documents do not bridge the gap between the NSA spying and the NSA delivering industry secrets to private US companies, which we know China to actually do.
Hmmmm not a bad idea, though that would put some friction in the interactive nature of it, which is really important to us. We haven't had a lot of problems with people showing passwords etc so far as people either 1. have two screens or 2. just use window capture to avoid showing something they don't want to.
Usually when there's an acquisition like this, there's some sort of bonus as long as the employee stays for X months/years. I think 2 years is pretty common but considering how young Uber is, it may be different.
My Co-Founders Took Away Everything I’d Created. Here’s What I Learned
Mocking framework for testing stored procedures on Microsoft Azure's DocumentDB
Does anyone know what technology is used to providing streaming? Both in terms of the broadcaster and the viewers. There doesn't seem to be any big open source projects in this space from what I can tell.
You might like https://github.com/chrippa/livestreamer
Anecdote:

I've had to use Microsoft products (Windows & Office) in an enterprise environment before and, while I'd much prefer to use Thunderbird & GnuPG, Symantec's commercial PGP products in conjunction with Outlook are a good solution for this environment. A centralized server controls configuration and policies and, once up and running, it just works(TM) and, IME/IMO anyways, was a better solution than Outlook + S/MIME.

Of course, this required both sender and receiver to have/use PGP and/or a compatible product.
I'm a huge fan of streaming coding, mostly because of Markus Persson and the Ludum Dare streams (one of the first http://www.twitch.tv/notch/b/293076467 where he builds a dungeon crawler, skip ahead a bit).

The big downside for me though is the login requirement just to watch - I don't think I'd watch Twitch if I had to login just to see streams. I think getting rid of that would really help you guys grow - code streams are pretty addictive once you start watching.
I'd love to read about people's real life uses of Elixir, whether it be for their jobs or side projects.
Yeah it would be good to get rid of it at some point - need to check with my cofounder why we use it but I agree flash isn't great.
Nuclear power plants in the U.S. pay a fee for waste disposal. Those fees have accumulated in a fund, currently amounting to over $30 billion. The money was going to go to Yucca Mountain, until that project was shut down.

The long-lived fission products are a very small portion of the total waste, and if we only had fission products to worry about, the total waste would go back to the radioactivity of the original ore within three centuries or so, since most fission products are relatively short-lived. It's pretty easy to contain them for that long.

The great majority of the total waste, and almost all the long-lived waste, is transuranics. Those can also be considered unspent fuel, and fissioned for energy in fast reactors or with neutrons from D-T fusion reactors. The Russians have a couple fast reactors in commercial operation, one of which has provided 560MWe to their power grid since 1980. They're working now on using them to process transuranic waste.
Greeks are rushing to Bitcoin
I have a product in beta right now that was created to solve this problem for my own agency and now I'm bringing it to market as SAAS - https://www.getbridgeanalytics.com . I don't list the actionable insights you describe on the splash page features but that is what is being built behind the scenes. Its in very early beta but I'd love to have you join if you are interested. Let me know at mike@getbridgeanalytics.com
A loan is an investment. Like almost all formal investments there are rules, laws, and contracts involved. When an investment goes bad both parties tend to suffer.

When I defaulted on my mortgage the bank got the house and I bought another one for a much cheaper price. The bank lost money. It happens with investments. That's part of the risk. I still secure credit and have a 750 credit rating even with a default on my record. My credit card company still trusts me. I've suffered no long term consequences other than that I can't get another mortgage for 5 years.

The point of me writing the above is try to show that defaulting on loans is not a black/white issue. It's not either or. There are shades of gray sometimes. And most certainly, when a bad loan is made both parties should suffer consequences.
Interestingly, they say 18F jobs are capped at four years. I wonder if this is a harbinger of change overall in government employment from being "lifers" to a more mobile workforce where people perform "civil service" at all levels as a more temporary thing (like elected positions are intended to be). On the other hand, it also strikes me a possible way to select for younger (less encumbered/tied down) applicants without explicitly performing age discrimination.
I can't see how they would be much different from the use cases of Erlang/OTP, of which there are plenty of stories.
To argue that something clearly wrong is ok because everyone else is doing it is just plain stupid.

In that fashion, ISIS could argue that their torture is ok and necessary because the USA is also doing it to obtain information.
People's experience with Stephen Wolfram is that he is very biased and self-serving, hence the popularity of an anecdote from an external source.
Network effects are intensely powerful. People use the big SV data silos because people use them.
Basics of C language
I am an indian, here computers are taught like literature. If u understand it well otherwise mug it up. Can anyone please guide me to course material to understand basic concepts of C.
This is awesome :-) Thanks for the link!
I think you would like to know that your comment is completely impenetrable to an average intelligent layperson. All the words are reasonably understandable, but I have no idea how they translate into a response to the parent comment. My guess is that you're falling prey to the illusion of transparency [1], though I suppose it's possible that you were only intending your comment to be meaningful to people familiar with the industry jargon.

[1]: https://en.wikipedia.org/wiki/Illusion_of_transparency

Edit: +1, much clearer what you mean now.
Learning Spring-Cloud – Writing a Microservice
Not sure about waste, can someone else here speak to that? Also deaths per unit energy are incredibly low relative to other sources.
Power plants fund their own decommissioning [1]. And they also (in a way) already pay for disposal - a 1 mill per kWh fee on all energy generated payed to the federal govermnent in exchange for the feds taking responsibility for disposal [2]. This fee has been paid for decades - the industry has no problem supporting that level of disposal cost (and could even afford a higher fee if necessary). There has been an enormous amount of research into ways for dealing with the waste all kinds of disposal, treatments, recycling, etc. The only real blocker has been a lack of political/public will to make any decisions and move forward.

[1] http://www.nrc.gov/waste/decommissioning/finan-assur.html

[2] https://en.wikipedia.org/wiki/Nuclear_Waste_Policy_Act
One important thing to note about this is that it requires writing to the page/descriptor tables, so it must be done from ring 0. It makes a great "stress test" for emulators though.
How is this anything but useless pedantry?
Perhaps we should call it all Big Bang energy.

I agree this is silly. Harnessing the radiant energy of the sun is categorically different from converting wind or carbon into usable energy. Trying to group these into one category seems out of touch with the reality of developing the t technlogies.
You could get super pedantic and say it's all gravity based energy, but it stops being a useful way to classify things long before that.

Distinguishing between carbon and atomic is a pretty useful and meaningful distinction, although ultimately not perfectly correct.
H1B Data (2015)
It's not paranoia, it's a real issue with that waste.

We have no working waste solution as of today.

We have no working long term storage solution as of today.

We have not priced the cost of long term storage/plant decomissioning etc at the full cost into the price of nuclear power - that is for most countries.

https://en.wikipedia.org/wiki/Asse_II_mine

http://www.spiegel.de/international/germany/dealing-with-ass...
edit: its off-topic

This surprised me: " The plant is estimated to weigh collectively 6,000,000 kg (6,600 short tons)"

I always tought that one ton was equal to 1,000kg. So this could be a typing mistake on wikipedia, but then I followed the link to https://en.wikipedia.org/wiki/Ton and found out that is quite a mess its definition:

"In the United Kingdom the ton is defined as 2,240 pounds (1,016 kg) (avoirdupois pounds).[2] From 1965 the UK embarked upon a programme of metrication and gradually introduced metric units, including the tonne (metric ton), defined as 1000 kg (2,204.6 lbs). The UK Weights and Measures Act 1985 explicitly excluded from use for trade many units and terms, including the ton and the term "metric ton" for "tonne".[3]

In the United States and formerly Canada[4] a ton is defined to be 2,000 pounds (907 kg)."

Any case, for me, living in a country using the metric system, appears that I should use the word "tonne" as translation for "tonelada" (metric ton in portuguese). This means that I am thinking the wrong quantity whenever I read "ton" on a american text. Quite a discovery!
Who says I'm not worried about all the "bad" things(tm)?

To be honest I'm just asking the question that while we can all say "isn't it great how safe nuclear is" we still haven't 100% figured out the waste issue. Fusion... well I'll believe it when it's powering my DeLorean.
What argument are you trying to make by throwing in the phrase "security through obscurity"?

This work is different from the kind of things that phrase usually refers to.
> using reactors designed to use the waste as fuel

What do you mean? The waste is full of nuclear poisons (a technical term, isotopes that stop fission by neutron capture). Reusing it means reprocessing to extract the Plutonium, which is burnable in a reactor (particularly as MOX). The chemistry required for this is pretty messy, and the radioactive environment (fuel from a power station is very 'hot' radioactively speaking) so horrific that you need a fully robotic plant.

This hasn't gone great for the UK,
https://en.wikipedia.org/wiki/Thermal_Oxide_Reprocessing_Pla...

But we do now have 112 tonnes of Plutonium as a result of our half a century of reprocessing. Which no one knows what to do with, and is an enormous liability.
I never had any plans to learn Ruby, but I'm going to now.
It suddenly becomes a solvable problem.

If something is infinite, meh, it's infinite, what you gonna do. But if it's a few million years ... whoa, we can reason about that!
1) I started releasing it as closed source because I don't have knowledge about open source management. I work in the corporate world for many years and I know how to manage private projects. At this moment I fear that if I release it as open source, it will fall in a kind of anarchy and that I will lose control over it. I know this idea is wrong, there are many well driven open source projects that generate revenue, but until I know how does this world work, I prefer to share it as closed.

I hope this aspect is not so bad that people don't want to at least try it to check if it's worth it...

2) The MSVC-only build is for the moment. In my roadmap I've planned builds for at least Linux, Android (NDK native) and Windows Phone. But the platform I know more is MSVC, so it's the first release. In fact I have a working build for GCC that will be the starting point for Linux and Android, but I still have to integrate libpng. This build only loads BMPs (not PNGs) and CSV tilemaps (not zip compressed) as the MSVC build does
I'm curious why the "just" qualifier? Is there anything that makes a pre-shared key a bad idea? (Particularly if someone follows the habit of one per private email, exchanged out of band.)
> Europeans are too naive about economic espionage.

I kind of agree. At the same time, France is one of the few countries that put satellites in space, sells fighter jets, have semiconductor factories, aircraft engine factories (Snecma)

I know, from the outside it looks like they only care about Wine and stinky cheese.
I think it's wishful thinking. I knew of a guy who wanted to open a coffee shop. He got to know another existing coffee shop owner and picked his brain for the dos and don'ts. He said, I'll be opening a shop (in a diff city) and I see yours is doing well...

So what does he do? Opened a shop one block down and drove the fist guy out of business.

Business is ruthless.
Also the origin of the news site Pando:

https://pando.com/about/
For a start, encryption could be used more widely.

Which is the polar opposite of what some governments want[0].

It's almost as if governments are playing the terrorist card to push through laws which benefit them—the political class.

Oh, but that's OK: everyone does it!

---

[0] http://www.theguardian.com/commentisfree/2015/jan/13/cameron...
I didn't know that was a thing. Thanks for mentioning it, i'll have to try and find one of those! :D
I wonder what environmental impact truly large-scale solar energy will have. In that it is moving energy away from where it would usually fall on the ground/plants, thus reducing heat, less rising air, less photosynthesis etc. Perhaps additionally aid global cooling? Though that energy will mostly end up as heat anyway.

(Of course it's far better for the environment than present coal/petrol/gas/wood, and their energy initially came from the sun anyway, but it will still have some environmental impact.)
"White privilege." Fixed it for you.
That's a big ask Googles software requires a different mind set than say correctly calculating veterans pensions.

From googles perspective having 2 or 3% suboptimal query's is fine but that wont pass muster for other types of work.

Try building billing systems for a global Telco and have one of Vint Cerfs reports nudge you and say this had be right otherwise we are both out of a job :-)
Aerobic Exercise: The Best Weapon Against Belly Fat
> It's rarer that open-source software is more featureful and functional than competing closed source software. In fact I'm struggling to think of any that are clear-cut.

I think the canonical example has been web browsers, for instance.
I think the US Digital Service is a great initiative and I'll consider taking a tour myself in the future. That said, I don't really like these kinds of thinkers who believe the only companies that are doing something "that matters" are non-profits working directly on a specific problem in healthcare or poverty.

I have yet to work for a company, from non-profit internet companies to product-oriented SaaS startup powerhouses, that didn't enable some great initiative or program that could not have existed without that company creating and improving their product and making it accessible, via availability or cost, to the non-profit that needed to worry about doing their actual work.

Take the author's old company, Google, for example. They don't do anything "that matters"? I assure you there are many non-profits, charities, and important initiatives around the world that would have a much harder time if they didn't benefit from technologies that Google ushered in to the world. Mass, cheap communication via free email that is highly-available and untied from specific ISPs. Free, globally available document storage to safely store records and share documents across the globe, saving on the cost of having an entire department to handle the same task.

These products may seem frivolous and unnecessary to us, because we can (maybe) live without them. But there are organizations directly doing important, charitable work that can't. Saying product companies that don't directly work on the world's poverty, social, or health (etc.) problems are not working on "things that matter" is just pretentious, in my opinion.

All that said, the author has the right to feel the way he feels and work wherever and on whatever he wants to. Just don't tell everyone else what they do doesn't really matter.

But that's just my two cents =)
It's cool to hear someone using it, but it's still doomed to be relegated to use inside private networks versus being used as a general use internet transport protocol, which was the point I was making.
SaaS on the Consumer Side
California bill to limit vaccine exemptions goes to governor
> Isn't decommissioning nuclear power plants still basically a huge bill underwritten by the tax payer?

That's an important question, but climate change is a far larger bill underwritten by the tax payer (and millions or billions more who can't afford taxes), so I don't think the question is a deal-breaker.
This is fantastic. Nuclear fission suffers from a hindenberg-type PR problem, where incidents from early design mistakes and poor choices color the opinions of people even though modern reactor designs are safe, efficient, and essentially clean other than small amounts of waste.

I would love to work on a project like this.
They probably do make that argument.
OpenOffice is "good enough"...

This is a matter of debate, depending on what circles you're traveling in. If you're working in a "mixed environment" where some people are using OpenOffice and some people are using Microsoft Word, you're likely to run into problems that range from minor annoyance to show-stoppers very quickly. Some of this can be blamed on Microsoft's weird file formats, but this is true not only for .doc files but for the better-documented (if arcane) .docx and, in my experience, even with RTF. I'm in contact with a fair number of small-to-medium press fiction editors, and while a fiction manuscript is one of the simplest use cases you can imagine in terms of formatting, almost every editor I've talked with has complained about OpenOffice (and to a lesser degree LibreOffice) screwing up comments and revision tracking. I don't really want to use Microsoft Word, but so far I haven't found an open source equivalent for my needs that is good enough. (The closed source Nisus Writer Pro and even Apple Pages seem to do better, ironically. But that's not to say they don't have their own problems.)

I tend to think of open source's most well-established terrain as languages and server-side components where UI is not really a major issue.
"When I'm developing software... I don't talk. I might do an odd grumble to myself every once in a while, but the loudest thing in the room, by far, is my keyboard"

That's often true of games too, though, and Twitch has plenty of popular streamers. I think their greater issue is that the steroetypical twitch viewer in their young teens is unlikely to be interested, and older people who might be interested are more likely to be time strapped. Though as I dig around looking for twitch demographics, it looks like the college aged 18-24 is Twitch's biggest group, so there might be a decent overlap.

I wonder if it might be a good idea for them to push the event angle more, with a special focus around on-campus things like hackathons or contests. If you had screen forwarding set up between multiple projects/competitors, it might be interesting to have a "caster" that helped walk viewers through what the different groups were doing.
I'm not saying you're not worried, or trying to pull one of those "but this is worse, so you must only worry about it!" things. I'm just saying that you don't need to "solve" the problem, as demonstrated by how we deal with other toxic waste. Yeah, chucking it in a landfill and calling it good isn't ideal, but it's not terrible if your landfill is reasonably well designed. Nuclear waste is a problem, but not a big one, and not big enough that the continued use of nuclear power should be gated on some sort of definitive solution.
Gigawatt-scale nuclear reactors take a long time. Ycombinator is investing in factory-produced reactors that fit in a truck. There are quite a few other companies working on small factory-produced reactors.

Solar with batteries is a lot more expensive than solar alone. Solar is doing well right now with natural gas backup, but a lot of us would like to avoid fossil entirely. Solar with nuclear backup might be a great combination, assuming demand correlates reasonably well with daylight hours.
French sources (former head of the French DGSE, of course you may question him) tell however that "we (in France) are light years behind the US in terms of offensive espionage, although we are pretty good at counterintelligence".

And I might be naïve but think that Russia had, and lost after 1991, its networks and spying capabilities. It probably takes some time to rebuild them.
تغير منزلك بحيل بسيطه
> there's little to gain by holding on to an exploit

Correct, but there's also very little to gain by developing it in the first place. Right now, the pinata's value is approximately $2500, or less than two straightforward XSS bugs on Google properties, which are waaaay easier to find. There's just not anywhere near the motivation required to get (mostly well-paid) security people on this. It's interesting, but that's about it.
It's hard to coherently sum up the response to Chinese hacking, because it's as big a component of the public dialog as NSA spying is.

However, I do think there's a difference between remarks about Chinese hacking and NSA spying. Outrage about NSA spying seems always to be moral. Outrage over Chinese hacking seems more practical: it's taken as given that China is going to sponsor hackers and that they're really good at it.

Look at the recent OPM debacle. Virtually all the coverage I see about it is about how OPM (and the USG more broadly) fell down on the job, not about we should retaliate against the people who broke in.
Does this mean that Uber now has an engineering presence in the Seattle area? Or are they acquiring the old Vexcel team based in Boulder?
London: the city that ate itself
No offense taken. :-)
I suspect that my part of the elephant just feels different than your part of the elephant.

https://en.wikipedia.org/wiki/Blind_men_and_an_elephant

Yes, I have consulted for everything from startups to large multinationals but your experience may be more common/normal/relevant for HN readers. With the most recent multinational client, it took some time for my contracts to go through legal but they approved everything without any changes.