skysight-inc/HackerNews huggingface dataset:
S3 does not allow random access reads/writes to the files. "Editing" a file in S3 just means deleting the original blob and creating a new one.

Meaning, you can't run git on it, you'd need to make a full copy of the repo each time someone makes a commit.
Super cool! You should blog about your experience(s), at least the non-NDA ones!
> but it's definitely some kinda recursive formula where you have to assume the other guy is also playing the optimal strategy.

I think it can be solved by searching for a pure strategy nash equilibrium
I had a longer answer, but the distribution is important. A 0.5001 has a less than 50/50 shot of winning.
Look, DrScump, if a Canadian (like the one I know) can get deported for helping his girlfriend who he spent 6 months of the year with (because he legally could without "working" with his visa), with painting a house for free, realistically there are laws and regulations which are an impediment to freedom. Times are changing, and I'm going to be the messenger, so that people like the guy who posted this remain free, even if it's unpopular and could keep me away from getting an investment, or help by performing a public service by telling him why he should say nothing to people about stuff like this if he was planning to help people for free. You can't help people for free and have freedom at the same time, according to past US government administrations, apparently.

Also, US Presidents on both sides of the political spectrum have issued "Executive Orders" to bypass both Congress and the Senate and write things into law. They are considered unconstitutional by some, and constitutional by others.
> The crowd looks pretty old

Oh man, don't say that! When I first got into C64 nostalgia, you had the older camp that was still staying productive on the 64, and us twenty-somethings nostalgic for the computer and games we grew up with.

Now we've got kids of our own, grey hairs and yellowed machines. At least my son got a kick out of playing Ultima V with me.
Maybe I need to take a few layers of tinfoil off the old hat, and I suspect it's just good old fashioned open source generosity, but..

Given that it's from Palantir, is there any way this could become a security attack vector at scale?
Definitely not 67% of cases, more like 50% + epsilon:

def round():
x = random.random()
if x <= 0.66666:
x = random.random()
y = random.random()
if y <= 0.5:
y = random.random()
return x >= y

sum(round() for _ in xrange(10000000))
5001450
sum(round() for _ in xrange(10000000))
5004434
sum(round() for _ in xrange(10000000))
5000238

I also ran a test of 0.6666 vs. 0.625, and... sorry to say, but 0.625 wins hands down.
> I was expecting much more support here for people wanting to learn to code.

I think if you said "my current job is packing bags in the supermarket, I want to learn to program, should I go for it?" there would be plenty of support. The issue here is that OP will be giving up a better job than that of entry-level programmer, which is what makes the proposed career switch irrational. I mean sure, it's your life, at the end of the day you have to do as you think best, but if you already have a good job and you ask for advice, the advice will be to keep it.
The controversial email from Grubhub CEO regarding the elections
True, if you don't like spending 40-60 hours a week doing your job, money/job security is a weak comfort.
Actually in snow, fog, rain, and related humans (and cameras) can do pretty reasonably. Things like brake lights and running lights can be pretty severely distorted and you still know the approximate distance to the car in front of you.

Lidar on the other hand is a point source of light (not from the environment) and any distortion makes it less likely for said light to return to the sensor. So with stereo vision (or radar) you can get a relatively accurate distance for a car in front of you. With lidar some fraction of the returns will be bouncing off fog/snow/rain between you and the distant object.

Because of this disadvantage lidar based systems might suggest a slower safe speed, and risk rear ending from humans.
> Bonus question) Why are we thinking about all of this. You should have just used s3?

NFS and Ceph both support the standard POSIX file access model, notably including random-access reads and writes on a file without replacing the entire file and consistency models that let you reason about directories and their contents usefully. If your goal is to run the reference implementation of git, or something that is compatible with it, on the filesystem, you absolutely need something that supports this.

You could write something new that speaks the git protocol but is designed to be backed by an eventually-consistent object store instead of a POSIX-compliant file store ... but that seems like an equally big challenge, honestly.
I assume for three reasons:

- small file performance (if they're not storing the git objects as packed)

- POSIX compliance

- Their on-prem installations for customers

For posix compliance, you can use s3fuse/gcsfuse or put Avere in front, but you're either paying more for it or you're not getting the best performance.

For small file performance though, no object storage system is particularly tuned for that (often the granularity is more like MBs, and at least with GCS you're talking ~100ms per write).

Finally, they need to be testing and supporting customers who want to run the whole thing "at home" wherever that is. So they would still need to run Ceph!

Disclosure: I work on Google Cloud.
I have used it several times when presenting the stuff we have done at my current job (i.e. show how we have grown from a 2 person startup to a 15 Engineer shop). Undergrads like it a lot.

The only thing that I think it is missing is having a "size" of each node to represent the size of the file. That will give a lot more visibility on changes.
Yeah. I'll be writting a blog post about this whole process, including this post on HN. How it all started, what we achieved, etc. Thanks!
Sure. Would love to. siddharth[dot]soka+hn[at]gmail[dot]com
That's awesome, thanks for sharing!
Research in the Right Order: When to Interview Your Customers
Your intuition is better than mine! I crunched it out (just now edited my answer to show how) but still have no intuitive sense of why it should be the golden ratio. Would love to hear some intuition for that!
I'm a CTO and active developer with a Harvard MBA, and I think you're nuts.

Not because the opportunities you see aren't there; they are. Not because management isn't losing its lustre in tech companies; it is. But because coding is hard.

I have a great software education (top school, top program), I've had tremendous opportunities to learn from the best and build amazing things from scratch, and I've been coding professionally for 20 years next year. I'm only just now starting to really "get it".

Having a top-3 MBA (I assume you mean Wharton) puts you pretty advanced on the product/management track, one it will take a decade to catch up with as a developer. Embrace that, dive in, enjoy it.

Here's an alternative suggestion: you don't need to code to understand crypto/blockchains/AI/etc. Those are complicated and sparsely understood, and they are math. Knowing what you can do with them and how to apply them in products is much more rare than being able to implement the algorithms. Why not focus on the theory beyond the code?
To which we could add:

5. The introduction of "Socialism with Chinese Characteristics" starting in 1978 (combined with the post-Tienanmen crackdown, which appears to have been largely responsible for cementing the CP's longevity).

6. Putin's appointment as Prime Minister on December 31, 1999 (and the ensuing waves of influence which have not only swept the region... but indeed, with the last election, have significantly impacted politics in the U.S. itself).

7. The Reagan/Thatcher elections in 1979 / 1980 (basically responsible for the rise of neoliberalism as we know it).

8. The Iranian revolution of 1979.

9. The onset of the global HIV epidemic (ultimately leading to far broader recognition of LGBTQ rights, and to loosening of mores with regard to non-reproductive sex in general).

We have to stop somewhere, so 1978-1979 seems about as good as anywhere. (Basically, nearly everyone here seems to be "post-Vietnam/Watergate" and "post-deindustrialization").

Other significant changes have had no specific turning point:

1. Major decrease in global poverty.

2. Major decrease in urban crime in the U.S (largely responsible for gentrification and the long-scale housing bubbles we have today), for reasons still not entirely understood.

3. Gradual winding down of armed conflicts in Latin America.

4. And of course, anthropomorphic climate change.
> I can't yet explain why

Your comment and simulation prompted me to attempt an explanation of where danielvf's analysis is incorrect, which I've posted here https://news.ycombinator.com/item?id=12941330
Ask HN: What should I plan to do on a 6 month sabbatical?
I will have 6 months off in the spring for a sabbatical. I've been working on a list of things to do during this time. I am constrained by a wife/kids so this won't include a 6 month trip to Thailand or anything. I've considered the obvious, work out more, hike/cycle more, etc. Any other suggestions/recommendations? I'm looking for tech stuff like projects/books/etc but also non-tech stuff as well. I don't want to spend 60+hrs/week at the laptop like I do now.

EDIT: here's my list so far: fishing and fishing knots (I have my grandfather's gear, but lack his skill), cooking more, learning to make great bread, raspberry pi projects with my son, reorganize/layout my garage, improve my golf skills, reading, explore trails I've never been on, visit friends & family (travel), camping/backpacking
> This software was written because a disappointing number of websites still does not have an RSS or Atom feed so I could subscribe to their updates, e.g. the KiTTY website.

It seems the KiTTY website does have an RSS feed at
http://www.9bis.net/kitty/data/rss/rssen.xml
Convolutional Neural Networks, Explained
Just to let you know, gmail omits the periods in their emails.

siddharth[dot]soka+hn[at]gmail[dot]com
siddharthsoka+hn[at]gmail[dot]com
siddharth[dot][dot][dot][dot]soka+hn[at]gmail[dot]com

will all go to your email account
I think you need to be aware of Jevon's paradox [1].

The only thing that is going to do anything about climate collapse (climate change is too wishy-washy for such a serious topic) is leaving the carbon in the ground or pulling it out of the air.

1. https://en.wikipedia.org/wiki/Jevons_paradox
In a perfect world lidar is far superior. It's trivial to say "out of the 50M voxels returned, are any from where the car will be in 3 seconds". So lidar wins in the best case, maybe even the average case.

However in the real world where the car/sensors gets dirty/wet, and the air is filled with snowflakes, raindrops, or mist it gets much more complicated.

Even if statistically better there's value to acting more like a human driver. After all the roads are filled with human controlled cars and any deviation from human norms because of weather(like wind, snow, rain, fog, and blown sand) cause problems.
Hmm, there is still at least one Darwin distribution. Darwin build is still available https://github.com/macosforge/darwinbuild

I'm not sure if the problem is Apple or a lack of interest and community.

I'd definitely be up to trying to build it sometime in the future. I'm a little busy at the moment. I'd expect it to take a few days at least based on my experience with Linux from scratch.
This one is in English: https://www.youtube.com/watch?v=gnn21smGVrQ
Thanks man, I really appreciate you giving me points and guiding me here.

> OK, let's work with this: in what way is Redis helping here over XML-RPC or JSON-RPC? What kind of problems does it solve that are pain in the ass with the other RPC protocols?

Redis vs XML-RPC/JSON-RPC is a mismatch. It's more of a msgpack-RPC with Redis as broker vs XML-RPC or JSON-RPC:

1. Most brokerless RPC protocols make it difficult to inspect the message on the fly. With Redis, you can open up redis-cli and subscribe to the appropriate channels to extract the raw messages. For most users this might not mean anything, but for others this could mean easier debugging, measuring performance, and so on.

2. msgpack's serialized format is small. This makes it faster to send it across a network especially when the message is considerably large (vs, say, JSON or XML). That, and msgpack itself performs serialization/deserialization quickly on its own. see: http://webcache.googleusercontent.com/search?q=cache:hYaRwEU... (I'm using a Google Cached link because main link seems to be down)

> I'm not against custom protocols or adding daemons to a system (I've recently(ish) written a set of RPC daemons with their own protocols; the daemons are replacing Celery task queue, which itself is a widely tested software), they just have a decent reason to be introduced. Additional complexity just needs to pay for itself somehow

I totally agree. However, the idea of introducing Redis into the equation to use as the broker didn't seem like additional complexity to me because a lot of other network messaging protocols rely on a broker anyway. For example, the widely popular Web App Messaging Protocol (WAMP) (http://wamp-proto.org/why/) relies on brokers to decouple callee/caller on an RPC operation. ZeroRPC, another popular RPC choice, uses ZMQ.

For Shisetsu, what I see is the main advantage of Redis is that I can delegate multiplexing work to it instead of having to code myself, making the protocol and its implementation easier to manage, just by relying on Redis' PubSub. The client and server don't even have to know each other's address and port, they just have to know which Redis instance to connect to and assume that there exists one of the other to work with. Redis also provides the channel buffer and the queue instead of me having to write those as part of the client/server code, which means anyone else looking to implement the protocol in another language wouldn't have to deal with those as well.
It would be nice if some of their contributions were less "throw it over the wall once or twice a year".

It would be nicer still if they stopped thinking their browser only needs to get new features once per year. Safari is rapidly getting a reputation as the new IE6. Fully supporting ES6 means nothing when everything is being transpiled and minified anyway, and the (arguably) dominant mobile browser your (kinda) forced to target doesn't support features that shipped in every other browser years ago, heck many missing features have even stabilised in other browsers years ago. The dev builds on desktop are just a token gesture that further displays how far behind the times WebKit/Safari/MobileSafari are falling.

Here are just a few things not supported in any Apple browser, Including the "Technology Preview" on desktop:

CSS Motion Path;
CSS Device Adaptation;
Client Hints: DPR, Width, Viewport-Width;
inputmode attribute;
MediaRecorder API;
Network Information API;
Web Animations API;
Pointer events;
Web App Manifest;
seamless attribute for iframes;
Payment Request API;
Credential Management API;
Push API;
FIDO U2F API;
Permissions API;
Screen Orientation;
Object RTC (ORTC) API for WebRTC;
Proximity API;
Ambient Light API;
Battery Status API;
Vibration API;
Web MIDI API;
getUserMedia/Stream API;
WebAssembly;
'SameSite' cookie attribute;
Public Key Pinning;
XHTML+SMIL animation;
The last line of the paper mentions seeing a triple inverted pendulum recover from even very severe perturbations and go back to vertical. I would love to see a video of this stuff!
The biggest impact people can make in this area is give birth to smart people. We need more smart people, not less.
The neural programmer is indeed interesting. The current research into have neural networks learn algorithms and procedures for data retrieval and computation is really exciting (to me at least). It almost makes the image classification work of a few years ago seem quaint.

For those who don't want to read the paper, it's a way to (try to) have a computer learn to answer questions on datasets, like those contained here: http://nlp.stanford.edu/software/sempre/wikitable/viewer/#20...
I second this -- they're fantastic courses
Fortunately, it's open source, fully open to code review!
Cardio exercise is like natural acupuncture for your internal organs. When you understand it that way, it becomes one of the go-to therapies.
I've been trying to mull that out as well from an economic perspective but I think it's highly dependent on the existing distribution networks which adds additional complexity.

Major League sports information is disseminated fairly quickly and the attendance levels make technological prohibitions a challenge. The nature of world chess championships make it a little different, as long as the globally recognized top ranked players are in attendance (preventing an organizational schism) I think the organizers could do whatever they want.

In the end I think this ruling just means they can't enforce a civil penalty for violation of these rules, but there's no reason they can't expel the violator from their event.

It's an interesting case.
We Become What We Behold, a Post-Mortem
Congratulations to @asksol and the rest of the team for sealing the deal on 4.0! I've been waiting for a number of the features now in 4.0 for a long time now. I know you guys have been busting your asses for a long time and juggling with some complicated dependencies along the way.

Some time ago I built a little celery addon library as a sort of experimental way to solve the problem of having dynamic celery beat scheduled tasks. I never ended up implementing anywhere for a few different reasons: https://github.com/fuhrysteve/CeleryStore

I really like the concept behind the old djcelery project. But I don't use django much these days, and I'd like for it to be more compatible with tools I've become more familiar with (sqlalchemy / etc).

Do you have any advice for how to approach this? I know 4.0 introduced some new abilities to add beat entries via API.
If you liked his Kabbalah story, you will love http://unsongbook.com

edit: and the much shorter http://slatestarcodex.com/2014/04/03/the-study-of-anglophysi...
It doesn't matter if you can't pass the interview.
Look at those cost factors. If you have an ops team (ie. 2+ people) it is a near certainty that cloud is more expensive. And if you absolutely do not need an ops team, VPS is going to beat the cloud by a huge margin.

2 people doing ops work cost 7-8k $ per month. Let's assume each of them is managing at least 5x their own cost in infrastructure spend, ie 35k+ $/month. That easily buys you 20-30 extremely high spec dedicated machines, if necessary all around the world, with unlimited bandwidth. On the cloud it wouldn't buy you 5 high spec machines with zero bandwidth, and zero disk.

Let's compare. Amazon EC2 m3.2xlarge (not a spectacularly high end config I might add, 8vCPU, 30Gig ram, 160G disk, ZERO network) costs $23k per month. So this budget would buy you 2 of those. Using reserved instances you can halve that cost, so up to about 4, maybe 5 machines.

Now compare softlayer dedicated (far from the cheapest provider), most expensive machine they got: $1439/month. Quad cpu (32 cores), 120G ram, 1Tb SSD, 500G network included (and more network is about 10% of the price amazon charges for the same). For that budget it gets you 25 of these beasts (in any of 20+ datacenters around the globe). On a low cost provider, like Hetzner, Leaseweb or OVH you can quadruple that. That's how big the difference is.

It used to be the case that Amazon would have more geographic reach than dedicated servers, but that has long since ceased to be true.

There is a spot in the middle where it makes sense, let's say from $100+ to maybe $10k where cloud does work. And you are right that it lets a smaller team do more. But there's 2 things to keep in mind : higher base cost that rises far faster when you expand compared to dedicated or colo. This is not a good trade to make.
> Are you saying that people shouldn't teach themselves powerful technologies?

That much it was clear they weren't saying. What was being said was that prolog is just about the last lang you'd do this in. Aside from that, I think everyone else was aware that this was an experiment.

To add:

I think this is a great approach. The last highly up voted article suffered from being the same ol' hello world intro to prolog. It's fun to see a real world problem tackled.
It would be illegal if I work AND get payed

No, minimum wage laws still apply; Federal law offers a baseline while many states have a higher threshold.
> “I really think that people should be suspicious of authority,” he told an interviewer last year. “The more you’re told that you have to believe something, the more you should question it.”

This amounts to a sort of intellectual homeopathy when it comes to dismissing the scientific consensus on an issue without commensurate evidence.
Wasn't Battery Status API discovered to be harmful to privacy and on the way out in all browsers?
I think it's up to the author to decide where they host. Just curious: Would you complain the same way if it was google sites based, but using author's domain? Why/why not?

Also, I don't think every page makes requests to google. All the ones I see go to a CDN (one designed for AMP, sure). So standard caching applies. But again, author's choice - are other CDNs any better?
I don't believe that. Today's cameras are tiny and the C7 isn't a particularly small car.
Eh. Is it clouds or a truck, or a shadow on the road or a moose? A tree besides the road or a cyclist) Hard to tell without really good classifiers.

I guess that with a lidar or some kind of 3d perception, you can relax the demands on the classifier a bit and ignore really flat things and the sky...
Why not both!
I don't expect anyone here reading this to understand or appreciate this but it is an epic, world-changing achievement and, like Aristotle, she will be discussed in the history books 1000's years from now.

It's pretty safe to say that if no one on HN knows what the hell you're talking about (and not even WP mentions PoS and AR in association with each other), then no, it's not likely that this will be seen as "the most significant turning point" of our era, centuries from now.
Sounds like Apple and Mozilla are planning to:

http://www.theregister.co.uk/2016/11/07/apple_mozilla_kill_a...
Muslim woman: I'm one of Trump's “silent voters”
And apparently abuse of flagging happens here too. Flagging a post that simply stated a historical fact they want to pretend never happened, because it had so many upvotes it couldn't be buried in downvotes.

What a fucking joke some people are here.
Very much so and that's why we don't want our cars to perfectly replicate humans. More sensors plus a limited and narrow AI is better than just vision and a smarter AI.
>A county commissioner who gets grandma or a mother of a small child thrown in jail will not be county commissioner[1] for long (or perhaps even a resident of the county). Getting a license is a waste except for those who actually want to run real businesses.

There are ways to enforce without people being thrown in jail.

In my state/county, the organizers of the farmer's market simply will not let you set up a stall/sell without one. Everyone has to preregister and show proof of license.

No jails needed.
USDCHF Faces Further Upside Pressure on Price Rejection
Should've gone to X instead:

https://en.wikipedia.org/wiki/X_(demoparty)
If a Software Developer serves the public, you bet your ass they have E&O.
Yep. Anyone smart enough to get that rich usually figures out that the attention that comes with it is at best, tiresome (and often quite aggravating).
Dostoevsky’s Empathy
Have they actually won?
Well, it depends on how much stuff you're buying and from whom. If you're buying $800 dollar workstations you won't get as many discounts as when you're buying 400+GB quad CPU 2U servers