skysight-inc/HackerNews huggingface dataset:
> are there some video features (like kaltura or youtube simple editing)?

Not at this stage, no. We're currently focusing on images.

> how does "Indesign integration" exactly work?

InDesign integration works by drag and dropping an image into InDesign. Associated metadata, including the canonical ID, are then read by an InDesign plugin so we can store a reference to the original asset.

Other integrations with other web-based editorial tools in our suite also use drag and drop (+ drag metadata). It's also possible to copy paste URLs.

> is it possible to use local storage, not Amazon services?

Not out of the box, but there is no reason why it couldn't be done with a few changes.

> is there some ansible / salt / chef / whatever installation scripting available?

I'm afraid not. We mostly use CloudFormation to spin up our infrastructure and inject the relevant configuration on each service. There is a lightweight CF script for development purposes in the Grid repo, but our main CF script is currently in a private repository.

> picture approval workflow

We had discussions with our picture desk about the level of permissions desired. Currently, we prefer the approach of keeping publishing open, so as not to introduce tedious barriers and slow down publishing (e.g. in case of breaking news, etc). There is a balance between the cost of publishing the wrong thing (e.g. not rights cleared) vs the missed value of publishing too late.

To balance the openness, we are focusing on providing high degrees of visibility to our picture editors, e.g. a feed of all images about to be published that aren't fully rights cleared. We also work really hard to get the information properly recorded (ideally automated) so the rights information is accurate about whether a picture can be used or not.

At the end of the day, we want to empower desks with the tools to come up with their own workflows and ways to limit risks associated with allowing all (or most) people to publish content, rather than imposing a rigid workflow.

- Séb, lead developer on Grid
On the other hand, here we get special insight into the attitude/understanding of statistics common in university psychology programs, and hence a particularly damning look into the field itself. This is how the research works; you come up with a 'just so' gut feeling, and you look and look and look until invariably you come up with /some/ evidence for it and then publish.
I was trying to answer each question, but got blocked, so here are some answers in one comment:

1. Yes, it's WIP.

2. Did RF+GBM so far, did not even start DL, but stay tuned...

3. For Spark I used number of partitions = number of cores

4. For why Spark is less accurate for RF see Databricks comments here: http://datascience.la/benchmarking-random-forest-implementat... (essentially current version aggregates votes, while it should aggregate probabilities).

5. The issue of Spark being slow is not only an overhead on small data, but lots of serializing/deserializing, garbage collection etc.

6. Non-linear SVMs scale badly, but one could look at what size can e.g. svmlight do (results/pull requests are welcome)

7. Logistic regression in Python scikit-learn can be much improved (as I mentioned on github) by using a sparse format (someone should do it)

8. The difference between implementations in somewhat surprising, but some of the tools take different approaches (e.g. RF in Python/xgboost works with the data, in H2O/Spark it builds bins from the data etc.) There are tricks, options available only in 1 or 2 etc. I was trying to do my best to match parameter values/setup, but it's not the same.

I also wrote a blog post (a slightly more organized text for RF than the github README): http://datascience.la/benchmarking-random-forest-implementat...

There is also a recording of a talk I gave at a Machine Learning meetup if you want more insights:
https://www.youtube.com/watch?v=DK87lCLH_6A
I'm fairly certain Arc influenced Clojure in some way.

Especially the naming of functions such as fn, pr, prn and the likes.
I think we use a lot of PR flow in our team. It's really powerful if you collaborate or plan to collaborate with others as it allows you to get together and look at the commits to ensure code quality (in theory).

Even the command line git itself is really nice because it gives you the current condition of your repo and suggestion on what you can do next. You have changes, if you want to commit use this command or if you want to add use this command.
A sphere is also four-colorable, functioning equivalently to a plane for such purposes; consider stereographically projecting the sphere (minus a point) onto a plane.
They can't ... I have managed to burn off the seasoning on regular infrared electric stovetop.
The issue that I'm struggling with as I picked up experience and learned how to estimate better (read: higher) is of becoming a wet blanket. People will rave about this awesome thing we could do, and I'm the one saying "no, we can't, and this is why". That's why Steve Jobs said to stay foolish, it lets you chase after ideas that a rational person would consider too risky or just plain impossible.
Yep, that's the entity I'm talking about.

Unless the utilities decide to become more competitive, the only way to win in the long term is NOT to feed the energy you make back into the grid.
"All of these were ideas that seemed bad but turned out to be good, and this is the magic formula for major success."

I see this sentiment expressed often, like it's a good thing that you want to pursue an idea that seems bad.

If I were to think about founding a start-up, I'd rather find an opportunity that makes sense and sounds good, validate the opportunity, talk to potential customers, and do as much diligence as possible before diving in. So essentially, if something seems like a bad idea, I'd move on to the next idea.

This may make it harder to create a unicorn (since I'd clearly miss some aspect that makes the idea not bad), but I bet it's a better, less risky way of trying to achieve a high-growth start-up with great potential. Good ideas fail as well, but I'd wager it's less often than bad ideas.
This is a delightful example of engineering! Now we need some physics genius to provide the analysis of how/which fundamental slinky characteristics determine its natural step rate:

dstep/dt = f(length, width, mass, spring constant, ...)
Can we take users on desktop browsers to the iTunes Store page instead of texting a download link?
It seems that most people are immediately pointing to why the author is wrong or that his numbers are incorrect. I think we are missing the broader point that spending less than you make and saving consistently for 10+ years is going to help you have the financial freedom to work less. Save 15% of your income into retirement and you will be set.

Another key point is to stop thinking that there is good debt (i.e car loan at 2%) and to stop the 'keeping up with the Joneses' mentality. If you need a loan to buy something besides a house, you probably can't afford it. Being debt free can give you a mental and emotional peace that is hard to find elsewhere.
I'm not really convinced Clojure is even one of the reasons, though. It seems like they have different goals and mindsets.
My sentiments exactly. It is a breath of fresh air to see a company depart from a huge multinational like Pearson. Somehow I wasn't aware that Pearson had a stake in the Economist and I frequent "Who Owns What" http://www.cjr.org/resources/index.php.

Now that I know I'm not subsidizing Pearson with my subscription, I'll be even happier to renew.
As someone still using an HTC One M7 and loves it, I don't think HTC's heart is in it anymore. The M9 was a retread of the M8, which itself was just a "refinement" of the M7. And somehow, despite two generations of refinement, the camera is still mediocre.[0] To boot, the HTC-built Nexus 9 got disappointing reviews, mostly due to build quality.

I wouldn't be surprised if they get out of the smartphone business altogether in the next few years to focus on stuff like the Vive or the RE camera.

[0]http://www.forbes.com/sites/ianmorris/2015/05/25/htc-one-m9-...
Internal Documents Show BuzzFeed's Skyrocketing Investment in Editorial
A couple of techniques I've found useful:

1. "New and Notable" philosophy. Clear focus on documenting what is new and notable about each update. Putting it in a larger context than just "this branch/this sprint" and making it meaningful to those who may not be deeply embedded in the project. (Learned/adopted from the Eclipse project).

2. Tagged comments. Be disciplined about tagging comments for specific purposes, such as `# TODO:` or `# FIXME:`, so that those working inside code can quickly jot down their thoughts and observations as they have them, while working, yet they can also be consolidated by IDE views or external grep scripts into broader reports about outstanding issues and options.

3. Labeled commit messages. I often include "ATP" in commit messages, meaning "all tests pass." While you might rightfully assume that actual releases or even pushes to upstream repositories pass all tests as a condition of release/push, my projects follow a "commit early, commit often" protocol that sees many intermediate stages committed to local repos. Unless you're committed to regularly and extensively pruning/grooming repo history, even minor commits are going to be pushed upstream eventually. So I try to embed in the messages shorthand notes about testing status. (A variation on this theme is to include urls to CI test runs.)

4. Diffable formats. Encode as many design notes, change logs, and other project narrative information into Markdown, YAML, RST, or other formats that can be easily diffed and tracked by version control systems over time. Microsoft Office, LibreOffice, and Google Docs also have built-in change tracking and collaboration features, making them another evolvable option, albeit with slightly less transparency than pure text formats.

5. Constant vigilance. A disciplined, repeated return to, and updating of, change logs, release notes, design notes, to-do lists, tagged comments, architecture descriptions, and the other documents that form the project narrative.
Check SmartGit out. I've used it for years and love it.
No big deal. Incorporate in New Hampshire and operate a server elsewhere. NY has always worked to stay deep in everyone's pockets and their business.

Besides, you might be a terrorist or use file encryption or something else dangerous to the status quo.
5 Remote Working EBooks That Can Increase Your Productivity
Sometimes dreams are long-term plans
That's interesting. Why was it a dead end?

Was it due to the (too dynamic) semantics of Arc?

Or perhaps you have too much code written in standard Arc to make infeasible to port?
I once had to explain to our executive team why a project had been such a shitshow...it had ended in a two-week crunch to basically unfuck the work that had been to that point, where I cleaned up a mess one of my devs had gotten themselves into (and which, frankly, I had screwed up and let them fall into).

I used the emails, wiki revision history, and commit logs to piece back together what actually had happened. It's a lot different looking at things after the fact, and saying "Oh, I guess we really did take that long to do something...oh, interesting, yeah, we never had direction from the biz folks here, here, and here, and that's where this kinda went off the rails."

As for keeping together a cohesive narrative, as much as I'd love to be able to look at a bound volume of "The Trials and Tribulations of Angersock, Software Engineer", the only inarguable records are the grey hairs, the worry lines, and the eye tics.

Everything else is basically reality-by-consensus, even if you've got the paper trail to claim otherwise.

Just let it go.
Name your 20 year periods where the s&p has given an annualised 10% return
If you have airline miles lying around, most programs offer a year subscription for around 5000 miles. No digital access though, just print.
Show HN: Sahara, a SaaS Framework for Azure
> Phew, I was really worried they were selling to News Corp or something when I saw the headline.

I am more wary of one of those greasy-activist-investor types coming into the picture and demanding the publication "does more for the investors", i.e. more Kardashian-style (garbage) news.
Ask HN: Is Google becoming the new Microsoft?
I'm considering SWE offers from Google, Facebook as well as other companies. I'm having some concerns whether in a way Google is becoming the new Microsoft (actually Microsoft has been doing better lately, so I'm referring to Microsoft of 10 years ago).

The latest Alphabet restructuring actually aggravated this concern. The visionary founders are distancing themselves from the core business to focus on new endeavors (similarly to Gates leaving his day-to-day responsibilities at MSFT last decade). Many of the "cool" projects are taken out of the new Google and placed directly under Alphabet. An effective, yet not necessarily innovative manager, Pichai, becomes the CEO, just like Ballmer at MSFT (OK I know there are many differences between Ballmer and Pichai, and that many of you admire Pichai and resent Ballmer, but Ballmer was an effective manager, who continuously improved the MSFT's performance year after year, yet missed almost every trend and innovation in the market).

What do you think? Is Google becoming MSFT? Is it passed it's prime? Would it be better for a SWE to join Facebook or another younger company?
Related to (1) is the breadth of interesting things that Elon Musk has invested in. Often SpaceX news will mention Tesla and vice versa.

It probably also has to do with the uniqueness of Tesla's product portfolio within the Car industry and the multiplier effect that can have in what is already a huge PR-driven industry. Car magazines seem to be just about the only "product fetish" magazine category left and they still need fresh content every month. Other magazines and newspapers (what's left of them) still tend have a (syndicated) "car guy" columnist or at least column space.
Will you still be able to see many meteors if you're watching from within a city?
The Best GulpJS Plugins
It's also a factor of what you choose to do in life. I don't know your specific circumstances - but as an attorney you probably took on a heavy debt load that adds bills that many others don't have. Many lawyers I know are chronically underemployed - and yet many more are going to school to compete with that diminished pool.

Other than perhaps older parents are dependents a choice for most to take as dependents? If so - a non-financially-productive dependent is like a second mortgage - but it was a chosen one.
Box Adds Jeetu Patel as SVP of Platform and Chief Strategy Officer
Imagine somebody decided to use $5 wrench method on you right after you randomized your RAID ;-)
The point is well taken, but sitting on my couch in PJs everyday would definitely make me very, very depressed; economic freedom or not. I'm very sincerely happy that this guy found his way, but I can confidently say that this is not for me.
I'd 301 it for sure. It won't take long for people to adopt. Not an exact match for a case study but when SEOmoz to Moz switched they also changed domains.
Once you solve the trustless problem without 'mining' ie proof of work you'll likely be in line for a fields medal, so cool bro, go do that.
"only" 5%? Even 5% would be incredible return to have if it were consistent and low risk.
Exactly. A lot of people here are mistaking the trees from the forest (as programmers are wont to do), but the guy seems to be doing it, so he can't be that far from the truth.
Some people call it FIRE (Financial Independence Retire Early). There are many people doing it and several resources online about this. I would start visiting some of the sites on this sidebar https://www.reddit.com/r/financialindependence
He should probably rephrase. Clojure has won as an acceptable Lisp in business. Lisp'ers should probably get behind it to help to grow it even more. Once it grows, other Lisps will have an easier time.
Better question:

Why should they adopt software?
s|news.squeak.org/2015/08/12/squeak-5-is-out/|squeak.org|
That's a while ago.. so another post would be fine. I'd recommend making the post when he starts commenting, as the audience and ratio of upvotes on show HNs would be higher.
Coolors: Fast color schemes generator
The biggest difference is that they'd have to write a new Qt or GTK+ UI.
It's from Murphy's Law.
It began in 1928 in its original form. I mentioned volatility in my original comment - but if you have a large portfolio and low expenditures you can afford many down years.

For additional information: www.firecalc.com
Silvrback has been acquired
Source Tree was irritatingly dumbed down. No built in force push because "it could be dangerous". Switched to Tower and never looked back.
> upon deployment, I'll be using bash

Unless you're on Ubuntu, in which case you will be using /bin/dash at occasionally entirely unexpected moments.
There's more to learn from failure than from success.
Where is the preorder page? :)
Not a formal proof, but close enough I suspect. See comments as well:

http://www.quora.com/Why-do-all-quadrilaterals-tessellate
I very much disagree that there are no civilians after the 19th century. Not all wars are total wars (the term used to describe WW1 and WW2). The American / Iraq war of 2003 had civilians on both sides.

I agree that all members of American and Japanese society share some level of responsibility for participating in total war, but I also think your "no civilians" statement goes too far. It is obvious that some members of a country have more direct effect on the war than others and that once you get far enough away (children are civilians, adults who do not work are civilians, workers who deliver mail are civilians, workers who make vehicle parts are probably civilians, workers who make tanks might be civilians, etc). To argue otherwise is to view war as some kind of 'original sin,' where the level of your contribution is immaterial and any association is sufficient to make one a combatant. If that's the case, then you and I and everyone alive today is certainly indicted in the many wars we are not working to stop. Even people working to stop one war are helping others to continue by not working to stop them. It's absurd.

Civilians do start wars and, in the modern era, they are often held to account for the wars they start. War crimes tribunals indict military and civilian personnel alike. I also agree that young men bear an unequal and unjust burden in war - but the suggestion you make is silly. The solution is not to extend that unequal burden by allowing more people to be killed, but instead to give young men more options to avoid being killed and killing others.
Thumbor let's you store and retrieve your images anywhere. We use AWS S3 with a redis storage cache + another redis cluster to store the result cache.
I don't think it's lame.

It sounds like they are living through a train-wreck moving in slow motion that will last a few months - and perhaps much longer.
Well I think people are getting the wrong impression here. They started this game in 2013 on their own money, got a subsidy to build a prototype that year, then in 2014 raised money from a loan in Belgium to finish the game. They communicated all of this in their Kickstarter. They then asked $50k I guess to finish up the game and expand the scope a little bit, and make some money on various rewards, but mainly I suppose as virtually all kickstarters nowadays: a presales platform.

In that regard they succeeded. The game is finished, it's for sale, and the backers got their game.

But the sales were also disappointing, and so they declared bankruptcy.

The issue here is that they created stickers, dvd crap, soundtracks etc... Kickstarter backer rewards. And they can't ship them as they're bankrupt. The problem obviously is that they didn't earmark funds ahead. I think that's disrespectful towards the backers and it's a genuine complaint, but I don't feel it's very significant in the scheme of things. Kickstarters know the risks. And the creators of the game put their heart and soul into it and ended up bankrupt, yet did deliver the game. I think that's a fair compromise for the backers of the game, even if they don't end up getting their rewards, like an artbook or wallpaper which can be pretty sweet but I doubt anyone will lose sleep over it, while the creators must've lost a lot of sleep going through a bankruptcy.

So this notion they raised $50k for 7 people to build a game in two months isn't really the case at all. Beyond that, your point on merchandise rings true but it depends on context. A soundtrack, artbook and wallpaper usually isn't a big deal. After all, the game has a soundtrack regardless, and they'd already produced tons of artwork in the process of modelling, you can see it on the kickstarter. The effort is printing and shipping it. But if someone is giving you a $20 premium to ship him a PDF you already have on your computer, would you say that's bad business? Not really, any smart indie will pay some highschooler $250 to take care of it, a small price to increase your budget by $10k or something to that effect. The issue is that some kickstarters go way overboard, and the reward/effort ratio plummets to below their IRR or even below 1. So it really depends, in this case I think it wasn't a bad decision as they promised rewards for things they already had laying around, they simply should've earmarked the funds.
For acidic things, buy an enameled cast iron. Those things are also great. They need no seasoning, but are a bit more delicate (you don't want the enamel to chip or crack).
SourceTree is really nice overall. To name a few things, I prefer its view of history, its hunk selection UI, and its commit message box (GitHub's is tiny and can't be made much bigger). It's also nice that it supports Mercurial.

I had some problems with it keeping changes synced with the file system, though (on Mac OS). E.g., I'd change something in my editor and SourceTree wouldn't pick it up until I reopened the repository in SourceTree.

I also prefer a single window like GitHub's app, but that is a minor annoyance. The non-syncing made SourceTree unusable after a while, and I went back to GitHub for Mac.

I wish Atlassian would put out an update, because I'd prefer to switch back.
I'm pretty sure the things where Erlang is a good fit would be the target, no? E.g., it's not going to be about doing your numerical computation--but it might be about using it to distribute it.
"The truth will set you free--but first it will make you miserable."

Less cynically and more constructively: If you have projects or components that you weren't able to touch for a long while, then orienting notes seem even more valuable. They can help reset your context and get you back up to speed, working in a productive direction more quickly than if you come back to a project and have to relearn what you were doing and where you were heading.
Anecdotes like this are the reason I keep returning to HN. They always shine a smile over my face.

Greetings from Germany.
My First ebook on Python is complete - https://leanpub.com/intermediatepython
I have finally finished my first ebook, Intermediate Python, and it is available on leanpub (https://leanpub.com/intermediatepython)
Along the lines of what you say about debt reminded me of this: http://jasonkelly.com/books/fsp/
Would docker make a good sandbox or can applications break out?
Glad you like the idea! I just noticed that the site is in a redirect loop. : p

Edit: Fixed the loop
Nice write up! Makes the feature much easier to understand and it's good that you've provided feedback from those who use it already in production.
> Find a way to live on half of your after-tax income

This is like "How to have an easy life":

1. Find a way to have plenty of money.
2. ...