skysight-inc/HackerNews huggingface dataset:
The nuclear deterrent has prevented a world war that would probably wipe out our species, though.
less than 10k
And you will gladly pay taxes to subsidize their housing and other living expenses, right? Maybe we could designate some sort of universal income for such people, so they could pursue opportunity with a safety net of sorts.
Awesome Curated List of RL Resources
you can also do some fun stuff with image averaging in ImageJ. here is a python script for ImageJ I wrote a while back that takes the standard deviation of several frames at a time and averages them onto a background
(https://pastebin.com/09wPkwhN nb: I am a terrible programmer and this was when I was just starting to learn)
that produced this:
http://imgur.com/a/eaLEO
I know this is a super-unpopular opinion these days, but...

Why can't you program the simple problems that interviewers use for whiteboard coding without Stack Overflow?

It's not even like interviewers are looking for syntax-perfect code (which you wouldn't need Stack Overflow for anyway, the compiler is what catches that for you). I've never had an interviewer that would quibble over a missed semi-colon here or there. Hell, most of the time I end up using "begin/end" style pseudo-code instead of curly-braces, because curly-braces are stupidly hard to draw well on a whiteboard.

And even if you don't know off the top of your head what "invert binary tree" means, every interviewer I've ever had has been more than willing to answer any questions I have about the problem. Ask questions about requirements and you should be able to figure it out. If, once you know what the inputs and outputs of "invert binary tree" should be and you still can't do it, I seriously gotta question what the hell you're doing interviewing for the job of programmer. I once passed an interview for a job I wasn't even applying for, even though I didn't know off the top of my head what "LRU cache" meant, by asking enough questions ("oh, LRU means least-recently used? Well then, something like this?")

I tend to think of whiteboard coding problems as being ineffective for interviewing because the problems are so simple. To me, anybody should be able to solve these problems. I know a lot of people can't, and this serves as a quick filter to winnow them out. But they are so ludicrously easy I just don't get how you can say you need Stack Overflow to solve these problems.

I'm with Jonathan Blow on this one: https://twitter.com/mxcl/status/608682016205344768
Six years is a damn long time to work on a solo project. There comes a time when you have to just put it down and move on to something else.

This applies to any discipline. I spent four and a half years working on a solo graphic novel. Five and a half years if I count the time between finishing all the art and running the Kickstarter to print the thing. I still haven't gotten all the shipping done. I'm done thinking about the book and I want to move on to drawing the next project, and my enthusiasm for doing all these other parts of the process is low.

Projects have ends and maybe this person's personal programming language has come to one.
Google’s AlphaGo Defeats Chinese Go Master in Win for A.I
What about people with red hair? I think they have a history of being bullied?
wao! You just mentioned something I actually do, which is recording questions and thoughts about what I'm learning. Now I don't feel so weird :)
Glary Utilities Pro 5.76.0.97 Crack and Serial License Key
I think that the users who DO have that usecase (like the OP) are clamoring for a machine that is more portable. The same debate raged when the MBP was released; people want a powerful, sleek and portable workhorse that they can use for longer than 2 hours, and no one is delivering right now.
... He just had a tan from tanning / being in Florida.

http://www.marieclaire.com/politics/news/a26621/donald-trump...
redmond asked about different board sizes to someone on the alphgo tech team and I think they said it wasn't setup to play different size boards.
Do you have instructions on this? I've never seen it before + can't reproduce it?
I recently joined a company as a senior developer with a partially unfamiliar stack, and it's very interesting to me how much my style of learning contrasts with others in that way.

I regularly am recommended to "read through all the docs, step through all the code", which might work for some. My brain just wants to switch off whenever I do that.

Instead a day or two of fixing problems - implementing a fix, seeing how/why it doesn't work, trying a new one - suddenly I get it.

Everyone's different.
It may be possible to mitigate the "create 5000 dummy accounts" attack by steadily increasing the age required to vote, much like in Larry Niven's Struldbrugs Club membership.

Obviously the harshest, most stringent approach would be to block anyone whose account was created after the time of the PR merge. But this would prevent new players from participating.

You could also increase the age requirement by one day every two days, or have a logarithmically increasing requirement.
> I am unconvinced that scaling these experiences in this environment is a healing force.

You might be right. But I think that's a limited point.

Mistreatment of women and minorities is as old as time. All that's changed here is that they're talking about it in a public forum.

Maybe that helps heal things (I tend to think it does, by way of raising awareness), maybe, as you say, it doesn't help. Maybe it even hurts.

But I am not about to tell victims how to deal with their own pain.
> why not just get a really solid laptop at that point

Their goal is to be a more versatile version of exactly that, though? The surface isn't meant to be a tablet alternative, it's more of a laptop alternative that's also sort of a tablet.
It can be the most versatile laptop without catering to all use cases.
This is awesome and definitely the future. Anyone know the differences between this and IPFS (https://ipfs.io/)? Anything else out there similar to either of these?
Bill Vass, also formerly of Liquid Robotics is a VP at AWS, maybe had something to do with the hiring. He had James come do at least one talk while I was working at AWS, talking about the things Liquid Robotics are up to. The prohibitive cost of satellite data is just astonishing. It really emphasised to me just how much livestreaming of SpaceX rockets landing on a barge is a PR move.
HN has a cool system where comments get up-voted if they are good or down-voted if they are bad. That really makes it easy to sort the good ones from the bad ones.
I'm curious on others insight about one section of the email management sent to employees regarding leaks:

"Please remember: whether malicious or unintentional, leaks damage our culture. Be aware of the company information you share and with whom you share it. If you’re considering sharing confidential information to a reporter—or to anyone externally—for the love of all that’s Googley, please reconsider! Not only could it cost you your job, but it also betrays the values that makes us a community."

I certainly understand the potential business impact leaking information, but what is the aspect of the Google culture a leaked email harms?
And for a bit more detail on what actually happens inside a chicken while it's forming the egg:

https://vimeo.com/86122048

Birds are surprisingly complex biological factories - especially the bits of their internal 'production line' which rotate the egg-to-be to twist membranes into shock-absorber-like suspension structures for the yolk.
Yes! Had a startup client with a 4 person full-time "Big Data" team. They brought me into help them automate their server infrastructure. As part of the process I had them show me the Hadoop jobs they were running. 100% of the jobs could have been done as rudimentary SQL queries to their DB.

Welcome to the land of engineering, where we will fine-tune an algorithm to save milliseconds, yet waste man-years of engineering time to look like the big kids.

So many engineering choices are based on fashion rather than need.

Gotta get that hot new bag from Prada to show off to your engineering friends! :D
//Offtopic - we've just started to raise 8 goslings, and they are completely different temperament to geese. Much friendlier and less flighty.
Yeah, but I prefer to program with a modern laptop than punching cards, even though so many users still know how to use the cards.
And an incredibly tone-deaf response by the author of the article... apparently he "had to" copy without asking because "10x devs are introverts".
Fair distinction.
The Best GPUs for ML Work
The US had eugenics programs up until I think as late as the 60s, as did some other countries. Look up for example Buck vs. Bell. The Nazis were inspired by the existing US eugenics programs, not the other way around.
I've been using PrestoDB for a few months now, and I'm deeply in love. It's such a well-designed piece of technology. The query execution engine is a tremendous boon to anyone with inconvenient-sized data. And it does most (all?) of ANSI-SQL!
From Google's internal investigator's memo:

> If you’re considering sharing confidential information to a reporter—or to anyone externally—for the love of all that’s Googley, please reconsider! Not only could it cost you your job, but it also betrays the values that makes us a community.

So the question is-- what constitutes "confidential" at Google?

Let's say a bad apple-- coworker or boss-- is abusing their power in a way that affects a particular class of employees, and the employee has exhausted the proper internal channels without success/resolution.

Is that information "confidential" according to the typical contract Google employees sign?
Both GCC and Clang have an extension to C that provide __builtin_xxx_overflow methods:

GCC: https://gcc.gnu.org/onlinedocs/gcc/Integer-Overflow-Builtins...

clang: https://clang.llvm.org/docs/LanguageExtensions.html#checked-...
What's "this kind of work"? :) The company I work for does reconciliation as a service, something that's pervasive in finance. We support customer-defined schemas; in fact that's one of our selling-points. I could start talking about the kinds of things we've done with MySQL to make this perform well - it's not difficult, just a bit unorthodox.

Anyway, the diversity in customer schema leaks out into the Hadoop schema, where we'd much prefer to give customers data using column names they're familiar with, and we also want to give them rows from all their different schemas in a single table (because many schemas have overlap by design). The superset of all schema columns is large, however. The problem can be overcome with more tooling - defining friendly views with explicit column choice - but having the option to implement that (and go to market sooner), vs a requirement to implement that, adds up to a distinct advantage for tech that can support the extra columns.
Halting interest payments on the US government's debt would instantaneously crash the world economy. This would almost inevitably lead to massive wars, not these little brushfire wars we have today.
People fought and bled and died for the right to own slaves too.

The point is that there's no such thing as a universal right. There are only rights some individual believes should be universal rights. If enough individuals band together, they can get those rights enshrined by whatever authority has the ability to grant and recognize rights for those people, but as long as that authority refuses them, they don't have that right. They just should have that right, according to you or me or whoever.
I'm not crunching big data in development or doing much with graphics (other than occasional faffing on some image editor). What I'm running is a lot of local servers. Each server has overhead even if you are only storing one byte of data.

ie I'm running Rails, MySQL, Elastic, Redis, Nginx, Memcached, and in some cases, multiple instances (dev, test, and multiple shards)

And then the usual OS requirements - Vim, 250 browser tabs, Slack, Hangouts, etc.

I'm sure there are all manner of optimisations and assumptions that could cut things down, but I'd rather the big manufacturers upgrade their RAM capacity every few years so I can focus on a dev environment that's a good approximation for prod.
Comments moved to https://news.ycombinator.com/item?id=14398175.
Um what? Very few people know how to use the cards. Most people have much more experience with keyboards and prefer to use them.
This looks way better than sitting in a dark conference room with a projector, trying to describe to the person projecting what you want them to do on their laptop.
Cassandra is not limited to use cases that need to scale-out, but it also excells at stuff that needs to be always-on, regardless of data size. Sure, you can do many nice things with data in memory or on a midsize USB key, but when your centralized hardware fails, you have a problem and in the best case you restore from a backup - and during downtime your customers go to your competition.
Ask HN: What jobs for when you enjoy coding but not full time development?
I'm just curious what job choices are out there for people who enjoy coding but don't enjoy being a full time developer. For reference, I'm not a 20 year old student - I'm closer to 40 than 30, and I've moved from an individual contributor (in a tech company) to a line manager/lead architect of a Data Science/Engineering team in a large non-tech company.

I love coding. And it gives me a great joy to build something with code and debug code. But I never enjoyed the lifestyle of a developer. I found the lack of real world customer feedback (e.g. actually working with the customer) and interactions with product management to be extremely demotivating. I felt like everything I was building was very abstract. I had good relationships with everybody I worked with, but I simply never clicked with them outside of serious work related conversations.

What do people do when they love to code and build but don't fit into the environment that developers typically exist in? I moved into people management, but I simply don't enjoy it.

For those of you who love coding but didn't thrive in the environment developers typically work in, where did you end up? What if you need a steady income and can't (for now) take a risk with a startups or consulting?

Thanks!
It's a premium device, like the Mac Book Pro. You can even say it's better because it can function as a tablet (has a digitizer), and it costs less.
A good number of the cases Kafka is used for where I work are even simpler: they'd be best handled by a very tiny flask (or similar) server backed by a common data store.
An ordinary PC can accommodate 4TB of data easily. But it is a SPOF, has slow I/O, the network card is probably slow as well.

I mean if that was the case then ELK stacks would not be running in cluster mode. There many 3-Node ELKs handling less than 4 TB of data efficiently where one could not. By efficiently I mean, not having time for Coffee while waiting for Kibana to load the graphs...
If I remember rightly that was a print applied to scanner glass, much less successful, and required absolutely perfect print transfer.

Which, imo, isn't much different conditions tbh (i.e. not representative of the real world)
He says some things with perfect confidence which are unknowable or false, but you do need a background in the field to see that. Also, he starts out with what seems to be an outrageous appeal to emotion, but I suppose "hurtful" could mean "harmful" rather than "mean."
Do you have any tips on how to convince management they don't have big data? My company's largest database has been in production for 10 years and could fit into the RAM on my dev machine, yet I'm constantly pushing back against "big data" stacks. This post made me laugh because "big data" and Hadoop were mentioned in our standup meeting yesterday morning.
I wasn't aware anyone doubted that there are genes that convey athletic abilities
I would say that business work and new tech should basically never meet.

Scout the technology ahead of business needs. If you want to look at new tech, you should be doing a proof-of-concept that the business is not depending on. If you are doing business work, then you can either use things you know, or use a completed proof-of-concept to move in a new direction. But you should not mix business needs with that initial proof-of-concept.
The culture of transparency.

Google is enormously transparent internally. The more there are leaks, the less incentive there is to be transparent.
Ask HN: What are some resources to learn about interface and Front-end design?
Samuel R. Delany’s Life of Contradictions
So do I...

Lets take a fun game. How about all of Atari 2600?

https://ipfs.io/ipfs/QmacAqRVhJX9eS7YJX1vY3ifFKF9CduDqPEgaCU...

Ok.. This is remote, across all the machines that have that IPFS hash. In other words, its not local.

(in console) ipfs pin add QmacAqRVhJX9eS7YJX1vY3ifFKF9CduDqPEgaCUSa4x5xb

Now its local!

Or lets do something more than a game... How about Node-Red in browser(PageNodes)?

http://ipfs.io/ipfs/QmSCrZUPkqH4gsncsD7tGXPiFpymsbwmywsHXLDh...

EDIT: I had the point in my head, but didn't put it down here. In other words, we already have this technology, and not using buzzword-bingo like "Its the interwebz but with blockchains!". These links are direct proof that it not only exists, but is working right now.

And in reality, making a type of blockchain in IPFS would not be hard. It's an immutable data structure, with append-only characteristics.

And, I also am partial to IPFS, primarily because it feels like a proper IETF-internet scale project. ZeroNET looks prettier, but.. throw away. Again, some subjective feel there, but IPFS feels elegant.
I thought that too. 1600 columns seems like quite a few columns.
And the projector is hitting the stove and counter, and highlighting where to put which ingredients when, and it's a Tasty video...
GeoEngineer – Transactional control of cloud resources
Trading the short game for the long game.
Yup. Hadoop is a DIY database engine ecosystem; the value is in the ecosystem and the choice of plugging in different bits, all tied together around a common core in HDFS and possibly YARN.
I think there's a middle tier of problems that don't need a distributed cluster but can still benefit from parallelism across, say, 30-40 cores, which you can easily get on a single node. Once you know how to use Spark, I haven't found there's much overhead or difficulty to running it in standalone mode.

I do agree in principle that you're better off using simpler tools like Postgres and Python if you can. But if you're in the middle band of "inconveniently sized" data, the small overhead of running Spark in standalone mode on a workstation might be less than the extra work you do to get the needed parallelism with simpler tools.
Lawsuit against world's leading AI corporation that tries to stop leaking secret dank memes. What a time to be alive!
I see in one of your sub-replies further down that you are in the US, but even hearing you mention "R&D tax credit" makes my blood boil. At least in Canada, the "Scientific Research and Experimental Development Tax Incentive Program" (aka SR&ED) is a complete scam.

Every development shop in Canada claims credits to recoup a significant portion of employees' salaries. Yet not a single one of my companies has ever performed R&D. The analyst comes in and spends a week getting every employee to lie about their work, enticing them to rephrase how their mundane copy-paste-from-Stackoverflow work somehow qualifies as "R&D". The majority of taxpayers' dollars paid to corporations through the SR&ED tax program is fraudulent.
I'm with you on this one. I understand frustration at "trick" problems or problems that make use of little-known algorithms or approaches. But there seems to be this sentiment that doing basic traversal and manipulation on data structures like a tree is burdensome. I simply can't trust in your abilities as a software developer if you need Stack Overflow to traverse a tree. You do need some fluency with basic data structure and algorithms, along with the ability to adapt them, in order to do non-trivial software development.
Integrating a scratchpad file into your Rails workflow
Love this idea!! Verify backups or some portions of backups randomly from time to time would be great. This is one of the biggest problems I've seen with backups. A number of cases where "it used to work" but now it doesn't a year later when you need the backup.
Documentation of complex systems.

If you do not have documentation explaining how the system works, its dependencies, diagrams, etc, you will have a hard time fixing security errors.

What happens if the guy that built the system leaves?
Yep. This is why I'm not sure that I want to do a deeper dive into algorithms. It seems like I could learn to implement all this awesome stuff with the least number of CPU cycles, but it's probably best to learn to communicate these things extremely well just to keep my sanity
Anyone have suggestions for tools to help with data analysis on moderate numbers of very large records? We're working with close a million records per year, which isn't "Big Data", but the records themselves usually contain over a thousand fields. (Is that "Wide Data"?)

Right now the records are stored in JSON documents, and we're working on ways to process those documents for reporting and analysis. There were some previous attempts to store the records "normalized" in SQL, but it quickly became difficult to modify and maintain.
What killed Sun was they made a big bet in something that was an evolutionary cul-de-sac. In business sectors that rely heavily on innovation, if you make and test bets carefully, you survive. If you don't, you don't. Cushy perks* don't matter.

And the jury certainly is out on Oracle. Right now Oracle is a company where great software goes to die. All signs point to them eventually ending up like Yahoo. It'll take a while, but the handwriting is already on the wall.

(*within reason)
Wow, this all sounds...sketchy.
Isn't this a question of upper-bound on input? Not specific examples that are less than the upper bound..
The problem you had was that you were trying to convince management to act in the best interest of the company rather than their own best interest. They would much rather be in charge of a $100k a month project instead of a $1k a month project. Also the big solution required a bunch of engineers working full time which puts them higher up the ladder compared to your 1 engineer working part time solution.

You were saving the company money but hurting their resumes.
Then elect yourself as a dictator. Experiment successful.
You're speaking like "Facebook" is its own entity. The first responders will be the friends of the victim who clicked on their video feed. How could the software itself understand what is and isn't self harm?
Sexy Dance by Asian Troupe
No its not :). I migrated from Java to .Net Core because of a cool project (and the requirements for it was to be in .Net Core), and I think it still has a lot to cover. It has some kind of Spring Boot feeling, but with the IDE (Visual Studio) , Entity Framework Core, missing third party libraries, very flakey testing frameworks it still feels like a beta at best.

In a couple of years, probably they'll be much closer. But that also depends on what the Spring guys and gals have to say :-).
I have been using GuixSD on my Thinkpad X220 for about 2 years now and it is has been good overall. I have fairly simple needs: GNOME 3, Emacs, Firefox (called IceCat in GuixSD). The full system rollback feature has been very handy at times when I do something terrible to my OS configuration file and just want to move on to other things.