skysight-inc/HackerNews huggingface dataset:
The amount of time it takes to keep up with all of the changes big sites make is impressive.

At some point I decided to write something similar in Ruby ( https://github.com/rb2k/viddl-rb ) and I'm kind of ashamed of how broken things are from time to time.

Video hosting sites don't have APIs and reverse engineering the sources for the videos is like shooting at a moving target.

So kudos for leading that project :)
It's pretty clear the list is talking about all-in costs, though.

Under the ER one it even specifies "the system" as who its currently costing $1000.
The visual trickery is fun. I hadn't noticed that only the centre lines on the road glow until reading that, nor had I noticed that the street lights don't actually have a thin line linking the pole and the light.
Seriously doubt it. Backwards-incompatible changes (mostly, deprecating some old kludges) had happened many times and I don't think there were any severe migrations.

I'm really not sure cons of User-Agent cleanup (or complete deprecation) outweigh the pros. At the very least I think it's not obvious and is debatable.
Are you really saying that Aereo failed due to a marketing? They always presented themselves as a technology platform that leases equipment.
It's possible that others ways exist and are better but which simply haven't caught on. That said, they're not much use if nobody it using them and I and many others are thankful to you for your contribution.
A temperature puzzle
Bad managers, sure. Not the sort that I'm talking about.
I guarantee you they do not "just like" foreigners in STEM. I currently live and work in Asia and the growth in the region (particularly China) can be orders of magnitude that of the US. Just looking at Vietnam, you went from 0.25% to 43% internet penetration between 2000 and 2014. China alone has over a billion people to the US' 0.3 and the percentage of Asians in the middle-upper class (those that both can afford, and desire an Ivy education) is rapidly rising, whilst the quality higher education supply remains constant. It's one of these cases where you have to refresh your view of the world every couple of years.

Not only are candidates more numerous, they are better prepared, some even doing a year or two in a local university to stack on the skills. In my experience, "locals" in the West don't see the sheer drive and intelligence of these students because of the language barrier (yours truly was, of course, guilty of that back then - it's been an expensive lesson). I've seen engineering undergrads with a tenuous grasp of English skip every lecture in the year and still get in the top 5% of the class (after all, grad-level maths lectures were so much more interesting) - the "Western" students were just nowhere near as prepared. There is nothing inherently special about the mythical Asian undergrad, it's just a numbers game - the top 100 Chinese candidates by IQ are equivalent, statistically, to the top 30 American ones.

The same story plays out with capital and is driving real estate prices up in major global cities. And in both cases, it is dismissed the same way that the British would dismiss the rise of the USA as a global economic power just as the Fabians put the finishing blows to prosperity at home (or, in Sydney's case, happily embraced with negative gearing and rationalized via any graspable straw). The region has issues the US did not, so the story's not written up yet.

FWIW I've seen plenty of Asians do great in non-STEM subjects (including publishing, acting and music). As a classically trained musician, I know many more Asians with a great knowledge, understanding and interest of music history and theory than Westerners, even those who studied the subject full time, even though it is theoretically the latter's "cultural baggage". I'm not a fan of Lang Lang, but hearing musicians like Yuja Wang is incredibly promising and shows that "foreigners" with not much local exposure to so called Western culture can easily master "our" arts.
Microsoft now testing robots as security guards
> It confirms to recent UNIX standards, such as various POSIXes (pthreads, rt extensions), UNIX98 (I guess), etc. and obviously don't have any Linuxisms, like udev, systemd (thank god!) fuse

I don't believe any BSD has ever been certified for UNIX98 (or any version).
http://www.opengroup.org/openbrand/register/

And instead of Linux-isms you get BSD-isms like strlcpy(3)
and devfs (which is the equivalent of udev).

https://wiki.freebsd.org/WhatsNew/FreeBSD10
lists "FUSE support in the base system" as a new feature.

Also the "native ZFS support" is not a "technology of FreeBSD's own" but ported from OpenSolaris.
Marketplaces are eating firms
You even quoted the part where he says "the system".

He's talking about total costs, including to the government.

Rightly or wrongly, he believes there's room to dramatically lower actual health care costs.
Baidu’s Andrew Ng on Deep Learning and Innovation in Silicon Valley
Ask HN: Usable remote desktop over WAN
I've been looking at remote desktop options on various platforms to see which ones are actually usable over a typical residential connection (for me, 20M downstream). The results have been disappointing overall.

This was a subjective, rather than scientific, test using a few random apps (browsers, text editor, terminal).

On Linux (Xubuntu 14.10 in my test environment):

* NX 4 - it's OK, but still not usable enough in my opinion (over LAN with or without simulated latency/rate limit). Still quite a noticeable lag, scrolling in a Web page for example is not very smooth.

* x2go - required some tweaking and it's about as good as NX 4, maybe slightly worse.

* various VNCs - abandoned because RFB is useless with latency

* X11 forwarding - some apps are OK over LAN, some apps like Chrome are worse than VNC. Add a bit of latency and it's completely useless.

Over WAN I've used MS RDP on 2008R2 to dedicated servers about 30ms away and it has never been anything near usable in my experience. NX on Linux is far more usable.

I also tested Amazon AppStream, which was by far the smoothest and best experience. I used Chrome as the test app and the Windows client. Once the client reached 60 FPS (at 1280x720), it was almost indistinguishable from running locally, even with the 60ms latency to us-east-1. Scrolling was smooth, even on YouTube. YouTube videos were smooth. Unfortunately, it's proprietary, only available hosted from AWS, and Windows-only for the streaming host.

AppStream is the bar to meet or exceed and none of the other solutions get anywhere close. It demonstrated what's possible with a good streaming H.264 implementation. I don't want to use AWS and I want to use Linux, so unless someone knows of another competitive option I've missed, I'm going to try to put together my own H.264 remote desktop implementation and see what I can do. (I may also do some testing with other encoders, H.265, VP8, VP9 at least.)
How is this not just a chat bot like Cleverbot with arbitrary trigger words manipulating the 'emotion' gauges? I didn't dig into the source code, but claiming a website simulates a human brain seems like something that'd require some hefty evidence...
probably cl[ient] then
Java Primitive: Sort arrays using primitive comparators
I think most serious startups will want to incorporate pretty soon in order to have access to venture capital and limit personal liability. I wonder what the social security contributions are for owners of a limited company in Germany. (And no, I don't expect you to Google that for me ;-)
I did stop, many years ago, in part because I was tired of this sort of thread. People who don't know the requirements and don't bother to learn anything go on ill-informed rants about other people's work. Hey, it's no longer officially my problem. But the people who are still working on improving the software still don't deserve the abuse.
Scala IDE support has improved a lot. I use IDEA and I have no complains at all, at least for my needs. For instance it is very quick to point out errors and to show the inferred types for expressions, functions and variables. Refactoring such as renaming and extract method work very well.

I mentioned Scala because it could be more attractive (i.e. "sexy") than plain Java, and produce a more clear and concise code base (if used well).

But I agree with you that you'll find many more available and trained Java programmers. If you avoid the old-style, heavy-duty "enterprise" frameworks and stick to a more straightfoward architecure, and perhaps take advantage of Java 8 features, it should be a very good platform to build upon.
I think that open-source projects need to take these questions of usability more seriously. There seems to be an unspoken but pervasive attitude that features should not be added for convenience or to guide inexperienced users when they make a mistake. To go on a tangent, I think this is why Linux desktop environments still lag behind in usability; Windows and Mac chose their fate a long time ago.
This is exactly why I contributed. In fact this morning, by coincidence, I had my first ever PR accepted, and it was for this piece of software [1]. I was using youtube-dl to download VK videos, but I really wanted to be able to download an entire playlist -- in the same way you can for YouTube. It didn't exist, so I just got stuck in and did it myself. It really helped that there was many other examples I could look at from other sites, and the maintainer of the package provided me with some very good feedback.

This kind of project that requires a lot of fairly laborious work to create support for many different information sources is a particularly good candidate for an open source project.

https://github.com/rg3/youtube-dl/pull/4233
Quora and Yelp are for profit.
Basically the whole package. The instruction set is pretty big, but this is not much of an issue as you generally just need a subset for a given problem (I generally only tweak SSE/AVX code) and it has a lot of if's and but's when it comes to performance, the out-of-order execution also adds a degree of uncertainty, branch prediction and prefetching, a complex(ish) cache... There is a lot of things one can fiddle with in order to improve performance.

GPUs are much stricter in their design, which can lead to some headaches when having to completely change the way you formulate a problem, but once you're past that step, the simplicity of the architecture makes it a lot nicer to optimize in my opinion. (And my personal experience has been that the tools are cheaper (free) and more stable as well, but your mileage may vary).
I worked as a recruiter for a number of years and never saw an offer retracted because someone tried to negotiate.

They will either say no, sorry or they may ask you why.

It's harder to have a good reason when just starting out.

You can always say "If I didn't push for better it wouldn't show much initiative would it"

Increases early in your career really help you when moving up/on.
True, although I wonder if doing it over even a 100m cliff, but with a much larger weight, would be cheaper than the drilling operation.
None of which are being used to deliver quality news much note concisely at low cost.
Technical Entrepreneurs Often Fail by Early Adopters
I'd guess they are using VXLAN or another similar technology.
That's a good idea. Hope Larry considers it.
The link between atmospheric carbon dioxide concentrations and global warming
Ground Drone Project: Urban mobile robot chassis
Not for everyone. Look at Yelp and Wikipedia.
Where can I download it from?
Agreed -- I remember some of the alternative ways to solve the same
problems, such as CORBA and various custom protocols, but they were
painful to use...

Now, early DBus was a bit lacking in that respect as well, but with
GDBus (GLib's DBus implementation) it's become as straightforward as
IPC can be, even in plain C; I've seen quite a few people new to the
technology that were able to get up to speed with it quickly.

It'll be interesting to see how people are taking DBus and pushing the
boundaries of what it can be used for, such as kdbus.

Thank you hp!
That's because it uses WebGL and not Canvas2D.
It's interesting that you mention X11. The Wayland developers recognised that X11 had not only become fat, which isn't inherently problematic, but that almost all of the old fat had become dead weight. X11 essentially became a horrific over-engineered, vaguely graphics related, IPC mechanism... just like DBus. Wayland is an RPC protocol.

I'm kind of hoping IPC mechanisms similar to those used by Wayland, which fell out of all the work on XCB (a clean X11 equivalent binary protocol for Xorg that, iirc libX11 is now built on top of), will ultimately be adopted by other projects. Interestingly they implemented RPC dispatch using libffi, which is pretty elegant.

The Wayland FAQ, in fact, has a rationale for avoiding DBus[0]. The core Wayland framework certainly hasn't suffered in terms of bloat or complexity by avoiding it. Go look at the code[1], and compare it to DBus[2]. Admittedly the topologies are different, but as far as I'm aware nothing prevents Wayland clients from establishing their own P2P communications.

[0] http://wayland.freedesktop.org/faq.html#heading_toc_j_10

[1] http://cgit.freedesktop.org/wayland/wayland/tree/src

[2] http://cgit.freedesktop.org/dbus/dbus/tree/dbus
Great headlines for TMZ crowd.
My advice is worth money, but things I want should be free.

...okay bud.
Forget This Work-Life Balance Blah, Blah, Blah
The playlist feature is actually one that typically annoys me. So I've just re-read the manpage and found the --no-playlist argument.
If only the folks at Redhat were improving things and not playing your sorts of passive-aggressive political games...
The startup’s ‘customer partners’ slide: All those logos and no dollars?
It's going to take enforcement. Some widely-used C++ compiler will have to have a twistable knob that treats those old features as an error, so companies or projects can require new code to compile with that knob twisted.
If they are defined as separate protocols, then the argument that the spec is ridiculous because it contradicts itself on this point is based on a misunderstanding, whatever the merit (or demerit) for these things being separate protocols is.
For Goldman, Government Gift from 2008 Crisis Keeps Giving
C++ has always been used, in practice, together with many C language features that should long since have been abandoned. That's just what people do. Maybe they shouldn't, and you don't have to, but the sociological fact is that people who want to have the advantages of C++ but leave behind the legacy of C move on to D, Go, or other languages.
Another thanks here. I use youtube-dl so much that I occasionally substitute it for wget when trying to fetch online content (and occasionally discover in the process that it will in fact grab what it was that I was trying to get in the first place -- mostly audio files).

I vastly prefer offline media players to browser-based tools, for a number of reasons: better controls and playback, richer features, uniform features (I don't have to learn each individual site's idiosyncracies), the ability to queue up a set of media from numerous sources and play them back without clobbering one another, and more.

Hugely useful tool, and I've been impressed as hell as well by its update frequency.

And lift a mug to old Warthog. I miss Joe as well.
Quick protip for those wondering, the simple command to download an entire youtube channel is like so:

$ youtube-dl -citw ytuser:LastWeekTonight

I downloaded a channel with 121 videos, 4.4 gigs, took 26 minutes, so 2.8MB/s average. Curious if the Youtube people will shrug it off and free the beer or rate limit or more aggressively combat this.

Also, to get the total number of supported sites:

$ youtube-dl --extractor-descriptions|wc -l

466 (wow)

As this can run on anything with Python, I guess that includes Android[0], iOS[1], Windows Phone[2], heck even Blackberry[3]??

[0] https://python-for-android.readthedocs.org/en/latest/

[1] https://code.msdn.microsoft.com/windowsapps/using-python-on-...

[2] http://pythonforios.com/

[3] http://forums.crackberry.com/blackberry-z10-f254/blackberry-...

Thanks pmoriarty for submitting this. Awesome and I'm just getting started poking around with it. Makes me really want to learn Python, seems that's what all the fun stuff[4] is coded in.

[4] http://motoma.io/pyloris/ :)
I'm not talking about runtime speed or latency, rather about development speed.
There is no such thing as JavaScript as an employable skill. It's all about the framework.
Is there evidence that fat people cost society money? They die earlier, and quicker, avoiding extremely costly end of life dementia care.
Did you hear mix remix? https://soundcloud.com/martin-leblanc-eigtved/monkey-island-...
Let me get this straight. To you, there is nothing wrong with embedding a separate ASCII protocol for authentication inside a binary protocol? Of course I realize that the quoted text about ascii-only describes a subset of the full protocol. To do this is ridiculous and bad engineering.

I also note that you completely ignored "If you know what this means, please contribute documentation via the D-Bus bug tracking system." appearing in the specification. Seriously. This is not a specification. This is a poorly written description of an existing mess of a wire protocol.

Other engineers clearly do not know what they are doing.
Dynamic scope (the expectation of it, and the patterns of programming that it encourages) become more than just a nuisance when you try to separate work into tasks that can be handled by any form of task pool. In general any form of concurrency combined with dynamic scoping is at best painful, and at worst a disaster, and working round those issues introduces considerable runtime inefficiency.
Which usually works, but there are some cross compiling and other options that need it (actually largefile options on 32 bit setups that need it like glibc, alas that hasnt died yet).
Or they could just use an airplane to relay to signal. The technology isn't really the issue. The issue is they don't want to release a video of a rocket crashing into a barge (or the ocean next to a barge). They know such a video would be replayed in mainstream media without the "this was just a test that only had a 50/50 shot of working in the first place" context. Especially after F9R-Dev, an Antares, and SS2 all RUD'd in the past couple months.

That being said, they have announced that there will be cameras on the barge. The fact that they have announced that ahead of time makes it very likely we will see at least some footage in the days or weeks after the attempt (they'll just want to do it in a PR controlled way).
And ease of tooling.
Whenever using C++11, I try to use std::function everywhere instead of function pointers, because it ends up being so, so much more readable. Taking the article's last example, I rewrite it using std::function.

void (*signal(int, void (*fp)(int)))(int);
function<function<void(int)> (int, function<void(int)>) > signal;

It is more verbose, but easier to read, in my opinion. The return value of signal, function<void(int)>, is in one place, instead of being split into the beginning and end of the expression.

As an added bonus, it can also handle lambda functions or bound methods, which the function pointer version cannot.
Ask HN: Can we talk about Linux vs. OS/X?
A lot of web programmers I meet use OS/X on Apple hardware. I see none of them deploying on OS/X however. Despite I hear about OS/X being part of the *nix family, I can't comprehend why it can't be used as a server OS, e.g. on AWS. Anyone has ideas why OS/X isn't good for servers (except hardware compatibility). I'm curious about OS/X init system, package managers, support for databases, web server sw, network stacks etc.

If there are good reasons for it, why people use it on development machines? Isn't that loss of precious brain cells to learn inadequate stuff for server development?
1+1 lol
Correct. Each class that handles information extraction for a different side defines a regexp to match the url against. (Note: Some of the regexps aren't hardy to the http-vs-https distinction, so you might have to remove the 's')
I wonder what Andrews and Arnold's approach to this problem will be. They're the last bastion of common sense in the UK.
You also need n number of motherboards, RAM, power supplies, etc as you have CPUs. The Phi looks a lot better when you fit 5-6 in a server.
There's no guarantee that individual banks will have enough deposits to cover their liabilities, so they first have to wait until the end of the day in order to clear all transactions made and fix any possible deposit shortfalls by operating on the overnight market getting short-term loans, either from the FED or from other banks.

http://www.investopedia.com/terms/o/overnightrate.asp

I'm not saying this is the reason why you can't instantly transfer money around, as there could possibly be a better implementation of such a system that allows consumers to do that. I'm just saying what I know.
Online businesses don't need to aim to the local market. It is easy to aim at another market (or the whole world) while living in Spain.
Andrews and Arnold do not.[1]

[1] http://aastatus.net/1984
After spending some time in a language with left-to-right declarations, going back to spiral declarations makes you realise just how many contortions your brain has to constantly go through. left-to-right is a breath of fresh air.

Edit: Of course I must add that it is a breath of rather old fresh air - Pascal and SML have had it for decades.
A big part of it is framing. If you frame something as a tech demo, that's how it's going to be recieved. 'The Art World' does seem reasonably open to stuff like this, but you really have to go out of your way to make sure people know "hey this is art, please interpret it as an Artwork, here's a chunk of text explaining the conceptual backdrop for this piece, here's how it fits into my wider practice, thank you". But with that perhaps you would risk alienating a big chunk of the HN crowd.
and who doesnt lol ?
> Adoption speaks for itself

Well, DBus was politically pushed onto KDE back in the day, when there was a strong interest in making a success out of cooperation efforts in the Linux desktop space. IIRC, KDE was basically strong-armed out of DCOP.

Once it was established as "the official IPC on the two dominant Linux desktops", it would have been difficult to ignore it regardless of its actual quality.
You would normally have to make payments into the Spanish social security scheme. The rules are actually quite complicated but if you live and work in Spain that's where you have to contribute to social security. Owning a UK limited company does not change that.
Rob Pike gave some details and historical footnotes about this and many other decisions during the evolution of Go.

http://confreaks.com/videos/3419-gophercon2014-opening-day-k...
I'm no C expert, but couldn't you contain the madness for a good part with a sane code convention and smart use of typedefs? It looks to me as if the part where everything breaks down is mostly with "nested" function pointer types like in the "ultimate" example of the tutorial.
(The syntax of "simple" function pointers is quirky as well, but without recursion, you might get the hang of it after a short time)

So, couldn't you avoid much of the confusion by mandating that function pointers may refer to other function pointers only through typedefs?

Of course this wouldn't work for legacy code...
Yeap. I expect it would be easier to run into one of these in the Sahara desert.