skysight-inc/HackerNews huggingface dataset:
Assuming you're running multiple pipelines at once you can add robustness in this sort of scenario by running the long-running tasks on guaranteed VMs (complete with live migration on GCE) and the short-running tasks on cheap preemptible VMs.

Another features that comes to mind for enabling this sort of work is GCE's support for attaching a persistent disk volume to multiple VMs (read-write for one, read-only for others) -- have each pipeline stage consume from a read-only PD containing the output of the previous stage and write its results to a PD shared with the VM(s) that handle the next stage. Have the VMs communicate with each other for control plane operations ("hey, this directory contains the complete results of stage <x>, one of you stage <y> workers can pick it up" or "I have completed processing the stage <x> outputs for job <5>; they can be removed or archived to GCS."). This strategy also allows independent scaling of the workers responsible for each stage based on the computational requirements of that stage, since a given PD can be shared read-only with many VMs (with limited performance impact in the many-reader case, especially if the readers are not hammering the same parts of the volume).

Another option for truly pipeline oriented processing (assuming the underlying workers can generate data suitable for it) is to leverage something like Cloud Dataflow -- then they'll handle the work balancing for you.

(note: I work on GCE)
Since we're talking about GPUs... search the NVIDIA archive [1], and look for the WHQL drivers:

Version: 359.00 - Release Date: Thu Nov 19, 2015
Version: 358.91 - Release Date: Mon Nov 09, 2015
Version: 358.87 - Release Date: Wed Nov 04, 2015
Version: 358.50 - Release Date: Wed Oct 07, 2015

[1] http://www.nvidia.com/drivers/beta
I love this -- Nicely done!

Does anyone know; is the smoothing guaranteed to be consistent across multiple browsers (I'm guessing it's done on GPU when possible with a software fallback and is probably just a bilinear filter)?
What language is used to program it? For some reason I'm having a hard time finding this.
What if the OS is the product?
I think I accidentally down voted your post instead of up voted, being on mobile. Your point is so fundamental and profound. I hate to admit it, because it seems a bit defeatest, but far too many people ignore the role of the individual and their decades of built up experience.
That would be best practice if you insist on using null hypothesis significance testing and only wanted to use classical frequentist statistics. We really can do much better these days with multi-armed bandits, and by focusing on effect sizes and credible intervals rather than a yes/no answer to a hypothesis.
Seems like the author is a q programmer so I'm not surprised everything is mashed together.
It's called a bug. It gets fixed. There's nothing special about this type of bug any more than any bug in the browser.
I'm pretty sure someone could (and has) proven Benford's law as an outgrowth of (A) random probability and (B) the design of our number systems.

I mean, it's basically like throwing darts at logarithmic graph paper: You're more likely to hit a "ones" box than a "nines" box.
+1 Nim is too messy for me. And the codegen bugs are very annoying, just like black magic.

Also I don't like the Python-style with no end-marker. I'll be glad if Araq does plan to provide another syntax for Nim. But I fear the style war in the community.

Things I like about Nim:
1. Unified function syntax call, which makes my code more OO-like.
2. Many customizable operators and easy to grasp operator precedence.
3. The pegs library is small but very nice. I began Nim programming with it, wrote handy grammar validators with it, and finally got parser trees in pure Nim for the ASTs. Really fun.
Not much, because I hope Nim could be simpler and get the most practical features done right. I am dizzy with its syntax and STL now.
"VLIW demands an even "mix" of instruction types,and it's hugely incompatible with general-purpose application core."

Has anyone ever done a study / experiment of a VLIW with multiple hardware threads and how that would impact the need for an even mix?
Much obliged.
Admittedly, the concept of entropy density has been used somewhat successfully for description of continuum close to equilibrium. But there are problems with extending this to general non-equilibrium case. I think a mix of oil with water is rather awkward to describe thermodynamically, because it is unstable and it is hard to introduce thermodynamic description for a fluid consisting of many drops of oil of different sizes scattered in water.
Second law of thermodynamics can be phrased in terms of entropy, but it does not really involve time at all. All it says is after process involving no heat transfer is finished, entropy of final equilibrium state is not lower than entropy of initial equilibrium state.
Actually, I would love more meritocracy.
It certainly has done well for Singapore, and I believe that was part of the strategy there.

The person involved in "dongle-gate" is what you get without meritocracy.
You described something with small benefits but limited downside, especially if your company has a team of a dozen or so people.
Found it. Mystery over. What's the fine for littering in Vietnam?

http://www.aerospace.org/cords/reentry-predictions/upcoming-...

Launch on dec 11.

https://www.youtube.com/watch?v=NrQLacne89s

Mission profile and payload. Elektro-L No. 2 weather-forecasting satellite.

http://www.russianspaceweb.com/elektro-l2.html

Edit: I think I was wrong about this being a blok-d upper. I think what came down over vietnam was the second stage of the rocket. This: http://www.russianspaceweb.com/zenit_stage2.html

Really BBC, do some digging before using the phrase "Space Balls" in a headline. It took like 40 minutes of googling to find everything about this debris.
@jsolson agreed on your points although I will say from experience that cloud dataflow doesn't work well with most bioinformatic workflows though unless one wanted to rewrite the tools from scratch. You end up fighting the system too much to make it work. Perhaps as the space evolves beyond the software wild west it is now this will change, I hope so.
Wayback machine suggests it's the same.

https://web.archive.org/web/20060203043136/http://samizdat.m...
I've only seen that autopilot work on a straight, gravel driveway. No way it works on my driveway: A steep incline followed by 90º turn.
Usually true. That's why high assurance security tried to identify the root causes of problems, formalize security schemes to stop/limit them, formalize designs, and show correspondence. Worked in many situations, not as much in others.

With defense in depth, inherently insecure OS's, libraries, and so on mean extra layers = some extra time/effort. We also know that software markets concentrate into a small number of products in each category that get dominant. We also know nation states and malware authors specialize and increase efficiency similar to markets with effort focused on greatest gains. So, naturally, these combine to dramatically reduce odds one will be safe if they're using popular combinations of hardware, OS's, and software.

High assurance is still necessary. At least at the level of CPU's, kernels, type systems, protocols, and so on. The critical stuff everything else depends on. Rest might be contained or detected running on right architecture.
Hacker Hourly? How quaint. Behold... Hacker Instant! => https://news.ycombinator.com
Remote screenshoting of hours old content across distinct local user accounts is perhaps more serious than many other bugs, especially when there seems to be a blame game going between the app/os/gpu vendors.
Advanced Algebra textbooks
GPUs don't have a page fault handler; when there's a page fault, it's an unrecoverable crash. Accordingly, zero-on-allocate (or potentially zero-on-free, but that makes assumptions about startup and teardown that may not be true) is the only way to do it.
I think regulatory hurdles will be introduced by politicians not due to safety concerns, but based on jobs. The conversation will switch from "immigrants are stealing our jobs!" to "robots are stealing our jobs!"
I stopped using lyft after moving from SF to Manhattan where yellow cabs are cheap and plentiful.

Since I stopped using lyft regularly I've received loads of "50% off for your next 10 rides" style offers.

I think they are designed to reactivate previously frequent users.
Instrumentation can be activated with customer consent, if support is requested by the customer.
What I really want to see -- but is unlikely to occur because there's no Big Money in it -- are systems that defend your brain from unscrupulous attackers.

Even now, traditional advertising is quite proficient at implanting false-memories.

http://www.jstor.org/stable/10.1086/660165
>>Possibly. But Uber raised 1B at the same time. So that suggests that the VC world still believes in the Uber model

No, it simply suggests that VCs behave as a herd, and one well-known VC firm investing in a company suddenly makes the others want to invest in it too due to FOMO (fear of missing out).
They just put 4G in the Chicago subways a couple weeks ago. That seems like a better solution than public WiFi, which you have to sign in to and is almost always overloaded or poor signal.
> What microcontrollers

STM32F7

* high-performance MCU with ARM Cortex-M7 core

* 32-bit ARM CPU @ 216 MHz

* 320 KB of RAM

* 512-1024 KB of Flash

* Single precision FPU and no fancy MMU

https://github.com/dart-lang/fletch

https://www.youtube.com/watch?v=Hx2iGEAvZRk

http://gotocon.com/dl/goto-cph-2015/slides/KasperLund_Intern...

Edit: Sounds like they plan to support the Arduino Due, but this is not implemented yet. They do not intend to support 8bit or 16bit MCUs.
"During the night of 21 December 2015, a weak signal was received by the Rosetta spacecraft and examined by the mission team. Their analysis revealed that this was not a transmission from the lander."

This seems like something that deserves a little more elaboration.
> Uber seems to only give a first trip incentive

Maybe in the markets they've already established themselves in. Here in Poland, they're basically throwing money at people. Every other week I hear that there's ~$7 worth promo code to be found somewhere. Or that they'll deliver you ice creams. Or donuts to work. Or something.
How the hell is that forum sliding? Forum sliding is where you post things unrelated to a topic on a bunch of fake accounts to get it off the front page of a forum, not saying "this isn't really a big deal."
I agree that the adoption rate will be slower than the 3-5 years rate stated by the commenter above.

I do think, though, that of the major cities, many people would agree that Chicago is among the most resistant to changes in labor due to customer preferences, due to its unique political system.

That said, though, imagine how absurd it would have been 6 years ago to imagine the market share that the Chicago yellow cab companies are losing, to newcomers that didn't even exist yet. I don't think many people, especially cab companies and Chicago legislators, could have predicted it.

The swell of opposition in legislators against cheaper technological answers to current labor solutions is heroic- the question that remains is, 'How long before consumer demand for the radically cheaper and/or more efficient option makes the opposition moot?'.

The answer usually seems to be: 'Sooner than everyone thinks.'
How much do you see going on in GPL'd hardware despite tools and motivation being available going back decades? Almost nothing. Takes expensive tools, limited expertise, expensive masks for prototyping... all sorts of expenses that mean it virtually doesn't happen unless cost can be recovered. Stuff is so outrageously expensive and difficult at better nodes that re-using proven (costly) I.P. is the norm.

Hence, you're going to need something that integrates with proprietary if you want them to build on it. There's still the possibility of a LGPL-style thing where at least re-synthesized or optimized versions of the open-source part must be re-released. However, forcing that for I.P. it integrates with would kill adoption by any provider unless they like operating at six to eight digit losses. Annually.
Thanks, looks like I'll be switching back to Uber for a little bit.
This might seem cool to people that aren't in NYC, but it's really not what we need. We need more tracks, more tunnels, and more trains. Second Avenue Sagas, the transit blog of record for NYC, is... more critical.

> wifi =/= building for the next 100 years. Massive subway expansion at reasonable costs is what's needed.

https://twitter.com/2AvSagas/status/685484086614437889

https://twitter.com/2AvSagas/status/685564984668123136

> I want to walk into a train station and never have to wait more than 3 minutes for a train.

https://twitter.com/2AvSagas/status/685537323124133890

The other thing is that Cuomo tends to just drop these announcements without any warning or planning. Sort of like the "throw it over the wall" model in open-source.
And in the mean time you share your porn with NSA for few years.
The wifi appeared in NYC before the LTE, but now that LTE is available everywhere wifi is, I've just stopped using the wifi, because LTE Just Works and is just as fast.
Our ancestors didn't spend all day in an office and only got to go home when it was dark outside.

In a country like Sweden, you might not get sun when you go to work and home again.
So spending all day outside hunting might have given you enough.

I feel better with Vitamin D, especially during the winter. Was also some research on how Somalians developer autism because of a severe lack of sun in Sweden: http://www.thelocal.se/20110328/32862
How 3-D Printing Threatens Our Patent System
> The notion that a type system is "just" logic

I would've never said "just". Formal logic is big f...reaking deal.

> so should be trivially followed by anyone "smart enough" or "careful enough" is laughable

I never said anything about being "smart" or "careful". I only said that hacker types, for whom the ability to subvert anything anytime is a fundamental tenet, tend to have a hard time sticking to the rules of a formal game, whether it is a type system or not. Just look at the reasons Lispers give for liking Lisp.
Free graphic design templates
Of course, gravitational potential energy of the system is higher when the oil is scattered temporarily in the water, because the water is higher than it would be in equilibrium state. However, I do not see how this has anything to do with the concept of entropy. The non-equilibrium state cannot be easily assigned thermodynamic entropy, because there is no obvious thermodynamic state variable that could describe the state of mixed water and oil. If you know how to introduce such a variable and corresponding entropy, then please explain it.
I believe it is the inevitable outcome of the "Internet of Things" meets the "identification of things". Today a number of police departments have red light cameras the give no tickets. So you might wonder why they are still there. As it turns out they do an excellent job of watching your license plate go through an intersection and recording that on a server. Add that to police cars with their own license plate readers and GPS and you end up with a cloud of data points, with time and GPS information for places in a city where a license plate has appeared.

That provides a very valuable database for law enforcement, if you know a car was used during a robbery, poof you know where that car as been, so you are one up on the robbers. Even if the license plate was stolen or the car stolen, you have it from the point the plate was stolen to the present. The ALCU has been trying to get statements about how long this data is kept and how it is accessed.

Today you can recognize faces with machines better than you can with humans. A camera can take pictures and store the face data with no other personally identifiable information, and yet when you suspect someone of something you plug in their face data and "poof" you get all the cameras that have seen them and when. Recent laws about trying to protect this sort of abuse not withstanding. [3]

IMSI catchers and simply Wifi MAC address catchers for the purposes of advertising (or surveillance)[4] can provide GPS + Time + identifiable number logs.

Storage is cheap, 32 bit CPU chips are free, HD cameras are cheap, and software radios can build white-space mesh networks on demand. When you lay a grid of these passive technologies around town, it will become the most powerful tool humans have ever invented for keeping track of, or locating, other humans of interest.

The fun part is that private citzens can play too, anyone can put together a fleet of cameras recognizing faces and license plates with a Raspberry Pi 2. And if you have a HackRF One you can pick up GSM bands and WiFi bands to note the phones, tablets, laptops nearby. Call it $400/unit, $40,000 for 100 units (two at every intersection would cover an area of 7 square blocks. Not something you would do on a lark but certainly within reach of someone who could profit from the information.

[1] http://www.kake.com/home/headlines/Salina-police-using-licen...

[2] http://www.governing.com/news/state/sl-surveillance-cameras-...

[3] http://www.law360.com/articles/742169/shutterfly-can-t-shake...

[4] http://www.bbc.com/news/technology-23665490
> Do you have any examples of AAA games (or even major indie ones) that use Rust or Haskell?

Nope, not in Rust AFAIK. Indie games in Haskell are around. Off the top of my mind, Niki and the Robots is written in Haskell.

> Often I find that when people recommend a technology for game development, no professional game studios ever seem to use them.

I was not so much recommending tech, just found these languages would fit nicely the list he assembled.
I don't get why they don't roll out LTE in the tube. Would be so much more useful.
InstaThreat.com: Demand letters as a service
I'd love to hear your feedback on my side project InstaThreat.com - we send physical demand letters to people who owe you money. Basically, if someone owes you $500 - $5,000, your options have previously been limited. We sit in the space between doing nothing and hiring a lawyer.

We'll send 3 legal-sound letters that escalate in seriousness over the course of 6 weeks for $49 encouraging people to pay up. Our service has been used to get back rent deposits, collect payment for consultants and freelancers, get money owed from friends, etc.

I'd love to hear your thoughts. Would you use the service? Why or why not? What services should I add or change? Thanks.
How is that "most cars worth stealing"?
It's no surprise to anyone who has read "The 22 Immutable Laws of Marketing". Once you establish yourself as the solid #2, your market share tends to grow as you distance yourself from the also-rans and also establish yourself as the alternative to the market leader, in this case Uber. (The law of Duality).
In Spain they found a few similar "space balls" in November:

http://www.iflscience.com/space/third-mysterious-orb-space-j...
Thanks! Yes, we got the website out in a bit of a rush. I hope to find some time to fix that (and several other outstanding issues). Looking fwd to your submission!
This is a good point I hadn't really thought about. For most tech stuff I've always got my head in a book, but when it came time to learn how to lift, my copy of Starting Strength only got me so far. It wasn't until I watched videos of others' lifting technique that I could really grasp some of the concepts.
> I've yet to find a better intra-office communication tool.
> If I'm having trouble doing it with email, I immediately
> switch gears and either get up and go talk to somebody or
> to go do some fact-finding.

...

> ... everyone who wants to replace email ...

I like email too. In the office, though, I've found it best used as one tool among many. In my last job we used email, IRC, a bug tracker, etherpad, pastebin, mediawiki, git+gitlab, and another "fulltext search most of the above" service.

I don't know if that's too many things -- are there good usability wins from combining a few of these things into one? Maybe not -- so long as everything we want to "point to" and share has a URL, maybe we were served just fine with that many separate things.

Still, it's easy to see why someone might say "Look how limited email is, it's not suitable for all of these extra tasks. I'm going to make something much more versatile."
The hose system tells you total traffic but unless you have two of them you don't know what direction the cars are going. Also it can't tell how cars "flow" so where cars enter the measured area and where they exit. Traffic planners need flow to understand if "express" lanes would help for example.
Performance is important because people use benchmarks to choose between vendors.

And even if it's <0.1%, there is strong "optimization mentality" in those companies (because perf matters) so it's unlikely to happen in the current climate.
Children used to play in full sun with no sun screen and minimal clothing.

Now they have UV blocking clothing and regularly applied sun block. Slip slop slap.

Children used to play outside. Now they spend a lot less time outside.
This is wrong. Your eye muscles can tire over the long term if not given a chance to focus on other distances. It's like standing up all day without ever sitting down. The eyes are fundamentally muscles.
I've had this thought quite a few times.

Basically, if you want your software to last and work on lots of platforms (particularly if it is a game you put a lot of love into), using a lot of dependencies you worry about it.

I know I've written some things - not even games, that would be a major chore to port.

But C and OpenGL APIs are still going to be there, and there's a nice feeling of quietness when it's just you, libraries you know are going to be stable, and the code, and not having to wonder "is this fully baked?" or "which one of these libs is the best".

You can almost get paralyzed in finding the ideal tools and libs to use and keeping up with all of them. Whereas if you limit yourself to just what comes with the language (and maybe a few small things) a side project can be a lot more fun.

A side project is also often about the journey, not the destination, and people can get a lot of mileage out of building incredibly complicated weird things that not many people will know are even there (I don't really know how to play Dwarf Fortress and don't play it, but the idea of the history generator, terrain generator, and so on... all that runs before you play the game strike me as great examples - the kind of thought that this is incredibly impractical and therefore must have been a ton of fun to write)>
The 'chromium' plugin has some fuzzy tab searching. From any page, tap `b` and type in a substring of a page title to match. It's quite nice.

I always liked the model of browser tabs as buffers rather than tabs. It reminds me of the philosophy difference between vim and emacs: since accessing a certain tab is O(N), Vim gets unwieldy if I have more tabs open than I have horizontal screen space. On the other hand, I have more than 500 Emacs buffers open and never have to worry when I switch between them. Wouldn't it be nice to be able to use Chrome that way too!
check out dpdk.org
Are they going to be open WiFi, or will require some authentication?
Large companies have used this because, like Ractive, with which it kind of competes, you can produce something very quickly (Ractive was initially developed for internal news room use). Alibaba used Vue for Singles day, Nintendo for its forum, etc. Using it for quick-turnaround work is a breeze.