skysight-inc/HackerNews huggingface dataset:
Having put many models into production in an almost real time environment (ad servers that need predictions in < 10 ms) I would say a large portion of what you need depends on your production requirements. The system I work on is very high volume 100k request / sec and we have massive amounts of data so it complicates everything.

First, I would highly recommend wrapping your ML models in some kind of microservice. Depending on your production requirements and if the ML is in Python a fairly simple Flask/Sanic web server should be sufficient. This is great because you can leave all your feature transformation code as is in Python.

If your production environment has very low latency requirements you are going to have some work cut out for you. You'll most likely have to rewrite all your transformation code in a faster language like Go or Java. You might also need to implement the inference code as well to get the speed you need. This adds considerable time and adds a ton of surface error for potential insidious bugs. The ML will still make predictions, but they will be wrong or very slightly wrong.

Because I'm working with larges of amounts of data and my source of truth is Parquet logs in S3, the pipelines start with Spark. We do as much data wrangling as possible in Spark to get things into a manageable size to create our train/dev/test sets. This data gets uploaded to S3.

The datasets are then trained on EC2 instances using Pandas & sklearn. When everything is fully automated the Spark job will push a message onto an SQS queue with the S3 path of the fresh dataset. An EC2 instance will be polling that queue and pull down the data and train a new model.

The final result of training my case is a text or binary model file that goes back up to S3. Our prediction microservice polls an S3 bucket and pulls down any updated model files and swaps out the running models.

Tips:

1. Instrument everything! Hopefully you have something like graphite/datadog/prometheus in place already, but you'll want metrics on your predictions.
2. Exception tracking on everything especially anything in your model creation pipeline. Sentry or something like that.
3. Try and keep everything as simple as possible.
Complimentary anecdote: I grew up playing Oregon Trail on the Macintosh, yet I also make a point to always wait at least a week before seeing any movie release so 1) the crowds die down, and specifically 2) so everyone there is there to see the movie and is unlikely to make any sort of noise (ESPECIALLY the class clown, who IMO ruins the movie-going experience)--ideally so I feel like I have the gigantic screen all to myself. If I _did_ have a theater-sized screen all to myself, I'd never go to the movies.

Maybe it's something like an introvert/extrovert thing, rather than a generational thing?
I personally am trying to build the primer. :-)
Improve Efficiency of Elasticsearch Domains W Automated Alarms Using CloudWatch
Cannabis Website Kannatopia Launches “Facebook for the Cannabis Ecosystem”
Google is helping the Pentagon build AI for drones
I appreciate the work that goes into carefully crafting a longform piece like this and usually prefer the full-course meal that this represents instead of the fast-food version you're asking for.
> the "class clown" that hoots and hollers at the appropriate time

This is exactly why I don't like theaters. I go to enjoy the movie, not have a shared social event. The extend of the 'social' aspect is my wife or friend next to me maybe getting an ear whisper, but even that is rare. If I want a shared social movie event I'll go watch The Rocky Horror Picture Show.

Edit:
I also grew up playing Oregon Trail
Geothermal energy, not geothermal heat pumps. Think geysers and volcanoes, not pumping heat into or out of a lump of ground.

It's a pet peeve of mine that everyone seemed to think it was a good idea to call ground-source heat pumps "geothermal." Of course it would lead to confusion. shakes fist angrily at sky :)
I guess if you try emailing the author, he may still remember the original year.
AndroidResources – Curated list of resources for Android developers
oh yeah, i will give xi another chance, what it didn't crash on it reacted nicely and fast. But no reason to trade in my sublime text yet :)
First US credit card with Bitcoin/Ethereum rewards
Thank you very much. This might help with my Master Thesis :)
"Nothing to show for it"... except the bank to go work for yourself and years of extremely valuable experience
If you use Algorithmia.com you can add your model in the language of your choice (on GPUs if you want) and it will do all of the Devops and give you an API end point. You get free credits at sign up and quite a few each month for testing.
I was qualified for the position but I got the impression that Google was just going through the motions. They got around to interviewing me a year and a half after I submitted my resumé.
Why couldn't Big Company B just do that themselves already?
Bacteriophages attach to certain receptors, they don't respond to any stimuli.

The entire process of injecting their RNA is simply a chemical reaction to being attached to a receptor.

Basically, they just drift along until they hit a bacteria with the right receptor, then inject their genetic material and the empty hull is either discarded or simply continues to hang onto the cell.

The outer hull of the phage doesn't do a lot.
I suspect there are some restaurants who are just now finding out what that mandatory binding arbitration and class action waiver clause in Opentable's terms[1] really means, today.

On the other hand, there's an Opentable lawyer who is getting an extra martini at lunch today for saving the company by including that text.

[1] https://www.opentable.com/legal/terms-and-conditions
Write Like John Carmack
Show HN: Investment Calculator – A simple retirement calculator
Brazil is currently overly excited with fighting corruption when its greatest problems lie unperturbed.

Income is too concentrated, taxes are highly regressive, and half the federal budget goes into servicing the debt.

All spheres of brazilian government have achieved a good level of transparency. But the national debate is always skewed by the current scandal cooked up by the media (that's another serious issue: the media is also too concentrated).
Grace Hopper – Nanoseconds [video]
> if customers would be willing to pay for it.

That condition resolves to false though ;). Most don't care and prefers to pay less.

Check anyone in a shop and ask him if he compares the internal components of both TV when he is shopping, he isn't...
Nothing to do with ground source heat pumps, tho. This is for geothermal energy. Ground source heat pumps don't need a hypersonic drill tech as they're generally going through soil, not bedrock.
Ringworld posited interstellar Bussard ramjets [1]. Since they were proposed (and Ringworld written) we have discovered there isn’t enough hydrogen in interstellar space to make such vehicles feasible.

[1] https://en.m.wikipedia.org/wiki/Bussard_ramjet
Didn't Uber stop tracking after dropoff?

https://arstechnica.com/tech-policy/2017/08/uber-to-stop-tra...
Does anyone have the videos for this? I remember watching them years ago but they seem to be removed now.
I would leave that information off because I had no way of knowing if it would be a help or a hindrance.

If I apply to Google in the future, I will probably include it.
Oh, and you can make your model private if you don’t want others to use it, and you can make it public to either give away or charge a royalty.
This is a pretty close-minded view on the pros vs cons of sharing any kind of data in return for benefits you value over that raw data.
Accept Interfaces Return Struct in Go
Also the fast track to normalizing pay-to-reserve/down-payment on meals at restaurants
Do what you love Do what you love WeWork WeWork WeWork
Interesting. Some kind of animation/repainting thing? This bug[1] seems to be along those lines.

[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1404042
Is this really a positive story about Comcast? I suppose you can say all's well that ends well, but that they were collateral damage in Comcast's attempts to make Netflix double pay for traffic in the first place more than cancels that out, in my opinion.
The affected restaurants don't use OpenTable.
A story that is expressly written to hook you for ads is obvious both in how it's written and it's quality (hint: usually bad).

There is a lot of trash written just to hook eyeballs so I understand your sentiment, but it's very tiring seeing these comments, especially when it's on a story like this that was well written and clearly not the kind of article you are saying it is.

The headline in this case was written to hook your curiosity, but the overall story was meant to explore more then just that answer. While it does answer it's original question, the story is also very much about the history of gorillas in captivity, and how their diets, treatmeant, and original misconceptions keepers had evolved over the years.
After LINQ, I entirely refused to work on DataTables code without refactoring it to something more sane, even if just ugly DBReader junk and its version of casting hell. I was briefly sad that .NET Standard 2.0 had to bring in DataTables and preserve that ugliness for the rest of foreseeable time.
Hours of daily parental exposure is not how anyone assigns "broken family" status. Psychologically it's about where both parents sleep at night.
I remember the exact time and place I first understood sin, cos, tan and SOH CAH TOA after months of being confused. The guy next to be at school Shaun Marshall just explained it to me in a sentence and bam, I got it, and have been using it in various forms of programming for about 20 years since then. Thanks Shaun, wherever you are now.
I wonder what would happen if we taught a computer virus to modify itself without restriction.

Of course, most of those viruses would probably just be rendered inert, printing a lot of segfaults into the kernel console.
I'm pretty sure you don't need to generate more heat in the summer though, so that's still a loss there.
If you think about zoos or royal menageries existing before hi-definition video, photography, steam engines, or even the printing press, then their existence makes a bit more sense. Human life was also at a different level of drudgery and cruelty not very long ago. Some zoos have a very long history with the oldest one existing today founded in Vienna in 1752. Institutions that have lasted don't tend to just shut themselves down, but I think zoos have responded to modern sensibilities with bigger, more natural enclosures, and a focus on conservation. If holographic tech gets good enough, I could see some zoos transitioning to having no live animals at all.
What about disabling the power button effect in the OS?
I can't help what other people think.

I know my craft and I'm good at what I do. Code that I wrote as an intern was in use for many years (to the best of my knowledge, it still is) at a former employer.
A modern interpretation of Hans Brinker.
Unscrew a bolt from the server rack and tape it on the button, done
You’re right it’s not that novel. Volvo has self-driving* truck convoys going back to the 90s I think.

I think for long-haul trucking it’s certainly pretty hard to stay fully tuned while driving for such long times. And for truck companies, they can save tons of money on labor when they don’t have to pay the driver for the hours on the road and just for the manual disconnect/connect docking. Maybe they can make it fully automated, but why haven’t any trucks done that already? It’s an easier problem to solve than self-driving.

* by convoy, I mean that one truck up front was driven by a human and then a few were automated to draft from directly behind to just follow the truck in front of them.

EDIT: Here's a source for the 90s, where this paper had a few authors from Volvo.

from:
http://orfe.princeton.edu/~alaink/SmartDrivingCars/ITFVHA15/...

>Additionally, different applications of automated driving for trucks have been demonstrated across the globe since the 1990’s. The focus has been on proof of concept for truck platooning due to the foreseen fuel economy and traffic flow benefits.
Shameless plug (I'm head of product at Algorithmia): we've written a lot of algorithms ourselves including many computer vision algos [1] that are published publicly for use. The underlying platform at Algorithmia is able to run production models at scale and puts a simple REST API in front of all of the algorithms so developers can easily call them from your production apps. The algorithms you see in the marketplace are publicly published but the platform runs private algorithms for software teams as well. Check it out: [2]

[1]: https://algorithmia.com/tags/computer-vision
[2]: https://algorithmia.com
This project is interesting, but real corruption doesn't happen with receipts. Corrupt politicians will receive funds in offshore accounts and then work for foreigners, such as the foreign oil companies that are now taking vast amounts of Brazilian oil contracts for next to nothing. The corruption cases presented by the Brazilian media are peanuts compared to these shady deals involving big foreign investments.
I also had a look on what Barcelona has to offer, before their little rebellion. But I would have had to accept 50% less money than in Germany according to Glassdoor. And renting there is almost as expensive as here.
Show HN: Summary Brew – Summaries for Top 300 HN Stories and Books
I try to do as much of the transformations as possible in tensorflow using the Datasets API so that I don't have to write them in another language/system in production.
I think you're confusing Friedman-esque theory of large corporation ethics (in large firms, management should/must only maximize shareholder value) with the law of corporations. Your local mosque is likely a corporation; at least some aspects of Mormon churches are incorporated too.

People in a group can share religious beliefs, and engage in religious conduct together, under the legal idea of a corporation -- the group activity is separate from their personal activity, for legal purposes.

And, unless the state meets a very high bar, we don't let government dangle corporate status for giving up your other constitutional rights. That's been true for most of the past century, even for profit-motivated associations.
Speed 3: Uptime
Ask HN: What is your daily routine as a Programmer or Entrepreneur?
A saddle chair fits that way of sitting better. Has anyone had experience with those? I have tried one briefly and it was comfortable but I am not sure what a full day's work on one would be like.
Updated Request for Startups
That's common knowledge here in Canada :)
So there is incentive for corruption with both public and private labs. The solution will require something far more drastic, which I'm not sure the population is willing to support given how many people don't like to use science when it disagrees with their emotional stances. As long as the population wants tough on crime stances, and are willing to dehumanize anyone charged (much less wrongly convicted), then the system is giving them what they want. So how can we change the voters so that they demand a more just legal system?
I wish I had this advice sooner. The new part for me here, beyond merely keeping a paper trail, is to make sure that everyone knows about your consistently kept paper trail, so that it wards off bad behavior before it starts.
You already are quite involved by providing translations, thanks!
can you share it with us?
> A certain amount of a language and its features is to protect your program from other programmers, to communicate your idea and vision about the code.

indeed ! language is about telling others (and yourself) about ideas that you want to express. c and c++ seems to be more suited for 'consenting adults' (oh dear) than anything else :)
Be sure to take your Boring Company™ flamethrower on any hyperloop trips that transit an underground section, in case the mole people attack.
To give a tool a fair chance I think it has to be used daily to really grok the pleasure / pain. We were aware of some of the problems, but perhaps overly confident about managing them, and underestimated the frustration and lack of agency. Possibly we let it embed too far before we decided we have tried as hard as could be expected. Around 6 months in, once a number of us formally proposed that it be reverted, we took the bold decision that we should persevere no further. Having worked in C codebases in the past - I can imagine it is almost a miraculous improvement there.
Are divorces in Canada contentious? I've been led to believe that USA has a uniquely dire set of divorce laws...
Real world finally fixed that issue. While selecting cheapest product still gets you the worst one, spending money on more expensive one doesn't guarantee it will be any better.
Everyone I've ever skied with knows this already...

Anecdotally, my phone (LG) doesn't whinge until it's at least -15C outside.
Venezuela says its cryptocurrency raised $735M
Control Over Phase Separation and Nucleation Using a Laser-Tweezing Potential
Yup, that's what I came to add. Have seen it too many times here.
Isn't this one of the primary reasons they were undervolting iphones? I thought this was already common knowledge.
Was it the 2015 13" by chance? Those were known to go bad quickly.
Meanwhile, I'll use mine that costs an astounding amount less to run. Gets clothes cleaner, to boot.
I'd be surprised if all phones don't have thermal range protection. At the very least the battery almost certainly does, not having it would be dangerous. Going into a partially operating state and giving warnings rather than just cutting off the battery is actually a nice feature that I doubt many phones have.
I've been thinking about doing this too. Great write up.
how you read the story depends on your subjective judgment. some might find it well written, others might find it too long to get a simple answer to a simple question regardless how well is it written.

edit: originally i was responding to the parent comment asking for TLDR on every article. this is not related to the content of this particular article
Would you risk it after the button is already pressed?

You'd have to take the bolt into the button without releasing it...
It depends on whether the propellant is used to increase or decrease the orbital velocity of the vessel.

Acceleration propellant would have to be ejected at the orbital velocity of the vessel plus escape velocity to escape. Deceleration propellant would just have to be ejected at escape velocity minus orbital velocity.

As deceleration near atmosphere is almost free just by dipping into it, or by using some form of sea anchor to pull on the atmosphere or magnetic field, it is more likely that propellant would be used preferentially for attitude control and acceleration.

It isn't impossible, but imparting enough velocity to propellant for it to escape Earth orbit--while accelerating a vessel in the opposite direction--seems unlikely for orbital station-keeping. You need at least 12000 m/s for escape velocity plus at least 8000 m/s to counteract the orbit you were already in, so the propellant would have to leave the vessel at more than 20000 m/s. That's a specific impulse of about 2000 s. Ion drives and VASIMR could do it, but the propellant is very likely to experience its own atmospheric drag and electromagnetic interactions, and the probability that any particular atom of propellant would actually escape with the minimum velocity-relative-to-vessel is very low. The propellant would spread out to a larger volume as quickly as it could, too. It's far more likely that one of those xenon ions would collide with a hydrogen atom in the upper atmosphere and randomly bounce it out, like a bowling ball hitting a billiard ball.
>it seems fair to say that it's at least enough bullshit that it should probably never be used as evidentiary.

Doesn't this also apply to eyewitness testimony, if not many other forms of evidence?
That's common knowledge even in Texas.
What interesting things? It appears he went a week and didn't seem to enjoy it. I imagine that would be the case for any diet where you only eat the same thing for a week.
If your network could speak, what would it say?
While I'm sure the article is old, Allegro is still around. The latest release was February 25th:

http://liballeg.org/
On the topic of corruption, my Spanish teacher said that countries where corruption is endemic and part of the culture almost always started out as "extraction colonies". That is, the natural resources were plundered by the colonizers (the Spaniards or the British or the French). What present day politicians are doing is simply continuing the strong historical precedent of taking out riches/prosperity/profits/resources from the country for their own use.

In Haiti, Jean-Jacques Dessalines, the leader of the slave rebellion who overthrew the colonizers rapidly became one of the "1%" and a de-facto colonizer once he gained power and they realized that slavery and plantations and serfdom was quite lucrative and profitable.

https://en.wikipedia.org/wiki/Jean-Jacques_Dessalines
> Hope is a strategy [...] At some point we have to hope and assume. for example eventually we hope the compiler authors did a good job with the next version we are about to use, or we assume that the kernel fix was good.

Or you can do a very slow, controlled rollout of the new version and see what happens. With all the systems I worked with while at Google, both as a SRE and a SWE, whenever we had a new version to release, we'd update one task in one cluster, let it run for a day or two, check the logs and the metrics... if it was OK, update one job in one cluster, then repeat the process with an entire cluster (the designated canary cluster), and only then release to the rest of the clusters. If any of these went wrong, we'd rollback or patch, depending on the severity. We rarely missed our weekly releases.

I'm sure the same applies to a new compiler version or a new kernel fix. You don't need to assume anything.
I think these companies (autonomous car/truck) understand that they need to transition these processes slowly over time. I feel like it's better to start with something only moderately different and iterate than try to completely reinvent the entire structure of such a large industry.

First they do this, then they automate more and more portions, at each step reducing the amount of manual, human supervision. It also allows the industry to more consciously reduce numbers through attrition rather than mass layoffs. Better to stop young guys from becoming truck drivers and have the automation increase over 10-15 years until it just really isn't a career. The only people that will be affected are in the 25-35 age range now who have already taken the plunge, but at least they get some time to consider other options.
> "Hopefully, we had ‘only’ read access and could not write or delete anything"

Sounds a lot like feigned ignorance about the nature of the root user. Not entirely sure if it would help them in a court of law. They should probably anonymized the whole thing better to be completely on the safe side (not a lawyer though).
It probably is, but a thing being common knowledge is not the same as apple confirming it.
iPhones, Android phones, music players, and other electronic things, if the weather is cold enough. Are we just trying to find anything bad to say about Apple so we can say it? Why is this on the front page?
>Jeremy told Who, me? that his mate asked to be relieved, as he was in a bit of pain. Those requests were denied due to the risk of the power going off and also out of a desire to make the poor chap suffer for his error.

Looks like they wanted him to suffer :p
My iPhone stopped doing this when I had the battery changed
Chapter 32: Please (GC pauses the world) rewrite (GC pauses the world) it (GC pauses the world) with (GC pauses the world) C++.