skysight-inc/HackerNews huggingface dataset:
It's expensive. I think when my last company bought it, it was 15k per license or something astronomical like that.

They bought 20 or so licenses and never actually used them in prod - mostly because of the effort in building up a sane config for ops to use. The guy who set it up did a pretty good job, but after coming up to him and mentioning the 2hr/day stop the world GCing going on, dynatrace wasn't able to see them, where the jvm logs could.

So yeah - it's a good product, but you better hope you have the money for it and the patience to build a good config.
I like what you've written.

What are your lessons learned on how Architects should keep up (and avoid becoming whiteboard architects)?

My personal realization is that it is necessary to be hands on to understand new technology rather than just reading up documentation and others' opinions on such technology.
Note to readers: From a post in the other Pentagon Papers thread on HN, r3bl claims to be a web dev at one of the sites reporting on these leaks, ICIJ, Guardian, BBC, etc. So he isn't guessing!
The startup world is similarly situated.

Those who are good at getting their voices heard triumph in "unfair ways," except those who don't misunderstand the totality necessary to have good work shine.
I think i should invest in corn, through my offshore company of course.
"which arguably corresponds to free peer review"

No, it doesn't. They are remarkably different. If I distribute free package X, which Amazon uses, then there's nothing to prevent anyone else from using X. Both can benefit the same way.

If I spend 6 hours to do a peer review on paper X, which is then accepted, then Elsevier benefits financially, because they have a new paper to sell, but no other archive can benefit that way. There is also a gain in prestige to Elsevier from having published a higher quality paper.

If the paper is not accepted, then the reviewer gets feedback from my review, but no one else does. (I am supposed to benefit in the future from a favor-in-kind by peer reviewers.)

While it's true that much open source software is at no cost, I sell free software, exactly as described at https://www.gnu.org/philosophy/selling.html . While AWS might purchase said software from me, Elsevier/ACS/etc. will never purchase my peer review.
We've achieve a similar thing, but through the use of feature branches. Tickets are branched off a feature branch and merge requests are made back into it which are reviewed one by one.

There is still a final review when merging the feature branch into the upstream branches, but it's merely a scan and not an in-depth review.
Looks great! Small visual bug here: https://panamapapers.icij.org/stairway_tax_heaven_game/
The zoom effect blurs the image.
>> Think about all the bad programmers you are aware of, and think about how many are employed. I believe medicine is trying to avoid that, somewhat understandably, with collateral damage against people who would otherwise be good doctors but are unlucky.

It's not accurate.

We definitely know from the UK, Australia and Africa, that properly trained nurses can do well, many of the doctor's jobs, while increasing accessibility.
With a reference to another recent hackernews story: https://news.ycombinator.com/item?id=11415747

Can we expect to see the source code for this application pretty soon?
> That developers couldn't write their own tests, [...] was super frustrating.

I can see advantages to having someone else write tests for the developers.

And I don't see how they stop you from writing tests for personal use, if you want to.
Go database/sql walkthrough
Oh it's absolutely the exception, and not the rule, the minority contractor who's a pass-through. It's just an inevitable byproduct of the people who have the money and power having found a way to abuse the set-aside/aspirational target system. I didn't mean to suggest that it was common (though I can see how I could have been clearer on that point!).

Also, congratulations on using the MBE/DBE certification to build your business! That's excellent, and I'm quite happy for you.
The thing with it for me is that mongoose is an easier to use ORM than sequelize. I would for sure use SQL databases if there was more community and documentations surrounding SQL-express
This absolutely not does not happen in government - at least, the federal government.

Every employee in an office with contact with federal government officials will fill out a disclosure form every year.

Every official will do the same.

I remember we had to figure out the value of free google lunch because they were not allowed to eat for free.

The federal government employees take this very very seriously.

State, no idea, they all have different rules (but most companies just apply the same "no gifts of any sort" policy to them anyway)
Online gambling is a solved problem, but airbnb with hookers looks like it could be lucrative.

I'm guessing airbnb is the de-facto "airbnb with hookers" at the moment?
To me, programmer is equivalent to writer.
Having sleep apnea diagnosed while you're in the military also gets you a disability rating by the VA so you're considered a disabled veteran.
I was wondering the same. Whenever I'm in the states, I don't find the media to be particularly different...read a NYT or a WSJ paper and you'll get a lot of international news, positive and negative. As always, if you want news, you have to go looking for it. It just isn't going to be hand fed into your mouth.

I do not for the life of me get CNN and the 24 hour news cycle, though. It just seems to be all noise for news on cable TV. Anyways, still better than what I can get in the country I currently live in (China), but there is always the Internet (even with the GFW in place).
Not to imply that any future revelations must necessarily be less impactful than the Iceland story, but I feel like that would have come up on day 1 alongside Putin, rather than the Iceland PM.

It would have made front page news in the entire western world rather than being largely ignored late on a Sunday night.
Autonomous cars with drivers ready to take control because that's their job. Figure 50 years for robo-taxis.
> Because people in general don't like to socialize with strangers and get into potentially awkward situations.

I'm not sure that's entirely true otherwise the likes of Meetup.com wouldn't have been a massive success.

Part of the reason I wouldn't use the "rent-a-tool" services is I know that sod's law dictates when I really, really need to use my drill, I'll have rented it out to someone else.

There's a lot of things in life that I would only use perhaps an hour in its lifespan but when you need to use them, you need them on hand and not elsewhere.
1. The TSA is ineffective at preventing weapons from getting past their security checkpoints.

2. Everything required to make a bomb can be bought past the TSA checkpoint.

3. It would stand to reason that if a terrorist organization can get a conspirator to infiltrate the TSA, they could get, I don't know, two?

4. There's more than one person involved in the screening process.
I don't believe the US is hung up on not improving. I think that's blatantly false and I think you're wrong about some of what you're claiming.

It's also a fascinating bit of hypocrisy, to say that the US is hung up on being right, and yet you feel free to bash the US while promoting the things others do right (you listed healthcare, education, roads). How does that work again?

The US does in fact improve. See: gay marriage legalization (something many of those supposed progressive nations you're referring to still lack). Body cams for police (a wide national interest in ending police brutality). Ending mass incarceration and the war on drugs (changes that are now supported by the majority of Americans). The ACA / Obamacare.

If you want to talk about roads, much of Europe for example has seen its spending on infrastructure plunge dramatically. The US is now spending more on its infrastructure than most of the countries you're likely to reference:

"Infrastructure spending in the euro zone has dropped to an average of 2.7 percent of gross domestic product, compared with 3.4 percent of GDP for the U.S. and 3.6 percent for Japan."

http://www.bloombergview.com/articles/2015-11-27/europe-has-...

It's almost universally recognized within the US that there are significant problems in both education and healthcare. You can hardly get away from discussions on these topics. What is occurring, is a slow moving national debate on what to do about fixing them. The US has a healthcare system the size of all of Europe's healthcare systems combined in dollar terms, which employs directly or indirectly millions of people - there's no scenario under which you're going to radically remake something like that in short order.

The US is a relatively complex, massive representative system, with local + state + federal systems that all play an important role and a total government budget so large it would be the world's #3 economy by itself. It's difficult for a government system that large to move quickly on almost anything. Imagine trying to get most of the countries in Europe to agree on major changes to their education or healthcare systems simultaneously, it's approximately an equivalent feat to remake education or healthcare in the US - both of which are heavily managed at the state levels.
Principles of designing Go APIs with channels
Pull request , one line changed
-My team has a fairly has a fairly standard github
+My team has a fairly standard github
That's where the actual journalism comes in.

Also, in some cases hiding money offshore is indeed illegal. One example that immediately comes to mind is for individuals holding public office in Iceland.
Well the truck driver's work is not only to drive. Also to do maintenance on the truck, inventory and such. How do you change a flat tire on a self driving truck? You will still need some alternative. That alternative can be automated, sure... but it's a problem yet to be solved.
I'd think that modern traction control on an electric drivetrain with instant response should make it a non-issue. The RWD Model S is fine, for example. You can make the rear end skip a bit if you floor it going around a good curve in the rain, but it takes some effort, and that's a much more powerful car than the Bolt. The Model S P85 can get a little too exciting, but that's a really powerful car.
Idiotic. All they have to do is block payment processing.
Something something dysentery.
Three takeaways from military that you can adopt in your day job
Rob Pike has his ambitions. Great. Meanwhile, almost no one at Google uses Go. They use C++ and Java almost exclusively. Not Python either, outside of Youtube. (There's a reason GvR left.... all of the stuff he was proud of writing in Python got re-written, e.g. Mondrian.)

Pike is right that a significant fraction of Googlers are young and fresh out of school, and aren't 'researchers' (like maybe 33%?). They're also crazy smart, and can learn whatever language you need them to. Note that Google makes new grads learn a new storage model (BigTable etc), learn a bunch of custom infrastructure (everything except compilers and VCS is custom-built), learn all sorts of crazy shit. What Google does with these facts about their developers is that it uses C++ for huge-scale things (underlying infrastructure like BigTable, or massive-scale products like Search) and Java for the less-incredibly-demanding. Not Go. Unless you're Rob Pike and someone asked you if you could take care of something that needed a rewrite anyway.

It only makes sense to talk about Go as a Google language if you are under the mistaken impression that there are about 40 engineers at Google.

Look at https://golang.org/doc/faq#Is_Google_using_go_internally That's basically an admission of defeat. "We eat our own dogfood, and also a few tiny projects use it (one of which is tiny but super important)." Note that "scaling MySQL" is not exactly a long-term priority in a company that built three or four alternatives to MySQL, all superior.

It's possible that, if Google were starting from scratch, that ideas like "write the fast stuff in Rust and the less-urgent stuff in Go, which is still fairly fast" would be good choices. Sounds like a good idea to me. But the value proposition of Go over Java is, I suspect, not big enough to bother turning the enormous ship.

I'd love to hear any current Googlers chime in about a Google product written in Go that actually matters and took more than a hundred engineer-hours to write.
I wonder, is there actual evidence that physical buttons are better? I don't doubt that screwing with a touchscreen while driving is dangerous, but I have to wonder about the common wisdom that screwing with physical buttons while driving isn't.
Oh, but overall this system works very well as a way to give purchasing managers an incentive to look at these historically disadvantaged communities in their buying decisions. The abuse of the system I noted (the minority contractor acting as a pass-through) is not the common case at all.

Buyers still have a challenge in finding qualified minority/woman-owned firms, but there are pipelines in place to help build those firms up. The set-aside/aspirational target system can support that, too, by favoring prime contractors that work with minority/woman-owned subcontractors. A lot of primes have mentorship programs that target minority/woman-owned companies to help them grow their businesses.

In the government purchasing world, this stuff is all pretty non-controversial because it generally achieves its stated goal. I was just trying to say that abuse happens here too, but abuse of any system happens wherever there is a system.
Fascinating. We programmers live by our eyes, and I've had a few frightening flights of fancy about losing my sight, and what employment would be like in this field. I still wonder though how you'd go about reading other people's (bad) code, since there isn't any prior memory about what it was _supposed_ to do, and how you perform major refactors that just appear so "visual" to my way of thinking, e.g. hollowing out a function body into two smaller functions and adding a tail call.
But no one got fired for choosing IBM
It is completely possible that the schemes provided in Panama wouldn't work very well for US citizens, and also the close relationship between the USA and Panama might make US citizens looking for such schemes look elsewhere.

As for the fall out not being reported in US news, it is Sunday night, and if they weren't involved, then they wouldn't have a leg up on this. Wait until Monday to pass judgement.
Thank you for that link. I was not aware of the circumstances.
Great. Now you're limited to eating only somewhere in the vicinity of a charging station. Personal vehicles are there to facilitate your life, not the other way around.
I would agree that Tesla has a history of safety, and that is laudable. I hope you are surprised by the Bolt's safety rating when it comes out.

It is really great that Tesla has prioritized safety.

They do have a few things going for them that other OEMs don't:

* Only two models in production, both of which are on the same architecture. (soon to be three)

* No history of failure:

- GM's X-frame

- Really bad seatbelts: Nearly everyone until the 1980s

- Chevy Corvair (Thanks Nader!) [1]

- Pintos catching on fire

- Audi 5000 unintended acceleration in the 1980s

- Pontiac Fieros catching on fire

- Ford Explorers rolling over

- GM's key switch issue

- Toyota's unintended acceleration

When you look at all of those, you can see that at the time, either the engineers didn't care about safety (most OEMs until the 1970s), didn't prioritize safety, just missed something, or they didn't realize that a particular design had safety implications.

Tesla has learned all of those lessons and that's great. Most other OEMs have also learned those lessons, and that's great too!

1. Nader has been credited with pushing for consumer safety generally and vehicle safety specifically.

Disclaimer: again, all opinions are solely my own.
Heh. I submitted a FOIA request two weeks ago for code for a $100M system used for storing parking ticket data. They have 5 days to ask for an extension, but they haven't even responded with that.

Guess I'm going to lawyer up again..
With over 200000 shell companies created, you can be pretty sure not every shell company is involved in illegal activity. In fact, it's perfectly legal to create them, though the majority of their use cases is illegal. That still doesn't mean you can just dump private information like that on the internet
The article mentions the Iceland info and characterizes it as a "token" revelation meant exactly to keep people obfuscated and arguing about whether the leak did or did not implicate wealthy Western elites.

I agree with the article. The leaks about Iceland and South America clearly do not count as major investigative reporting on western involvement.

When U.S. officials, celebrities, and financiers start getting named, since there is literally no doubt they have been involved in this in illegal ways, then I'll believe they aren't holding back to protect Western interests.

Until then, the article is absolutely on point with its criticism.
Japan’s elderly turn to life of crime to ease cost of living
Does this look a bit like a flux simulator? I haven't got access right now. But from the abstract and the pictures it makes a sound a bit as if. Basically model and simulate the flux of metabolites via connected functions, linear-, step-, etc. It looks a bit like Matlab's SimuLink? Will read tomorrow and amend if necessary.
Note that the Bolt's $30,000 price is after the Federal tax credit, while the Model 3's $35,000 price is before the tax credit. The Bolt's real price is more like $37,500. Still close enough, and there's the additional complication that Tesla will run past the end of the tax credits well before GM does at this rate, but not quite as cheap as it might sound from the PR.
Pat is indeed a diamond, though there are plenty others to keep him company.

As for your experiences with ThoughtWorkers, do bear in mind that at the end of the day, everyone is a human who could make mistakes. It appears from your experience note that the month-long engagement could have been structured better.
Best proof I can provide at the moment: https://tech.occrp.org/about/ (members of our tech team on our lame tech blog) and, of course, our affiliation: https://www.occrp.org/en/panamapapers/. Also: https://twitter.com/r3bl_/status/716754286059864065?s=09 and https://twitter.com/r3bl_/status/716325999785418753?s=09

Our journalists have already started posting this on Twitter, kind of like we did yesterday when we warned Russian spokespeople that they're going to have a sleepless night tonight: https://twitter.com/DrewOCCRP/status/716320506052493312?s=09
The article about the performance, doesn't give the actual performance results. /facepalm
What is the penalty for not responding in time?
+1 for that.

Really, really cool initiative.
I'm fascinated by Echo because it seems like a silly idea on paper, yet I can't stop hearing good things about it.

Genuine question: are people not concerned about the NSA potentially listening to all their conversations?

I am tempted to buy one, based solely on the rave reviews, but I'm 80% confident the NSA could hack into it and bug my home if they wanted.
How does that intended positioning work, if not through price differentiation? Is it just a matter of the marketing?
Sure 2.6 TB is a lot of data. Probably had to be handed over in person rather than via some anonymous website. Also not easy to distribute in unprocessed form.

But I think this suspicion is very called for.

After all the law firm had offices in many "non-corrupt" European countries not on list of leaks:

http://www.mossfon.com/contact-our-offices/

(For some reason there are no offices in the US on this list; eventhough many reports say that this firm is also big in the US?)

Yet it is just the usual suspects ...
I'm really curious how the ping pong PRs worked out. I've often wanted to do this - both when reviewing code and having code reviewed. Especially for relatively small changes it can be almost as much work to describe a change as it is to implement it and give a little explanation for why.
Subject: Strategy For Getting Great Home Deals Is Here
Hello,
I am excited to present this opportunity that allows you buy, lease or sell properties with a strategic system. We have done a review of all the properties in the area and we can help you play in this market with multiple advantages. Our organization is currently working with a list of clients who have interests in residential properties. In any way you choose to partner with us, we would ensure you get unmatched value.
You can reach the contact details in this mail for more information. It is one opportunity that you must grab. Together we can make this work.Add yourself to my VIP Buyer List...http://www.fdviplist.com
Yours,
Lynne Phillips
Secret files reveal more Canadians using offshore tax havens
My word, their cups floweth over.
What do we know about Elon Musk’s electric plane design?
great points.
You just hand them fun, interesting work that doesn't do too much damage to the company when it fails. In practice, this means that your most senior people end up doing work that is very interesting, yet very arcane.

I mean, anyone senior around here should know that it's precisely making something production ready, as opposed to just 'work in theory', is one of the hardest parts of software: Who hasn't seen some code that mostly works, but is operationally unusable? Something that works with 1 server, but when you put it in 20, it all blows up? It's not about the nice presentation, or the talk where you explain how you turned MongoDB into a queue, but about making a system that works almost all the time, but when it doesn't, it is not the end of the world, and easily fixable.

The sad part is, the world is so full of powerpoint architects and projects that don't provide any real value that many people have never seen a system work right. And that's why we see tons of SV companies that are built around tire fires: Nobody in charge of anything has ever seen a system that we shouldn't be embarrassed of.
Is Google a good benchmark? They get all the attention, but it's weird to believe an advertising company about the timeline for autonomous cars.
I guess an obvious question is: what makes you think they haven't already? You have a smartphone, yeah?

More realistically, I would say that for most people, the NSA thing is a non-issue. Most of America isn't as privacy-minded as HN tends to be. I personally am not concerned about that. If the NSA is hacking into my Echo, there are bigger issues than the Echo -- namely, the NSA is overreaching. I'm not sure that ruling out an otherwise beneficial symptom of the problem really fixes the problem itself.

In other words, if you don't have an Echo, does that magically make the NSA powerless? No, of course not.
Oh my god. Thank you!