skysight-inc/HackerNews huggingface dataset:
Would be useful if AVRO files were supported. This was the data can also be imported into Redshift if needed (Redshift does support Avro).

Other formats are schema-less (JSON,CSV, etc.) or not supported by Redshift (ORC, Parquet). Perhaps less efficient for some queries (AVRO is not a columnar format) but still useful.
Billing alerts that are simply a notification you exceeded $X is not any sort of limit, particularly when they may take hours to arrive.
That would be nice. I myself am someone who can't stand doing UI work in code, and prefer to lay it out visually if possible.
The article mentioned kubernetes multiple times and I think it's providers like Heroku that actually stand the most to gain there. With kubernetes in theory they should no longer have to make you choose between providers, and be able to run on spot instances of whatever provider is cheapest at the time. You just choose your max latency at certain geo areas and a budget to balance by, some AI to help you determine the tradeoffs, and it does the rest. If Heroku isn't working toward that then there has to be someone doing so soon. If not it seems like there's a pretty big opportunity there.
Richard A. Eisenberg has a nice comparison of Dependent Haskell with Idris and Liquid Haskell in his PhD. thesis[1].
There is a difference between refinement types and dependent types. In Liquid Haskell you basically state some predicates and then let the SMT solver figure out whether they are true. With Dependent Types you have to do all the legwork, but they are also more powerful.

[1] https://github.com/goldfirere/thesis
and even if you are (call me, i've got a bridge to sell btw), you should be able to afford it.
The Modern Plague of Noise Pollution
That's common in Lisps. Just use cond and when if it bothers you.
NeuralFish – Evolving Neural Topologies in F#
I think he means large storage space, not physically large devices.
Did you get the latest update? Newest release have fixed alot of the issues you've mentioned above.
Changing a single cell in a table with hundreds of rows and a dozen columns would be a good test.
Huh. That might be a problem with CIDER, because it never happens to me with Geiser.
If it can actually decide, it should probably just decide at random.

Then we can adjust speed limits and move dumb walls and so on to reduce the deaths attributed to random selection by an autodrive system. Kind of like we do with deaths attributed to poor driving.

(I say if in the first paragraph because you need at least 4 conditions to be true: the information to make the choice is available, the vehicle is sophisticated enough to make the choice, there is enough time to make a maneuver and there is not enough time to make a maneuver that saves everybody)
Not to nitpick your dilemma, there will always be a dilemma, but at any speed where children in the road are likely (<70km/h, 45mph), the driver of a modern car will have a 90% chance of survival against the wall. Cars really are much safer than they used to be even at the instant where you are meeting the wall.

(Ok, I used a "head on collision" number because I couldn't find a wall number, but the physics are probably pretty close. Numbers from a New Zealand Ministry of Transport PDF from 2012: http://www.transport.govt.nz/assets/Import/Documents/_versio... )
> I am not clear exactly what your criteria for a large software system is.

Let a "software system" mean any assembly of processes that communicate to provide some shared functionality, with the components being coupled to one another in some non-trivial way (i.e., there are correctness conditions that cross processes boundaries, so that changes to one program may necessitate changes in others). Excluding the compiler, how many lines of Haskell code do you have in your largest system (using my definition)?
The real question to ask is, will Amazon contribute back to open source? Presto itself is plenty proven and scalable: after all, it was created at Facebook.
Thank you for the recommendation
There are specific drugs out there, that permanently disable your ability to cognitively function in a reasonable manner. Heroin permanently alters the way your brain measures its dopamine levels. PCP causes all sorts of serious mental harm, same with crack cocaine.

These should be regulated the same way we would regulate any other chemical that hard those sorts of toxic affects.

But people wouldn't do those drugs, if there were alternatives available that created similar feelings, that were legal. And that's the crux of it. Many drugs have little to no negative affects (compared to nicotine / alcohol), and could be used without horrid ramifications if they were legal and their purity levels were regulated.

No one would do crack cocaine, if a legal safer variant of cocaine was available, for example.
> CoW backend allows for nearly instant snapshots and clones

LOL => A 80GB EBS SSD snapshot takes more than 1 hour.

Subsequent snapshots are incremental and will be less slow.

> multi server/rack redundancy with EC

You can move drive manually after you stop an instance, if that's what you call redundancy.

> ability to scale up with provisioned IOPS

Nope. You need to unmount, clone the existing EBS volume to a new EBS volume with different specs, and mount the new volume. You can't change anything on the fly.

The last time we had to change a 1TB drive from a database, we tried it on a smaller volume... then we announced that it would be a 14-hours-of-downtime-maintenance-operations (if we do it this way) :D
I suspect that the VPS cap is more about discouraging large AWS users from spinning up a zillion to reduce egress costs.
IIRC, "most UNIX variants" didn't have an undump command. It primarily came with a few huge applications that played these type of games. The two worst offenders that I remember were in fact GNU Emacs and TeX! A few other programs that I dealt with (porting to a new platform) which depended upon a similar hack were Sendmail and Franz Lisp.

The Sendmail "WIZ" SMTP bug was in fact caused by it's use of reloading the frozen configuration file (the pointer to the password was saved in the data section, not the BSS region that was reloaded from the frozen config, so that if you used a frozen config you effectively had an empty password).
Why do Lisps separate these related semantics? Are there implementation reasons, or is it mostly "the way it's always been"?

Edit: thanks folks! You've helped me get over the facepalm from years ago :)
Hey Liz!

What would you say to a company on the fence who considers providing support a core competency within their org?
No more VACUUM then?
Comparing theoretical efficiency of new design for incandescent lighting with commercially available LEDs does not make sense

Yes. They say they are currently at 6% efficiency, which is better than the worst CFL's and LED's, but far from matching the best.

as theoretical efficiency of white LEDs is also around 40%

Yes, although one should probably include the power supply. I think the advantage of the incandescent approach is that there are no losses here.

I'll consider incandescents once the efficiency of commercially available ones reaches the efficiency of commercially available leds.

Sure, sounds wise. Light quality and longevity might be factors too.

But what does this have to do with the claim that the article says "LEDs are only twice as efficient as traditional bulbs"? The article can be read as claiming that the worst commercially available LED's are about 2x the efficiency of the best incandescents, and perhaps this is false, but I don't see this as reason to discount the rest of the details.

Here's earlier discussion of this approach, which includes a link to the actual paper: https://news.ycombinator.com/item?id=11771001
This article is more click baity but the previous article is better written. http://www.codelitt.com/blog/the-art-of-defining-products/
"On-Topic: Anything that good hackers would find interesting."

While website design is right on the money, I have to assume that Jewish New World Order conspiracy theories don't fit that description.
I haven't used it myself but I've been keeping an eye on Keycloak[1] (sponsored by RedHat) for awhile now and it looks promising.

[1] http://www.keycloak.org/
depending on which kinda of phone you have you can have your smartphone screen shared via HDMI to your projector:

https://www.amazon.com/Samsung-MHL-HDMI-Adapter-Packaging/dp...
gg7hhuhuhhu
There's likely a significant difference in cost and capacity between copying a PB of data from a corporate datacenter over that corporation's connectivity to S3 and copying from S3 to Google over Amazon's and Google's connectivity.
Node is great if you want to utilize npm modules.

My recent projects have been built on a Node server. I like to use knexjs as an ORM, sometimes including bookshelfjs for model building. Cacheing or rather message queuing has been done with redis. Often, this backend server will feed a much smaller front end web server that leans on react and jsx to spit out HTML.

PS I started out with rails but moved to a primarily node stack last year.
These HPKP instructions are rather dangerous (as in: more dangerous than they have to be).

The hash is for the ISRG root certificate, which is not widely trusted yet. While an ISRG-signed intermediate certificate is available, all clients currently default to the IdenTrust-signed intermediate, and even if you decide to use the other intermediate instead (or both, which most browsers can handle), that doesn't guarantee that browser build a trust path through that intermediate - it might have the other one cached from a different site. In other words, the second pin would almost never be satisfied, which means you're screwed once your private key is compromised or changes. Screwed as in your domain is bricked for up to 30 days with this max-age setting.

A slightly better approach would be to pin to both the ISRG and the IdenTrust root[1], plus your private key and a couple of backup keys that you keep offline. One or two backup pins to other CAs couldn't hurt either. Oh, and best run with Report-Only for a while.

[1]: https://www.identrust.com/certificates/trustid/root-download...
GoPro announces 15% personnel reduction
George Hotz once said[1], if Tesla Autopilot is the iOS, Comma.ai's system is the Android. Today he's the MAN of his words by open sourcing Comma.ai openpilot.

Big kudos to Geohot!

[1]: http://learnbonds.com/131150/tesla-ios-self-driving-comma-ai...
Full quote from FAQ :
"How does my data transfer allowance work?

Beyond the free data transfer IN and between instances, every single Lightsail plan also includes a healthy amount of free data transfer OUT. For example, using the cheapest Lightsail bundle you can send up to 1 TB of data to the Internet within the month, at no extra charge. Your data transfer allowance resets every month, and you can consume it whenever you need within the month.

If you delete your instance early and create another one, the free data transfer allowance is shared between the two instances. Data transfer overages above the free allowance are charged at $0.09/GB.
"

I assumed that each light sail instance would get the 1 TB bandwidth. But, the FAQ seem to suggest that each plan gets 1 TB. I can't tell if I can provision one VM of each plan and proxy bandwidth through. Say for $5 + $10 VM costs, I get 1 TB + 2 TB bandwidths..
What level of support did you have? I've been on developer or first-level business support, and generally get someone knowledgeable; only the timing changes.

The only bad experience I had was with SES - we got blocked by high bounce rate, sending to a test email that did not exist (specifically because it was a test email). It took two days for the special unblock team to unblock us, even though the general support guy I was talking to had responded a couple of times in that wait period.
AWS should donate a few of these to the Internet Archive.

They just specifically asked for money to help establish a second copy in Canada.[1]

It would be great publicity for AWS among a demographic not far from their target... AND it would probably benefit AWS itself in some way eventually.

1: https://blog.archive.org/2016/11/29/help-us-keep-the-archive...

EDIT: "a few"?? One trip?
It's not necessarily always easy or painless. I certainly didn't claim it was. But you can't really grow the economy without introducing labour-saving devices that change the composition of jobs. Economies didn't have 90% of people working on the farm because they preferred it to anything else; it was that way because it had to be - the productivity of labour was so low. Likewise, if we want the economy to continue to grow at reasonable rates, it must be understood that job change is part of that.
https://www.twitch.tv/p/rules-of-conduct

"All content that is neither gaming-related nor permitted under the rules for Twitch Creative Conduct is prohibited from broadcast."
Renting for a short period of time vs. buying the hardware are very different IMO.
Any chance that multi-master will be open sourced ?
>and it's at least arguable that reforms within it that would still be within that broad umbrella could roll back some of the growth in inequality

Yes, it's just that many people believe the current mix too heavily favors the government, which creates a massive consolidation of power & resources as well as a weak point susceptible to being co-opted or corrupted. This is what people who want the 'slide back into capitalism' are concerned about. Moving more towards state intervention moves us more towards the horrors of systems that are worse than wild west capitalism.

>I think it's a mistake to see the particular shape of the modern mixed economy (even recognizing it as a broad umbrella) as the ultimate stage in economic progress

I wasn't accusing you of claiming that.

My main point is that by most trends as the power of the US federal govt has grown it has correlated with wealth inequality and stagnation for most of the people in the country. Basically, the greater the mix, the worse things have gotten. As we look towards the ultimate outcome of too much mix, it would seem that if we're not going to move towards something better, then we shouldn't be too quick to write off moving towards a more pure capitalism.
What a day for AWS on HN. 8 AWS products made it to front page. I've learned new AWS product like Cognito today just from the comments (ironically in the "Google is Challenging AWS" thread).

I feel as excited as I was for Azure's Build 2016. Now I'm feeling pulled to AWS. This is great for AWS, not so much for Google Cloud which further fades into obscurity in my mind. I'd love to see that change, more competition in the cloud space = more options for us developers = more conditions in our favour.

Amazon LightSail just killed digitalocean for me which has been steadily getting more expensive (for instance I can't downsize to a less expensive plan once I resize my image, meaning I forked out $100/month for something that would work for $5/month + multiple DO images now cost monthly fee.

$5/month + tight integration with AWS products is enough for me to move completely off DO. If only AWS had DO's community style documentation, I'd definitely question DO's future viability.

Now a killer IDE from AWS that lets me deploy and configure AWS without leaving the IDE, that's a checkmate move, which I think will be very difficult for me to switch to another cloud provider. Right now things are in flux but I think an in-browser/desktop IDE like Cloud 9 with one click deploy to AWS would be the end game for other cloud providers.
I could go on ad nauseum about all the potential non-software ways that could go a long way in helping someone intent on breaking the law break the law, but the common thread in all your hypotheticals is people who want to break the law will find ways to break the law. If you want to help fix our current societal issues that drive people to want to break the law, that's another story.

We have armed guards, large vaults, and cameras in banking centers, but that doesn't stop people from trying to rob the bank.

We have federal laws and regulations protecting people's mail, but that doesn't stop identity thieves from going into your mailbox or digging through your trash for banking statements.

If a creepy stalker spots their ex's car driving down the road, what's stopping them from following her/him home? "But how would they find out what car they are driving?" you may rebute, well who decided to post what brand new car they drive on facebook? At some point, people have to take responsibility for the information they put out there about themselves. I wouldn't call into a radio show and blurt out my full name and address for everyone to hear before I gave my opinion.

I think this leads to a different issue -- why is appointment management software asking for personally identifiable information? Maybe we could make a distinction -- if you deal with PII, then these standards should be placed upon you.
Yes Haskell makes a significant contribution. The person responsible for our industry leading portfolio compression joined us because we use Haskell.
Any writer who still characterizes Michael Brown as an innocent victim of police violence has zero credibility in my eyes.

https://m.reddit.com/r/pics/comments/2ndfuo/innocent_young_m...
What about docker for Azure ? I also thought there were too much issues with Swarm to be used in production.
Zero Cost Abstractions
Scientists urge Trump to respect ‘scientific integrity and independence’
So kinda kills the primary analogy the article is based on.
What specifically do you find so great about Emacs? I've forced myself to try it a few times but I couldn't get past the slow performance of the editor itself and the unreliability of basic things like syntax highlighting.
A lot of what used to cause trouble for Vim was fixed with Neovim and the new async stuff Vim 8 introduced. This mainly ensures plugins don't have to block (though a lot still do).

That said, there's still parts of Vim that don't benefit from this and especially on large files can get annoying. But since switching to Neovim I've had a significant drop in the amount of times I have to wait for vim to do something and sit there screaming "oh come on" at my monitor.
Not for bandwidth, though. That's where AWS gets you. All the complaining of server costs are the AWS of yesteryear - servers are pretty similar in costs to competitors now. But traffic doesn't have any caps that I'm aware of.
In the basic mode, this Docker for AWS enables installing some Docker engines integrated into a Swarm with integration into AWS.

It also provides an option for an alternate full stack which solves a similar problem to Docker Cloud called the Docker Datacentre.

Docker Cloud is a public platform for managing containers.

Docker Datacentre is the behind the firewall version, but here they are standing it up in AWS.

I would expect them to converge over time.
And what if the child's parents have paid Mercedes to avoid hitting their kid? You think you are safe in your golden Mercedes, but not when the kid's got Platinum Protection on his phone!
> Would anyone please tell me which of Linode, DigitalOcean and Vultr have cost ceilings? I looked at their pricing pages but couldn't figure out. They all claim that they have monthly billing caps for the hourly rates, but meanwhile, both DO and Vultr have per-GB charges if the transfer quota are exceeded, and Linode is silent on this on its pricing or FAQ pages. Can the data transfer charges be capped too? If so, what happens when the quota is reached?

They don't for traffic. So you do run a small risk of something happening.

However, Linode at least pools your VPSs so if you have 100 of them and 20 of them "go over" the cap you still are often okay because of the other 80 that didn't "go over".

The truth is none of these providers provide truly hard caps. The difference is with Amazon/Google/Azure/etc you can realistically get hit with a 4 figure bill if something goes seriously wrong.

DO/Linode/Vultr I've never seen accidental "mistakes" causing that sort of thing and even an active dos/ddos attack that would cost you more than $100 in overages before they started null routing you.
>Don't focus on startups or reducing your income with the promise of future earnings.

I would rephrase this as "Don't focus on startups that reduce your income with the promise of future earnings."

Nothing wrong with startups if that's where you are most happy. Just be realistic about your options and don't expect to become a millionaire from them.
Ask HN: Developer Friend Office Furniture
Hello everyone,

I need some help. I'm building out my first ever software development office that'll hopefully house 4 developers. My company has purchased Dell Precision units for everyone along with two 27-inch iMac with Retina 5K for Mac and iOs development.

Now we need furniture. I've done some research but have found lots of conflicting details about height adjustable desk, Herman Miller chairs etc.

So I want to ask real developers what furniture (chairs, desks etc) that makes your working in the office super comfortable and adds to ensuring you deliver your best code.

Again advice would be greatly appreciated.

Thanks
Bank of England looking to make £5 note meat free
Honestly, you can get by with $2k if you're frugal and can write it yourself. There are always younger folks who are up and coming (like Knox Avenue but earlier) who will take a shot. But it's a good bit of work sorting through the noise.

I think we had a leg up since we made a Kickstarter video ourselves a couple of years ago. We knew what we were looking for.
Amazon Lex:
https://aws.amazon.com/lex/
https://aws.amazon.com/lex/
What's your usecase for Athena (Really curious how this changes anything)?

You can hook your lambda up to a cloudwatch scheduled event (http://docs.aws.amazon.com/AmazonCloudWatch/latest/events/Sc...). If you don't do much when this happens (like, you exit immediately), then you won't be charged much compute time. Can't find the reference to how often you should ping it to keep it warm, probably varies, IIRC hourly would be plenty.
This is about Docker distributing their software onto a new platform rather than attempting anything radically new.

They have distribution deals with Microsoft, HP, Canonical (announced Today), AWS & Azure.
I disagree. Anti-Semitism accusations and PC, in general, are the way to sweep things under the rug. Neither I or anybody else is suggesting that these things were done, if they were, because they were Jewish people. There are things presented as facts in that post and I am interested to know which ones are false and which are not. How hard is to understand this?!
My First Children’s Book, Grabbling
This is why I'm confused. Hasn't Apple provided laptops and desktops that are sufficient to meet your needs? The size and robustness of the App Store indicates that sufficient hardware is there. So what is the problem exactly?

Is the idea that Apple should be providing an interchangeable parts desktop like a Windows PC I can build off Newegg? Sales of mobile devices and laptops seem to indicate that those sorts of machines are now a tiny niche market.
Nbvcxz: Password Strength Estimator – Initial Release
>> But they've never offered a hard "suspend my account" ceiling that a lot of people with limited budgets have asked for.

That's probably where most of their profit comes from. That option was most likely squashed from the highest authority.
What Should Libertarians Think about Standing Rock? – Give This a Listen!
I use a CDN for js/css/fonts/images, but the $270/mo is the bandwidth for the gzipped HTML going out from the web servers.
Am I understanding this correctly?

DO and LightSail are close (if not) exactly the same spec wise?

All that's I've read so far essentially states that.