skysight-inc/HackerNews huggingface dataset:
That is pretty remarkable. One of the limitations of doing one's own version of mass analytics is the cost of acquiring, installing, configuring, and then maintaining the hardware. Generally I've found AWS to be more expensive but you get to "turn it on, turn it off" which is not something you can do when you have to pay monthly for data center space.

It makes for an interesting exercise to load in your data, do your analytics, and then store out the meta data. I wonder if the oil and gas people are looking at this for pre-processing their seismic data dumps.
I think the (ostensible) reason is similar to this, from the link:

> As security expert Bruce Schneier likes to note, such screenings don't have to be perfect; they just have to be good enough to make terrorists change their plans: "No terrorist is going to base his plot on getting a gun through airport security if there's a decent chance of getting caught, because the consequences of getting caught are too great."

That is, the act of confiscating the liquids almost ensures that the liquids are already harmless. But if they didn't confiscate the liquid, it (supposedly) might not be harmless. It's a bit like Newcomb's Paradox: https://en.wikipedia.org/wiki/Newcomb%27s_paradox
Upload is useful in case you're on a connection with severely worse upload than download. Say 10mb down and 384k up.

How much uplink do you need to send enough ACK packets for a HD stream?
People are social creatures and one aspect of that is that we feel a natural, slight constant pressure to harmonize our mental states with the people around us. Diversity is good, of course, but we experience dissonance in outlook as an uncomfortable friction. When together, we always seek common ground to focus on.

When someone says "I don't drink"—an entirely valid and acceptable choice!—at a point in time where we've already established that someone else in the group does, it draws attention to that disharmony. It's not that not drinking is the bad thing, it's just the delta between that and the previously accepted reality that another in the group does. You've subtracted some territory from the common ground.

To get a sense of this, consider an imaginary scene:

A group of people are standing around trying to decide where to go out. The first few people suggest a place that is does not serve alcohol and that they are OK with that since they don't drink anyway. The next person mentions that they do drink.

In this case, it's now the drinker who looks flatfooted, at least as I imagine the scene. To me, then, this indicates that it's not being a non-drinker that's socially awkward, just that expressing a divergent preference that is.

Fortunately, most people have tact and can gracefully handle a little dissonance here regardless of which preference comes up first. Certainly, in the groups I frequent, we try very hard to make non-drinkers and drinkers feel comfortable and included regardless of who makes the first move.

The way this tact gets expressed is through plausible deniability. We express our preferences as vague or potential so that if a clashing preference comes up, it's easy to retreat from ours and get back to common ground.

That's why, at least in American speech, people say things like, "I could go for __." "I would be up for __." "__ sounds good." All of those are softly worded enough that they can be amended later to reach consensus without losing face.
The shoe bomb attempt, the liquid attempt, underwear attempt, all happened AFTER the TSA checkpoint, in the aircraft. All the new measures were applied as a reaction--after the fact.

The TSA didn't prevent those terrorist attacks--the people on the plain, luck/ineptitude did.
I think it's pretty clear that it's because there are actually very few terrorists in most of the world, and certainly very few of them in the U.S. The fact of the matter is that a terrorist attack is trivial to conduct, especially if you're willing to die for the cause. There are just a ridiculous number of soft targets out there. It's simply not possible to secure them all. The only reasonable explanation (AFAICT) for why NYC doesn't look like Baghdad, with car bombs going off on a regular basis, is that the number of actual terrorists in the U.S. is indistinguishable from zero.
fast.com doesn't give upload speed?
It's only been since 2005 when the TSA was reorganized under the TSA as part of the Department of Homeland Security. Before that, the Air Marshals were part of Immigration and Customs, if I'm not mistaken.
Searches don't legally constitute a violation of security. I agree it's disgusting.
Yeah, it's tough to find the line of when to stop giving the benefit of the doubt though. I was using speedtest.net at the time, which is pretty well known and widely used. I had also had multiple visits recently regarding the issue that still had not been resolved, and so my impatience made the decision for me.
Quite the opposite. If you're a small business in need of compute, then it's quite a value.

I'll give you a case in point. I have a friend who works for a construction company. He has three servers he's cobbled together all at one site, and a NAS for storage. They provide email and document sharing, accounts management, etc. Every new blueprint that comes through needs to be reviewed for accuracy, but they come in as images, so he has another server that just runs tesseract OCR when he gets a pdf in. He asked me if he should get three servers, or one and virtualize the three. He wanted to plan for growth, but didn't know what that would be. the NAS was underutilized.

He's buying no servers. He's setting up Workmail and Workdocs for their users. (Workspaces is an option in the future.) Blueprints are uploaded to S3 as they come in, where the file arrival notification triggers a lambda function that performs an OCR pass on the file and dumps it into a new bucket. Because this function runs on-demand, he avoids paying for a server to sit there, and only pays a few cents for a doc. His other services no longer run on servers he has to manage, so he doesn't worry about patching. He has reliable, off-site backups for the first time and version control, and he only pays for the exact amount of storage he's using as opposed to buying space for his NAS in advance. And he doesn't need to worry about scaling.

That story plays out all the time. It's arguably a bigger savings for smaller people who can't afford the upfront costs than large corporations that already are likely to have massive sunk costs in datacenter space and assets. If you're a small business, the moment you go cloud you not only save money, but you gain capabilities (the biggest being in redundancy and reliability, which are the most important...how many small businesses have a DR/COOP capability on-prem?) which you would never have had otherwise.
How the Green Book Helped African-American Tourists Navigate a Segregated Nation
make people aware of a moral decision

This response came out unexpectedly negative

You make a moral decision to not engage, which means you have acted superiority to their decision to engage in something that you consider a moral choice. People are reacting to the superiority, not to the lack of alcohol (as it evidenced by the suggestion that you say you're not drinking tonight rather than 'don't drink').
I think we are on the same page, then, I think I misunderstood what you were saying. Carry on! (But only one carry on, everything else must be checked.)
that's kind of how dns works, yeah.
This is why I love taking my motorcycle to any after hours work/professional events. I can not drink and no one questions it even for a second
I'm omnivorous. I can't even imagine people having an issue with being vegetarian now. It's just so common. Around my area, finding out a person is vegetarian leads to an exchange of recipes.
And what do you think they should do?
They didn't eliminate the need. To get my IP from there programmatically, I'd have to parse the DOM. Or, I can "curl https://i.ngx.cc", and have it immediately available.
Are you using seismic to describe what the data is, how big the data is, or both?
Weird, can a mod change the link to https? That seems to be working - https://home.google.com/
That was kind of my thought as well... I worked on a small-mid sized classifieds site (about 10-12 unique visitors a month on average) and even then the core dataset was about 8-10GB, with some log-like data hitting around 4-5GB/month. This is freakishly huge. I don't know enough about different platforms to even digest how well you can even utilize that much memory. Though it would be a first to genuinely have way more hardware than you'll likely ever need for something.

IIRC, the images for the site were closer to 7-8TB, but I don't know how typical that is for other types of sites, and caching every image on the site in memory is pretty impractical... just the same... damn.
I wish the same existed for BBC music broadcasts. Their DJs are excellent. I had tons of their broadcasts on an external HD but my business partner thought it was his speaker and threw it away.
s/really rudimentary/totally flawed/
It strikes me that if this is part of a strategy to get peering agreements with ISPs, they could save a lot of money in the long run.

EDIT: Added the word peering.
I have an Echo. It's great. To me the Amazon play for this is very straightforward: they want you buying Amazon stuff using it. They don't sell ads, they sell products. When they say that the device only listens for its own name locally, I believe it (sans someone hacking it to spy on people of course, but I don't believe that Amazon deliberately programmed it to do this).

Google is a different story. I imagine that they would try to sell a device that listens 100% of the time and targets ads at you based on what you talk about. Google makes money by selling ads, not by making buying stuff convenient. Their incentive is different.

Ideally, I'd love for Apple to create such a device, but it won't be open, would cost an arm and a leg, and would probably use Siri, which lags behind the Echo in what it can do by quite a bit now.
> Apple's, among other streaming services, has impacted this music negatively, and whether you are a fan of rap music or not, it does set a precedent that affects all styles, genres, and tastes of music.

I don't share this interpretation: look at Drake, Wiz, Kid Cudi, 50 Cent, A$ap Rocky, The Weeknd, Chance, Young Thug + the rest of the 1017 label, Lil Wayne. These are people who found success on amazing mixtapes, and now those streaming services allow the artists to get paid for content they expected to release for free or for publicity's sake.

I'd throw in Kendrick but he didn't really blow up until Section 80, which was an early itunes exclusive(?) rather than a mixtape.

Besides, I don't see DatPiff going away any time soon. Coloring Book will be on there in under two weeks.
Exactly.

Too bad aluminum is too soft for this technique to provide any advantages.

...or perhaps that should actually be tested. Would this kind of processing change the mechanical properties of aluminum in any significant way?
Memory leaks be damned... Seriously, that is just huge.
Sure.
One company I worked with was actually US-based with PMs and high level architects scattered all over the Midwest and the actual dev team in Ukraine. They were very up front about it from the get go and once they realized we don't beat around the bush too much once the SOW was signed they started inviting the dev team to our status meetings and offered that we get hold of the devs directly if we would like to when needed. Which was awesome since most of the outsourced shops I've dealt with in the past would only have us deal with the PM and a couple of high-level SAs. And then if you do manage to get hold of their tech team they won't be overly responsive and typically you'd need 3 or 4 of the devs to get a complete picture of what's going on or to solve the issue you're having.

Another company was based in Ukraine altogether with no US presence. Same deal basically, little rougher English-wise but not too bad, their chief SA worked in the States in the past so he would jump in to clarify things if need be.

Where those guys really shine is understanding things end-to-end no matter what the role on the particular project entails.
I'd be talking to a front-end developer about some symptoms I'm seeing and he'd be troubleshooting down to the wire basically - dumping proxy logs, generating wireshark captures etc etc.
Often times it's the non-drinkers who imagine that it is a moral judgement when someone else doesn't drink. Perhaps this is because they secretly feel that they are making a wrong decision but are doing so because the group is all doing it together. They then see one person not drinking as an affront because deep down they are judging themselves.

If you are truly comfortable with your own decision to drink you will not see someone else's decision not to drink as a threat.
I find it odd that Google is going to take so long to get this out the door - "later this year" seems like ages. Did they start on the hardware that late?

Amazon has what, 6 months to get more competitive on the search/trivia front? or this is going to kill it.
Turns out fire-hardened spears aren’t as badass as we thought
I should be TSA Pre the first time I went through their procedure and so should everyone else. Rather than going through the arduous process and paying money for it, what's different from your screening from the one that people go through daily?

edit: deleted a word
Everyone knows the answer is _yes_ without clicking. The only qualification is to modify "startups" to "startup culture."

Are there exceptions? Of course!

But the prevailing culture enshrines and celebrates a lot of the worst aspects of being young, male, and competitive.

It's absolutely non-unique in this respect, but honestly, there should be a much stronger countervailing voice flatly stating, _we can do and be better than this_.
So much this. Back in 2001 I used IntelliJ IDEA on a PC with 128MB of RAM. It worked perfectly, and it was the first IDE I used that checked my code while I was writing it. The much less evolved JBuilder on the other hand stopped every couple seconds for garbage collection.

Both were written in Java.

And don't get me started on Forte (developed by Sun itself, no less). It was even slower and more memory-hungry than JBuilder.
Google Photos update: 200 million monthly active users. 1 trillion labels assigned.
Looks like something that should've been under the Nest brand. Whatever happened to that?
I hate security, though I hate the discomfort of air travel even more. In fact, I just got back to the US from Europe, and the cold that struck 12h after I left lasted 7-10 days (and I rarely get sick!)

That said, am I the only one who doesn't have these long security waits? I typically show up at the airport ~1h before boarding is to begin, and am often at my gate 50min before boarding begins.

I typically fly out of SFO, and I do admit, several journeys ago, I was actually IN LINE at security for 30 minutes which seemed absurdly painful and I was actually starting to sweat being late for boarding. Of course, at SFO they had TONS of extra machinery, they just didn't bother staffing it.

As much as I HATE taking off my watch, fitbit, ring, car keys, wallet, belt, shoes, phone, then the scramble to take my laptop out of my bag as soon as I get room on the table (it becomes a high pressure situation to do the laptop thing as by the time you get to the table you have roughly 8 seconds before you're holding people up!).. the actual lines are quite tolerable.

I typically fly SFO, SEA, SAN, SJC, and fly cross country at least once or twice a year. I just got back from Copenhagen, Frankfurt, Stockholm, Munich airports, and again, no problems. I've fairly recently been to Auckland, Queenstown, Reykjavik, Heathrow, Florence, Paris as well.

There's no doubt most other countries do a better job than the US; the automated machinery for dealing with your possessions to be xrayed (they hold your bin until it's empty and then automatically return it to the beginning of the line!) and the switching between 10-15 security lines so that you're never behind more than a few people was a revelation.

But the actual time in security is rarely all that bad inside or outside the US.
Coincidentally just noticed firebase integrates with adwords as of today.
Excellent talk with great pointers to other material.

If you have a pointer to Fogus' talk he mentioned, titled: Macronomicron, well, that sounds intriguing.
Best estimate I can find, her flight cost her work about $20,000 round-trip.

I think we're upper-middle-class-ish, but there's no way we could justify chartering a jet for a family vacation if it costs as much as a car (a smaller jet might "only" be around $12,000 for the same trip AFAICT).
This URL works. The main link returns a 404
> How realistic the bomb was would radically change the test.

Not really - the screening is done by looking at x-ray images of bags on a conveyor belt. The visual representation of a 'bomb' on the agent's screen would not change one iota if a pipe bomb didn't contain a real detonator.

Detecting the presence or absence of a real detonator would require much more sophisticated techniques, equipment, and personnel than are in use at tsa checkpoints
Sure, some people are worried. But these devices only listen when they hear the wake word ("Ok Google" or "Alexa"), so there's no real concern about the companies listening to anything other than your queries. And 99% of people are not interesting enough for a state actor to care about. If you are a spy, criminal, politician, etc., then I'd agree you should think twice about owning one.
You too can bring a slice of 1984 into your home with this lovely crafted listening device!
I don't drink now, and I like to say "It works out pretty good - when people drink, they get relaxed. And when they get relaxed, I get relaxed" It's worked well for me, ymmv.
,,Always on call'' - it just got the worst memories for me of waking up at 3am
Yet another messaging app: Allo.

Goodbye Google Talk, Hangouts, Google Voice, and Messenger. This time, they're getting it right!
If that were the only concern, then it probably would have been appropriate to drink the champagne. If your work suffers because your boss insisted you drink, then dicking around on HN for the rest of the day would be an acceptable option.
New Communication apps: New Messaging app Allo. It can add emojis, whisper or shout and has smart replies like Inbox. It can also reply to images. And has the Google smart assistant.
Copying Pictures, Evidencing Evolution
IMO, The tech industry has a huge alcohol problem in general.
It's not uncommon for even largeish companies to have beer kegs and frequent happy hours.

Just recently we had a team event that revolved around alcohol, a mixology class. Although attendance wasn't mandatory, it wasn't exactly optional either. So there was a lot of awkwardness considering a number of people on our team were non-drinking muslims, 1 person was pregnant, and several others just don't drink.
This creates an exclusionary sort of culture, and as one of my coworkers said it "I don't really want to be forced to go to the bar with my middle aged male colleagues". If you think about it, it does seem a bit creepy.

Other industries have moved on from this sort of model. Sure, there still can be alcohol at events and the occasional BBQ with beer or happy hour, but they have strict policies about returning to work after consuming alcohol, and alcohol is not the main focus of the event.

I take full advantage of the beer keg at our office, but if it went away I certainly wouldn't be upset. I'd just do what I used to do, and go to the bar after work with coworkers who want to go.
I've seen the ads my Kindle Paperwhite displays as a screensaver, and... no, I'm not worried about Amazon mining my personal information to start doing better ad targeting.
Could be using tags to style text instead of css or style attributes?
Lost count, at least a dozen.
When I get home I'll check my Xfinity connection (SF). When I run speedtest I get over 150Mbps down.
Eligible (YC S12) Praciticing Styleguide Driven Design to Win and Profit
I agree that it's a problem, but your distinction still seems generally pointless. If you have a company policy to not hire alcoholics and you reject 1,000 people based upon this metric then 65% would have been an alcoholic.
I mistyped. That is the one drawback.
Upload does not matter when streaming video.
Hey 'dang, why is this so far down the front page? Is it because people flagged it? I feel like there's some very good discussion here.

Edit: Uhh... I was downvoted for asking this? Depressing.
"It's the most uncomfortable place in the world to be for someone who doesn't drink. It's like someone who can't swim hanging out at the public pool."

No one can tell the difference between a rum and coke, and a coke. It works for me pretty well. We have some similar outlooks, and perhaps you'll find my sneaky idea to be useful. Its much easier to fake drinking than to fake swimming.

I don't even have a variety of reasons not to drink. In the LSD community or whatever you want to call it there's a well known effect called the 50 trip limit or 100 trip limit or whatever number, after doing it 50 times you're either repeating because you never thought about it, or you're bored with the whole experience, or you're hopelessly addicted. Same with alcohol, at least for me. I've done it all, drank incredible amounts, stayed up all night, passed out, puked up gallons, made out, had all kinds of fascinating hangovers, its really an interesting, although fundamentally worthless, experience. I checked every square on the checklist. Once your inner completionist is satisfied, its really a very boring and unpleasant experience. And now that its boring, I just don't do it anymore. It isn't the kind of response that fits in 10 words or less at a bar. So I just order a coke and everyone assumes its a rum and coke.
Competition against Amazon Echo is always positive for consumers.
~$4/hour???

Thats amazing.
Ultimately it comes down to a question if you trust Google or not.

I do, but I know that sentiment is not widely shared on HN.

Enabling state spying would destroy people's trust, and hence their business. I think Google is highly motivated to keep your data private.
Encouraging folks to write more inefficient code?

I'd be interested in hearing what Gates [1] has to say about it, though.

[1] "640 kB ought to be enough for anybody"
Hey buddy, do you own slow.com? If you do, could you send me an email t e n d i [at] outlook.com
IAMA request: an honest to god TSA screener. Not an imbedded pinko journalist... someone who actually signed on.
*Prescription only in the US
> But these devices only listen when they hear the wake word ("Ok Google" or "Alexa")

It's not like there's a law of physics requiring that always be true, you're trusting that to:

A) Be true now, and
B) Keep being true in the future.

And it's the sort of claim that is very very easy to lie about.
I drink and I don't see that comparison as a stretch. Our society regularly endorses drinking as a way to deal with your shitty life. This is just like the soma in Brave New World.
SPEED MEGATHREAD, post your speed/location/ISP below here:

44Mbps / London, uk / BT
I tend to use testmy.net, which includes both upload and download.

> The reason for fast.com is that it tests download speed from netflix. ISPs can't prioritize it without prioritizing netflix as well.

Is there any way to distinguish traffic between the two? Does fast.com actually download a random video from Netflix? Does it benefit from the Netflix local caching server? If ISPs can find a way to cheat, some might.
"Fail quickly, fail cheaply."
Allo: Google's AI-Powered Messaging App