skysight-inc/HackerNews huggingface dataset:
Question for those who have used monster servers before:

Can PostgreSQL/MySQL use such type of hardware efficiently and scale up vertically? Also can MemCached/Redis use all this RAM effectively?

I am genuinely interested in knowing this. Most of the times I work on small apps and don't have access to anything more than 16GB RAM on regular basis.
That is a tremendously courageous post. Not many people can publicly discuss their addictions.

I've worked at many places that have had a strong alcohol after work culture, but it's only recently that I've seen it in work hours. As someone who likes to drink, it hasn't bothered me, but I also don't want to be exclusive of people. Many people choose not to drink due to their religion or health goals, as well as addiction.

I wish the world were a better place about this, but this is part of the background checking one needs to know about a new job. If you're worried about being able to take off to see your kid's play, you have to inquire if any of the senior execs have kids. If you are worried about age discrimination, you have to see if others with gray hair are thriving there. And if you're worried about an alcoholic culture, look for people who don't drink. This is very hard to bring up in an interview, but you can learn about culture via back channels.

For what it's worth, when I went through periods of non-drinking, I would just tell people that I was training for a martial arts competition, and needed to keep my weight down.
Kind of cringey, feels like I'm watching a Sillicon Valley scene.

Machine learning to one-hit reply "Cute dog"? Billions of dollars and these features seem pretty boring.
That's just an ignorant response. There are plenty of board-certified midwives, birthing centers, etc. Importantly, a great deal of risk can be ascertained before labor, and like any other medical procedure you're either a good candidate for non-hospital birth or you're not.
Interesting. I'm on AT&T Gigabit (Google Fiber competitor here in Austin) and I got 660Mbit on fast.com (Windows 10 desktop directly connected via Ethernet.) A MacBook Pro laptop with Wifi (802.11ac) connected a few rooms away shows 260Mbit.

Are you wireless or wired? If wired, that seems quite low.
Scaling NSQ to 750B Messages
I don't know how to send PM's. Here is a short video of the three spots. https://www.dropbox.com/s/w0q6frn9bxufy8m/2016-05-18%2011.34...
That's nice, but isn't it still a violation of net neutrality?
But HD is only 5Mbps and 4K is 25Mbps, so you wouldn't necessarily be testing the full bandwidth of your connection.
I've not watched the keynote yet but I'm hopeful the announcement of Home will also come with opening up of Google Now's voice search similar to Alexa. I really want to like Google Now but it's just so limited at the moment - let me control Spotify, Hue bulbs, and my TV with it please!
No kidding. And my fiance was under the impression for a while that it was the cover of what I was reading at the time... She was probably somewhat concerned.
Slightly tangential: You have your history slightly off.

Before Linux was even conceived, the GNU project was started, but its aim was not writing Unix tools, but to write an entire Unix replacement – Unix kernel, Unix tools, all of it. The GNU tools were initially written not for use in existing proprietary Unixes, but for use in the (then thought to be) soon upcoming GNU system. However, since the GNU tools were superior to the aging and buggy Unix implementations, the GNU tools were widely ported and became very popular, and the patches for running the tools on contemporary Unix systems were accepted upstream. Then, the name “GNU” came to be associated with these tools, and not with the actual project to replace Unix; the fact that the GNU kernel never really materialized did not help. Only then did Linux (the kernel) burst onto the scene, and it happily noticed that there were all these tools available to be easily ported (and they were all adapted to be easily portable), and the concept of a “Linux system” was coined, meaning a Unix-like system with additional Unix-like tools gathered from around the Internet. Too bad that these were all actually the GNU tools, made by the GNU project for GNU, a replacement for Unix. A Unix-like system with the GNU tools, using Linux as the kernel, then fulfilled the object of the GNU project. This is why GNU people are slightly irked when this system is called a “Linux system” – it’s not about the size of the kernel vs. the GNU tools, it’s that the goal of the GNU project was always a full Unix system, and the Linux kernel was the final component, the appearance of which allowed the project to be realized.
Perhaps, but bear in mind that Google is a PRISM partner, whereas Amazon is not. The NSA will likely record every sound from your house, if you own this.

Edit: Downvoters, please educate me on where I am wrong. Thanks.
Google has had voice search for much longer than Siri has been around. It just isn't branded as well (or at all).
Many have already added excellent comments, and here's mine, as someone who's recently worked on a project with React + Redux + ES6 (Babel5 -> 6) + WebPack, etc.:

Start simple and refactor the application as you add the other libraries gradually.

In your particular case, forget everything else except React and ES5. It won't take long to understand what props and states are in React and to get used to the idiosyncrasies of JSX. You might even want to start out by kicking around in JSFiddle or JS Bin.

The other tools are very useful, but they won't be so until you see the need for them, Make notes of which parts you find annoying with the simple setup and turn to see the tools you listed to see if/how they will help you.

Kinda changing gears into a diatribe about the crazy ecosystem in the JS-land: I feel that there are several subsets of it that have been rising above the rest to give developers the productivities that they need. It's not clear-cut and there are many valid options, plus even more subspecies within those options. Several of them could be well-suited for the task at hand, so I wouldn't worry too much about making the wrong choice and paying heavy price for it. The way I see it, frontend development scene is tough if you have not already been immersing yourself in it for a while. It is like that now and it will be for immediate future. The good news is, it is getting better, and I think we will see the community gradually converging toward several collections de facto standards. It will remain amorphous, but not as overwhelming, I think.
Funny. He actually calls it Damascus Foil in the video.
Personal Electric Aircraft developed in Germany launches in 2018
A lot of stuff on DatPiff has been removed because of copyright claims.

Rick Ross's last mixtape: "Black Dollar" is a classic, and was debuted on DatPiff. Now when I look for it on there, I get this:
http://www.datpiff.com/Rick-Ross-Black-Dollar-mixtape.732049...

Jeremy Banks is a copyright lawyer with IFPI (International Federation of the Phonographic Industry).

I see that OP uploaded Rick Ross - Black Dollar to this collection. What'll happen if Jeremy Banks demands it be taken down?
Hopefully someone will run the numbers from this. Effectively it is a large scale test of outcomes for patients with equal risk factors, some treated with statins and some untreated.
It would be interested to see the distribution of 1000 comments from each account over the period of 12 months. Some people go dormant - like vacation, or depression, or lack of interest in topics - then cluster a bunch of comments when, say, they are on a drunken rage binge.

What time of day the accounts most frequently comment. (I'd bet there is an interesting grouping of those that post while at work during the day, and those who post from home at night.

or what subreddits people comment in most during the day vs which /r/ they post to at night ;)
Oh, man, that's scary. My doctor suggested using Zantac to help with flare-ups of a chronic stomach condition. Now I'm going to be much more wary.
>Thus, good (or at least neutral) will always triumph over evil.

Unless the game they are playing rewards being evil, in which case being benevolent or neutral would be a distraction.
It makes sense. Comcast is directly paid off (I mean peered) with Netflix, and they overprovision intentionally. See https://www.dslreports.com/faq/15643 if you are curious.
This would address an important element of high Bay Area housing costs: the discretionary project veto by local authorities. This is the main reason why only super-high end luxury stuff gets built in San Francisco.

In most parts of the US, there are certain local zoning laws. You apply to the local government for review of your project. This is expensive, as you must prepare detailed professional studies for the proposal.

If the project conforms to all of the zoning laws, it must receive a permit. They can only deny you a permit if your project does not comply with some specific zoning law.

In San Francisco and several other nearby cities, the local government can arbitrarily withhold a permit even when a project conforms to all local zoning laws in every respect, usually under the vague and arbitrary guise of "not fitting in with the neighborhood's character."

Since applying for a permit is an expensive and time consuming process, most developers simply don't bother to even try in San Francisco. They just go elsewhere, where their project can't be arbitrarily vetoed by local authorities despite conforming to all applicable zoning laws.

The main exception is luxury developments: since the profit margin on luxury construction is so high, it's worth the extra cost and risk associated with navigating San Francisco's permit process.

If this law passes, then municipalities will not wield the power of arbitrary veto anymore. There will still be extensive zoning regulations, of course; the difference is that development restrictions will have to be spelled out in the law, in advance, rather than made up on an ad hoc, per-project basis by local officials. This greatly reduces the risk involved in starting a development project, and makes non-luxury developments much more likely to be profitable and thus undertaken by developers.
Wow, "fast.com" is one helluva valuable piece of DNS real estate Netflix is throwing at this.
16GB of ram should be enough for anyone.

Edit, y'all don't get the reference: famous computer urban legend...

http://www.computerworld.com/article/2534312/operating-syste...
I love what they're rolling out but I definitely feel like I'm at a Hooli event.
This place is not a place of honor.

No highly esteemed deed is commemorated here.

Nothing valued is here.

This place is a message and part of a system of messages.

Pay attention to it!

Sending this message was important to us.

We considered ourselves to be a powerful culture.
Dupe of https://news.ycombinator.com/item?id=11722775 ?
I have absolutely no reason to believe that every well-known "speed test" app/site/utility out there isn't being gamed by my ISP.

Guess who runs the nearest speedtest.net server: Comcast.
Dupe of https://news.ycombinator.com/item?id=11723157 ?
I don't think it's quite that bad, but "for numeric programming" is a very important caveat here. As is "define higher-level".
SFO uses private screeners, not TSA.
"I don't drink," is not a moral statement. Unless you are willing to read in to it. Which is your own problem. Even if it is a common problem.
It's scary how close this is to being one of 1984's telescreen devices. I might even argue that it basically _is_ a telescreen considering Google's previous dealings with state actors, though with some of the 451-style "you asked for this" as opposed to the 1984-style "this is forced on you".
You, the filthy unwashed public: "Is it possible that the test is wrong?"

Them, apparently omnipotent gods: silent shaking of head and look of pity
It's a classic Google delusion - they produce keynote demos, not products.

This Allo app doesn't solve the problem of people (that actually means all people you talk to) having to opt into it.
Google unveils its new virtual assistant
200Mbps / Stonehenge, UK / Virgin Media

Exactly as advertised though having the cabinet on my front garden does mean I can get about 220Mbps in the quietest periods so I"m fairly lucky.

Unfortunately, a 12Mbps throttled upload is not a great experience, especially when Virgin had said it would be at least 200/20.
I Gave Up on Productivity
Just curious - but wouldnt the GPU based instances be more efficient for oil and gas people?

Or load a data set in this monster and then use GPU workers to hit it?
Netflix has boxes that are colocated at some ISP locations to stream videos closer to your location. Maybe fast.com connects to those systems.
You do a clean-room implementation to preserve the ability to say "even though these lines of code are similar, they couldn't have been copied because we locked these engineers in a room while they were writing this implementation." But it's also part of the story: "we're good guys; we did all the work ourselves from scratch instead of trying to leverage all the work our competitor already did."

Which is part of the whole rationale of unfair competition law. It hits a moral button when someone takes advantage of someone else's work to make themselves a bunch of money. The more intentional and purposeful that copying is, the more wrong it seems.
Is this alongside or replacing Hangouts?

A messaging app is only useful if enough of your friends use it.
My office also uses Comcast/xfinity for business. Incredibly, in 2016, we had to get a $40 device that reboots the modem and router every single day once a day when the office is closed. This is the solution we were given to maintain decent speeds with their hardware. And it works.

But it's sad.
Arbitrage has been around since the very beginnings of modern banking and provides a very important function to allow markets to accurately adjust to proper price signals.
When Windows10/Cortana was released my buddy attached a mixer/switch to his PC allowing him to wire input mics and sound speakers to every room in his house.

And though I can't see any personal uses for such a device, he swears it has changed his life, and the only thing I believe he does with it is tells Cortana to play Van Halan first thing when he wakes up.
Gigabit becomes quite common in Europe. I get 910
I was hinting at that towards the end of my post: the idea that you're expected to drink it if it is offered, particularly after work hours are over. Not all of us fancy sticking around at the end of the day.
On AT&T U-verse in Palo Alto area. $72 p/month for 24mb now with even more data caps.

Fast.com ~23mb
Speedtest.net ~38mb

Hum, I wonder which is right and which is the ISP screwing with traffic?
One of the most useful HFT tools is to reduce liquidity. Doing this over an hour would cost ridiculous amounts of money, but cornering a specific exchange over 0.01 seconds is cheap and potentially profitable. Remember, if a HFT extracts money that means the actual seller and actual buyer's price never meets which means the market is not doing accurate price discovery instead providing two prices separated by fractions of a second.
You're joking.
10 most in-demand Internet of Things skills
I've found it really depends on the checkpoint-to-gate ratio of the airport.

ATL is the absolute worst. There are three checkpoints for the entire domestic side of the airport, two of which are often closed. Wait times are normally 45 minutes in the normal lines. There are 3 checkpoints for about 150 gates.

FLL, OTOH, is one of my favorites. This is because the terminals don't have a central entrance, so there's a security checkpoint per 15-ish gates and some checkpoints actually serve fewer than 10 gates.
The secret here is that this is measuring speed to Netflix, which on many ISPs is throttled well beyond what other speed tests will report. I'm in the Boston area and getting 100Mbps on fast.com, but getting 250Mbps on speedtest.net. Fast.com is even encouraging you to compare their result with speedtest.net.

It's a pretty smart tactic. If you're paying for 150Mbps, but being throttled to 100Mbps on Netflix and your ISP doesn't tell you, you're not really getting what you pay for.
My own experience (and I won't claim this is necessarily representative) is that drinking is a big part of it, but nobody will care at all if you refrain. Asking for water or soda instead of alcohol will barely get a second glance.

I think the title of this article would be better written as "Do startups have an asshole problem?" It just so happened that the asshole problem manifested in terms of alcohol because that's where the author was set up to come into conflict with the assholes.

You could easily have the same sort of experience as a vegetarian in a company that revolved around barbecues and steak. That wouldn't mean startups have a "meat problem," but that they have an asshole problem that manifests in terms of meat because that's where you're in conflict. Other possibilities include smartphone ownership, hobbies, and political affiliation.

Alcohol is certainly an interesting case because it's one of the few drugs that's legal, socially acceptable, and extremely commonly used. The only other one I can think of is caffeine, and even there we tend to go out of our way to make non-caffeinated equivalents available. But it seems to me that hassling people because they don't drink is just a symptom of a larger problem, which is that there are assholes in power, and one of the things assholes do is hassle people who are different.
This is competing with the Amazon Echo. It's more oriented toward the Google brand because it's about searching for information. Obviously, Google still wants people to think of Google whenever they want to know something, even if the search is conducted by voice.
I was flying with my wife, and we did a controlled experiment, since the Pre line and regular line both looked daunting. We got on different lines at the same time. We both took about 45 minutes to get through, but the Pre line was actually a bit slower.
Disappearing West
I am 23, work at a startup, and also never drink, but definitely disagree with the implications of this post. Startups don't have any sort of particularly entrenched alcohol culture in the US- everyone does. And it's not really a problem, either. You can't ask for planet earth to be a safe space so you never get tempted by your booze urges again, just continue refusing, it's not something that can- or should- go away entirely.
Oh, and let me address it with something other than "OK, Google". Let me name it, or set the trigger phrase, or do an interpretive dance. Anything but that awful phrase.
Why isn't this hangouts? Are they going to kill that too? I can't get onboard with any of these Google products because they drop them as soon as they have something "cooler"
Yes, except I trust Google FAR less than I trust Amazon--simply because Google has permeated in many more facets of my digital life (gdocs, gmail, chrome, maps, search, etc).

Amazon just has my shopping history.
and Scala too.

Scala _beats_ Java in most of the benchmarks: http://benchmarksgame.alioth.debian.org/u64q/scala.html
Possibly, the concern is whether multiple callbacks from the API share the same thread, or is there a pool, or does it create a new thread?

Can you keep that thread as long as you want without impacting the ability of that API to deliver callbacks to other contexts, or must you return that thread ASAP?

Can the callback re-enter the API?

If there are multiple callbacks pertaining to the same logical transaction do they use the same thread (so that I can, for intsance, lock a mutex in one callback and release it it another?)
It really depends on your needs... if I can have my postgres/mysql, or other table storage serviced by another company without having to become intimately familiar with another set of software to administer and/or pay someone to do so it may be a good option.

If you can save a FTE admin, you're saving at least $10K/month, that can cover the hosting and bandwidth for a pretty big site/software/service on AWS and the like.
Google phone can now do 'ok google' behind lock screen.
Investment Banks as Information Companies
All the SMTP addons require credit card info, obviously to prevent spam abuse.
This is just sad.
Yet another messaging app. This time with ads built right into your private conversations. And the crowd cheers :(
Flirtey (YC 15) claims to be first drone co to make approved commercial delivery
Just make sure your scripts won't fail if the site claims your IP is "$(rm -rf /)".
Are we really saying goodbye to those products or just adding another to the list?
> Back up a TB of data to the cloud? Yeah, that'll take weeks.

I feel your pain. 12Mbps here but it seems that Crashplan tops out at 4.5Mbps anyway here in the UK so sending 2.3TB up there took over 2 months.
Just imagining the entirety of Google running on 16GB of RAM :).

To answer the question at hand though, MySQL seems great at up scaling with larger hardware, as does Redis (from what I've seen, it seems to almost get more efficient at sizes >500GB). MongoDB (my goto database) occasionally doesn't seem to scale very nicely off the bat, but after some configuration that too scales very well, possibly even better than MySQL.
Here is a good link: http://www.seismicsurvey.com.au/

Basically you take waves that are transiting the area of interest and do transforms on them to ascertain the structure underground. Dave Hitz of NetApp used to joke these guys have great compression algorithm, they can convert a terabyte of data into 1 bit (oil/no-oil).

One of the challenges is that the algorithms are running in a volume of space, so 'nearest neigbor' in terms of samples has more than 8 vectors.

In the early 2000's they would stream their raw data off tape cartridges into a beowulf type cluster, process it, and then store the post processed (and smaller) data to storage arrays. Then that post processed data would go through its own round of processing. One of their challenges was that they ended up duplicating the data on multiple nodes because they needed it for their algorithm and it was too slow to fetch it across the network.

A single system image with a TB of memory would let them go back to some of their old mainframe algorithms which, I'm told, were much easier to maintain.
Haha, no thank you. i don't want google to listen to everything I say in my house.

Next thing you know it's going to tell me is "Smith! Put more effort in those crunches!".
Next step in Allo: just automatically pick the best "smart reply" for me, add "smart questions" and we can leave both sides of the conversation to the bots. "Have your AI assistant contact my AI assistant to work out the details" :)
Google Nope
That sounds like a more interesting conversation than most the ones I have at these types of events. Even though I am a social drinker, I may give it up just so that I can use it as an icebreaker.

"No, I don't drink any longer. Strictly for the sake of small talk, really. But you say you do drink? Tell me about your history of drinking. Is it a long one?"
OK, but only if I can pack my carryon full of ammunition for the gun I'm hiding in my pocket.
Maybe he was referring to that TODO comment that was left in before the closing body tag.
No. Try to simply pass with a no thanks, and almost always you'll face a line of questioning as to why not. It's really annoying. Even if they respect your decision not to drink they still ask why. Some get frustrated too.
It's not that easy to lie about - if it's sending everything you say then it'll be sending data over the network as well.
You are right. I believed I didn't need a test for that. See what happens? :-)
A term I have coined: "TSA Radius" -- the distance below which you would rather drive than fly. For me this is currently about 600 miles, but may increase with the news about spectacularly long security lines.
Thanks for looking that up... I was going to say, I'd be surprised if these servers weren't costing Amazon over $70K to begin with.