skysight-inc/HackerNews huggingface dataset:
In statistics, what matters far more than the size of your sample is the method of your sampling.

This is where lay and academic understandings of statistics diverge dramatically. There's far more discussion of how to ensure an appropriate sample size (determined generally by the independent variables you're tracking and how you plan on subsetting the sample) and tests for randomness. Which is why the time to call a statistician into your study isn't when you want to run algos over your data but before you even begin collecting data.

Oh, and large sample statistics is a thing. You need to have a minimum number of observations before large-sample methods are generally considered accurate, described by n.

n = 30.

If (and that's a crucial if) your sampling is random, you can draw tremendous inferences from small datasets. This is why many national-level polls rely on samples of about 300 individuals. The key isn't the size, it's making sure those 300 are really, really random. Goof that and you end up with a "Dewey Defeats Truman" headline. Or Trump as the GOP candidate.

https://en.m.wikipedia.org/wiki/Dewey_Defeats_Truman

(Both owe a lot to how phones are used -- in 1948, landline phones were still a sufficient luxury item that it skewed phone-polling methods. In 2016, cord-cutting is having similar effects.)

I had the interesting experience a while ago of looking at data as it came in generating an estimate of a population of 2.2 billion individuals, based on a sample of 50,000 (Google+ activity, relying on a sitemap file of profiles, where sitemaps are restricted to 50,000 entries per). Well within the first 100 records, the long-term trend of ~8-10% (my final value was 9%) of profiles showing any public activity was established. Given web polling and delays introduced (I tried, and succeeded, to avoid tripping any bot-denial mechanisms), the data rolled in slowly, so I simply set my stats script to loop over the incoming files every minute or so.

Somewhere in my testing I also ran a set of resamplings based on the data I'd ingested -- taking small sets of data from within the larger one and looking for any wildly anomolous trends. This would have suggested that the sitemap file itself wasn't randomly constructed, but eyeball tests of various aspects (including account age, region, and activity) strongly suggested it was. This spared me some more complex sample-generation.

(My conclusions were independently verified from a much larger sample of 500k profiles by Stone Temple Consulting and Eric Enge, a pretty heartening validation.)

________

Edit to add: another crucial point is that statistical error is governed by sqrt(n) -- SE = 1/sqrt(n). To halve your error, you've got to square your sample size. So if 30 doesn't work for you, you're looking at 900, not 60. Assuming sampling costs increase with n, reducing error gets expensive fast.

And for the pedants, SE is "standard error", as I'm aware.
> And in the end, in 2016, you generally don't care if you download a few extra 100Mo.

I suggest a trip to anywhere outside the western world.
How to improve communication between developers and designers on web projects
I hadn't until now. Thank you for the nudge.
Company towns would not necessarily have to be exploitative. But it is important to understand that even one that started with the very best intention can all too easily turn bad. The massive power imbalance could remain dormant for decades, until one day some temporary crisis comes along and makes management accidentally discover the potential for abuse. It won't ever be "undiscovered".
Here. Please don't bite :)
It's like people forget how govt. evolved, just completely ignore feudalism, monarchism, tribalism etc. The reason we have democratic govt. is as a reaction to systems like that - creating an entity more powerful than all single groups but accountable to all (in theory). Of course, it turns out power always finds a way to concentrate, but that's just life, and why it's so important to have a strong and critical civil society as a bulwark against the concentration of power.
Getty Images sued for 1B USD for copyright infrigenment
Because they've spent tons of money on it and now want to earn something
The French word for work, travail used to mean torture, and still designates suffering induced by child delivery (as does labor in English).

In Latin there isn't even a word for work, it's just "non leisure" (neg-otium) (I think... it's been a while since I've studied any Latin...)

Work isn't supposed to be fun or meaningful.
New gTLDs and domain names
If you do proper customer development with your MVP prior to product market fit, then by the time you hit PMF you will already have your reference customers - your 'social proof'.

Regarding the statement that SF is the ideal place to find early adopters...

Maybe that is more true for b2c than b2b early adopters, because - and here is my question - isn't the place flooded with founders trying to canvas people/companies to try their product?
Then probably I didn't get that far while reading, sorry about that.

Still not sure how it can be atheist if it is all about souls, though.
How about accelerating Keccak/SHA-3 (used on Ethereum)? I found this but seems it's not implemented on ARM/Intel hardware yet

http://caslab.eng.yale.edu/workshops/hasp2016/HASP16-10.pdf
No. How much does an Apple TV cost, and what do I do with the TV I already have?
I concur. No true Linux user gets stumped by these things.

For my part, I've had perfect, smoothly-running Linux workstations for decades now, and for me its a no-brainer to select hardware for the purpose of running Linux. Like I said, if this has decent Linux support, I'll switch from Apple in a moments' notice. Linux can do just as well, if not better, than OSX for many, many things ..
The main problem is management wanting shiny and new and not being aware of the value of paying down technical debt.
LabSharegroup – engineering services – CAD – CAE
> Also what has this to do with Retina? I always assumed Retina is just a resolution thing, right? But the screenshots are the same resolution.

Retina does effect screenshots. I use Dropshare[0] and it actually has an option[1] to downscale Retina screenshots to a 'normal' resolution

[0]: https://getdropsha.re

[1]: http://s.rnbk.org/kBB0yPIs0M
> What do you say touching the disks is? Like physical touch, or logging in and looking at the logs?

There is a reason why foresics data capture devices are so expensive and certified never to touch a bit.

> I don't think both of those can be attributed to tampering of evidence, like criminal tampering since you use the word 'accused'

There has been various cases of people accused of destruction of evidence for wiping (allegedly) compromised hosts.
Aurelia 1.0 is Here
oh wow thanks for all the details. Legit and very interesting :) That makes total sense.
I have a Linux DAW and two Linux Dev workstations that don't need much "sysadmin'ing" beyond the normal update maintenance schedule, so I dunno .. I think the beauty of Linux is that it allows for your end of the extreme, and mine, and doesn't just force everyone into a pissed-in sandbox, like OSX.
R is higher than javascript? I didn't heard it before.
See also https://en.wikipedia.org/wiki/Great_Vowel_Shift
Shouldn't there be cement in between the bricks? Or am I missing something?
I am actually in Europe, even in the EU. Virtually every company I've worked/interviewed with was like this, in four different countries.
Can we break free from the fear of missing out?
Use a Slack bot to deploy your app
The website[1] of the lead author, Andreas Peschel, lists funding at the bottom. Almost all projects are funded by the DFG. The DFG is an institution that funds research and is itself funded by taxpayer money.

So yes, this research has been paid for by the German public. However, it is common for universities to apply for patents. Revenue from patent licensing is then usually shared between the university and the researchers.

[1]: http://www.uni-tuebingen.de/fakultaeten/mathematisch-naturwi...
Manage containers using SystemD
>Do you want to find out for yourself?

Would not care that much even if it happened, to be frank.

And I do have some old iPad lying around that I seldom bother to update at all, so 1-2 OSes might pass by before I do anything. It's at 7 IIRC, not even sure if it can go to 9.
nice one. small, sharp tools in the unix toolbox. given that this is the type of processing one might routinely over a file with tens of millions of lines, what's your guess on the difference in performance between the python snippet above your your awk one-liner? (my guess is about 100x in favor of awk)
Monopsony is buyer-side monopoly, i. e. there is only one buyer. A labor market monopsony means that there is only one company employing people.
because he changed the repo permissions to allow the UnrealEngine organisation write access, and github automatically watches repos for you when you're granted write access.
I'm pretty impressed!

Do you know about IBM's Spark+GPU Hackathon?[1] There are some pretty substantial prizes (I thought they were offering cash, but I'm not seeing it now).

[1] http://openpower.devpost.com/details/spark_rally
> I'll resume it for you all: "Buildings change over time to adapt for their owners livestyle."

An important concept in the book is "shearing layers" [1]: different parts of a building change at different rates due to differential pressures. E.g. walls change faster than foundations.

Its a few years since I last read it, but fwiw I found the book insightful and not at all boring. Each to their own though.

[1] https://en.wikipedia.org/wiki/Shearing_layers
It starts "Australia's coordinates are out by more than 1.5 metres", which is a link to http://www.abc.net.au/news/2016-07-28/aust-latitude-longitud... .

That gives the reason for needing a new datum:

"Because Australia sits on the fastest moving continental tectonic plate in the world, coordinates measured in the past continue changing over time.

The continent is moving north by about 7 centimetres each year, colliding with the Pacific Plate, which is moving west about 11 centimetres each year."

That's some zippy fast movement!
Paywalled for me, but that was from .au.
NEW Clinique Lash Doubling Mascara Black and 62 Tenderheart Different Lipstick Duo
I'll check that out. Thanks!
Actually, its both. Old English is related to Old Norse as modern German is to modern Swedish: They're similar but not as close as German and Dutch or English and Frisian, for instance.

However, in the Early Middle Ages English was also heavily and directly influenced by Old Norse because Vikings at that time not only more or less continually invaded the English east coast but also settled and established their own jurisdiction (The Danelaw) there.
Worse yet, you donate money 'for the cure' it's discovered and sold back to you at 5000% mark up.
Scipy Lecture Notes – Learn numerics, science, and data with Python
>Cars have 30 years of resale value, if they're cared for

Well, if resale value is what you're after, then you have the best deal with the iPhone in the first place, combined to any other mobile brand.

>Like many other electronics, phones have basically stopped improving in the past few years.

I beg to differ. Except if you mean "for what I do/care about".

50-100% faster processors and GPUs every 2 years are not "stopped improving". Newer camera systems (4K, image stabilizations, slo-mo), touch id sensors, etc. A lot of the things people do depend on those improvements.

Of course for mere phoning, casual app use, etc, then sure.
Maybe I didn't read far enough, didn't think a book about souls could be atheist.
Default parameters in JavaScript ES2015
It would be nice to have evidence of tampering in the event of theft or, worse, contraband appearing.
Interesting,
The graphs seem to correlate very highly with population density from just looking.
I wonder if that is a cause, coincidence, or something in the calculations?
Hah, yes! Theres nothing more annoying than someone sauntering along with their umbrella held low in a crowd. They rarely even apologise after smacking you somewhere with it.</rant> ;)
Introducing RackToolkit: a fast server and DSL designed to test Rack apps
You know something is wrong with the IP system when companies start patenting snot.
Scheduling Your Kubernetes Pods with Elixir
>The way things are going, I see all parties approaching zero sum. Hardware is nearly identical and software stack is approaching too as everything is moving into web apps

For the staff I do (image, audio, video, programming), that couldn't be further for the truth.

For the rest, that stuff is technologically trivial to begin with (email viewing, writing a document, creating invoices, etc).
You can fully specify any rectangle by its length and width (and the fact that it's a rectangle...). They're all very round compared to arbitrary shapes.
CS9H Online Study Guide(2013)
Introduction to Scientific Python
Why food tech in India is more than just a bubble
Thanks for sharing, it's nice that you found your peace and balance in life. Your “1 hour per day” approach is a great one and it looks like it has been proven to be successful by many people, because it's not the first time I read about something like this.

However, even if I personally have a big plan and that 1 hour per day, sometimes I just don't feel like doing anything at all but just purposelessly walking/biking or drinking alcohol. I guess that's the problem the author highlighted. It's not about accomplishing something, but not knowing what you actually want to accomplish in the first place, what to do next. When you know what to do, it's actually not that hard to find time for it, because you have a clear understanding and motivation, otherwise you're just getting caught in an everyday routine spending year after year burning out that limited time you have of your mediocre life.
Indeed. It is all about incentives. And in the end, pharmaceutical companies have the incentive to keep people sick so they can keep selling drugs, while the public has the incentive to keep people healthy. So it is actually a no-brainer.
That's not actually a bad thing. The first signs of resistance occur on average 1~2 years after introduction of a novel abx; the search for variants helps to extend the usable life of a new family of antibiotics.
> The standard library also includes Path/PathBuf and OsStr/OsString.

Right. And you want people to explicitly convert between them.

Having to convert between string types isn't a problem. String encoding is hard, and you're going to have to pay that cost somehow.
>Then again, I don't understand a lot of this home automation stuff personally. If we come home and it's hot, we turn on the air conditioner. If it's dark, we turn on the lights. These are hardly difficult tasks for a child, much less an adult.

Yeah. With the exception of disabled people (where those could be very valuable) for me it looks like a solution to a problem nobody had and nobody much cares about now that it's solved. Contrast to e.g. washing dishes.

(Oh, and by nobody I mean: aside from statistically insignificant outliers).
I had to Google that, and got, of course, Wikipedia: https://en.wikipedia.org/wiki/Clathrate_gun_hypothesis

"The clathrate gun hypothesis is the popular name given to the hypothesis that increases in sea temperatures (and/or drops in sea levels) can trigger the sudden release of methane from methane clathrate compounds buried in seabeds and that are contained within seabed permafrost which, because the methane itself is a powerful greenhouse gas, leads to further temperature rise and further methane clathrate destabilization – in effect initiating a runaway process as irreversible, once started, as the firing of a gun.

In its original form, the hypothesis proposed that the "clathrate gun" could cause abrupt runaway warming on a timescale less than a human lifetime, and was responsible for warming events in and at the end of the last glacial maximum. This is now thought to be unlikely."

Basically substitute "highly unlikely random cataclysmic event transpires" for "clathrate gun fires" and you get the sentiment of the post :)
This is an exciting opportunity, thanks, we will study it.
Except if you're going for a "70s sexy purple coloured bedroom with Barry White playing" or "Acid party lightshow for the Timothy Leary society" on demand, how is "multiple scenes" even remotely a "killer app for voice control"?
It's not a constraint as much as it is a consideration imo.
Gan canny woer Geordie!
American police are framed as warriors, not peacekeepers or counsellors.

There seems to be little about the culture surrounding policemen in the US that would encourage him to have acted "reasonably" here.

From quotas, to the increasing militarisation, to their intense public vs. cops tribalism, there is little reason why police aren't encouraged to apply the strongest "zero-tolerance" tools they have, which has led to a bunch of unfortunate instances.
I've tried to understand what this is but I can't crack the English. Anyone got an ELI5?
Chinese satellite is one giant step for the quantum internet
I wouldn't say Appelbaum is a psychopath, but I'd say he's certainly trouble. I agree torch wielding angry mobs are not a solution; so how do you prevent that, yet deal with the problem without relying on the legal system?

Perhaps the global 'social networking' phenomena / the democratization of the media / etc offers something - all in all, all the discussion around things like this is ultimately useful; it raises people's awareness.
$99 compared to $35 for much better hardware and much more options.

>and what do I do with the TV I already have

You keep it. The Apple TV is a set-top device, not an actual TV.
New video element Policies in iOS 10 (safari will allow autoplay if no sound)
Thanks :) I feel like some key concepts are a bit beyond my reach, but that they are such a small quantity that it can be a good starting point for googling around. Thank for your help!
> Shouldn't the patent be for specific treatments derived from their findings on lugdunin, not the compound itself?

I would expect the patent to be on the process for isolating or synthesizing the compound.
Look at their jobs page ;)

But it can be explained as:

- Development/Ops (the technical side, from developing the services, supporting those services to debugging network problems and support of API users, it's a huge area)

- Sales/Commercial affairs/Customer support

- Localization/Editorial production

- Growth/Product management/UX and everything that goes in designing the product

- Corporate support functions (HR/Legal etc)
i think a small addition to this chart (but not requiring any data not already gathered) would significantly increase its value and interest.

in particular, adding one small column (about the same width as the "Types" column) with a sparkline having five points, connected by a single line and which represents the Spectrum Ranking for the years 2012 - 2016

with this, the reader could see for each language the five-year trend in their Spectrum Index.

two languages might be next to each other on this chart, yet one might be trending monotonically downward, while the other might be trending sharply and consistently upward.

so for instance, look at places 26 - 29: Rust, Delphi, Fortran, and D. Those are contiguous, hence have similar Spectrum index values, but the shapes of their last-five-year time series are probably quite different (eg, Rust, sharply upward trend, only perhaps slightly flatter for D, essentially flat for fortran, and perhaps downward for delphi).
But I can't go to command line and tell it "delete all of the files from the project X I do not want anymore" or "find me the change in this file in the history that caused bug Y".

Sometimes it is better to mass delete files with a find, grep and rm, sometimes an auto-filtered search and cmd+a cmd+delete is better.
When I flew into Heathrow last year, I was amazed by how visible the pollution was- over central London, there were no clouds (there were clouds around the outskirts) but this vague, blue haze was quite noticeable.

Although compared to Shanghai, London is really clean, if you live in Shanghai you keep your windows permanently shut and run an air purifier 24/7: http://aqicn.org/city/shanghai/

> I'd recommend anyone living in a city to invest in a good air purifier from BlueAir or IQAir (if you can afford it).

Another, more environmentally friendly option: https://www.youtube.com/watch?v=gmn7tjSNyAA

Also basil plants are a natural mosquito repellent, might not be an issue in the UK though.
Apple reports third quarter results
This is simply due to the language having been heavily influenced by a host of other - quite different - languages over the centuries, Old Norse and French in particular.

It's actually worse than that. I see that the Great Vowel Shift[1] has been linked to, but it's probably not immediately clear why that was significant.

What happened was that "between 1350 and 1600.... all Middle English long vowels changed their pronunciation". Unfortunately this occurred just as spelling was being standardised, so some spelling was standardised using the old pronunciation (which then shifted) and some with the new.

[1] https://en.wikipedia.org/wiki/Great_Vowel_Shift
Surely is only so long as you don't sue google over VP9 codec issues. It can't be a blanket "Never be sue'd" statement.

These patents are all about a corporate cold war esque standoff and a licence term like that to me sounds like a dead hand.
It's quite an investment of time, but this is a good answer to "do we have to do academic studies to learn this stuff?"

=> Maybe, but nowadays you don't have to quit your job and move close to an university to learn, you can just have online courses.

Thanks :)
You can see how IBM is putting a lot of money into (ads for) their "cognitive computing" stuff (probably crappier and more expensive than the competition)

They're pretty much drifting into irrelevance each passing day. But enough to fool some people into giving them money
Please use the standard km/h instead of kph.
If you love 80s kinetic typography porn check out this music video Justice put out a few years ago: https://vimeo.com/30371091
If the aim of the Rust Platform is to provide a 'blessed set' of 3rd-party libraries, why not have something akin to an official, curated 'Awesome Rust', where depending on what you want to achieve you can get a streamlined list of well-maintained libraries, perhaps with user-submitted usage-examples, comments, alternatives and the like - that way, you're not constraining Rust itself to be in sync with all the 3rd-party libs, (and thus by necessity stagnating to a certain degree), nor you're making authors of libraries that are not in the Platform feel essentially invisible.
I liked how they depicted being a kid in the 1980s -- that's really how it kind of was -- we just hung out with each other playing D&D and riding bikes, etc. These days kids have such a regulated life style -- they generally aren't allowed to wander off on their own but are expected to be in regulated environments like organized sports, swim lessons, etc.