skysight-inc/HackerNews huggingface dataset:
While only briefly mentioned in the article, theory and analysis of existing data are a lot cheaper than new experiments.

I am a PhD student in engineering right now. I've found that most of what I would have liked to measure was already available in the literature, but the papers of interest took some digging to find. I will be doing some experiments, but they will be very targeted at filling in gaps. Most researchers seem to think they are targeting gaps, but (in my field at least) literature reviews are typically not detailed enough to truly know where the cutting edge is. Researchers often end up reinventing the wheel.

I also have extended existing data by taking advantage of the properties of a special case to get some information most would consider very difficult to obtain. (Basically, I use a proxy which has a known strong correlation to the quantity of interest in the special case. It doesn't work outside of the special case.) Most avoid getting this information because either the researcher chooses a bad proxy, or knows how to get the information more directly but dislikes the method they know (because it would be a lot of work).

I supplement existing data with sanity checks on existing theories too. In fact, I will be presenting a paper at a conference in a few weeks where the entire motivation of the paper was to criticize an earlier theory which fails many sanity checks. (Wrong in the limits, wrong trend, lacks a necessary functional dependency, etc.)

The remainder of my time is spent developing mathematical models. Math is cheap and I think most researchers in the physical sciences would benefit from more of it.
Post does mention it.
To say that masculinity has a problem because of violent crime statistics is identical to say that femininity has a problem because of eat disorder statistics.

Correlating statistics is useful when looking for potential causes in a large space of unknowns, but horrible when misused as evidence to justify a negative label on a category of people. Its not an olive branch for peace.
It's corporations have rights to and if they want to have a global reputation, fighting for users' privacy makes business sense. Or at least so I would hope.
Try lunacy[1] it supports .sketch files and is quite good for the early stage it is in, sometimes it has strange behavior (e.g elements disappearing from the screen after dragging)and the navigation needs a bit of polish etc. hopefully they will get these issues ironed out soon in future updates. There are also online solutions like Figma[2] and Gravit Designer[3] which also has an electron based app for offline use. Not exactly a Sketch replacement but they will get the job done.

1. https://icons8.com/lunacy
2. https://www.figma.com/
3. https://gravit.io/
Told you I’d get the last word. LOL
There is very little sport in inventing syntaxes that are hard to parse. My response, like the doctor responding to the patient who complains, "It hurts when I poke myself in the eye", is: don't do that.
Fast Programmable Match-Action Processing in Hardware for SDN (2013) [pdf]
In tech high revenue per employee is indicative of shirking responsibilities, like the minimal fraud oversight on google and amazon, or not paying taxes.
"Multi-threading is a must, when scraping at scale."

I disagree on this point. Starting with a single threaded model allowed my team to scale quickly and with little additional overhead. What we have lost with performance we gained in simplicity and developer productivity. That being said tuning and porting portions of the app to a multi-threaded system is slotted to take place within the next year.

Start with single threaded and simple, move to multi-threaded scrapers when the juice is worth the squeeze.
I've regretted that every time I've done it, with the usual "why is this document not like the others" failure case. Nowadays I use schemaless databases/fields extremely sparingly.

Relevant talk: https://www.youtube.com/watch?v=BN8Ne2JCGBs
bad taste is a evolutionary trait that has kept them in the gene pool
Any good totalitarian state implements the most ubiquitous surveillance they can. When the framework for that is already present, it becomes much easier to birth something like that. It's very easy to avoid creating a fertile breeding ground for totalitarian governance, and a factor of that's not having ubiquitous surveillance.
">>But I encounter a bug cloud maybe once a year. Our garden is also quite silent"

Where most people live, virtually everything is covered with concrete and whatever is left green is routinely sprayed with lots of chemicals.
That seems to be (one of) Purism's ultimate goal(s) with the Librem 5, their upcoming phone that runs Linux with a GNOME desktop.
link to the abstract (not a pdf):

https://www.aeaweb.org/articles?id=10.1257/jep.27.1.3
Xiaomi Mi Max 2 ?
This confirms my suspicion of world power being concentrated in the hands of a few mighty industries.

When software engineering took off, the first industry that software engineering helped was software engineering. Then once that was nearly complete, the second industry they helped was the financial industry. And now the next industry being revamped/upgraded/futurized is the healthcare industry.

Surprised to see energy in there but as another commenter pointed out, it is because subcontractors are not included.

So Financials is the most powerful industry, second is healthcare, and then IT. After IT, my prediction is manufacturing/factories, media, building construction, and then engineering... in that order.

Not sure where to place energy, but I always saw them as too backwards for shift. Not sure where to place auto industry either.
It's not "conditioning" it's teaching empathy, kindness, courtesy and respect for others.
Test Automation Services – Case Study – Banking Application Testing
Postgres cannot (without some wild and wooly SQL) do an increment upset in a JSONB field. I.e. If I wanted to add 1 to a JSONB attribute that may not exist, I cannot do this, not simply.

I'd, of course, love to be wrong about this, but when I looked into it about six months ago, the best solution I could find was a hack that had untested performance characteristics. While in Mongo, it's a very simple, standard operation.
This is a good article. However, in the US there is a flip side to hardware purchase optimization -- labor costs. It is sad (or infuriating, if I paid for it) to hear a lab worker boast how he saved $200 on wiring up some monster one-time contraption instead of buying off the shelf and it only took him two days; great, huh?

With all loads (and his $1 salary probably costs 2.5-4$ total) he just wasted at least $500. Just a data point, almost certainly not applicable to poorer countries.
Thailand cave rescue: all 12 boys and coach successfully rescued
This is another reason why people like me are skeptic about that whole "submarine" thing. Taking "pre-designed parts of his Falcon rocket" is ... also a bit ridiculous.

If I were do design a rescue capsule getting a stainless steel pipe and welding a flange to it or anything would be the least of my worries. You can get stuff like that off-the-shelf with same-day delivery.

But surely a submarine made from Falcon parts makes for a nice myth or headline.
I think this product is called the iPhone 8 Plus (https://www.apple.com/iphone-8/) or the Samsung S9+ (https://www.samsung.com/global/galaxy/galaxy-s9).
$ ssh brow.sh

(It starts, prints "Waiting for Firefox to connect")

Then...

panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x6de976]

goroutine 11 [running]:
browsh/interfacer/src/browsh.handleMouseEvent(0xc4203d3b00)
/home/travis/gopath/src/browsh/interfacer/src/browsh/tty.go:151 +0x36
browsh/interfacer/src/browsh.readStdin()
/home/travis/gopath/src/browsh/interfacer/src/browsh/tty.go:46 +0xd3
created by browsh/interfacer/src/browsh.TTYStart
/home/travis/gopath/src/browsh/interfacer/src/browsh/browsh.go:185 +0xf2
Connection to brow.sh closed.
Why is shorter life cycle of insurance claims critical to the industry?
You might have read it, but you didn’t understand it, and the reason you didn’t understand it is because you don’t understand the concepts behind UNIX. No matter; here is your next stop:

“The art of UNIX programming”

...punch that into a search engine, read the book. Then we shall continue.
This is exactly what I thought would happen when I switched off of CoreOS earlier this year. I recently switched back[0] since according to their blog post[1] Container Linux would live and not be replaced by their Atomic project... I thought I was a fool for overreacting.

I don't want OpenShift, it looks like a bloated clusterfuck. I don't want Atomic either -- Container Linux had all the pieces I needed and not much else, along with innovation just where it was needed (the update engine).

It might not mean much to Red Hat in the economical sense right now but Red Hat has gotten a red strike in my book from this. I won't forget. Corporate double speak/renegging on acqui-hired goodwill normally doesn't get me so riled up but man if my jimmies aren't rustled right now.

What does everyone else use for their server distros? Is debian the way to go? Ubuntu seems bloated but maybe I just don't know enough about the fat that is cut out of Ubuntu Server? CentOS and Fedora are stable but they seem like they update too slowly, is my assumption wrong?

[EDIT] - This post is likely an overreaction (again?) -- as pointed out by others the linked thread is from May 2018 -- so my reaction is very much delayed. If I had seen this thread when I made my decision to switch back to Container Linux, I wouldn't have.

I'll likely be moving to flatcar linux[2].

[0]: https://vadosware.io/post/yet-another-cluster-reinstall-back...

[1]: https://www.redhat.com/en/about/press-releases/red-hat-acqui...

[2]: https://www.flatcar-linux.org/
How Fast Can You Learn React?
Another article on this technology stated that the efficiency gain comes from there being only 4 points under load versus 8 points in a chain with derailleur system.

A fixie also has only 4 points, since the derailleur is gone, so it's presumably more efficient.

But the big problem is that there is also an efficient human cadence (I think around 100 RPM), and a fixie has a massive problem here. So overall, a fixie is massively more inefficient. Which I guess is no surprise, cycling competitions are run with geared bikes, not with fixies.
I always assumed Web Scraping wasn't something particularly challenging because of how many libraries existed for this purpose.

This article made me realize I assumed wrong.
98-99% iirc for a fixed (track) gear setup.

There has also been a recent trend on the track towards larger chainrings and sprockets for a slight increase in efficiency, as the chain has to go through less of a tight radius, whilst still maintaining the same gear ratio.
> One of the big reasons ICANN can't do the sensible thing and just discontinue whois is that it is heavily influenced by the big copyright corporations who presently can start enforcement against a domain by lookup in whois. Once whois is gone they will have to use legal process to compel registrars to reveal the identity of domain owners.

Doesn't WHOIS typically just show the registrar anyway?
If you have a deployed fleet of CoreOS instances, FlatCar[1] looks like a viable alternative. This article from NewStack gets into the details.

[1] https://www.flatcar-linux.org/
[2] https://thenewstack.io/flatcar-linux-the-coreos-operating-sy...
Thailand Cave Rescue: Today One More Saved
that gear is perfectly flat-ish and could accommodate a fairing quite easily.
Being rational is separate from being objective. Please do not mix these terms to confuse people.

Typical way to attempt rationality is to follow a well defined algorithm to make a decision, with well defined inputs.
Even if it is a simple as "sum these assigned numbers and pick highest option" it is more rational than the alternative.

You can quantify and tune your "gut" or estimation skills the same way as with any other. Remember and learn from both successes and mistakes, exercise the skill.

Most people learn only from representative instances which is actually irrational and a known human logic hole - representativeness heuristic.
This means their gut feeling is relatively mistuned this making for bad decisions.

Asking just one simple question - how meaningful was it - is very effective to avoid the pitfall...

Emotions have more context than one would wish and not all of it obvious. This is what makes using this as decision input hard.
You got banned. Please stop. We both were rude and it's good it ended.
don't doubt that the things you mention are dimensions here, but:

a) non-US organizations/gov's have been critical of US hegemony of internet policy for some years - this also is a good way to attack that

b) various multinational treaty organizations have been attempting to create agreements where cross-jurisdictional legal actions are valid but haven't been very successful (see also TTIP) - some provisions in GPDR are another instance of this pattern, and would appear relevant here

c) logically, hiding website ownership also benefits large media entities as it facilitates a way to obscure ownership information across many domains, potentially making them appear more independent than they actually are

disclaimer: dont have direct insight on any of this
heard of covers?
They do address this fact in the paper, and in fact note that a simple KNN approach using only the account creation time gives 99.98% accuracy.
The Added Value of Agile and Project Management Certifications
>The only species that thrive are the opportunist ones that tied their fate to the humans: cockroaches, fruit flies, dogs, cattle, chicken, etc.

rats :-(
One thing I thought about recently is just how 'theory of mind' works. When you're trying to figure out someone else's motives, often times logic and reason just get in the way. Emotional processing uses the limbic system and is much 'faster' than cognitive thought. You definitely don't want to over-rely on knee-jerk emotional responses, but you don't want to completely throw out the hundreds of thousands of years of primate social evolution in a vain effort to be smarter.
s/Ultrix/IRIX/

It's Unix, just way cooler than the other kids ;-)

> eventually NT workstations

Heaven forbid.
> What I dream of is single computing unit (read: cpu + ram + storage + etc.) with the ability to attach to different UIs.

The Surface range is the best progress I've seen in that direction to date. A compute unit that one can use as a tablet, a laptop, or (via the Surface Dock) a desktop - my Surface Book has replaced what used to be three separate devices, which is pretty good going.

Yes it would be ideal if it could also shrink down to phone, watch, or ring size, but let's walk before we try to run.
I own the following devices: Surface 3 (non-Pro,) Surface Pro 3, and a Surface Pro 2017:

- Surface 3: Atom x7, 4 GB RAM, 128 GB HDD
- Surface Pro 3: i7, 8 GB RAM, 256 GB HDD
- Surface Pro 2017: i7, 16 GB RAM, 1 TB HDD

I use these devices daily as my main machines. I use them interchangably. All of the devices run Arch Linux with identical configurations. None are currently configured for dual-boot. All of them run the same long-running programmes (e.g., Slack, Hangouts,) though I use each device for a different purpose:

- Surface 3: reading PDFs & documentation, email
- Surface Pro 3: backup device
- Surface Pro 2017: software development, general use

All of devices are usable for actual day-to-day work.

The devices run different kernels:

- Surface 3: stock LTS kernel or Zen kernel with patches
- Surface Pro 3: stock LTS or stock Zen kernel
- Surface Pro 2017: git kernel with patches from (http://github.com/jakeday/linux-surface)

None of the devices support S3 suspend. They support only "Connected Standby." (https://lwn.net/Articles/580451/)

Works on all devices:

- hibernate
- SecureBoot, TPM
- touchscreen, pen input
- Typecover (detach/reattach), touchpad multitouch
- sensors (rotation, ambient light)
- WiFi, Bluetooth
- audio
- SD card

Surface 3:

- DisplayPort doesn't always work
- webcams don't work

Surface 3 Pro:

- everything works 100% with stock kernels

Surface Pro 2017:

- battery readings don't work
- webcams don't work

I am overall very happy with these computers. They are the first machines in a long time that I have been "excited about." Linux support so far is good (ranges from a B- to an A+) and within the range of being usable for daily work.
You're literally describing a smartphone.
I think many are using Alpine linux [1].
It's very light weight and seem to be well suited for the task.

[1] https://www.alpinelinux.org/
Generally speaking, I don't like MongoDB. Though it has little to do with the database itself: its more so a combination of the limited use-cases of NoSQL and the lack of managed hosting options directly on AWS or GCP (Azure can kind of do Mongo via CosmosDB, but I don't use Azure and don't plan to at this time).

If I've just got a small project that needs to throw data somewhere, I'll probably reach for Redis, DynamoDB, or (if its simple enough) just serializing JSON files to S3 (this is an underutilized way of storing structured data if all you need is key-value lookup with no latency or consistency guarantees, very cheap). Its likely my project is already on App Engine or Lambda, so I don't want to have to go to a second login portal just to manage the database.

I don't hate NoSQL. I prefer SQL, but I also respect the fact that if you combine something like Mongo with in-app schemas, and are careful about keeping those up to date, writing proper migrations, etc, you can get a very production ready and highly scaleable DB out of Mongo. Its not as bad as people make it out to be.
Douglas Adams' idea of an "entire geological layer of compressed shoes" sounds a lot less daft than it used to. (-:

* https://scientificamerican.com/article/humans-leave-a-tellta...
>>E.g. lobsters were once so plentiful that native americans used them as fertilizer

Plentiful for that population, at that time. We're now 7+BILLION people and a lot of them are rich enough to demand fish, lobster and so on. Just in China we have millions of newly minted millionaires. Not to mention their middle class. Maine lobster is good? So get me some.
>Much of what we think of as natural landscape was made by man.

We have similar in Ireland, blanket bogs here were essentially man made.
10 tools to improve the productivity of your startup team
This is a terrible title and should be changed. The story has nothing to do with unmasking anonymous Twitter accounts, rather it is about using metadata to identify posts by the same user from a dataset which has had specific user IDs removed.
Generally speaking, I like to use json tables for inserts only.
I don't read that as openshift being the replacement. I read that as openshift being the first target of integration efforts, with the replacement coming afterwards.
You don't have to buy them if you request a copy from the authors. The authors don't make any money when you pay to download a paper from a journal. So they'd have no reason not to send you a pdf.
Practical example from the last ~8 months. I started building my somewhat non-trivial Saas [0] with MongoDB + NodeJS. Getting started was quick.

Soon however, things started playing up:
- transactions
- aggregations (avg, percentiles), rollups etc.
- simply having a relational model to express the business domain

I switched to Postgres and I've been more than happy with it. Heroku hosting is top notch. Libraries are pretty mature. I use the JSONB and Array datatypes not heavily even. Turns out an "exact" data model is quite useful on anything none-trivial. As always, YMMV

[0] https://checklyhq.com
I bet you own an Android phone tho’
>For example, Deadmau5 has a folder of unfinished loops and melodies. He calls it his "Mr Potatohead" bin. He spends his time building little components – and then once in a while experiments with different ways of putting them together to make a track.

KRS-One reportedly did something similar:

> ‘Go to the car, and get me the black, blue, and green bags. And bring those here.’ They bring them in. ‘Great.’ He unzips these duffle bags full of stacks and stacks of rhyme notebooks. Rhymes he wrote in the ‘70s and ‘80s. He’ll go, ‘Umm, let’s see here, and that, and here, give me that yellow one, okay, and give me that brown one. Okay, let’s go lay the song.’ And he uses like three different rhymes, but they all sound relevant. And they sound like something he just wrote. He just skims through it, and murmurs then goes, ‘Okay, I got it.’ These are rhymes he been had, and they sound like today. That’s amazing.

from https://www.complex.com/music/2011/02/dj-premier-tells-all-s...

I'm pretty sure he was referencing this practice in 1, 2 Pass it:

>I'm the difference between indo and oregano.
Imagine how fresh I am now; I made these lyrics up a year ago.
Why bother? The only time I have to email other PIs regarding their papers are when protocol steps are missing or when data has not been deposited.

And in about half of those instances, it simply reminds me why I love not relying on the “goodwill” of competitors.
I completed the "Tree walking interpreter" section of this book about a month ago, I used modern JS to write it and I found it a really good experience and learned a fair bit. A lot of the content is obviously about implementing the interpreter so there's probably quite a bit that doesn't apply to your project, but

If your looking to make your lexer as simple as possible I would recommend looking at (http://journal.stuffwithstuff.com/2011/03/19/pratt-parsers-e...). It's written by the same guy, and gives a short look on pratt parsers, which is one of the simplest ways to write a parser. There's also a simple language he wrote that uses the method as an example available on GitHub. At a top level you end up with declarations like:

infix(token: "plus", parselet: BinaryOperator, precedence: 13);

Having done a fair bit of prototyping parsers and reading about it the hardest parts of parsing JS are regex literals and automatic semi-colon insertion.
Thailand cave: All 12 boys and coach brought out
You mightwant check Alpine or ArchLinux. They are fast, reliable and updated regularly.
>You are comparing one company Google against all the energy companies.

Doesn't matter for my point, Google is the majority of web search in the west. Even if we add Bing and that Chinese engine, the argument is the same.

Can read it as "if we lost web search".
Keep in mind that a millionaire meant something entirely different when this phrase was first uttered. It'd be something closer to $10 million in wealth today. Today being a millionaire just means you won't eat cat food when you retire.
The Peak and the End (How Event Order and Intensity Shapes Our Memories)
Other than being obscenely busy.

Go away, Elsevier troll
I suppose HHMI investigators already have labs when they get picked by HHMI, but HHMI funds very nicely.
Doulci V_iOS 12 Software Updated: iCloud Lock Screen Bypass iOS 12, 12.1, 12.2
Hunt for dark matter turns to ancient minerals
Realistically, both should happen. That way you don't have any losses when it happens again from another scraper.
Deploy That Node.Js App to a Docker Container (AWS Elastic Beanstalk)