skysight-inc/HackerNews huggingface dataset:
By “do your own research”, do you mean “repeat a statistically significant number of the various studies to find out how repeatable the results are”, or do you mean “read a book which convinced me”?
Rust-audit: Making production Rust binaries auditable
Plenty of organisations store encrypted personal information in S3 buckets. I'm failing to see an issue here.
Hey Hacker News!
I would like to present you my project I've been working on: Timmi.
My intention with Timmi was to create a minimal time tracker which is private by default.

At work, I needed something to simply track the times I spend on my tasks. Most apps I had found required a user registration or were bloated with features I didn't really use. As most of them had integrations with different kinds of applications, the data had to be stored on 3rd party servers. So for my simple use case, this was not a viable option.

I love to give back to the community, so enjoy your time with Timmi.
Your feedback is very welcome. :-)
You'll find sed and awk in busybox, virtually always, even on minimal systems. Including embedded devices, routers, Android, etc.
For my next book, I'm working through a concept I call "good enough programming.

Good enough programming is something you code that provides something people want -- and you never look at the code again. Find the problem, solve the problem, walk away from the problem. That's not sexy. It's not going to get you an article to write for a famous magazine, but it's good enough.

We have lost sight of "good enough" in programming, and without some kind of guardrails, we end up doing stuff we like or stuff that sounds good to other programmers. For instance, while I love cloud computing, I'm seeing "how-to" articles written about setting up a VPC for doing something like playing checkers. Yes, it was an oversimplified article, and you have to write that way, but without wisdom, how is the reader supposed to know that? What criteria do they use to determine whether it's a co-lo server, a lambda, or a world-wide distributed cloud?

We're going like gangbusters selling programmers and companies on all kinds of new and complex ways of doing things. They like it. We like it. But it is in anybody's best interest over the long run?

Recently I rewrote a pet project for the third time. First time it was C#, SQL Server, and an ORM. Then it was F#, MySQL, and linux. The last time it was pure FP in F# and microservices.

Some of you may know where this is going.

Just as I finished writing the app in a real microservices format, I realized. Holy cow! This whole thing was just a few Unix commands and some pipes.

My thinking went from all kinds of concerns about transactions and ORM-fun to just some nix stuff in a small script. The problem stayed the same.

Something else happened too. At each step, I did less and less maintenance. The last rewrite has had no maintenance required at all. In my spare time, I'm going to do the nix one using no servers at all on a static SPA. In a very meaningful way, there's no app, there's no server, and there's nothing to maintain. Yet I still get the functionality I need. And I never maintain it.

Of course that's not possible for every app, but the key thing I learned wasn't the magic of serverless static SPAs or the joys of unix. It was that I didn't know whether or not it was possible or not until I did it. By thinking in a pure FP fashion and deploying in true microservices, the rest just "fell out" of the work. At first I was actually thinking in a way that would have only led to more and more complexity and maintenance requirements.

My belief is that we get our thinking right first, use code budgets, and try for a simple unix solution. If it doesn't work, why? At least then we've made an effort to be good enough programmers. That beats most everybody else.
> Sure, in that case, awk works great, but how often does that come up?

80% of bioinformatics.
Are you planning on open-sourcing the downloader part? I'm very interested.
The Gish Gallop is one named rhetorical tactic of this kind, which describes a subset of edgar you describe:

https://en.m.wikipedia.org/wiki/Gish_gallop
Show HN: Robot Lovers? Domestic Robots Reviews Here
All of the source text for all of Google+ Communities posts is a few hundred GB. This for 8.1 million communities and ~10 million active users.

Add in images and the rest of the Web payload (800 KiB per page), and that swells to Petabyte range. But the actual scale of the user-entered text is stunningly small.
> billions of records a day

A good GPU can do >1bn calculations per frame.
> If you’re more interested in shifting the landscape, changing the incentives becomes the priority.

Or changing laws to make the bad stuff illegal.

I'd be happy to make most ads illegal. In some places they banned all roadside billboards and you know what happened? It made the view better and didn't hurt the economy.
Understanding a Performance Issue with “Polymorphic” JSON Data
Emacs.dev is redirected to Vim website
Put some instruction in English. Many people know their native language and English. [Hi from Argentina!] I could guess that the ASDW in the text are for moving, the space is for shooting.

Or perhaps add some graphical instruction.

Why are the asteroids shooting at me?!
I guess it would just make it difficult for mobile browsers? Unless they automatically switch to mobile mode from the desktop website.
I recently read The Idea Factory [1] which covers Bell Labs in its heyday. Many of the most brilliant human beings of that era worked for very modest salaries, and seemed content to do so. I wonder why it is that nowadays the "smartest" people tend to work in tech or finance and mostly pursue wealth. A few possibilities:

1. The rate of meaningful new discoveries in basic research has slowed significantly compared to the mid 1900s. Most important advances now involve enormous groups of researchers, and require decades of work. So the basic research route is less appealing overall.

2. Technology and finance provide clear avenues for outsized financial returns that simply weren't available in the past. Enrico Fermi, for example, was fairly enterprising. He wasn't an academic ascetic at least, and made some effort to amass wealth. But the best strategies he came up with were publishing textbooks and maybe some dabbling in the stock market (That is if I remember my details from The Last Man Who Knew Everything [2] correctly)

[1]: https://www.goodreads.com/book/show/11797471-the-idea-factor...

[2]: https://www.goodreads.com/book/show/34746094-the-last-man-wh...
Sure, and the UK could have a 4-hour work week if it halved it’s manufacturing and automated all its services.

Annoyingly, people don’t follow such oversimplified economic models. (If we did, free market economics and communism would both be ‘right’).
Cat Living in the Menubar
Allocation of capital is one of the most important roles in society, bar possibly the judicial system and maybe the government legislature. Not the most powerful role, but quite possibly the one that has the biggest practical impact on people's daily lives along with entrepreneurs. We want smart people working on it.

There is a lot to say on the subject of whether the financial system regulation is creating the right incentives. But there isn't really much room to debate that designing trading strategies is a waste of talent.
Did anyone ever question this? Of course they want the phone number to identify you across data-sets. That's why some of us get a new phone number for each service that's important enough. I even made myself an android app that allows my "burner phones" in the basement to send xmpp messages to my real phone with these 2FA messages.
"Kari-Anne Opsal, president of the Norwegian Bridge Federation, said the drugs were “not performance enhancing”."

That isn't some Bridge player.
Facebook Research App Analysis
What's wrong with good old-fashioned wget?
> How can someting like 95%+ of the population who make less even cope?

For starters, most don't aim to retire at 40 in "economic freedom".
It would be interesting to see a crash test, for sure. I imagine the top of the car is still pretty firmly attached to the bottom for rollovers, etc. But even if it's not, as long as the passenger compartment is firmly built and stays together with its crumple zones, isn't it fine if the bottom skateboard goes flying away as long as the passengers are safely decelerated in one piece. Or do the feet go down into the skateboard?

In the worst case, at least the underrun skirt should help the collision avoidance systems avoid the collision in the first place.
> composing tiny bits is always good, whether it's unix commands, lisp functions, or forth words..

It's not so much about "tiny" but about no fuss, low complexity, no-nonsense, etc. For example, Forth may be tiny, but it's unusable for most applications. Assembler languages are tiny, too.
music - have premium version of di.fm.

you took excersize off the options - and I think taking a walk and tai chi fall in that, although some may say that's not the same.

I have found the best thing to help relax is dedicating 5 minutes to write - get stuff off the brain so you can relax and stop stressing it - pen and paper is fine, notepad, whatever. Write notes, jot ideas, a todo list, some mind mapping balloons.. sometimes some rhyming song lyrics to get stress off the brain and engage the heart in a healthy way.

After things are off the brain and into the paper or digital archive I find it's easier to relax in whatever situation is next.. sleep, hanging out with people, a book..
Yes, you are right: This is not what Craig's theorem says! It is enough to assume that the theorems are recursively enumerable. From this, it follows that there is an axiomatization where the axioms are recursive.

The key point is that I would find it a worthwhile addition to the paper to somehow make clear that "s proves S" is assumed to be decidable. Since you have done this: Thank you!
A useful block diagram showing that AI projects are simpler than you think
There is a lot of finger pointing at China and wild claims by people who don't care about these things. After Iraq, Afghanistan, Libya, Syria, Yemen, threatening Iran and now with open meddling and orchestrating coups in Venezuela its utterly absurd to pretend to care about human rights or democracy.

Apparently you can do the same thing every time and cause catastrophic devastation, kill millions and put millions of families in disarray and continue to claim 'innocence'. And some here talk about Tienanmen in 1989 as if none of the above happened, while colluding with regressive regimes like Saudi Arabia as we speak to bomb Yemen.

In the same way some care about surveillance, but only in China. The NSA revelations, secret courts, secret orders, Snowden and Assange being hounded and not a single person held accountable has nothing to do with surveillance, rule of law or democracy. Google, Facebook and others making billions spying on the world and building invasive profiles is not surveillance. US law enforcement demanding to go through your phones and laptops at airports like the stasi is not a police state. Credit scores and social credit are somehow different. This is a culture of smug finger pointing based on dissonance.

This is an orchestrated sabotage of a company perceived to be a threat by some interests with zero evidence or due process in collusion with a global media that is apparently not too reliant on evidence or investigation. This will be lesson for many on capitalism, free trade and the 'natural constraints' of our global system.
Yeah, that 's one of those things in which everyone involved needs to be held to account - if the promise is based on CCS, then the plant must not be allowed to turn on without it.

Generation with CCS is not impossible, it's just .. uncompetitive with renewables.
Thanks for your tip, I tried that but then I wanted to use some lathe type thing to make a shape and got into module hell. I am trying to not distract myself with having fun with that right now as I only want to make an 'undocumented feature' along the lines of embedding a flight simulator in a spreadsheet program, but it pleases me that I can get on it later to cook something fun up.
Programmer Friday: Do You Need Daily Standup Meetings? – Thomas Kjeldahl Nilsson
Write a blog post about it! It would be nice to see the progression and read about your insights of such complete reworks, even if it's a pet project.

Edit: Can I can sign up somewhere to get a heads up when your book is available? Would be appreciated!
Dealing with absence of value in programming languages
Asking for (part) payment in advance [1] is really common, so, say, you could ask for 1/3 before work starts, 1/3 halfway and 1/3 on completion.

If these are not paid in time, you are in a good position to pester your client before the job finishes, because you have the very real threat of walking out before the job is done, likely leaving them with essentially worthless WIP. The threat is so obvious you don't need to allude to it, just say that if you don't get paid soon, you will need to take other work to tide you over.

No need for escrow, which is tricky in the same way as PIA if there are milestones: what if the client agrees to the escrow contract, puts in the first installment, but then fails to put in later installments? Don't you still need to dangle the possibility that the job won't get done anyway?

If you do want escrow, there are a number of problems with smart contracts:

1. They are notoriously difficult to phrase in an exploit-free way

2. Your client may be suspicious of the technology

3. Cryptocurrency-based contracts are exposed to high volatility; there is an element of gambling

There are more traditional escrow services that are not too expensive, such as https://www.escrow.com - of course you are exposed to risks from the escrow service provider, but with a reputable company these should be small.

[1]: https://due.com/blog/10-invoicing-terms-need-know/
> None of these problems are new or unique, unless you ignore the last few decades of lessons from engineering concerns in other ecosystems, which unfortunately people seem determined to do.

Not intentionally you see. This is completely anecdotal, so take it with appropriate grains of salt, but I have observed that the majority of people is the JS ecosystem are not proper students of computer science/development. Most are either self-taught or come from fast paced bootcamps. So they lack the historical knowledge of software engineering and basic passing knowledge of other ecosystems.

Now for the most of us that have spent time studying the field, it is easy to identify the problems and at least remember that some solutions exist. Most of the people in JS community do not. So they go through the same process others have gone through before and land in the same mess.

There is nothing anyone can do about it.
This is pretty much where we are at, especially with a lot of transforms and processing on high-speed video captures.
It’s been tried repeatedly. Iron isn’t the only limit on algal blooms, though it is often the most relevant. I think the main problem is control over which species bloom, partly to avoid toxic bloims near fishing areas, but also as you want something that sinks the carbon rather than floating it.
Show HN: PivotHelper, utility for generating Pivot tables and charts
> We know it

^citation needed
I think you're taking it too literally. What I mean is that, as an example, if they say $POLITICAL_FIGURE has said this or that, I will suspect they're taking the words out of context, but I am not going to find and watch the entire video, because I don't have the necessary time and energy to do that.
They do automatically switch, at least for me (Firefox on Android).
Live stream - https://www.youtube.com/watch?v=21X5lGlDOfg

As of now - it's 90 min to the hatch opening.
That's the beauty of free Open Source projects. Code is written when it's required. When the project does it's job, coders move on to other useful projects.
How to Approach the Challenges of DevOps in Large Organizations
We are working on a project where we plan to manage our new HPC system with OpenStack. This will replace 3 legacy HPC systems that were manged with propriatory management systems. Due to shifting requirements by our customers (scientist) we decided to move to a cloud framework where probably still the majority of resources is dedidcated to a batch scheduling system but it would allow us to also provide more cloud like services (jupyerhub, rstudio, databases, etc)
It's quite an ambitious project and we (4 engineers) basically spent the last year understanding the in and outs of OpenStack. We also went full in with integrating all kinds of datacenter components into OS (NetApp, SDN, DNS, etc)

Some lessons learned so far:

- OpenStack is very complex
- It's less of a product and more a framework and you need a dedicated engineering team with cross cutting skillset
- You definately need a dev/staging environment to test upgrades and customizations
- Some of the reference implementations of OS servies (SDN) are fine for small deployments but if can replace them with dedicated hardware/appliances you should do that.
My understanding is that CTA is a general term for a hedge fund that uses trend following strategies, primarily trading futures, but not actually restricted to commodities, so it's not a particularly accurate name, just industry jargon.
An Obsessive Aristocrat, Rediscovered Paintings and an Art-World Feud
The correct answer to the question "what's a monad?" is not "learn haskell". That answer misses the point and is not helpful at all.
Four Hundred Brand name Brick and Mortar Closures in 48 Hours
Literally just a Bash while-read loop over community IDs. It's embarrassingly trivial.

I'm planning on posting the data, probably to https://social.antefriguserat.de/ and will include procssing scripts.

This is the fetch-script, which saves both the HTML and HEAD responses:

#!/bin/bash

sample_file=$1

comm_path='community-pages'
base_url='https://plus.google.com/communities'

i=0
time sed -e 's,^.*/,,' $sample_file |
while read commid;
do
i=$((i+1))
echo -e "\n>>> $i $commid <<<" 1>&2;

url="${base_url}/${commid}"
commfile="${comm_path}/${commid}.html"
commhead="${comm_path}/${commid}.head"

echo "curl -s -o '${commfile}' -D '${commhead}' '${url}'"

done

The sample file is simply a list of G+ community IDs or URLs, e.g.:

100000056330101053659
100000310247038604843
100000355641542704509
100000408644688836681
100000537266485621548
100000813948204546252
100001055751908082772
100001158162744298957
100001173291703462139
100001193552641351693
But blind trust is what this article is suggesting by comparing demands for evidence to "denial of service attacks":

> Quickly, the 80% can overwhelm the 20% with demands for explanations and evidence. ... Every minute spent refuting X takes away energy that could be spent refining Y.

Sorry, but providing explanations and evidence to the 80% is necessary. The fact that academia doesn't reward this behavior is a problem with academia, not with the people demanding explanations and evidence.
Could anybody explain (or point me to) the pros and cons of using ISO/IEC 29115 vs NIST 800-63B authentication and identity guidelines? I just started working with electrical identification (eID) but can't find any good resources on which standard to choose.
Can `wget` easily upload files? More like `scp`, isn't it?
Why Do Cloud Migrations Fail?
It really helped in our case. We have a team of 10+ researchers who alse ship code in production. They were repeatedly running into a problem where they recompute same data in runtime, or reinvent the wheel because they didn’t know somebody already computed that datum. I end up writing a small single-process (for now) workflow engine running a “company-wide DAG” of reusable data processing nodes (all derived from user-submitted input + models). Now it is much easier for individuals to contribute + much easier to optimize pipelines separately. I might open source it some time soon.
This is such a frustrating phantom discussion. It‘s so pointless, yet so typical of German cargo cult privacy considerations.

Bodycam footage can both be a tool of surveillance and opprosion (if the police has sole control over how, when and what is used) as well as a tool for dissolving power asymmetries (when use is controlled not by the police). That‘s the important discussion to have, not this weird Amazon discussion.
In the late 90ies, the joke was always that Emacs is short for Eight MBs And Constantly Swapping.
Nice article, though I think you should work on your blog's typography. Using a bold typeface for body copy is not pleasant to read.
Wget is not a “tool” - a “tool”, in modern parlance, now has to be a web service, which is what this is.
> In the real world, those 5M lines are growing by several hundred thousand every day

Or they don’t. Not all data are cloud-scale aggregations.
Do your VMs have very long uptimes? This is an indicator of the stable system fallacy.

If the system was implemented correctly the first time, resource use never exceeds capacity, maintenance always works properly, versions are always up to date, and the infrastructure (power, network, host, storage, cooling) never has problems, then the system appears perfectly stable. But introduce changes and errors with increasing frequency and you quickly find out how robust it actually is.
Well they are both "right" in the sense that they have different premises and optimise for different variables in the economy. They both work in certain circumstances and not in others. There's no such thing as a perfect economic system that magically solves all human problems, but that doesn't mean that there aren't gradations of how good one is compared to another, given a set of things you want to achieve in a society.

Capitalism has advantages and disadvantages, and the same is true for communism. If, however, the variable you want to optimise for is carbon footprint, then clearly capitalism is the wrong tool for the job.

Also, models are a perfect representation of reality, but since we can't possibly capture all the data inherent in a system as large as our planet (or Solar System, or the Universe), it's pretty much all we have to make sense of the world.
Spider silk could be used as robotic muscle
> Many people here have roommates or alternate living arrangements.

Is “alternate living arrangements” a euphemism for homelessness?
If you connect remote communities with poor bandwidth http allows a shared cache behind the bandwidth bottleneck.
And other caching scenarios.
> Many data sets are basically proportional to the human population.

Awesome point well put.
Selling weapons to ISIS is not a crime then?
>There are valid historical reasons to explain why there is a correlation between wealth, ethnicity and gender but the causality is not there anymore.

Why not? What allows you to make the claim that the time of extreme disenfranchisement (one generation ago) or ever slavery (two to three generations ago) bear no effect in 2019? Because they are not formally recognised in law?

>My point is that a poor white kid will be just as disadvantaged today as an equally poor kid of any other race.

Some would say that the white kid still has access to structural privileges afforded by society through extra-legal means. That's not to say his situation isn't bad, but it's probably less bad than the poor black kid's fate. This is reflected in biases about intelligence (for instance when an employer is deciding whether or not to hire), for instance.
This doesn't really explain anything, does it? Fear is such a universal emotion that it can be present in any are of life, and more importantly not going anywhere any time soon. It can also be easily adjusted to any topic, because every topic can be viewed from the two perspectives - if something is good, we can strive towards it or be fearful of it's lack, and vice versa. The more important the topic, the more chances of being fearful about it.