skysight-inc/HackerNews huggingface dataset:
The problem is that there is no turning back. Especially considering nutrition, chemistry, material science.

Environment has changed enough - especially number of people - that attempting to use traditional methods en masse could be very risky.

(Much less in nutrition or medicine where we have made major gains on the average.)
There's a lot of complaints here about "erasing reality" and other hyperbolic talk, but these models are trying to make predictions within a particular user's context.

It's just inappropriate to apply some global biases for a particular user, and avoiding that can result in a better user experience.
Thank you. I appreciate your concern. My understanding is that the Blockstack team has more development planned for GAIA, but to date have been focused more in other areas, as you discovered. We've been working on their platform since December of '2017 and so far their GAIA storage system has been reasonably reliable for us.

*Edit: Though recently I've been considering the system and Stealthy's use of it for scaling purposes and it's likely that we'll be looking into running our own hub(s). A brief discussion on throttling of the free hubs, best practices, and performance here: https://forum.blockstack.org/t/gaia-read-write-and-throttlin...
Can't help be reminded of this (awesome) book [1] where a bacterium is engineered to eat PCBs and released in the wild without proper testing, leading to very interesting side-effects.

I wonder what byproduct of this digestion would be. I don't want to sound like a luddite but remember BPA?

[1] https://en.wikipedia.org/wiki/Zodiac_(novel)
My 11th grader's high school starts at 7:10AM
I've used most of Hashicorp's tooling - Consul, Nomad, Vault, etc. - and I consider myself to be a Hashicorp fanboy. But if you're spinning up a bunch of VMs "in the cloud" and that's all you're doing, you're not taking advantage of the platform. The idea behind using AWS is not just to avoid your own capital infrastructure, it's also to allow someone else to do the "undifferentiated heavy lifting". In our case:

Consul -> ParameterStore

Vault -> KMS/Cognito/IAM

Nomad -> Elastic Container Services/Fargate (serverless Docker)/Lambda

SQL Server -> RDS -> Aurora

Memcached -> ElastiCache (Memcached protocol)

Consul+Fabio (service discovery/load balancing) -> Elastic Load Balancers/Route 53/Autoscaling

VSTS (MS's hosted CI/CD platform) -> AWS Code Build/Code Deploy/Code Pipeline

"not marrying yourself to a one cloud provider" is equivalent to "coding using a repository pattern to access the database" in both cases people claim to not wanting to tie themselves to one vendor and then they realize that they aren't taking advantage of what the vendor has to offer.

In my experience, no one wants to go through the pain of moving to another vendor just to save a little money.
So it's a blockchain! /s
Is it safe to download an installer from sourceforge these days?
"The global consensus of what happened on that computer is what is useful."

Nick Johnson appears to disagree entirely in a Reddit thread.
Yeah, I've particularly liked the approach suggested by Beancount - you in some ways treat your finances like a software project - meaning you keep the plain text ledger file, importers, and documents structured and all in a git repository. The repo gives you a feedback loop of how often you're keeping up with your finances. Plus, recategorizing/restructuring things

The learning/migration curve is hard. But eventually you get rewarded once all the data is in and can leverage web-based frontends like fava https://github.com/beancount/fava to visualize and filter things. Or just write your own script for a custom report.

Other notes:

- It took me about a year from committing to organize my finances this way to now having a regular import-review-commit workflow. Your situation may vary but it took me a while since I didn't organize finances at all before aside from earlier attempts of using mint. Beancounts documentation ( https://docs.google.com/document/d/1RaondTJCS_IUPBHFNdT8oqFK... ) is great but is dense and spread out a bit, thankfully their email list ( https://groups.google.com/forum/#!forum/beancount ) is pretty active and helpful.

- The ledger file will get big, but it's easier than having multiple files. Use syntax highlighting & more importantly code folding. And no you don't have to be an emacs/vim nerd to do this (i'm using sublime FWIW).

- There's migrators from mint/etc. but those aren't perfect because the data from mint isn't always perfect. I went through the exercise of categorizing many transactions from earlier years. It's a masochistic option but really wanted some historical data. Ultimately you'll find yourself refactoring/re-categorizing things over time, and because it's in a git repo you won't be afraid to be ruthless about this.

- Writing your own importers is part of the learning curve. You might find some odd ones on github but you ultimately want to write your own - the examples in beancount's source code are a good starting point. You don't have to do it for everything, just the ones that are too unwieldy for tracking manual transactions.

- I'm still wrapping my head around how to leverage beancount to function as a budgeting / forecasting tool. Several friends use YNAB (there's also financier.io) instead for those needs.
I agree with most of what you said, however, Netflix most definitely does not operate at a scale well beyond what most AWS managed services can address.

AWS managed services literally sit behind billions of devices, a scale that makes Netflix look small in comparison: https://techcrunch.com/2018/02/27/apple-now-relies-on-google...
That principle is much, much older than companies and business.
Yes but the point is that what is 'misbehaving' is defined by market norms. 'Misbehaving' is engaging in behavior which decreases profit but it can never help us to escape the question of profit altogether. That's what government is for - when what is good for society and what is good for profit conflict government steps in to correct. The point of markets is that they rely on only individual decisions and what may seem like a rational individual decision to every member of society may lead to an overall outcome that no member of society supports. In those instances we have democratic government to allow us to reach out of the realm of individual and act in a collective self-interest. That in recent years our government has been malfunctioning in a way that suppresses our ability to act this way is not an argument to get rid of democratic governance altogether, it's an argument to bring it back and strengthen it.
A few examples from actual interviewing experience:

- Treating anyone (be it the interviewer, the janitor, the intern, or people from a different background whom you've never met) as below you

- Treating the interview as a power struggle

- Failing to solve a fizzbuzz within half an hour despite claiming 15 years of software development experience ("well, I've mostly been managing people lately")

- From a developer with 18 months experience applying to a mid-level position: "I expect to have at least three people reporting to me within 12 months" [Even more ridiculous when you take into account that we're a tiny, slow-growing team that's unlikely to add 3 people total within 12 months.]

- More than 3 years out of school, never held a job for >9 months.

- "And then I told them we should put development on hold until we rewrite all seven services in $new_shiny"

- Shows up to the interview drunk or high
Oh absolutely there is a sliding scale on both the actual practice of science as well as the reporting. From the practice of it, I know as simple anecdote I have participated in conducting research in hard science (physics), softer hard science (biology), social science (behavioral and economic), as well as straight policy analysis with a "scientific approach" through data science. The findings from those are reported differently and have stronger or weaker words and conclusions. I think that is where the practice sliding scale comes in, is how the researcher decided to write up and report their findings and appropriately identifying their methodology and short-comings.

From the journalism side I think you end up with the problem the wide spread field of journalism has, you have to be read by your audience. That means something with a wider audience is probably going to be more on the ELI5 side which means both the reader and the journalist have to take any reported findings more lightly.

The sliding scale, I believe, comes in with the rigor something is reported. That is both in the practice and the journalistic side. More details can give a more granular understanding showing limitations but some times broad strokes are necessary to get some information out to a wider audience or more quickly.
The author, according to my understanding, says that parsing with derivatives does not improve the state of the art either in terms of complexity or in terms of elegance.

My personal opinion is that Matt Might uses a different avenue to derive the state of the art and even though the original algorithm can be trapped to exponential complexity, the improved analysis and amendments in the 2012 paper save the situation.

I think it is quite an achievement to fight against so many experts who believed that the flaws could not be worked around and re-derive the state of art complexity. At least in the field of pure mathematics this has a very big value.
vscode/intelj idea
Isn't Netflix invested heavily on Mesos than k8s for their container orchestration? for example Titus https://medium.com/netflix-techblog/tagged/titus Fenzo https://github.com/Netflix/Fenzo
I also work for a CDN.

Some of our stuff dynamically utilizes other CDNs. A customer might go try and test deploy something and we might use (AWS or whatever) to do it.

It's CDNs all the way down.
Code of ethics does not matter in an authoritarian state which will dictate what your ethics are to be.
Do You Know Transitioning to a Healthier Diet Brings More Success?
All those "SEO Obsessed" clients, please listen to this guy/gal.
Awesome! Thanks a lot!
Initially the algorithm is a reflection (or amplification) of our existing behavior. But at some point, that reflection and amplification causes it's own ripples.

So, the Beyonce fever becomes pitched in large part because of algorithms suggesting that content. I don't think each of those tweets would have happened independently.

The critique is that we're being fed so many suggestions that we don't have room to find out for ourselves what we like or want to talk about. Instead many times we're simply responding to and consuming the recommended content.

So there are people at the wheel, but the majority is along for the ride.
I get the point but presentation is just as important as technical details. You have to show the people.
Addressing the Data Center Skills Shortage
I may have missed it but I didn't see anything explicitly spelling out what components of pollution in the air that were so deadly. You'd think they'd define what form of air pollution we're talking about, not just pollution in the generic.
"However, it looks to me like Russia's recent pants-on-head move (banning 2M IP addresses because Telegram won't give up their keys) indicates that MTProto, if not a very wise development to begin with, doesn't have any obvious cracks that the FSB could just quietly pry open."

Or you could be falling for a classical misdirection trick, which the Russian gov't is well-known to do, and they already have the crypto broken and are doing this to cover up such a fact.
This article makes some decent points but it's a shame that it had to be weakly and opprobriously framed as a kind of 'wealth' struggle. As the article itself says, "the tribes have become weaponized", I guess.
Depends, if you are just going to do simple deploys then its' not worth it. If you are going to make good use of it, then sure. Besides deployment, the labeling feature, namespaces, bin packing of pods, container resource constraints, declarative nature which gives you resilience and scaling. If you use all that it's worth it. If you don't have a scaling problem and don't deploy often. Then probably not.
How  to Earn Bitcoins Quickly – Guide 2018
The most fun thing about startup world is that it pretends that normal rules of economics and accounting do not apply to it (until a startup runs out of money)

$X in CapEx makes balance sheet look better than $X in OpEx.
What do you mean by using science blindly?

Three is NO way to do that. There are ways to misuse scientific results. Premature generalisation, assumptions of safety. Cherry picking to support preconceptions.
Attributing strong support to tentative and/or unchallenged results. And more...
Antiquated doesn't mean unstable or unusable. It means old fashioned. It's not the new hotness.
And yet I find it impossible to muster any indignation at the idea of more people watching and enjoying Amélie.
It's 50/50, honestly. In some cases doing that is incredibly useful for the customer.

The problem is when the business decides to start promoting similar, yet different items, knockoffs, etc. that "match" your profile, yet aren't what you would've wanted to originally buy. So you wind up getting steered to something that may be of lesser quality, etc. This might be the result of the company making a larger profit on the alternate item or something else.
No, social media exposes us to a bigger world making it more easily to find people like you online that share the same interests or "taste".
If you only take into account people on your close social circle, you will still be "the one with that unique taste" around your bubble like everyone used to think they had -a unique taste- before social media.
I'm not arguing against populism, more so the nationalist aspect of the "nationalist populism".

Particularly the idea that "diversity is the root of our problems" and "immigration is inherently bad". These ideas seem central to most of the nationalist movements in western society recently.
I'm as much a fan of Karate Kid as the next guy, but calling both Johnny and Daniel-san 'hollywood talent' is questionable. I'd not seen either of them in anything from Hollywood since the 1989 Karate Kid part 3
it is implied that they are payed at a sweatshop price in sweatshop conditions
Sourceforge has been under new management for approximately 2 years. They revamped the site and cleaned it up. Since this change, I have seen no reason not to use it.
I don't have one yet although I'm slowing transforming my existing team into one.

I'm doing so by.

Communication, communication, communication.

Documentation, documentation, documentation.
Not mine. I'm still really fond of quicksort and BFS, and marvel at their elegance rather frequently.
A little-known fact: WHOIS is extensively relied on by spam fighters like Spamhaus to do their good work, which collectively saves all of us from an enormous tidal wave of spam that would otherwise consume vast resources. Internally, the anti-spam and more generally the anti-abuse community builds a huge and mostly real-time cross-referenced database of information about domains and IP addresses. This database would be impossible to build without WHOIS.

For example, if one domain shares the same contact email address as another, then the domains are related somehow. Doing some data mining on a variety of signals which are apparent in the WHOIS records can help to cluster related domains to help anti-abuse researchers find newly problematic domains by following the trail through WHOIS.

I'm not sure how researchers will do their job effectively without WHOIS. This development is truly a disaster for anti-abuse.
> P<0.05 doesn't mean 1 in 20 are wrong

> It does mean that ... 1 in 20 would be explainable by the null hypothesis.

That seems like splitting a pretty fine hair to me, particularly since I haven't actually committed to any of the many possible interpretations of the word "wrong".
Googling his name, he seems to have always been an author, my interpretation is that his "half baked idea(s)" is just a fictional premise he's made up, so he can experience what it would be like to try to get into the tech scene. If he were writing about Hollywood he'd say he's trying to be an actor. And well duh it's a plug for his book, it's adapted from it.

But his criticism is valid, IMO. It's not like Silicon Valley is a concentration of brains trying to solve the world's problems, it's a concentration of brains doing silly shit, like the billionth app that will let you order pizza or some algorithm so your video stream loads faster, or as he quoted: "what is my mother no longer doing for me?". What's their (SVers') goal? Success, within monetary terms? If that's your religion, and you're in IT, of course SV is your mecca.

I wrote "solving the world's problems" above, I'm inspired by this TEDx criticizing the shallowness of TED Talks (video is embedded: https://www.theguardian.com/commentisfree/2013/dec/30/we-nee...), why are we just making the next pizza delivery app instead of thinking how to fix problems like climate change or food shortage?
IDK what GNUCash recommends but keeping separate books is literally the first factor the IRS uses for distinguishing hobby vs business income: https://www.irs.gov/pub/irs-utl/irc183activitiesnotengagedin...
A step-by-step guide to the “World Models” AI paper
what do you mean by revolution? there has been 2 already.

https://en.wikipedia.org/wiki/Timeline_of_the_2014_Venezuela...

https://en.wikipedia.org/wiki/Timeline_of_the_2017_Venezuela...

Theres nothing much we can do, guns vs stones.

People realized is easier to leave the country than figthing this.
FWIW: I just tried the 3.0-1 macOS version and it crashed when trying to configure/save. The save dialog was non-native and seemed to have some weird "offset" where clicking the mouse would select a folder/file not under my cursor, but offset by like 50px.
I agree that entering large numbers of manual transaction can be clunky, but for the occasional single transaction it can be pretty quick. For larger numbers of transactions, I've created a rules file that hledger uses to parse the downloaded CSV file from my bank to create a fairly detailed journal entry. (https://github.com/simonmichael/hledger/wiki/Convert%20CSV%2...). The real added benefit for me is using git not only for my journal file, but also for the CSV files. It gives me an immutable record of transactions from my bank. I had a revelatory experience reading adept's methods for tracking his financials. Version control for everything. https://github.com/adept/full-fledged-hledger
Assuming you have an accountant, you should be able to ask them for a listing of the necessary accounts. That's what we did when creating the Portuguese localization of another software.

GnuCash should do the accounting itself just fine, but in my experience accountants don't like to see reports that aren't exactly like they are used to, so you might lose a lot of time adapting its reports to the format they're expecting.
If it's not the role of government to solve problems that are tearing apart the fabric of society, then whose role is it? Who is going to do it? Maybe no one. Maybe we're all screwed.
https://en.wikiquote.org/wiki/Jan_L._A._van_de_Snepscheut
Their thin crust pizza is pretty good. I know most people don't consider that pizza.
Customer Appreciation Funds/Customer Acquisition Funds/etc.

"We have $500M available this year that we can spend to lock in $1B in revenue. If you give us $1B in revenue, we would spend $500M on helping you to achieve your objectives. If you give us $100M in revenue, we give spend $50M in helping you to achieve your objectives"

So say I need to spend $10M on some project and I am looking at $20M of spend on hosting. You are offering me 10M CAF. I spend $20M on hosting, and 0 on some other project - instead you spend your 10M CAF on helping me with my project, which of course looks really good on my books.
Exactly. And nothing new in my being contrarian. Back in my Windows days, back in the nineties, I had an iron rule that no vbrun.dll ever entered my machines. Mainly because they invariably turned out to be badly designed, poorly implemented, and just not worth the trouble.

These days, I do* have a couple of Electron-things installed, because I occasionally need them, but they are ugly hacks which bring me no joy.

No JRE either, by the way, if I can help it. Same reasoning.
loaf -> load, lol
Studies about people in general are of poor quality, due to difficult to define metrics. Even today, psychology and sociology studies aren't rigorous for the simple reason that it's hard to measure these things. Biological studies are hard too, it's hard to suss out the confounding variables and mechanisms of bodily functions.

Just the premise of the "racial science" studies would render them invalid, how could they even have controlled for the myriad variables that we have no idea how to control today?
This reminds me this talk from GDC by Raph Koster.

https://www.youtube.com/watch?v=kgw8RLHv1j4

Quite enlightening.
All those former smokers on oxygen are the lucky ones.
There are several. To offer but one:

http://www.jnr-eeb.org/index.php/jnr/index

I would actually prefer that each and every journal devote at least half of their space to negative results. I have seen some sublime experimental setups that produced negative results. I can't begin to imagine how instructive it would be to see more such experiments.
This deserves more attention. Thanks for Firefly.
My deploy times came down since I started using K8.
Deploy just takes 20 seconds for me now.
I've not measured the performance lost.
Reliability/speed of rolling features has improved a lot.
> But other than rush hour or special events how often is that 1000 ppl capacity reached?

A single train can carry 1,000 people. It's not a "rush-hour event."

> Shouldn't the whole system be more flexible? Does everyone have to leave work at the same time?

The work day is still roughly 9-5, nothing the MTA does is going to change employers' opinions on scheduling. Good luck telling your boss you want to come in 2 hours late to avoid subway overcrowding.

> How economical is it to run subway trains with few passengers?

Train frequency is slowed down significantly during non-peak hours.

Don't get me wrong, there are efficiencies to be had -- like not having a live human at every station 24/7 -- but unions fight those measures.

> It seems that a whole lot of resources (i.e., money, including ongoing maintenance) is being tossed at outlier situations.

I'm not sure what you're proposing. Buses? Again, buses won't work -- see above.

They could massively increase fares but that is essentially a tax on poor people.

What they need is for both the state and city to cough up more money to address crumbling infrastructure and overcrowding.
Entirely separate Slack instances? Not just separate channels?
Japan is always touted for this, but Chile (Santiago, Viña) are similarly plagued with extremely large earthquakes, with regular occurrence over 7.0, and you see tons of mid-rise buildings in Santiago. The building standards there are exceptionally high after the 1985 earthquake (8.0). If Santiago and Viña del Mar can do it, surely San Francisco can.
FWIW, Bison (which I'd expect most people are using rather than the original yacc, though I can't be sure) does support GLR parsing.

I haven't seen GLR used in production either, but my experience with projects I've been involved in is that this is sometimes just due to inertia. Taking full advantage of GLR's support for ambiguity requires reworking both your grammar and your early stages of semantic analysis, and even if people agree that the result might be nicer, nobody has the time or motivation to do all that work.
Websites would need to be continuously vetted because their content could change, unlike a binary release.