skysight-inc/HackerNews huggingface dataset:
I suspect that the problem will end up being something quite 'simple.' Our time didn't have the horsepower nor know how to accurately compute feedback loops in our environment. We didn't understand the numerous and unforeseeable tipping points that we tipped. We didn't understand the dance of nature and how disparate events tied into the pattern of our actions.

The deliberations, however, are over and the verdict is in. We have done fucked up. There's no point in lamenting our failure. We've made the mess and now we need to fix it. The only real question facing us is how.

Whether it's carbon sinks in the form of olivine and 20 million trees, new methods to suck carbon out of the air, or some desperate act of geoengineering. Humanity needs to come to grips with the situation and act quickly and decisively. Like we did with nuclear weapons and space races. An Earth Race (so that we don't regress), if you will.
A single field also breaks the expectation that people do not get called by their full names in every interaction. This is a very common expectation, and violating it makes you sound subtly more like an evil robot.

Is this a lesser offense than mangling a name that doesn't cleanly split into first/last? At the individual scale, probably.

The impact, in aggregate, on UX/sales/utility? Could definitely go either way depending on your userbase.
Right, I think they're using Chrome as a testing ground for this.
That's ludicrous.
As far as I know, floating point add and multiply are commutative (but not associative) in IEEE 754.

Usually, but not always. (+0) + (-0) yields (+0), while (-0) + (+0) yields (-0).
A Chinese digital currency is the real threat, not Facebook's Libra
https://web.archive.org/web/20191112011511/https://www.johnd...
The myth of the "welfare queen" is an ugly racial stereotype based on a single person, and bears very little relationship to the reality on the ground.

https://newrepublic.com/article/154404/myth-welfare-queen
That's been a large part of my job at times - working with product stakeholders who give a high level requirements overview and then trying to figure out all the edge cases they didn't specify up front, so that my team could properly design and estimate the work to build the features.

So: yes, most companies already don't require people designing things to be able to fully spec every edge case in advance, without any dialogue.
1. Argument from authority doesn’t mean anything to me. I also don’t believe creating Django or running a Python consultancy endow someone with especially useful opinions of Python packaging tooling. (Not that the author isn’t knowledgeable, just you seem to think there’s an A implies B relationship between those two items and having good opinions about Python packaging, and there’s not).

2. Conda is quite widely used outside of data science. It’s for example part of Anaconda enterprise offerings used by huge banks, government agencies, universities, etc., on large projects often with no use cases related to data science. Conda itself has no logical connection with data science, it’s just a package & environment manager.

In each of my last 4 jobs, 2 at large Fortune 500 ecommerce companies, conda has been the environment manager used for all internal Python development. Still use pip a lot within conda envs, but conda is the one broader constant.
If Apple considers walking users through the process of disabling Gatekeeper to be developer abuse, then I don't see how anyone can claim that notarization or the developer fees are optional.

The change is that in each release of Mac OS this process is getting harder to avoid and is starting to include additional requirements. "You need to sign apps" becomes "we need to run an automated review on our servers for every release you make." This matters because a lot of the original criticism around the original Gatekeeper was dismissed via the argument that it was just an optional security feature that was turned on by default. It wasn't like Apple was going to block 3rd-party marketplaces, this just made Mac OS safer for computer illiterate users.

With El Capitan, people are starting to suspect Apple does not want unvetted apps on the Mac in any context, and it seems more likely that future Mac OS versions will continue the trend of having stricter, more burdensome vetting requirements.

It is increasingly harder to take advocates at face value when they say that 5 years from now I'll be able to run a 3rd-party app on my Mac that didn't go through a manual review. Which might sound great to some people, some users love the app store.

As to why I think that could be a problem for creative mediums, see my parent post. It may not matter if Gatekeeper begins to live up to its name, because creative mediums may just migrate off of Mac. But if Mac becomes a platform too big to ignore, or if other platforms like Windows follow suite, then I think creative mediums will suffer.
Developer “Swiss Army Knife” v0.3
Circles Sines and Signals
Why was it believed that the Aztecs greeted Cortés as a deity?
At least based on the picture, the 'slow' badge should only show during the TTFB, ie. before any paint occurs. Since Google Ads loads after the paint websites likely won't have issues of mis-labeling.
Both indicators (along with python) that this is an article written by a yet another data scientist that thinks engineering is unecessary. Data science is a field that is plagued by individuals having very specific narrow experiences that are often easy to engineer making them think they are experts in data engineering. Vertical scalability has a hard bound, if your algorithm changes complexity it could become literally impossible to move forward. Horizontal scalability gives you options, this is why we like it, not just because we like to overengineer systems, but because we don't like embracing hard limitations on the systems we engineer, especially when we often don't know yet what problem we are solving. Engineers often don't get the liberty of solving extremely specific instances of problems like data scientists do.
Based on my understanding, Google would be communicating _why_ the site is loading slowly (the network, or the site itself), which isn't something that would be immediately obvious.
In addition to the popular conda, it's worth checking out WinPython for scientific use. Each WinPython installation is an isolated environment that resides in a folder. To move an installation to another computer, just copy the folder. To completely remove it from your system, delete the folder.

I find it useful to keep a WinPython installation on a flash drive in my pocket. I can plug it into somebody's computer and run my own stuff, without worrying that I'm going to bollix up their system.
Strange that I think that a sarcastic reply that goes a bit further in moral punishment would be indistinguishable from a real reply these days. Mercer was practically forced to resign due to the backlash that his democratic political views generated against RenTech, but you deem the company as beyond redemption. You speak as if commenters here are idolizing, while being black-and-white religious and faux-cult-collective yourself, prescribing what others, we, should or should not worship. Take that to the street corner. If you gather a large enough audience, I will tell you that you are the one negatively influencing the lives of others. By my and your definition, companies and institutions would then be forced to disable you, your business, and your platform. But first let's go after Mercer.
Why did they add the terrible "read more" garbage?

Et tu PG?
The article posits that the "privileged position" should be the common position: that poverty and hunger can and should be eliminated, and then from a position where everyone is so privileged to not starve to death, good work that advances the human race may arise from those people who still work despite it not being required to survive.
> Incidentally, bc -l gives the right result, no matter how small you set scale.

There's an easy explanation here: bc has it's own arbitrary precision number library embedded in it, so it doesn't make use of floats, doubles or even quads at all.

The number library is surprisingly readable [1] for such a complex topic, and doesn't use complex types at all, relying on ints and chars and pointers inside the struct it uses to store the numbers.

It's been wrapper up for a couple languages, I stumbled over it with a Lua wrapper [0]. Useful when you want better precision than you currently have, but don't want to drag in something like GMP and are okay with minor edge cases sometimes appearing.

[0] https://webserver2.tecgraf.puc-rio.br/~lhf/ftp/lua/#lbc

[1] src/number.c & src/number.h from https://www.gnu.org/software/bc/
There will always be wars. Unless you can get every human being on the planet to agree to something, people will resort to violence to get what they want.
Love these kind of problems... is chunking the same as streaming in this context?
Pennsylvania DOT Using Crowd Sourced Data to Assess, Improve Statewide Traffic [pdf]
<pedantry>
Replying to myself: the 2.4 in a Toyota Cavalier would be an LD9-series Quad 4, not a "Quad OHC" which was an earlier L40-series SOHC version of that engine.
</pedantry>
That's as strong a case as anyone could make and I appreciate it. Perhaps if you or someone had posted a full comment like that early in the thread, it could have taken an intellectually interesting direction—they are sensitive to initial conditions.
Thank you.

Trust is one element. Common weal, the sense of acting in the common good, is the more critical element.

Trust here is a mechanism, rather than and end goal itself. Through the undermining of trust in a system for the public benefit, the common good is harmed.

Your counterexample becomes far less difficult when phrased equivalently:

Through the undermining of trust within a system opposed to the public benefit, the common good is increased.

TL;DR: you've confused ends and means.

Though generally, common good is extremely reliant on a strong social trust fabric.

(As to the question of whether or not "common good" / "common weal" is an appropriate goal value of a system, that's another discussion. I've elected to adopt for now the general idea that it is, but there are varying points of view on this point, and cases in which there is no globally beneficial outcome. Most especially where some are disadvantaged such that others, any, might survive. See also: "lifeboat ethics".)
Techbro culture strikes again.

If I ran Facebook I would fire all the whites, see how they like it, pastey little bastards.
That just gives you a warning. It doesn’t automatically create a virtualenv and link the bin scripts into the path.
Based on what this feature is and the scenario you described, I think it may disincent site owners from speeding up slow sites. At the moment, a user doesn't know if a site will ever load. If Chrome reassures that "this site usually loads slowly" they may stick around since they are then reassured that it probably will eventually load, it's just taking a while.
Thanks for trying to explain this stuff, I really appreciate it, but I think there was also something else at play here.
> Idleness is the kind of comfortable life Russell lived.

Russell was born into a wealthy British family. He grew up in the household of a former prime minister and inherited an earldom. He was able to enjoy idleness due to the labor of other British (not to mention the labor of Indians, Pakistanis, and Bangladeshis who enriched the British empire).

Maybe one day we’ll invent replicators and be able to provide everyone—not only in Britain but in India/Bangladesh/Pakistan—with the comfort of Russell’s idle existence. Until then there is much labor to be done!
I like pip-tools for venv requirements management, but I don't see it mentioned much.
Unsupervised Doodling and Painting with Improved Spiral (Demo, CPU Intensive)
My point was that the quoted characterization of targets of American intelligence agencies was grossly inaccurate.
What we need is a rootkit that the computer owner controls, a master of all rootkits to prevent other rootkits gaining a foothold in the first place
That's not a sign of bad bread. If you bake your own bread, you may find it also molds in 4 days, depending on your climate and how you store it.

I'm more leery of manufactured breads that keep forever.
The Dockerfile that's provided looks like it would be very slow to build. I always try to make Dockerfiles that install deps and then install my python package (usually just copy in the code and set PYTHONPATH) to fully take advantage of the docker build cache. When you have lots of services it really reduces the time it takes to iterate with `docker-compose up -d --build`-like setups.
Ehhh... everyone is brilliant in the early stages of a project.

Coming up with a fantastic green fields design isn't hard and represents a fraction of a percentage of the overall work.

Give me a solid engineer who can deal with all the legacy cruft and still produce a maintainable piece of software.
Good readin’, up until he said it’s not cool to snitch on your Nazi battle buddy. Just, wow.
Related from 2018: https://news.ycombinator.com/item?id=16439270
Link to Arxiv paper

https://arxiv.org/abs/1910.01007
Switched to poetry and couldn't be happier. From my experience, poetry wins hands down. It managed to replace flit, remove duplicate dependencies, and maintain stability across machines. All while using the standard pyproject.toml configuration file.
Good point. OTOH, there wasn't as much amateur digital content back then -- pretty much anything I wanted to watch was owned by a larger company. Nowadays, hobbyists and retirees and all kinds of people own the rights to content that I would want to see.

The environment has changed a lot, and it might not be a prerequisite to copy YT's growth model.
If you don't mind my asking, why?

I've identified a few possibly concerns:

- Privacy.

- Avoiding distraction.

- Cost.

Others?
I've used both and recommend Poetry. It's got a larger feature set (it can be used to manage packages _and_ publish packages), it's faster, and it's more actively developed (measured by releases). Pipenv's last release was 2018-11-26, and Poetry has been publishing pre-releases as recently as three days ago to prepare for v1.0.0.

I did a quick comparison here[0], and I'm planning to do an update with the latest version of Poetry.

[0] https://johnfraney.ca/posts/2019/03/06/pipenv-poetry-benchma...
Don't forget, big companies used to have QA. They actually tested stuff before barfing out the perpetual betaware we have now. So relying on a vendor with deep pockets and QA used to kinda make sense.
Related from last year: https://news.ycombinator.com/item?id=17310568

and https://news.ycombinator.com/item?id=17299356.

2017: https://news.ycombinator.com/item?id=13780587
They're not quite highway speed, but still pretty crazy:
https://www.washingtonpost.com/world/asia_pacific/the-surpri...

Peak speed: 18 m/s (40 mph)
"One other lesson needs to be drawn explicitly. A project is not a house of cards which collapses when a single "key"
person is removed. At least, it should not be; but often, when management thinks it is, the prophecy becomes self-fulfilling. That was one of the lessons in Mark's case, for if a little less reliance had been placed upon Mark, his manager might have populated his team with other than trainees. After all, even if the "key" man is as contented as a cow with his work, people are sometimes inconsiderate enough of their managers to get sick, to get drafted, or to die. No, if a manager wants to run a stable project, he would do well to follow this simple maxim: If a programmer is indispensable, get rid of him as quickly as possible."

"The Psychology of Computer Programming", Gerald M. Weinberg
The data model question is - at best - a very poor choice of words. Implicitly assuming a data model is a bad idea as the data model is one of the major choices every program has to contend with. So implicitly assuming it isn't really a desirable goal. It is like types where explicitly having information on types in key places in a program is always desirable and the only question is how pervasive it should be.

I also liked "They will instead ask questions about data in a natural language". Humans can't answer questions about data in natural language - when data questions come up they have to be couched in formal terms and statistics. I look forward to the day an AI can answer "what is the best decision we can make with this data?" but it runs into a problem we already have in spades. If the asker of the question isn't thinking in formal terms I question whether they are going to be able to consistently pose meaningful questions and interpret the answers. Applied Math is not easy to implement in industry because a company's ability to perform is limited by its management's understanding.

It is easy to nitpick. I'm also glad we have people thinking about the big picture of how data gets handled.
https://www.theguardian.com/world/2019/nov/04/sweden-bomb-at...
Startup Wants to Make Reforestation More High-Tech
> Although Docker meets all these requirements, I don't really like using it. I find it slow, frustrating, and overkill for my purposes.

How so? I've been using Docker for development for years now and haven't experienced this
EXCEPT with some slowness I experienced with Docker Compose upon upgrading to MacOS Catalina (which
turned out to be bug with PyInstaller, not Docker or Docker Compose). This is on a Mac, btw;
I hear that Docker on Linux is blazing fast.

I personally would absolutely leverage Docker for the setup being described here: multiple versions
with lots of environmental differences between each other. That's what Docker was made for!
That's why remote workers are more productive, provided they can get isolated at home.
Notarization is automated and similar in principle to something like LetsEncrypt. This could serve as a backing off from the push towards sandboxing and in review.

Today it is a layer on top. But my hope is that Apple comes to peace with non-AppStore distribution, with automated notarization and waiving of the $100 fee for open source, students, etc.

Mac OS X was such a joyous platform to learn to program on. But macOS is throwing up more and more obstacles to native apps. When you squeeze a balloon, the air goes to the other thing.
EPA to Limit Science Used to Write Public Health Rules
That's just standard "any reason, no reason, or all these explicit reasons we've thought of" legalese.
>I tried replacing exp(x) - 1 with expm1(x). This made no difference.

Interestingly, in Rust, all four q(x) are non-zero, using f32::exp / f64::exp in e(x) consistently gives 0, and using f32::exp_m1 / f64::exp_m1 consistently gives 1. (Given non-zero q(x), this is to be expected.) Both f32::exp_m1 and f64::exp_m1 are implemented using libm's expm1 [1], so I wonder what the author's C++ compiler is doing instead.

https://play.rust-lang.org/?version=stable&mode=release&edit...

[1]: https://doc.rust-lang.org/src/std/f64.rs.html#724-726 + https://github.com/rust-lang/rust/blob/bc0e288ad02ef362b5a6c...

Edit: Actually, I can't reproduce the author's situation on godbolt. The expm1 method consistenly returns 1. https://gcc.godbolt.org/z/RvsdHU
Rather than specifying a schema+indices or an Elasticsearch like mapping, preprocessing queries to derive the mapping will definitely be the next step.

However, I doubt we will ever derive mappings from application code or (retroactive) profile guided optimization. The biggest problem will become deployments.

We would need to couple application code deployments to deployments of databases even more than we do today (which is a giant problem).

When a new index is needed or new data types we would need to “prime” the datastore in order to get optimal queries from the start.

Even if this application-database deployment issue is fixed through automation it’s likely we wouldn’t want it to be coupled. Database index creation or schema change can take hours or longer. Application code needs to be very nimble. In the days of CI we don’t want Feature A’s database migration to block the deployment of Feature B or BugFix C.
I volunteered to teach two lessons on programming to two elementary classes for coding week this year. I have never done this before.

But if you have CS skills I think you could do the same. Just visit a local school.
No, in this context, it's creating a virtual disk using only RAM as a backing store. If you do this, then you can use whatever tools you'd normally use (cat, wc, grep, etc) to explore a dataset as if they were files. It's the super quick and dirty way to go if you don't want to code up a proper solution and your data fits in RAM.

(assuming the data is organized in files to begin with)
I don’t get this rebuttal. You don’t need to change the organization. You just need to set expectations with your boss. This is what allows you to go home on time. Instead, technical workers tend to let the deadlines be driven from the top and then they complain about working for slave drivers.
pip in virtualenv installs in virtualenv, if you add --user option it installs locally, but today I always do developent in virtualenv.
We had one of those too: https://news.ycombinator.com/item?id=10301147
Persistent Layout Patterns in Next.js
His last video is really sad. https://youtu.be/oH41gGBVpkE
>When there’s no return on it, it’s just being hard on oneself for no benefit.

If I didn't work hard every day I'd have no home, no food, I wouldn't be able to respond to this comment because I'm using a phone with internet I pay for with my work, I wouldn't be sitting on a ferry right now on my way from visiting family because I paid for the fare with money from my work. I'm not sure I understand the logic behind no returns. Sure it doesn't make me rich, but it stops me from being homeless and starving and provides me with what I need to love comfortably and not worry most of the time.
From the article:

A new draft of the Environmental Protection Agency proposal, titled Strengthening Transparency in Regulatory Science, would require that scientists disclose all of their raw data, including confidential medical records, before the agency could consider an academic study’s conclusions. E.P.A. officials called the plan a step toward transparency and said the disclosure of raw data would allow conclusions to be verified independently.

...

The measure would make it more difficult to enact new clean air and water rules because many studies detailing the links between pollution and disease rely on personal health information gathered under confidentiality agreements. And, unlike a version of the proposal that surfaced in early 2018, this one could apply retroactively to public health regulations already in place.
A collection of bad practices in HTML
Heh. The former.
Video: Edward Snowden on Surveillance and Free Speech
Catalogs for Small Businesses – Whatsapp
The Seattle politician Amazon tried to oust has declared victory
I agree. Given how fascinated he's become by it all I think un-diagnosed ADHD should be on the list, too.
Similar to the OP, I found pipenv to be quite unstable. At the time (about a year ago) it was really more interesting beta software than the production-quality software it was advertised as. It was also quite a bit slower than pip.

But what really pushed me away is that installing or upgrading any single package upgraded all dependencies, with no way to disable this behavior. (I believe you can now.) A package manager should help me manage change (and thereby risk), not prevent me from doing so.

Poetry is probably the best of the all-in-one solutions. It does its job well but I've found the documentation lacking.

In the end, I've settled on pyenv-virtualenv to manage my environments and pip-tools to manage dependencies. It's simple and meets my needs.