skysight-inc/HackerNews huggingface dataset:
This is the focus of Andy Pavlo's research: https://www.cs.cmu.edu/~pavlo/blog/2018/04/what-is-a-self-dr...

Essentially, there is a long history of developing tools to make databases more "autonomous". Pavlo's research centers around accurately capturing the state of the database, and training a system to learn the impact of tuning one of the many available knobs.
Meta: Why are paywalled articles doing so well on HN lately? I know about the "web" link, but it never works for me. It's frustrating to want to participate in the comments on a subject, but not have access to the specific content that everyone seems to be discussing (and no, I am not paying for an NYT subscription).
I thought there was a difference between a C and C++ implementation, but it was an error on my part. When I fixed the bug, I changed the post title. But the post hit HN while I was in the process of fixing it.
Intense focus can be a symptom of ADD/ADHD [1]. I've always wondered if software developers who experience flow/zone (myself included) have varying levels of mild ADD that presents as intense focus.

[1] https://www.additudemag.com/understanding-adhd-hyperfocus/
You really don’t know what you are saying. The leverage is to boost absolute returns. Sharpe isn’t changed by leveraging. They are automated black box
strategies making 1000s of trades a day with massive undeniable statistically significant information content.
Oh, this is an easy one! I hope GP doesn't mind me handling this one for him.

GP was bringing some additional clarity to the content of the article and the discussion about it. See the Chicago public library had conducted a study and found that by eliminating late fees, they'd increase traffic and usage of the library system. See they found that poor people and children were less likely to engage the library system once they'd begun accruing fines. The city felt this was a negative, and to address it they changed their policy.

Again, of course they're capable of returning things on time. But the city had found that 1-the fines weren't needed to keep the libraries functioning. 2- the fines had a greater impact on the poor than other patrons, which feels bad.

The poor and their usage behaviors were part of the decision making process, and knowing this may inform the discussion. It's extremely relevant.
My experience is that saying something and being mean leads to others doubling down on their position, unfair or not because you made yourself an enemy.
Pyenv is for installing multiple versions of python. Virtualenvs are a layer beneath that.

It’s super useful for maintaining static versions of python, like 2.7, 3.6 and 3.7 when you have many projects that have different python requirements.
Continuing the speculation, they could be just "picking" the stocks after the fact when the returns are already known, iff there is no external record of their positions and transactions
I worked a 34 hour shift one time at a grocery store. Because of staffing issues, work hours can be quite chaotic. Didn't even get overtime for that shift though I did later in the week when I went over 40 hours total.
There is no circumstance where you can reasonably state the positives outweigh the negatives. You are conflating a vague improved digital health system, with google blatantly gaining access to millions of people’s health data without consent. They have absolutely nothing to do with each other. I’m all for people opting in, but to have no say over random google employees accessing my health data? There’s no way that’s a positive. Perhaps check your own biases? Thanks
Would this be considered acceptable if it was a large company doing it to a much smaller company?

i.e. if Samsung was shoving itself into the searches for all non-Apple phones?
> Whether they practically share all finances on a daily basis or not, legally all of their property and income is shared.

This assumes that this the case for the lifetime of credit. Would we have to consider possibility of divorce given it happens at a high rate?
I have never met a startup founder that wanted to address a problem or improve the world.

I don't know where you live or work, but wow this is the complete opposite to my experience.
One of my favorite facts about Bertrand Russell is that he invented type theory in the context of math, and in that way contributed indirectly to computer science.
The common parlance in the US is that concentration camp means ‘what happened during ww2’ because that is how the education system explained the term.
The build step for installing or upgrading a package can be a killer with nontrivial projects.
> you could have a macro of sorts that just lets you write the sync version and have it generate the async version

That sounds like a good idea in theory. In practice you will discover that async is a bit different. E.g. you can't have recursive functions, some new lifetime effects will come into play (an async fn returns a Future, and everything that generated Future captures lifetimes of other things).

async/await made async programming in rust definitely a lot more accessible! But at some times the lower layers still leak through and cause some unexpected compilation errors.
The job ads are already staggered so that a company's ad can't appear on the front page until it has fallen off https://news.ycombinator.com/jobs. That's why you're seeing a week or two elapse between any of those posts.
Seriously. The author is bending over backwards to accommodate poetry from every direction, from the stupidest installation instructions I've heard, to "can't transfer from requirements.txt" to "it doesn't work well with docker but doable". Like what exactly does it add that's worth all this complexity? Make you a maitai every hour?
Vaqueros, Gauchos and Llaneros(Venezuela) probably have the same origin in horse riding country side people on the Iberian Península. But I doubt the Gauchos influenced the Cowboys since they are far, far away.
If you're not attracted to men, do you feel weird about being asked "so, what kind of guys do you find attractive?" Some of my guy friends who have done this exercise have found it's more gendered to them than they thought.
Thimerosal-Derived Ethylmercury a Mitochondrial Toxin in Human Astrocytes (2012)
Sure, they seem like that. But the study Chicago conducted showed that fines increased patron anxiety and were antithetical to the intended goals of library leadership in engaging their patrons.

So it actually may have actually been detrimental.
I would generally reach for conda instead of this, but they seem quite comparable in aggregate.

And, given that I've been trying NixOS lately and had loads of trouble and failing to get Conda to work, I will definitely give this setup a try.

(I haven't quite embraced the nix-shell everything solution. It still has trouble with some things. My current workaround is a Dockerfile and a requirements.txt file, which does work...)
It manages interpreters, not environments. So one environment can use python 3.5, while another can use 3.8.
Blizzard Entertainment's 10 Year Issue with In-Game Chat Spam
How is this not a controversial topic?
I think it really comes down to Python not having a chosen way to handle package management as well as Python being dependent on the underlying C libraries and compilers for the given platform.

Since Python did not prescribe a way to handle it the community has invented multiple competing ways to solve the problem, most of which have shortcomings in one way or another.

To further add to the confusion, most Linux and Unix-based operating systems (Linux, MacOS, etc.) have their own system Python which can easily get fouled up if one is not careful.

This is one place where Java's use of a virtual machine REALLY shines. You can build an uberjar of your application and throw it at a JVM and (barring JNI or non-standard database drivers) it just works. There is also usually no "system Java", so there is nothing to break along those lines.
Students and Professors Win Big Prize. University Takes It
I hear you—the front page only has 30 slots, and those 30 slots are by far the scarcest resource on HN. To burn one of them on an ad is a pain. Also, don't forget that we place Launch HNs on the front page from time to time (https://news.ycombinator.com/launches), especially when YC is in session and with a traffic jam towards each Demo Day. There have even been two of those plus a job ad on the front page at the same time, though that's rare—only once, or maybe twice, IIRC.

It's just so reasonable for HN to give back to YC in exchange for funding it, though, that I don't believe the bulk of the community has a problem with it. It seems to me, if anything, on the modest side.

Writing code to make the browser drop the job ad and slide #31 up to #30 isn't hard. The code for HN's 'hide' feature does something similar already. That's probably your best bet.
Right. Sorry for the confusion. The post hit HN while I was editing.
Depending on the subculture in question, "guy" doesn't even need to be a person. In others, it definitely refers to a male.

Know your audience.
I mean isn't it possible that it is very poor due to rampant corruption?
I could be mistaken, but IIRC, Neanderthals had larger brains than homo sapiens sapiens even when taking body mass in to account.
Great Apes Pass a False-Belief Test
On the other hand, buying toilet paper at whole foods sucks.

(maybe that will change - post amazon, I noticed whole foods selling cheerios)
They probably have significantly better raw data sets than even their competitors like AQR or Two Sigma. Satellite data on parking lots. Credit card swipe statistics. Parsed and structures full financials. Supplier consumer relationships. Analyst data. Short interest data. Options activity. Fund holdings. ... Everything you can possibly think of. All integrated into a single streamline analytical and modeling technological infrastructure.

So yes to us little people it is insider trading. But I’m 99% sure it is real alpha at the core.
I suspect HN users are likely to be either a) willing to pay or b) able to circumnavigate paywalls by using private windows, blocking cookies, disabling javascript, or whatever else works.

I wonder how long before paywalls aren't so easy to get around.
I suspect, but could be wrong, that the disconnect here is bc devs who are making open source packages need to make sure it runs on multiple different versions of Python.

If you're working on closed-source code or have tight control of your environment, it's enough to develop and run on a single version, rendering pyenv and whatnot unnecessary.
Yes a turbine engine is a internal combustion engine, specifically a Brayton cycle engine vs a Otto or Diesel cycle piston engine.

Turbines are not used in cars because they have high rpm and low torque requiring large transmissions to gear them down properly. They also are not very responsive to throttle requiring spin up, very noisy and have have an abundance of hot exhaust to deal with. You can't muffle them as easily.

Series hybrid diesel electric trains are actually less efficient than diesel mechanical drive trains. They are used because of the need for precise traction control to prevent wheel slip, they sacrifice efficiency at speed though to attain it.

Double conversion from mechanical to electrical back to mechanical will always be less efficient than a straight through mechanical drive once up to speed, this is why nearly all hybrid cars are parallel and go full mechanically coupled at highway speed.
> So at what point do we start seeing the benefits of this "replicator" (in the limit) technology?

When we stop consuming more and more. For the most part I could work a single day work week (at 1/5th of my comfy developer salary) and live a lifestyle better than Russell's, that easily covers all basic needs (including modern ones like internet access) with two exceptions.

The first is the sin taxes (cigarettes and alcohol), these are avoidable but the latter is the sort of thing that makes life worthwhile. These are easy enough for society to eliminate if we want to decrease work hours.

The second is housing costs, this is extremely complicated but suffice to say that we aren't at the optimum of what society can achieve, as evidenced by the fact that we've gone backwards in many ways.

If you minimize pointless consumption, live modestly and as a society eliminate those two problems then an 8 hour work week seems achievable.
As the Instapundit has it: https://pjmedia.com/instapundit/?s=%22i%27ll+believe+it%27s+...
There is no going back, our entire way of living is unsustainable, climate change is going to happen. Good news is, planet Earth will be fine, give it a few thousand years, it has survived far worse.
Pipenv has been nearly completely broken for a year without a release. Installing from scratch rarely works without providing a full path to the python you want to reference.

Now that poetry also manages virtual environments it’s far and away the better choice.

Caveat - Heroku doesn’t understand pyproject files yet, so no native poetry integration. Heroku are working on this.
If you're interested in this sort of thing, it's worth checking out https://drill.apache.org/

It lets you query multiple databases but also join between them. Or say, translate your mysql table to a local csv file. And if you need it to be faster you can deploy to hadoop.

worth checking out anyway, I used to use it a lot before i started on Apache Spark.
>A semi-common beginning programmer's exercise is to write a program that numbers the lines in a text file. The naive solution will use O(n) space, while a bit more thought reveals that this can be done in constant (to be really precise, O(log n) where n is the number of lines in the file) space.

I guess I'm misinterpreting the task, because I'm having trouble seeing how it's possible to access each line in a file without it being O(n) at a minimum. I understand O(log n) to mean that not every data point is "accessed" due to the way the data structure is organized, lines of a file in this case, but to me it appears that not every line would be prepended with a number. My instinct is that there's a lot going on with new lines/line breaks in files that I'm not aware of, so I'd really appreciate any reading material on the subject to help me better understand this. Thanks!
https://outline.com/BX3pHp
What you keep seeming to miss is that you only charge the amount you drive. If you drive 50 miles you can charge on a level 1 (120V 12A = 1.4kW) in 8 hours while you sleep. It does not matter whether the car is a Spark EV (18kWh battery) or a Tesla P100 (100kWh battery) because you only charge to replace the amount you used up, not the total amount the car could hold.
The CA law is 1.5x for the 8th-12th hour and 2x for the 12th hour plus [0]. Federally overtime is only required for non-exempt employees working more than 40hours a week, but other states have shift limiting laws as well.

https://www.dir.ca.gov/dlse/FAQ_Overtime.htm
Using the internet is disadvantageous to us
How many possibilities does that leave? You might have just given your real name to a sufficiently motivated researcher, assuming what you said is accurate.
You are using O(n) to measure the actual performance of an algorithm in practice. This is not the intention of O(n) -- rather it is used to classify functions into groups depending on "how they grow" with respect to the input as it goes to infinity. This is good because different instructions, or sequences of instructions, will perform differently across CPU architectures, for example two CPUs might have different cycles-per-instruction. Big-O makes claims independent of the hardware that remain true forever. Just because algorithm A is O(n) and B is O(n^2) does not mean that A will always outperform B.
If it's just a simple display to the user saying "this website generally loads slow, dont worry", I'm ok with that, I often wonder whether some sites are just bloated or it's my internet connection.
Hmm... I might just try this
We actually do, at least on a per-company basis: https://news.ycombinator.com/item?id=21510998
Chunking and streaming are different things to me. Chunking means you get to process multiple rows of data at the same time, usually useful to take advantage of SIMD. Streaming means that the data is accessed in a single pass: once you compute the effect of a given row on your statistics, you never have to rewind to see it again.

Many modern performant solutions will use both, but they're not the same thing.
Along those lines, but more than that:

https://news.ycombinator.com/item?id=21511026
Are they carrying proper OTC medicines now? I don’t even bother looking because it’s mostly herbal and pseudo medicines. I just want some freaking cold medcine but noooo it’s gotta be “natural”.
I'm glad you like it. I was going to remove it at one point, but a two-initialed founder of this site who shall remain nameless protested strongly against that idea.
Maybe users will respond that way, but that's still a good outcome. Giving users a better idea about what to expect so they can make more informed decisions? Great!
If this were truly journalism, we'd be reading a bit about Chelsea Clinton, the Obama daughters* and most of Hollywood.

They managed to torpedo the Trump family, and the (hated by the far left) Bidens as well. If this were real journalism, we'd hear about some favorite lefties as well.

* Fun fact: In February 2017, Malia Obama started an internship for Harvey Weinstein at The Weinstein Company film studio in New York City. Good luck reading about that one in an article like this!
That sounds like a typical retail job. Up to 10 hours doesn't mean it will be normal, it just means they might ask you to work over when your typically flaky co-workers don't show up.
Who are these managers with nice even 1 hour blocks? My time gets chiseled down to 30 and sometimes 15 minute blocks, with rampant double scheduling.
I tend to agree with you, but I'm compelled by the argument that organizing your productive time in a way that minimizes the impact of context switches will make your programs much better anyways.

There might be a good reason why code developed under extreme focus also tends to be inscrutable to others.
Bertand Russell, ahead of his time in his socio-political musings, as with foundations of mathematics.

Although the essay begins as though he is advocating for leisure for some privileged section of the society -- and one might especially suspect his position is thus given he himself was part of the old aristocracy by birth -- he explains not only that idleness being a collective right will elevate the society but also that it can be achieved. The time to have achieved it, in my opinion, has already passed and yet we continue to be "foolish", as he puts it.

His argument is so cogent that the following lines seem completely within reach for the society and paint the idea of paradise"

>>> In a world where no one is compelled to work more than four hours a day every person possessed of scientific curiosity will be able to indulge it, and every painter will be able to paint without starving, however excellent his pictures may be. Young writers will not be obliged to draw attention to themselves by sensational pot-boilers, with a view to acquiring the economic independence needed for monumental works, for which, when the time at last comes, they will have lost the taste and the capacity. Men who in their professional work have become interested in some phase of economics or government will be able to develop their ideas without the academic detachment that makes the work of university economists lacking in reality. Medical men will have time to learn about the progress of medicine. Teachers will not be exasperatedly struggling to teach by routine things which they learned in their youth, which may, in the interval, have been proved to be untrue.
The IPCC's 2014 AR5 WG3 report is the latest to provide a detailed mitigations response. That would be the concensus view. There are a wide range of others.

I've only just now looked it up, so while I can't answer your question directly, it's all but certainly the most comrepensive concensus answer you'll find.

https://www.ipcc.ch/report/ar5/wg3/

For the Paris accords: net negative emissions by 2050, now 30 years away.

https://en.wikipedia.org/wiki/Global_warming#/media/File%3AM...
I'd rather work with an employer who values honesty.
There are also Launch HNs, which get placed on the front page, mostly when YC is in session and especially towards Demo Day, when our inbox piles up with founders handing their papers in before the deadline.

https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...
You're talking in generalities. Even if it's not the majority of people, some people will change their lifestyles, or at least parts of it (buying eco friendly cars, using less AC, eating less meat, etc.) But in general, you're right, most people won't do enough. That's why there need to be institutional changes, like investments into green energy/tech and incentives for companies to pollute less.
Now. Work on solutions now. There are lots of them and we should all be doing our part.
The Xinjiang camps appear to be nearly identical in purpose and behaviour to the original concentration camps used by the British at the end of the Boer war[1].

The Chinese ones do not seem to be doing mass execution, unlike the Nazi ones.

[1] https://en.wikipedia.org/wiki/British_concentration_camps
"Damn, it, I have PEOPLE SKILLS!"

But seriously, it seems to me sometimes, that having a "meeting guru" would be truly helpful sometimes... a SPOC that can filter all meeting requests by the email / 5 minutes / required vs inflated attendees / agenda / etc criteria before they even happen.

Most of those questions aren't detail specific, so someone well versed in asking them politely and choosing the appropriate action could save so much time and attention suck.
Inverse Conway's Law; organizations are encouraged to create isolated, disconnected teams in order to benefit from modular maintainable code with clear and distinct interfaces.
Just as a thought experiment, suppose the best prediction that could be made right now would see the earth's carrying capacity drop to under a billion people in the next 50 years. What would you expect to see different, in media, in papers in top journals, in public discourse, than we see right now? I think the world might look just as we see it today.
It won't necessarily be obvious which devices or apps are doing it.

One of the reasons DNS over HTTPS has gained popularity is because it's not possible to MitM it (easily, at least). That's kinda the point of it's existence.
Looks like this is an idea that resonates with people here! A cheering antidote to many other "Sell your whole life away working and working on businessy nonsense to make rich people richer and maybe, maybe get rich yourself" strains of posts popular here.

[On edit: Oh, just noticed this comment itself duplicates https://news.ycombinator.com/item?id=21510442]
> 100ms with how many responses per second

As always, it depends. Benchmarks are cool, and yes we know that Rust and Go will always be faster than Ruby out of the box. Once the number of responses goes up, you throw caching at the problem. But the benchmark says

> The requirements were clarified to specify caching or memoization of the output from JSON serialization is not permitted.

> the table has 12 rows

Which is low and should be quick regardless, but regardless of your tech stack if you are creating a "modern" UI, you handle this update asynchronously with JS anyway, and if you're not, do you really care about sub 100 ms responses?

If you want performance out of the box, yes you will use Go, but like I said earlier, you use a hammer for nails and a screwdriver for screws. If you want performance and type safety, you choose one, if you want faster prototyping and a more mature web dev ecosystem, you choose another.