skysight-inc/HackerNews huggingface dataset:
I've had to dive into the pandas code over the last year for a project [0], and my attitude has shifted dramatically from...

* old attitude: why does pandas have to make things so hard
* new attitude: pandas has a crazy difficult job

I think this is most apparent in the functions that decide what "[d]type" a Block--the most basic thing that stores data in pandas--should be.

https://github.com/pandas-dev/pandas/blob/4edcc5541ff3f6470f...

And then, for the ubiquitous Object dtype, often figure out which of the many possible more specific types to cast it to.

If you think that is easy, ask yourself what this outputs:

import numpy as np
np.array([np.nan, 'a'])

Lo and behold--it produces an array where the np.nan has been converted to the string "nan".

And yet

import pandas as pd
pd.Series([np.nan, "a"])

Knows this, has your back, and does not stringify it.

It also has a pathological fixation on when it tries to convert dtypes, since avoiding all the bad conversion outcomes is a relatively time intensive process (compared to e.g. creating a numpy array).

I realize things could be much easier in pandas user facing interface, but really appreciate the sheer amount of effort that has gone into its dtype wrangling.

[0]: http://github.com/machow/siuba
Let me put this another way.

Please remember that for the purpose of this discussion the receiver of the stolen goods and the person they are sold onward to are 100% innocent and nobody suspects them of being dishonest. If the receiver was in on it then this does not apply.

If someone stole 2 iPhones from you and sells them to a used phone dealer, who then sells those very 2 iPhones - your iPhones - to someone else, does the law require the used phone dealer to give you 2 other iPhones of the same model that he happens to have?

I believe, and perhaps I am wrong here, that it does not. As the victim you may well be happy to made whole with 2 other identical iPhones but that is not what will happen. Furthermore, the used phone dealer will not be required to pay you any of the money he received from the buyer of your phones or reimburse you for the cost of your phones.

If the dealer had sold only 1 of the phones then you would get that back and not have to compensate the dealer for his loss resulting in paying the thief.

If the items were such that you cannot prove you own it, such as with coffee beans, then you get absolutely nothing. You do not get some fair volume of them to compensate you.

That is how I understand the way stolen property is handled in general currently. I am not attempting to pass a moral judgement about it, merely describe how it is. (may not be so in all jurisdictions, but in CA/US/UK/AU/at least some parts of SE Asia)
This company has been unprofitable for ten consecutive years as a public company. That’s a record. I’ll hold my breath on people saying the future will be different.
Facebook has 30,000+ employees. There's no way even half of them are getting paid $500k.
I use iMessage every day. Most of my friends are on iMessage. Most of my family too.

The problem is our family group text. Some of the family is on Android. For the family group text, I use Hangouts because not all the messages go through if I use iMessage.
Thank you for your perspective. I strongly disagree that important truths are not being silenced, because I saw :multiple: stories about Gina Haspel get removed while under heavy discussion on the front page. I don't have any idea what other important stuff got removed, because there is no way to know.

I would have thought that a community of so called tech hackers and entepreneurs could demand some form of logs to know that censorship :really: isn't a problem.

> If you want to criticize HN, I suggest that you do it outside of HN.

That's truly awful advice. Disallowing criticism is step 1 of bad shit happening. At a minimum it stifles any possible improvement. And it's :always: step 1 of fascism.
On the street, mushrooms have a reputation for being much more gentle than LSD, and LSD is supposed to be more pushy (ie. LSD will make you face your issues, while mushrooms might just invite you to do so). But it's questionable how strong a dose of mushrooms those who maintain it's more gentle than LSD actually took.

Also, a long time ago I read of studies that showed that even experienced users couldn't tell the difference between all the various major types of psychedelics when they were administered in a double-blind fashion.

Something else to consider is that, as I've mentioned in another comment, a lot of what's sold as LSD on the black market actually isn't, and most people don't test their drugs. So much of what you read these days about self-reported LSD use is probably actually about other substances.
The US Is Losing Its Fight Against Huawei
It's not latency that GP was bemoaning, it's the sequential nature: two note-on measures cannot arrive at exactly the same time. If it was just constant latency, GP probably wouldn't mind (or criticize that, but it would be a completely different argument). Latency alone can actually be worse with real instruments because electrical signals easily outrun sound. (Nerve conduction velocity however is the worst of all, it's a wonder that we can function at all with that shitty data transmission)
If that is the case why were so many US entities victims of the collapse?

1. AIG
2. WamMu
3. Merrill
4. All the monoline insurers (MBIA etc.)

In my view, your comment is just one part of the (v complex) set of conditions leading to the financial crisis. There were also:

1. Substantial savings from mercantilist economies (China / Germany) driving a glut of malinvestment
2. A regulatory view that financial complexity always reduced systemic risk
3. A central bank seen as overly accomodative of speculators (the Greenspan put)

“The world has enough for everyone's need, but not enough for everyone's greed.” - Mahatma Gandhi
Dollars spent per staff member is a metric that should necessarily increase over time as automation increases. Fewer and fewer staff is required for all of the costs.
Glad to hear of someone using it for a while and who's impressed with it. I've only used it a very little bit but I was very impressed, I think I'm going to dive into it deeper now.
What frustrates me about the i<thing> and smart-phone ecosystem in general is the abject lack of integration with computers and, in the case of i<things>, the lack of sensible file system access, memory card slot, f-ing cursor control, and more.

Simple example: Why can't I pop-up my iPhone X screen as a window on one of my three workstation monitors (Windows 10) and run it from my computer?

Why can't I make calls with it from my computer?

Why can't I click on a phone number on a web page in Chrome and dial it with my phone?

Why can't I type a text message from my PC keyboard and send it with the phone?

Why can't I copy and paste onto the phone?

Why can't I copy and paste an image and send it with the phone?

Why can't I do the reverse and grab things from the phone from my PC?

Why can't I access a file system transparently (other than images)?

For that matter, why can't I transfer large videos?

Why can't I use my PC headset through the PC to communicate using the phone?

I mean, the thing sits there ALL DAY, 10 to 12 hours a day, right next to my workstation. If I want to do anything with it I have to go from a full size keyboard with arrow keys and all kinds of nice things as well as a beautifully efficient trackball to typing with one finger on a small screen and using the f-ing ridiculous select-copy-paste mechanism, etc.

If I want to send someone a link from my PC I have to email it or SMS it to myself, grab the phone, disconnect it from the charge cord (because it is inconvenient to do anything with it plugged in), go to SMS, email or FB messenger, copy the link, go back to wherever I need to go to send it, paste it and click send.

It's 2020. The phone should meld into the computer with full transparent operability. Same for tablets.

BTW, this is what I was hoping Microsoft would finally bring to life with Windows Phone. I was eagerly awaiting this one killer integration. I firmly believe that would have inspired, I don't know, a billion people world-wide to adopt Windows Phone. Instead they wasted time trying to make it an iPhone killer. It didn't need to be that. All it had to do is become symbiotic with a PC in all possible ways and it would have been an absolute hit.

Here's hoping they try again. If anyone from MS is watching, call me, I know exactly what you have to build (and you guys have no clue).
Most likely. They still seem to be hiring aggressively at least in Boston and NY
Not GP, but I think they are referring to https://github.com/jupyter/jupyter/wiki/Jupyter-kernels
One of the effects of psychedelics (LSD in particular) is extreme suggestibility. This was the reason the CIA was so interested in LSD in the early days. Basically, whatever setting one happens to be in when they do LSD can potentially become the basis of the rest of their lives. It makes you imprint easily. There was this phenomenon of so-called acid casualties: People did LSD in places like hippie communes or music festivals (the only places to acquire them) and 20 years later they are chaining their dreadlocks to a tree holding a sign that says Save The Whales. I think a healthy level of fear and reverence for the drug could go a long way. It certainly isn't harmless. When they made that antiquated propaganda about cannabis ("Reefer Madness"), the drug they thought they were talking about is LSD.

LSD was initially studied by psychiatrists as a way to temporarily simulate schizophrenia. Psychiatrists took it themselves to get a better perspective on what their patients were going through. There are stories of this effect not being temporary in some people.

I doubt this time we will see Timothy Learys. I would liken the Timothy Leary era to the 1999 dotcom bubble. It was something new that people didn't know what to do with. Both sides exaggerated. Majority opinion overcorrected. Now we can look at things realistically. We have the advantage of research and decades of people using it. It won't make you enter nirvana. But it also doesn't belong in the same category as drugs that make you break into people's cars.
Businesses are even more neurotic and irrational than individual consumers.
I think for the vast majority of people (no complex investment strategy, pay bills and go on with life) home ownership is incredibly valuable, both for stability and security, as well as for a decent investment to leverage later in life.
No one makes you suffer through anything. You can’t get push notifications without specifically opting into them, and you can disable them forever for any app with about 3 taps.
> it's quite similar to the new JS anonymous fn declaration (x => x + 1), or maybe the inspiration is reversed.

Yup, that family of syntax descends from Standard ML.
bcachefs is looking promising to me. I hope that it doesn't unlearn any of the lessons we've learned over the years from ZFS, which is itself excellent in many ways.
It's also interesting to note that many on-line maps of China (google maps for example) are shifted off of their actual locations by a few hundred meters.

https://en.wikipedia.org/wiki/Restrictions_on_geographic_dat...
I'm researching ways to scale deliberation and qualtiative decision making in the number of participants. I think this is the base for making politics work and tackling big wicked problems like climate change. It's slow, since my time is limited. But talking with lots of interesting people about ideas and approaches is promising. If you're interested to talk, please contact me.
Newly released satellite data reveals the patterns of record warmth in 2019
Most of that is being consumed on smartphones, I would assume.
Discussed at the time: https://news.ycombinator.com/item?id=17044518
OSC is a message transport protocol. It describes how to packetise messages, but not what they mean -- it doesn't define an application-level semantics. This is both an advantage (making it flexible, and malleable to requirements of ad-hoc projects) and a disadvantage (places a limit on seamless interoperability between COTS hardware). In general, OSC needs either (a) the sending and receiving endpoints to a priori agree on an application-level protocol (message schema), or (b) some kind of glue/mapping layer in either the sender or receiver that can translate and map schemas. Such a mapping layer is easy to construct if you're using a programmable environment. OSC has support in pretty much every programming language and many music environments and, like MIDI 1.0, is a viable DIY protocol.

By contrast, MIDI (both MIDI 1 and 2) are flexible application level protocols. For example, among other things, MIDI 1.0 describe schemas for musical notes, parameters, transport control, and time synchronization. Built-in application schemas allow devices that fit the application model to communicate in a relatively seamless way. I believe that MIDI 2.0 provides a more extensive schema, that includes (for example) device discovery and capability queries, and removes some limitations of the old schema. I'm not familiar enough with the details of the final MIDI 2.0 spec to say much more than that.

As I recall, some of the features of MIDI 2.0 (e.g. capability queries, discussed elsewhere on this page) were proposed for an "OSC 2.0", however the fine people at CNMAT who produced the OSC 1.0 spec didn't have the resources to sponsor 2.0 development, and no one else stepped up. In contrast, the MMA (MIDI Manufacturers Association), who sponsored the 2.0 spec, have all of the major music corporations as members (e.g Roland, Korg, Yamaha). That said, as I understand, the MIDI 2.0 process was open to anyone, and I know of at least one independent developer who was involved.

Will they compete? I suspect that the situation will continue much unchanged: commercial hardware will support MIDI (1 and/or 2), and as is currently the case, few commercial music devices will support OSC. OSC will likely continue to be the protocol of choice for custom projects using custom hardware, software and application schemas. Perhaps with time, as the tools improve and we get API support for MIDI 2.0 in operating systems and embedded libraries, it might become easy enough to develop MIDI 2.0 software to choose between OSC and MIDI 2.0.

Edit: clarity.
That's a good question and really puts it into perspective. From a company-centric focus, and excluding things like "eat food", I thought of:

Google Search/Gmail/Android

iPhone

That was it.
So buy a cheap USB isolator ala https://www.aliexpress.com/item/32965730354.html ?

Or do you need High Speed (480Mbps)?
Headcount 45K. Wow! It'd be interesting to see a breakdown of what they're all working on. (I'm not criticizing)
I have this router and set up the wg interface but got stuck at how to route all my home traffic through wg. Any recommendations on how to troubleshoot this part?
Nvidia and AMD are also hyping 7nm process to the enthusiast market where it'll propagate onwards.
Would you rather take cold showers every day for a year or catch the common cold a couple of times a year? I'd rather catch the common cold...
https://news.ycombinator.com/item?id=22180166
Fliping bad publicity level 9000
Does this do live process replacement too? E.g. transition smoothly from old web server to new web server while still handling requests without downtime.
I read it as "they didn't continue long enough to get to the benefits, as we did", i.e, they already reached the diamonds.
I don't think using data as input to an algorithm necessarily breaks copyright law.

I can read a book to post my impression on it somewhere right? I can read it and say "it was beautiful" on twitter.

I can then automate my "taste meter" through machine learning, it reads a given book character by character, and spits out what I'd think of it if I actually read it. Then posts it on twitter, says "it was beautiful".

Did I break copyright law? I don't think so.
A quarter of that is CapEx alone though, so it's not about staff numbers despite the headcount growing relative to revenue.
Suggest Less Music Like This works just fine.
Due diligence is not sufficient in the interesting cases. If exchanges instituted a blacklist of known ransom payments, for example, ransomware authors would just wait until the coins have been changed into some other untraceable form before releasing their hostages. Blacklisting the transaction in time to do any good would be the same as not paying the ransom. Reporting the address after the fact can only harm innocents several stages removed from the ransomers who could not possibly have known that the transaction was tainted.

The only reasonable solution is to track down the actual ransomers and make them pay for the damage they caused. Dragging other parties into this can only make things worse.
I wonder what Neil Young thinks about Raspberry Pi, since you can get some really good DAC hats for it, and they're super cheap (especially compared to an Apple laptop or his own products). How does a Raspberry Pi Zero with PHAT DAC or similar compare to his product?

There are a lot of great USB input/output devices that don't have the limitations he's talking about. Most professionals don't use built-in consumer-grade audio hardware for anything other than system beeps and whatnot. He has a product to sell, which is probably why he omits that in his anti-Apple tirades. Just a guess, but this isn't the first time he was harping on that subject.
I've been waiting for this! My friend and I were starting to doubt it would arrive.
And even iPhones are only about 10% of the world (728 million versus 7.7 people on the planet).
Forgot to mention a potential problem with WireGuard, server keeps the list of clients' virtual IPs (AllowedIPs used for routing/ACLs), not ideal for VPN service providers in terms of privacy.

It's not a problem for overlay network (e.g. Nebula) though, as it is considered a `requirement`.
Thanks. As an example, as I mentioned above, stories about Gina Haspel were unceremoniously dumped directly from the front page while under active discussion, at least three times in a single day.

Any conversations here about mass surveillance, Snowden, Assange etc are chock full of misinformation and smears. Those comments are rarely removed, so I don't buy the 'that story doesn't fit in HN's remit' narrative.

My major gripe is more general though: How can we call ourselves a community of hackers and entrepreneurs if there is no space whatsoever for critiquing the forum itself?

There is currently absolutely no accountability here whatsoever. If this community were healthy I don't think it would be tolerated - instead people don't even see the problem.
Do you have a favourite solution for this problem?
Ticket revenue is the majority of total revenue, while concessions have a much higher margin. For the last quarter with published results, AMC's gross profit on exhibition exceeded that of F&B. ==> http://investor.amctheatres.com/Cache/1001258324.PDF?O=PDF&T...

MoviePass sent additional people to the theater --> additional concession sales + additional ticket sales

AMC A-List customers occupy prime seats that would have likely been sold anyway --> no effect on concessions, reduced ticket revenue
what does this have to do with Coronavirus?
5G may hit 1 Gb/s peak, but I'm 100% sure that the major US carriers will throttle the crap out of it so that you don't get anywhere near that. I'm on Verizon in a decent sized city, and any streaming is throttled heavily. Speedtests work fine because the carriers know how to game them. But actual throughput on cellular sucks.
Show HN: Student Happiness Ranking for Universities
It's "ingredient branding" now. I think the foundaries are becoming the "ingredient" more consumers and looking at, similar to how Intel famously pushed their CPU as the important ingredient in PCs. I think it will be a very good decade for TSMC/Samsung/GF(?) similar to Intel's 90's/2000's.

https://en.wikipedia.org/wiki/Ingredient_branding
I've found this to be the right thing to do for several reasons.

1. Music does not improve my concentration in the long term. It will help for a few hours and then make it harder to focus after that.

2. Headphones make me less approachable at work, and I want to contribute to a positive team culture by being easy to chat to. If I need to buckle down I will work from home.

3. Headphones make it much more tempting to watch youtube, or listen to podcasts in the background. Without headphones I find it much easier to keep myself on track.

4. Most importantly, silence at work makes me appreciate music a whole lot more when I do listen to it, because it is no longer simply background noise, it feels worthy of attention. On top of that, I am more capable of listening to more demanding and more rewarding music.
Just to give an example: a 30 year mortgage for $300,000 at 4% is about $1400 per month where a 30 year mortgage for $100,000 at 17% is about $1400 per month. That can explain a 3x multiplier in the home price to income ratio assuming that people purchase based on what they can afford monthly.
I often wonder how Tesla will make use of Starlink. Such a huge data stream up and down will enable all sorts of interesting things. Maybe each car won't need a brain, maybe one huge brain will drive all cars. Sync all the cars up, make them act like a single giant distributed being.
Restrictive governments in coastal cities (Boston, NY, SF, LA, now Seattle) as well as a few places where people, often retirees, are asset rich but income light (N. Arizona, S. Florida, some parts of Colorado) are limiting nationwide growth.

It is a shame that there are no national supply-siders in congress who are willing to to 'encourage' coastal building.
Both statements are true. The satellites are visible if it is dark but it they don’t interfere with enjoyment of the nights sky.

They cross over so fast it’s basically like looking at planes, but they are much further away than planes so you have to really look to see them.
The Chicago Manual of Style which is pretty much the authority in the USA says you do apostrophe-s for all possessives even if it ends in an “s”. So “Ross’s” if it is a singular Ross.

But if you’re describing a family possession, it would be Rosses’ as is possessed by more than one Ross.
Reasonable relative to income is what I'm talking about.

If you're able to get total comp from 200k -> 400k and save 50% of that or more per year into a total market index fund for ten years that's pretty good, especially if you start at 21 or 22 out of school.

The economics make sense even when you ignore the other benefits (great environment for cycling, running, general outdoor activities - huge amount of smart people to learn from and work with, huge amount of companies hiring, startup opportunity, high quality food, etc.)

It's still a shame though because if Prop 13 was phased out and housing was built we could have all of this without having to waste huge amounts of money on overpriced, run down, tiny little houses, but that's Moloch [0] for you and local NIMBYs operating in their own self-interest.

[0]: https://slatestarcodex.com/2014/07/30/meditations-on-moloch/
Why were they able to meet a run rate or 500k cars a year in Q4 of last year and not sustain it if their factory was maxed out? And why would they claim in projections that their factory was capable of producing that if they didn’t meet that?

Companies are rarely production constrained. Many claim they are, but the fact that Tesla sales in their two largest markets declined doesn’t indicate to me that production is their number one issue.
In hot markets you see a lot of cash buyers because they don't want to lose the deal. Some will then finance afterwards, and a lot of them are flippers who will sell the house a few months later.
Indeed, it isn't your employer's business what or whom you donate to. But the more straightforward answer is that they are likely required to ask by law (possibly subject to other criteria).