skysight-inc/HackerNews huggingface dataset:
Some background, I work for an ad-tech startup. We provide workflow and performance optimizations on top of Facebook and Twitter ads.

A few years back we managed to draw the attention of a pretty big agency who at the same time was in the news because one of their employees killed themselves over the work pressure. Now, this company has ten thousands employees so we never gave it much thought, but later we learned that the account we scored was actually the account of the employee who killed herself. The employee was of a similar age to me at the time, and the company approached us the day after the news of the suicide broke.

Although it's not in similar vein, it made me feel like shit for a few good days and I still think about it whenever the Agency is in the news or someone mentions it.
If you are already doing Big Data / ML / deep learning work in Spark or Dask, Arrow is (with caveats) more or less a drop-in performance optimization (because it's optimized for in-memory vectors) and complexity reducer (because it does all the interop between JVM, Python, TF, etc)

So by itself it doesn't necessarily introduce new use cases that weren't there before, except where performance was a bottleneck.

But we're talking like 500x performance increase on workloads vs ODBC, so night and day for a lot of data scientist pipelines.
I'm not a lawyer, but I think we're entering into a legal gray area. There are the existing frameworks of copyright, parody, free speech, slander, libel, etc. that are all somewhat tangential to this.

I believe (I'm not certain) that celebrity voice impersonation is legal as long as it is not used to sell or endorse a product.

Most models are trained on the original speaker's voice, but maybe only a little bit. Models might incorporate learning from many speakers. We might even be able to boil down a speaker representation to a small vector encoding in the future. It'll be interesting if we can capture the representation of a person with just a few numbers.

I don't think the legislature should be overly protective against machine learning. It seems obvious to me that neural networks will play a huge role in creating entirely virtual musicians and influencers. We're already seeing this start to happen. r9y9 on github has published some models that rival Vocaloid in lyrical ability.

At the same time, we don't want these techniques used to commit fraud, slander, or have them be used to falsely accuse someone of committing some act. These are things we might need new legal protections for.

But I don't know what I'm talking about. I'm not a lawyer.
Lat-Long level geo-headers on AWS CloudFront
I agree but I think the issue here is complexity. This app is built with Swift, probably because most developers prefer high-level languages like that over system-level languages like ObjectiveC. Unfortunately, OS vendors typically don’t provide interfaces for high-level languages in their OS machinery unless strictly necessary. Can you actually write a Preferences panel in Swift? I wouldn’t be surprised if the answer were “nope, Obj-C only”.

It’s not even an Apple thing, Windows has been the same for a very long time - remember how browser extensions “exploded” when Mozilla made it possible to write them in JS? IE forced you to C++, dramatically restricting the number of developers.
I’ve been part of workshops run by key contributors, as well as seen consultants brought in to try to optimise code using their open source code. There are a lot of ways, but they usually aren’t as direct as “normal” employment.

There’s also another category where you get hired by a company using your code to help drive and prioritise enterprise features in the project. I’ve seen plenty of internal forks of big open source projects where contributors are actively working and trying to upstream the internal development.
He has been cancelled. He no longer has any TV shows. He can't write for TV. It killed pretty much all of his projects. So he can do standup. So what? It's the big corps that cause the cancellation effect and they don't control all the little standup venues. If Louis hasn't been cancelled then no one has which I am guessing would probably be your next argument. I have noticed a trend from the left to try to deny the reality of it which I find really strange.
I worked at a company last year (specifically their RPA sector) that one of the projects we got was create a "robot" to automate certain tasks within a client.

Later after we delivered it, we learned that project alone was the reason the client cut 700 low level positions. A single "robot" could do in an afternoon what 700 people did in a week. (Was/is a pretty large company.)

The words from my manager still echo in my mind: "If we think of the "ethical" aspect of it, we wouldn't have our own jobs."
> It would be difficult to just stumble on a system like Simple-sub without that guidance

Actually, I'm not sure it would be that hard (Simple-sub author here). If you look at the core of the algorithm closely, you'll see it's really not special: you create type variables, add constraints on them, propagate the constraints, and that's mostly it. In fact, it's perfectly in line all previous work on subtyping inference, going back at least to Pottier's 1998 thesis — that thesis already had many ingredients of MLsub. The three big things MLsub brought to the table, in my opinion, were: 1. the idea to coalesce constraint graphs into compact type expressions, which are easier to read and understand; 2. using the algebraic insight to develop an elegant and simple principality proof (but I'm not sure it's really worth it; AFAIK the proof sketch I provided would also work); and 3. to provide a simpler subsumption checking algorithm. Specifically in terms of pure type inference (so, ignoring points 2 and 3), it's possible to imagine making the leap to compact types without the algebra insight. But this is just speculation, and it's of course impossible to tell a posteriori.

> If you want to add subtyping to a language with a more sophisticated type system, or add new features to a language that already has subtyping

In that case I think Simple-sub is a good place to start, as it does not presuppose all the algebraic structure that MLsub does; Simple-sub shows that principal type inference really doesn't need much at all form the type system. Now, you're free to add more structure to your subtyping lattice if you want to be able to simplify types more, and if you want to make checking subsumption easier, but the choice is in your hands.

> you should probably take a long hard look at it from an algebraic point of view to make sure they interact the way you want

That's still definitely true!
Does this surprise you? Interacting with my doctors has never given me the impression that they stay abreast of current literature, and their employment doesn't seem threatened by the deficit.
Not sure, plenty of individuals have coaches to keep them on track. I personally do better with accountability systems to keep me on track.
AWS VPC Tutorial
One of my early-career jobs was working for an ISP that old fogies may remember called Slip.Net. This was 1994, just before everything took off in the commercial Internet space. There were a couple gray area things that resulted in me being eager to leave that particular company.

The first was that they were a "free" ISP. The way they made money was that all their POPs were in facilities taking advantage of the rules around long distance termination fees. Effectively you could set up a CLEC in a corn field in Iowa and as long as you could get a lot of people to call you, you could make money from the Bells. Free Internet access, but a long-distance call. It was probably a good deal for people who didn't have a local POP anyway. However, it led to a weird incentive -- you wanted to keep people connected.

In order to sign up for the service you had to dial into it. In order to create an account (these were regular shell accounts on SunOS systems mostly -- totally insane by today's standards) we had to have an entry in /etc/passwd and of course you needed their login to get an entry there. We had worked out how to take their details and create an account, but you had to disconnect to log back in as that new user, and we lost money every time someone disconnected. The solution was obvious -- please modify logind so that you could essentially sudo from the "setup" user into their new shell right there in the existing session. Boy that was fun, and felt a little dirty.

It turns out the other thing people liked to do besides Internet dialup that would keep their computer on the phone for a long time was to download porn (you could argue they were doing that with their Internet dialup too). So of course the company ran many Wildcat-based porn BBSes out of each of their POPs. In fact that business came first. They flew me out to (somewhere outside of Toronto I think) to upgrade the access for a particular POP and asked me to load some CDs in the jukebox at the same time. I didn't think much of it, but when I got there I realized that these were all hardcore porn. I don't think there's anything inherently unethical about porn, but it clearly also didn't check the box on things I'm going to tell my mother about my job.

I left that job after about 6 months, but I liked it better than the one before it, where they weren't paying their phone bills and would regularly tell their customers that they were having "technical problems" while they got SBC to turn their access back on. I think I lasted most of 3 months there.
I have never heard of third place before. Its a really cool idea. Its something that I have missing from my own life but I can really see the value. Do you think that you have a small social network of friends due to a lack of third place in your life?

Let me know if you find the HN article on the decline
I know about a dealership that sold 50 Zoes in a day last month. And they are located in a small city in Germany, almost rural. I can only imagine how much they are selling in bigger cities.
Projects like homebridge cater to less-technical folks, so it’s no surprise that the support burden would be high.
No one who works from home has job security in a global market. Plumbers have job security in a global market.
> ...this sort of assertion is often thrown around with no data.

I think it's basically impossible to have "data" on why people work on OSS, on what their actual motivation is. All you're really going to get is anecdotal.

There are good reasons to explore ideas and participate in projects that extend beyond making pocket change through clickbait.
> "be smart and detect actual traffic for modifying the red light behavior in real time"

This is something I've been frustrated by for years. "Autonomous Cars" are hard. Autonomous traffic lights should be much easier. Here in the suburbs there are tons of stoplight intersections between small residential neighborhoods and central arteries where cross traffic is fairly rare. There are sensors in the roadway to detect cars waiting but they are still incredibly slow to change as they seem to stick to minimum timers during most of the day. The crazy part is that one or two cars waiting to cross often wait two minutes for the apparent timer to expire and the light to change while there was no oncoming traffic the other way that would have been inconvenienced by an immediate change. The cross-traffic cycles are very short anyway because there's only a couple cars at most.

Even more perverse is the number of times I sit waiting two minutes with no approaching cross traffic in sight from either direction, then when some cars are finally approaching, then it stops them with a red so I can cross. A semi-smart system based on a Raspberry Pi-level SBC with a camera would have had me on my way while no one was coming. It seems like in the aggregate camera-based autonomous traffic lights could save enormous amounts of fuel and time.
"for interchange" in data science might well mean data on-the-move rather than data at-rest: i.e. a pipeline in two stages, step A in python and step B in R. The data is exchanged (relatively) quickly via disk, and speed beats compression.
How to Writ Advanced SQL Episode 4 – Rolling Sums and Analytic Clauses
Here's a list (and as mentioned in my comment, Apache Spark, Pandas, turbodbc)

https://arrow.apache.org/powered_by/
The solution is to make media literacy and logical fallacies a required course in democratic basic education.
A happy accident? I could do that.
Thanks! I kind of want pg to see :)

If he thinks this is egregious, I'll take it down.
Ask HN: What have been your experiences with Pair Programming?
Hate to be that guy but I can't participate in this discussion due to javascript being required for the landing page.

As an outlier not running javascript, I'm reaping what I sow, but it would be nice to me and others in the same boat if projects make their landing page viewable without the need for javascript.
related, but not the third place submission:

https://news.ycombinator.com/item?id=20468767

https://news.ycombinator.com/item?id=20547295
Yeah. You can't just produce random white sound[1] to cover the signal either, because speech has enough redundancy to still communicate over a static-y soundscape. The term here is that white noise lacks "diffusion"--analogous to the ECB vulnerability (see the picture of the encrypted Linux penguin image on this page[2]). I can't think of a good way to provide diffusion for sound--a better cover might be to provide alternate signals, i.e. a few layers of random human sounds spoken in a deepfake-d version of the voice of the person speaking.

I'm skeptical even this wouldn't have vulnerabilities however, as history has shown us that cryptography which has not been formally proven is often broken.

[1] I'm using the word "sound" here to differentiate the noise in the auditory sense from noise in the "signal versus noise" sense.

[2] https://en.wikipedia.org/wiki/Block_cipher_mode_of_operation...
I've seen managers have over 100% turnover in 6 months and still not change their approach.
Locust Swarms Are Getting So Big That We Need Radar to Track Them
> Also the fact that my IQ drops by 50 points when someone is watching my screen and I look like an idiot.

I've heard this a lot, and have basically trained myself by rote not to hover over people's computers when we're looking at something together, but I still can't say I understand it. I don't know if it's an inarticulable phenomenon, but do you have some sense of what drives this and/or what it feels like?
The article involves a remote device watching the light bulb but it would also make sense to think about devices in the room as well.

Your device might have its microphone disabled, in hardware even, but I wonder if the ambient light sensor has enough gain to see audio frequency variations in room lighting. We already know hard drives and speakers and whatever else can act like mics for exfiltration...
I have such a project in my mind. What is required to start a similar project?
When I lived abroad I delivered my ballot to my nearest consulate. I understand they are just putting it in the mail, of course.
Thanks for clarifying that the plan is to stop relying on it :) Is there a specific place/issue/ticket to discuss this? If time allows, I would be interested in helping out.
Bandwidth is one of the things that gets significantly cheaper at scale. For most users, if they call a wholesale bandwidth provider the rates they get will be more than what a public cloud provider will offer. So it looks like a good deal. That's much more true than with something like hardware/compute where the differences between what you can buy a server for and what a big cloud provider can is less extreme. That's not to say Amazon or Google can't get better deals on servers than someone who just phones up Dell, but it's nothing like the savings you can get at scale on bandwidth. What's been interesting is how little competition there has been between the different public clouds on bandwidth pricing. That's starting to change and I'm proud of how we've pushed that at Cloudflare with things like the Bandwidth Alliance (https://www.cloudflare.com/bandwidth-alliance/). Oracle's cloud is also pushing on this (see Zoom's comments on why they chose the Oracle cloud). If you saw the margins that AWS gets on bandwidth you'd throw up in your mouth.
If the client could cut 700 low level positions with automation then they were probably treating human beings like robots.
Virtual Tracing by Correlating Anomalies
Not from that retailer, at any rate.
Plus the RORSATs leaked coolant all over the place, which is both a radioactivity and debris hazard.

But in any case, these are all problems that are both less likely with new designs (e.g. kilopower uses sealed heat pipes with no moving parts for coolant), and less of a concern when the reactors are either in interplanetary/cislunar space or are nice and buried.
I'd argue there are ethical issues in letting them turn it off. It makes the user less aware that the site they're using is accepting money from that ad source. It reinforces their bubble. And it overall makes them feel like the customer, when they're really not, which is deceptive.

If FB let users click that button, but secretly broke the functionality, then that's a different issue.
This is a major dealbreaker that it needs to be called out earlier.

Not only is this an interface you adhere to to use their service (incoming event, outgoing response), that type of coupling is fair and expected, but the underlying runtime is custom without full support for standard APIs?! What's the upgrade path? Can they port things over in a reasonable amount of time? Is it well documented what's supported and what isn't? Imagine developing against this and resolving these issues as they come up. Oof.

I'll use Azure or AWS.
That's quite a workload you've set for yourself. I honestly don't know how my doctors do even the basic stuff I see them do, like seeing patients and charting. When you have to see 4+ patients in an hour (this is too many!), it would seem to me that charting would be one of the things that ends up going out the window.

I also find it interesting that you go so far as to repeat your licensing exams. Is this common among physicians as a whole? Having known a couple of med students personally, these exams were usually seen as a hurdle to be overcome and a source of stress, but, I suppose it might get easier after a few years of practice. On a related note, I find it hard to imagine that, say, lawyers would routinely re-sit the bar exam for funsies.

Regarding CME, isn't that required to maintain licensure? Or, are you talking about courses above and beyond the minimum to keep your license?

And, BTW, I don't know who you are, where you practice, or even what your specialty is, but you sound like the kind of person I'd like to have be my doctor.
I'm explaining why sites that HOST but do not necessarily send content are blocked.

I've got no problem with their operation, but YOU are going down a VERY dangerous and slippery slope by saying I can't block domains that clearly host trash because they might host something else.

On my network I can block child porn, malware sites, scam sites and even entertainment sites like youtube. If you are running a service that mixes the content together, then you may be blocked by folks (like me) who don't have time to chase down every (free) subdomain you allow scammers to create.

That is my right. Period. Full stop. That is not censorship.

Folks here get censorship confused. The govt does virtually nothing to stop these scam sites - so they are certainly not being censored. I'm fine if govt does nothing, as long as communities of people can block these places.

And yes, if you run a site on the internet and don't make it slightly difficult for scammers to use your site to host crap, then other folks in the neighborhood will move the heck away from you.
I came up with a good analogy the other day for "cancel culture" as a renewal more than a destructive tendency, and it's an analogy baked into the name so partly intended despite easily forgot. We already have a "cancel culture": every season we cancel a few TV shows so new ones get a shot. In more than a century of radio and TV show cancellations we haven't yet run out of "fun", have we? We keep finding new sources.

This other sort of sociopolitical "cancel culture" seems nearly as effective (or not) as radio/TV cancellation: shows still show up in rerun in syndication sometimes, it doesn't stop (and isn't really intended to stop) people with tapes/DVDs at home from enjoying rewatches. Even early shows in TV show history were sometimes re-edited for syndication to remove jokes intended for a live audience that didn't always land or that needed a context that syndication could not provide. (Today sometimes shows going to syndication need re-editing because the show doesn't have the rights to original broadcast music.)

While there are of course extreme proponents of "cancel culture", a lot of it does boil down to certain forms of "audience" dissatisfaction and a request to maybe air a new "pilot", see if a new series is waiting in the wings ready to wow the audiences. That's not to take the "fun out of life", but to find new sources of fun in life.
Yes, I did. In the best case it's a happy customer and more money for the company. I'm a glass-half-full guy.
EU orders Airbus A350 operators to install drink spillage covers in cockpits
> Either Apple used to do a better job, or else developers did.

A bit of both I would think. When the Mac was a more niche platform the developer community tended to be more bought into philosophy and design sensibilities around it. And as the Mac has gotten more widespread in popularity, Apple has gotten less good at planning around power-user use cases or communicating how to handle them elegantly.
Can't one do this using protobuf, flatbuffers, etc ? What advantage does arrow offer here ?
That's an interesting point. I'm not sure how to measure that though. Also my guess is we have the sensors on for part of the day only, plus that's filtered heavily by your attention process, eg you can't read two books at once.
Just look how much safer racing has become since it's inception. And also at the same time, the sport has become magnitudes faster. There's no reason we can't have faster, more exciting, and safer all at the same time. It's just another challenge to the sport.
No, as far as I understand Swagger it's just a tool to document your API. I'm more thinking about some ways GraphQL is used/implemented.
Thanks Tyler! Do get in touch if you have specific feature requests. It's always interesting to hear our people who are very critical.
Easiest is to license it as GPL or AGPL, sell a commercial license.
Minor point. Its nice when people write URL's so that we can just follow as opposed to requiring mouse interactions to cut and paste.
Spark uses it under the hood to interop between PySpark and JVM
In my experience this is not 100% true. Many times you get involved on OSS to "scratch your own itch" be it a personal project from scratch or collaborating on somebody else OSS project by fixing/adding something that irks/needs you specifically.
Thank you for your kind comment!
Show HN: Your DevOps Control Plane, in Slack
Writing a file system from scratch in Rust
I'm also on Chrome (84) macOS, using the Craig Ferguson model.

I switched to Safari and Disabled CORS, but a 500 error is coming back now. So maybe the 500 response is the root cause, and the error handler is not returning CORS headers, masking the issue on Chrome.

Edit: by putting in a shorter input (sentence rather than paragraph) I was able to get a response.