skysight-inc/HackerNews huggingface dataset:
Despite only occasionally hacking around with array programming languages, I have always enjoyed the terse syntax. But I admittedly find weird syntax somewhat engaging.

I have wondered what was happening with statistics in the larger group of array languages. Do other HN readers know of J, Q/KDB+, Klong, or others in use by teams outside of the normal financial folks using Q/KDB+? I'd be quite interested in hearing any stories from the business world where it isn't a "lone hacker" situation, but rather even a small group of programmers were using array languages in production situations.
paging dani fong to weigh in on this....
As I’m curious, are you using Android or iOS? I can’t prove it, but I find it suspect this happens on iOS, but I know from first hand experience it’s technically possible on Android.
They're listening, but not to your voice or with a microphone.

Facebook is listening to your data--to all of our data, all at once. They have locations, searches, clicks, messaging, photos, hashtags, and any other form of browsing patterns for everyone in your country, everyone in your neighboorhood, everyone in the same room as you.

They have enough data with such advanced analysis that on occasion they can get really close what you're thinking/doing without you explicitly telling them. They're doing this frequently enough to creep a lot of people out and they're only going to get better at it over time.

What we have here is something like Turing test for privacy: a sufficiently advanced amount of data and analysis will be indistinguishable from surveillance.

It's simply unnecessary to listen with a microphone.

Edit: found this slide from F8 in 2015 where they said they store 300PB and process 10PB (with a P) of data per day https://www.instagram.com/p/0tUjrQKH6R
Not really... these days 20% downpayments are the norm. I know several people holding off purchases because they simply don't have downpayment. Higher home prices reduces number of potential customers but right now we have so many of them that reduction doesn't matter and margines are much higher on higher end.
There are some other knobs that NVIDIA will surely try (has surely tried?) to tweak as well, such as making the consumer devices deliberately less power efficient, fusing off chip features which make compute workloads more efficient, or sabotaging the drivers (either in general or on a per-application basis).

With disks there was always just as much pressure on the consumer side to keep energy down, cost down, and capacity up, which means that there was no natural segmentation, and no straightforward unnatural segmentation.
"We don't gather data using microphones"
> Not every distro has -dev packages to install headers.

Really? I would be surprised if every distro didn't have a mechanism to install the headers and static libraries for all of its dynamic library packages. How would the distro's own build process work otherwise?

> But the bigger issue is version requirements mismatches.

This is the killer. Distros are based on the idea that there should be only one version of any package installed at once. A development package manager needs to be able to handle many.

This feels like it should be relatively straightforward to add to distro package managers, though. You would need a package-space concept analogous to a container - a consistent set of packages separate from the host's, and some way to run a build process within it. So i can say:

dnf create-pkgcontainer ~/dev/myproject
dnf --pkgcontainer ~/dev/myproject install zlib-devel-1.2.8

Then inside ~/dev/myproject i have some sort of metadata listing what is installed in that container - say, a bunch of symlinks to pkgconfig files, a ld.so.conf and a ld.so.cache, etc. Then i can say:

dnf pkgcontainer-run ~/dev/myproject make

And make will somehow pick up the environment inside the container, rather than the global environment. That's easier said than done, of course, given how many different independent parts of the toolchain there are, and how intertwined but uncoordinated they are. You could use the sledgehammer of constructing an actual container, or at least a chroot, but ideally you wouldn't have to.
From 2014.
There's the rub. If the government made a neutral internet a human right, or increased competition by breaking up monopolies, the idiots who think they can get away with offering just Facebook would get royally shafted because consumers would realise that they can get a lot more for the same price by moving to the competition. This would lead to a glorious future where internet would be used properly for what it was intended to do: let anyone share anything with anyone else.
Some ISPs do indeed throttle some video services, and that’s a violation. It wouldn’t vastly increase prices for them to stop doing that, though. They’re doing it to push their own video services, not to save money.
30% Off X-series T470P #Thinkpad #laptops
The Most Iconic Celebrity Wedding Photos
My partner is convinced this happens, she even tried to run experiments trying to say random things and see if they show up. None of the experiments worked out, but I have to admit some of the coincidences are interesting. But not so much advertising, just any content that ends up in the feed. I'm more on the side of confirmation bias.
Over 20 years ago, we had MILO, the "mini-loader" for DEC Alpha machines that was a Linux kernel used as a bootloader to find the real Linux kernel we'd then boot. In that case, it would initialize built-in device drivers to be able to use the network or the block devices, load another kernel file into RAM, and then kexec the new kernel and disappear until the next system reset.

It is an interesting wrinkle to ponder leaving such an embedded kernel running in place of UEFI or other SMM hypervisors. Should there be a new syscall layer between the two kernels, or are current SMM traps, ACPI, and UEFI constructs really the right way to do it, even if the same open source community is in charge of both layers?

However, a general practice has been that the firmware loaders would be replaced less often and stick with "known good" versions, while the booted kernel could be updated more often. But in this new and threatening world, the firmware kernel can be "known bad", so you need a way to push out updates frequently. You also need a fairly good fail-safe technique to recover when the new update isn't so good after all. And you need to avoid solving this problem with yet another firmware layer which lets you choose between your firmware copies, but itself can be compromised and cannot be easily patched...
For almost everyone real guild isn’t entered via exam. The college degree is just a day pas to get your foot in the door somewhere. After that it’s performance that dictates whether you get to stay and whether you get promoted.
Is the initial cost of purchase the largest factor? Or are running costs enough to tip the balance?
I’m not sure what you’re saying here. It’s not that the feds must somehow regulate interstate commerce, it’s that the states can’t. The 21st carves out an exception.
You don't need 20MP of your face, that detail is undesirable. You want more MPs when the image is many people or a landscape
Or like the article said, you just noticed the contextual eyeglass ads because you had just been to lens crafters and it seemed weird to you. Also, by contextual ads, do you mean the eye glass ads were related to context they were shown next to?

The other explanation is Facebook has data sharing agreements with the payment instrument you used for the wipes.
But they most likely do. Voice corpora are extremely useful to train voice recognition systems, for one.
> How could they respond to remove all doubt they're listening?

Amend their privacy policy.
> If a friend came by to brainstorm ideas, it does't seem likely that someone would have the nerve to open with "Ok but first we need you to sign this PIAA agreement."

Better the awkwardness of that discussion than the situation they almost had of someone suing for a payoff after they had success because of (uncompensated?) discussions with friends. If any party is under the impression that what they're doing requires compensation or ownership that NEEDS to be known up front by everyone.
Agreed and I am not sure the majority of population realize this or would be accepting of it.
Could it be because the kids who these stories were initially aimed at, grew up and became adults, DC/Marvel realised they could “adultify” the plots and appeal to the same audience now 20-30 years older to expand their demographic leveraging nostalgia and thus make more money?
This is accurate. Net neutrality is a band-aid on an open wound. This is not to say that net neutrality should be done away with - stopping a bad thing from getting worse is, after all, what band-aids are for. The problem is the wound itself. There is no where in the US where Comcast and Charter are competing. In fact, when you filter down to functional internet providers (10Mbps+) very few places have any choice at all. This is an effective monopolization, made possible through explicit cartelization. And where there is no open wound, the market does work, and net neutrality isn't really an issue. Australia, for example, legislates that any owner of the infrastructure must lend it to other providers at a set price. Where a lack of net neutrality is kept in check there by the market, a similar lack of would only be used in the US to achieve greater price granularity/discrimination at the expense of the consumer.
If this is legit it seems hard to explain in any other way:

https://www.youtube.com/watch?v=U0SOxb_Lfps
I'm sure many people have tried to do that and have found nothing. But having found nothing is not a definite proof of such a thing not existing so nobody published their results.
I use a iOS VPN app called Speedify, that simultaneously bonds wifi/cellular channels into a single channel, ostensibly for speed sake. It seems to handle situations where either wifi or cellular is flakey, and even has a redundant mode, where all traffic is sent via both channels simultaneously. Redundant mode is not fast, but it is rock solid reliable. I use it if I want to make sure I don't drop a VOIP call.
I think sparkie has a very valid point. It has to do with Unix because a 'program' in Unix has specific meaning (and Windows is no different in this regard, btw). A Unix program doesn't map exactly to what a program means in the theoretical sense.
E.g. two Unix processes talking over a socket are not thought of as single Unix program, even though they can be considered a single theoretical program. So there is a tendency to think in 'processes' not 'systems'. I elaborated a little more about this elsewhere in this thread (https://news.ycombinator.com/item?id=15581591).
....Duh?

But it's absolutely insane to take the impossibility of low-constant, low-degree embedding as evidence as a general lack, given the rich structure of "large" numbers.

Which is what it's being used as in this post.
This is what I came here to say. They may or may not be listening, but the end result is the same.
> but rather political challengers (i.e. legislators, regulators, activists.)

Interesting, but that's exactly what I thought of when I read the title.
Yea, the stories and characters depend on the writing and writers change over time. No one looks back to Conan O’Brian leaving as the end, Groening et al just hired a replacement.
ESpeak.js Demo
Looks neat.
Free for public presentations and paid plans for private presentations and enterprise users.
My implication is there is a balance between doing nothing and acceptance and doing reasonable due diligence to combat social issues.
Thermal is also useful at the utility level, if you're trying to make concentrated solar work (though it can only really work okay, ultimately). The usual medium is molten salt.
This is also because of mass migration to urban centers in recent times. Every major urban center in US is currently facing massive number of incoming people. When everybody wants to live in same little place, prices are obviously going to shoot up. This should also explain why there are no too many new homes being built - because urban centers have little room to expand. This is current phenomenon in much of the world. Even if you go to 3rd world countries and look at prices in core urban centers, you will see exact same trend as in 1st world countries. This always had been a trend through out history but in recent times curves have crossed the knee and has taken a vertical leap.
Bread and circuses.

Think about who can partake in Fandom. What an elevated position they're in, globally. What a luxury such indulgence is.
To add, how about Wikipedia doing the same?

https://en.wikipedia.org/wiki/Wikipedia_Zero
The analogue of a transducer is an iterator transformation, aka. something like `IEnumerator → IEnumerator`, which is also just a function.
It's nice to see NVidia's behavior here is more widely known now. To this day, I do not understand the justification for asserting that one cannot install GeForce GPUs wherever one wants to install them. I really wish that Nvidia felt more secure that killer Tesla features like NVLINK and the Tensor Cores were sufficient product differentiation to make purchasing Tesla GPUs worth the price.

And that's because to the best of my knowledge, most of the CUDA ecosystem out there was developed on GeForce GPUs.

There is currently no GeForce equivalent of Volta at a time when the underlying programming model has undergone some traumatic changes that really alter the way to write efficient code going forward. If the only way to access Volta GPUs turns out to be AWS instances at $25/hour or $150,000 DGX-1V servers plus hosting costs, I suspect a lot of existing CUDA code will bitrot.

Imagine a near future where AMD Vega GPUs are faster than GTX 1080 TI at FP16 training and inference for deep learning. Without some sort of successor to that GPU, I really think that could happen because Nvidia went out of its way to cripple FP16 performance on GeForce.
I was skeptical until I experienced an ad in my feed which in my estimation could only attribute to data captured by a conversation had hours earlier. Of course there is the possibility of coincidence but I find it hard to believe.

I took advantage of the option to see why I was shown the ad, and was told demographic information, as well as a data partnership with DLX. I would like to know if others who see and ad they suspect was displayed due to microphone captured data have this DLX data supplier source in common.
I like this! Another idea--I'd love a site that lets me buy/sort/search wine by importer. To this day, I've not found a better way to find good wines than by picking a bottle I enjoy, and buying other wines from that same importer. For instance, if an online store let me select Louis/Dressner (importer I love), and offered me free shipping on a full case of their wines, I would use it in a heartbeat.

Not a single wine shop offers this sorting ability! So what I saying is: don't be a unified storefront for vineyards, be a storefront for importers. Logistics would be easier, too.
"We don't serve you advertisements through your microphone."
It's only iconic as a movie car, so why not just buy the rights to the Batmobile instead?
From a technical perspective, it is not very likely that they will listen to people's voice to push advertisements. They needs to listen to you ALL the time, collecting your voice from all kinds of noisy environment, uploading to their server for further analysis. And in order for this service to be profitable, they need to train model to extract the part of your conversation that hints a shopping intention.

This requires infrastructure at a really large scale I don't think even FaceBook can sigh up for that. And if they have a legal department, which I assume they do and a functional one, those ideas would be killed before it moves to implementation.
And people have a problem with it, and so the companies use Corp speak to try and make it seem like they aren't doing what you asked. The poster higher up asked how they could remove all doubt, and it's really easy. The problem is that they are trying to remove all doubt while continuing to do business as usual
Google servers and home users have very, very different privacy and security needs. The bottom line is that the biggest threat vector on most home machines is the user. Securing a PC against threats when the user installs a browser extension for coupon printing and blasts through UAC prompts without reading them is very, very different than securing a server farm.
Containers are overkill if you're just trying to isolate environment variables and filesystems. I mean really, if that was your problem and you came up with containers as the solution I'd say you over-engineered the solution. Environment variables -- trivial -- set them in the wrapper script used to launch the binary and you're done. Filesystem -- use separate nix accounts for your binaries and set appropriate permissions, for additional security use tools like se-linux if needed. Somehow, somewhere along the line it seems like there's this huge echo-chamber of 'containers for all things' and we have thrown out all we ever new about basic nix.

Contrarian views like the one in the article are healthy!
"Now grown ups ... can go and watch this comic-superhero rewrites on the big screen and talk about how great the acting, story and everything else was, as if it was serious art that they had seen."

How is this any different from e.g. Kyrgyz nomads listening to a bard recite the Manas, in which the eponymous hero shows veritably superheroic strength in battle? Indeed, if you are an ordinary man barely making ends meet and the politics of the world are rough, the make-believe of an epic tale where your people are depicted as great and once capable of great deeds, can be a great consolation.

Now, the reason that the Manas and similar folk epics have been acclaimed as masterpieces of intangible culture is that the bard is expected to improvise much of it, and Western superhero stories might not show that particular kind of skill. But in terms of the subject matter, the contemporary superhero obsession isn’t all that different from previous genres worldwide.
It can be lifted much higher if you have the right topography.

I also wonder about using something much denser, but still reasonably cheap (lead is what, $1/lb?)
I removed Facebook from my phone years ago when I learned they were accessing my sms messages. Simple.
Front End Developer VS Back End Developer
I used to have a favorable opinion of AgileBits but I can't recommend them after they started their push to subscription-ware. And if you look at this URL:

https://1password.com/sign-up/

it appears that they are still playing games in regards to letting people know that there is a regular version that you can pay for up front.

Personally, I would recommend finding an alternative.
Regardless of whether or not they are doing it purposely, the capability is certainly there. But the other data they have from cross referencing other web traffic, financial data, etc is probably much more powerful than what they could get from listening in to our conversations.

However, I still turn off microphone access for facebook and instagram. It's probably not fool proof, but it can't hurt.
That would require Microsoft, the F# team, and the vocal F# community members to actually want F# to be a proper first-class .NET citizen, which sadly isn't the case.

https://np.reddit.com/r/fsharp/comments/6tdrwq/after_so_many...
"all of our data" includes recorded audio.
"...for dental pain".
You do NOT want to suggest to a teacher that their salary isn't that bad, for working 3/4 of the year. Especially if there are any throwable objects at hand...

Whether they are or not, many firmly believe they are underpaid.
That is a surprise. How is the Windows version less secure?
thank you, I edited the title to include the date.
I am not sure if this is real. However, there are people on YouTube talking about topics they have never typed, never cared about, or never shared on Facebook and sure enough, the ad appears.

It would be great to really inspect the traffic and see if this is really the case. Independent of what Facebook claims.

Either way, I am happy I have deleted it off my phone. I have never been happier each day not reading garbage and actually focusing my time on apps that improve my life and move my life forward.
> Turing test

Sorry to 'actually' you but that's phrased like Clarke's third law: "Any sufficiently advanced technology is indistinguishable from magic."

https://en.wikipedia.org/wiki/Clarke%27s_three_laws
Inversion is the big gun, but rarely used. Just owning stock in your own foreign subs is enough to give you tax deferral.
People with trailers are not benefiting from the mortgage interest deduction.

The mortgage interest deduction overwhelmingly benefits households earning over $100,000 per year. Only one in five tax filers take the mortgage interest deduction, the extreme majority are in that $100k+ income bracket.

The substantially increased standard deduction is far more important than the MID for the middle class. Cutting the MID tax break for the top 1/3 of earners, is what will help pay for raising the standard deduction that is a huge benefit to the bottom 2/3 of earners.

https://www.cnbc.com/2017/08/31/that-beloved-mortgage-deduct...

"Mortgage Interest Deduction Saves Middle Class Taxpayers All Of $51/Month"

"Most of the MID 2012 tax benefits went to people making six figures or more. Households earning over $100,000 in 2012 claimed 77.3 percent of the total MID tax savings, essentially the same as in 2010. And just looking at those making $200,000 or more, we found the very top earners claimed 34.6 percent of the total MID benefits and saved $5,021 on average for 2012."

https://www.forbes.com/sites/realspin/2013/12/18/mortgage-in...
Modify their apps to not request microphone permission.
> There are plenty of reasons a person would want access to those articles without wanting/having the means to pay

There are plenty of reasons the Wall Street Journal does not want this, e.g. its paying journalists top dollar relative to industry. As a subscriber to the Wall Street Journal and New York Times, I'm quite fine with their paywall policies.
18 Excellent Podcasts for Librarians
Please don't use fascist propaganda slogans like this. It's not clever or funny.
Read the article. Running costs can be quite high (up to 1000 dollars/months with colocation/energy), but they are still massively cheaper than running 24x7 the same GPUs in the cloud.
“Facebook does not use microphone input for ads, user interest assessment or for any purpose other than facilitating a single user initiated transaction.”
My favorite is "WE" don't, but our partners do.
Or even earlier. Catalog sales and mail order have been around for a long time. 1-800 numbers for orders by phone started in the 60s and became standard in the 80s. The internet didn't invent remote ordering.
I just assume that they hire a 3rd party to do it and just incorporate the processed "external data source". Now they don't use the mic, just a text stream purchased from Acoustic Magic Analytics Inc.
I couldn't have used this many times over the years. Kudos
How many conversations have you had around your phone?

How many ads have you seen on FB that matched a conversation that happened earlier?

Isn't this the exact definition of confirmation bias?
This reddit post is the very top of /r/all right now: https://www.reddit.com/r/videos/comments/79i4cj/youtube_user...

And the general sentiment appears to be very far from what you claim. I think it's possible that this issue is going to come to a head this time around. I don't know what the outcome will be. Just saying it's confirmation bias (the likely real explanation?) may not be enough to satisfy people.
> if our voices aren't part of that conversation, we're screwed

Have you ever called your Congressperson or U.S. Senator about your views on this? I have, and I'm usually the only one in my Manhattan Congressional district talking about tech issues.