skysight-inc/HackerNews huggingface dataset:
I work at a company who's a major player in online academic publishing.

We use Solr to power our main, end user-facing search after migrating from a custom Lucene solution some years ago.

To me it seems Lucene based tools are the best for the job if the main thing you care for is having text focused search with a huge potential for extensibility.

But there are a lot of use cases where you will never need anything more than the base capabilities of this technology (so you can be served by something simpler to use or maintain nowadays) and there are probably a lot of use cases where your search will be mainly driven by vector similarity (in which case you are working around the limitations of picking a technology with another focus).

As far as jobs go, I'm not sure how in demand specialists are. After a few years of working in the field I had a look to see if I could leverage my experience to get a remote position and came up with pretty much nothing.
Nitpicking here, but the parent agency of the FBI is the Department of Justice. The EOUSA is the Executive Office of United States Attorneys, and is basically the back office support for the 93 US Attorney offices. It's parent organization is also the Department of Justice.

Basically, he is saying the DOJ planted a back door so that it could spy on its own internal network.
regularization, dropout, early stopping etc.
Scientists Capture Photographic Proof of Quantum Entanglement
>> But really, isn't Warren at all concerned that the ones to pick up the pieces after her plan is implemented are very unlikely to be American?

Well Trump or whoever is the president then can instate a national security emergency and kick out that foreign company. I know this sounds like a broken record but it looks like this is how trade works now.
The complicated bits are the import notations (what do the different variations mean and when to use them?), the recursive declarations (and knowing when to use them). Also, since expressions are often functions and the nixpkgs people don’t believe in types or docs, it’s difficult to track down the type info for each argument (what properties does it have?). You just end up grepping blindly through nixpkgs to find the callsite and even then the argument is often the result of a function call, so you have to find the function and it’s definition and look at the return and hope that it is not “return someOtherFunc()” lest you have to track down yet another function (also, odds are “someOtherFunc” is not the name of the function, but rather the name of a parameter into which a function was passed, so you’re back to blindly grepping nixpkgs).

Nix is great in concept but the language or idioms make it really difficult to use.
Error rate remains more or less proportional with qubit growth as long as companies optimize for qubit growth alone. But once you have thousands of qubits you can use that to build something like a few dozen error-free logical qubits. Most companies don't believe it's worth attempting that yet and that it's better to optimize for qubit growth for now.
Yeah they might defend the domestic market by protectionism measures but they won't be able to do anything about international one.
There have been many reports of bloat recently in Python. Now we have hard evidence.
I would take Warren more seriously if she started out by talking about ATT/VZN/Comcast. The "big tech" companies have the potential to harm consumers, but telcos have been harming consumers for decades.
The Nix expression language has branches and functions (including recursive functions). It is Turing complete, and it probably is necessary for its charter.
My heuristic goes like this

20C ~ 70F (ok it's 68F but close enough)

a variation of +10F is +5C (same for minus)

Of course you can remember that 32F = 0C, that helps
I feel a bit old now :) Really appreciate the ethics of citing sources, explaining in much detail and presenting choices from first principles.
I work with a DevOps guy who is the biggest enthusiast of Postgres that I know. I am responsible for the Data Warehouse, and he blocks Redshift and Athena, says that a Postgres RDS instance can keep up with any in-memory columnar database, given enough tuning.

Aside from that, its mainly CV-driven development, where people either want to work with what they already know and are comfortable with, or want to add a feather in their cap so the backend has to have the latest buzzwords and the frontend has to use the latest JavaScript framework.
"Google already has special deals for companies that lowers the 30% fee significantly."

Source?
The reason to use float16 isn’t to make individual operations faster, its to fit more numbers in vector registers. For example, AVX512 vector registers are 512 bits. That’s 8 64-bit floats, 16 32-bit ones, or 32 16-bit ones.

=> A vector multiply using bfloat16 may not be much faster than one using float32, but it will do more multiplications.
minisign is pretty cool. I've added its signature to my software releases along with md5/sha256.

https://github.com/jedisct1/minisign
I tried one of the older, shorter .onion addresses once out of interest. Didn't take long on a laptop to get a specified 7 characters at the beginning.

I don't know how much the longer .onions affects generation time - anyone?
Can you share the critique? It would be an interesting read.
"Mercantilism
The page is hosted by a foreign web server and is therefore banned to ensure the supremacy of our own software."

Isnt that protectionism?

Wouldn't mercantilism suggest the article was better being supplied from a different website.
Also makes it a lot slower. For a really nice/readable (but therefore also “naive” and slow) spectral one, look at this one: https://github.com/TomCrypto/Lambda

It’s a lot easier to learn from than the pbrt one in my opinion.

There are ways to avoid having to do single wavelength rays (hero wavelengths or basis functions) but it’s tricky.
The culture still thrives, but not how it was, for sure. The older guard of the tech community keeps it alive, but for the most part, the brogrammer wave we got hit with in 2007, when everybody "did social", definitely sucked the life out of the area.

One side effect is that you are a lot less likely to find out. Spaces I used to attend which were generally "if you can find it, you can come" now have guest lists and sometimes vouch lists with the intent of keeping the bros out.
Note: this is in the new nature machine intelligence journal which many leading academics in the field have argued against for reasons like that:

The article cannot be downloaded: "Complimentary shares do not allow downloading. If you have another access method, please visit the regular publisher article page in order to download."

More background: https://retractionwatch.com/2018/05/01/thousands-boycott-new...

F that. No need to read it either, it's a straight-forward uninteresting "neural networks applied to toy problem X" paper. No interesting use of structure or geometric deep learning, just brute-forcing with 10 billion samples.
https://twitter.com/kennwhite/status/591074055018582016
It's worth nothing though, that a C5D (c5d.2xlarge) instance kept up for 40 hours/week costs $75/month with on-demand pricing and comes with 8 cores, 16 GB ram and 200GB of nVME ssd disk space.

It would be interesting to see how much would it cost to have AMI snapshots everyday.
O-1 is extensible, isn't it? You can get it first instead of H-1B, and then apply for a green card once you move to the US.
This has got me thinking about MW and the speed of light .... a quantum event occurs here and the universes split, that split propagates out at the speed of light ... at roughly the 'same' time a quantum event happens at Alpha Centuri ... the universe splits there and that change propagates out at the speed of light .... 2 years later half way in between the splitting universes meet - what does that mean?
This is what I use. I'm not quick with arithmetic in my head so if I want anything more accurate it's faster to just grab my phone.
Growing a Brain: Fine-Tuning by Increasing Model Capacity
I meant someone with the op’s skills will have companies vying for and paying handsomely for
What are you talking about? All the parties have been crystal clear on Brexit. "Brexit means Brexit", what's unclear about that?
If you don’t already know c++ I’d go for Rust.
The IC has no problem supplying data to LE who then come up with parallel construction to justify the fruits.

https://theintercept.com/2018/01/09/dark-side-fbi-dea-illega...
Is there a script to do that or did you roll your own?
Um. No, Retail and Pre iPhone Carrier don't get 60% of the cut. And their operational expenses are completely different.
Run K8S Like Ninja
What exactly make you think it was arbitrary?

But besides, "person who cant work in our office due to sickness or disability gets to have more home-office time and position suitable for that" is not arbitrary rule at all.

Whether it is unfair can be debatable, but I would not see accomodation for someone sick as unfair to healthy me. I would also see it as good sight that if I get sick or need adjustment to some own situation, I get accommodation too.
Lumos: Dependency-Driven Disk-Based Graph Processing
That's not how keybase works. Keybase doesn't send you encryption keys you blindly trust. It only sends you a bunch of data structures allowing you, the sender, to verify that your correspondent really is who they claim they are. All verification of the proofs is done on the client.
That means that your client is going to fetch all the sites allegedly linked to that account and do a verification locally. Because of this, if keybase ever receives a court order, there must also be a court order for Twitter, GitHub, Mastodon, all the websites that are linked to this account.

This verification happens everytime you receive new information about your peer; if something has changed it must be new, otherwise a rollback or a change in history is detected. Once your client has made this automatic check you can get a list of the linked accounts and manually check if they are the correct ones; at this point your client can take a snapshot to prove even more strongly that it's the correct one. Those snapshots are shared, so if an account has multiple followers (the name of someone whl manually verified na account) it's that much harder to crack.

If that's not enough, any change to any account is stored in a Merkle tree whose root is thus monotonically incrementing, and tht tree can be retrieved at any time to verify nothing happens. And that root is stored in the Bitcoin blockchain so that any fork is easily traceable. You really have to go out of your way to distribute a compromised key to a client. In the meantime the encryption is end-to-end.

Here's an article about how they protect against malicious attacks against the server:
https://keybase.io/docs/server_security

Here's how they store that Merkle root in the Bitcoin blockchain:
https://keybase.io/docs/server_security/merkle_root_in_bitco...
To her credit, she gets net neutrality: https://www.warren.senate.gov/newsroom/press-releases/senato...
>Am I the only one that wants their browser to be 100% stateless?

I achieved it by using Disposable Virtual Machines in Qubes OS. Works flawlessly.
(Upvoted, even though I disagree with you.)

Yes, I still think that breaking up MS still would have been a good idea. It took three unexpected developments for MS to be as docile as it is now:

- The rise of Linux and F/OSS more generally. There are all sorts of reasons it didn't have to happen.

- The failure to execute competently on mobile (making a scaled-down Windows instead of a mobile-first OS) at the exact same time that Apple, almost out of nowhere, was executing competently, and Google, not previously an OS or hardware company, acquired Android, which depended on Linux and other FOSS being ready and robust for consumer use.

- The failure to execute competently on the internet. They certainly had the positioning (IE, ActiveX, IIS, Hotmail, MSN, etc.), skills, and compute capacity to have won on everything from personal cloud services like email/docs to cloud computing infrastructure.

FOSS was a miracle and the other two mistakes. We can't write laws as if we assume that miracles and mistakes will happen.
Providing reasonable accommodation, which is required by US law, is not unfair or arbitrary.
Are you claiming that construction today is fast? I don’t understand.

Are you claiming that a contemporary construction project would be able to build the Hoover Dam? That was almost 100 years ago and a lot of things have changed...
This example seems a little tricky, because it involves remote work, which many people prefer, and which some organizations successfully offer to everyone.

If the accommodation were instead something that was desirable to you, but (unlike a remote work option) not something that would be viable to offer to everyone, would you still feel it's unfair?
Interesting. Can you point to an example?
I've been doing it full time since my mid-20's and I'm 39..so no?
Because if I can do my job from home office just as well why should I not also get that?

I would not argue though. The beautiful thing about living in a free country is that I don't need to I just get another job.
Charles Dellschau and His Extraordinary Sonora Aero Club
If it were something possible and desirable for all then yes!
Sorry, just to be clear.

Everyone stands around in a circle and one person drops down on the floor in a plank to talk?
Maybe it's just me but I'd have a hard time taking this seriously.
You were pretty much guaranteed to die if injured and lying there in the Napoleonic wars. It was an act of mercy.
> But in a privileged container you could still take away capabilites and/or permissions with an apparmor profile.

Right, what you want is “privileged except for XYZ”, which is not supported by Docker. That’s a missing feature which is not the same as a bug. Calling it a security bug is even more misleading.

> Sometimes that happens, sometimes it does not. And when it does not, you have no way of knowing.

Right, it should fail every time. That is a bug. But it’s not security bug, and fixing that bug won’t give you the feature you want, it will just make it clearer that the feature is not supported.
I agree we should also plant trees and cultivate forests however that won't help fix our oceans.

The reason why I like the olivine weathering proposal is that it weathers co2 out of the ocean and uses the ocean as a carbon sink. This way you remove co2 from the both the atmosphere and ocean (if you weather enough of it).
the metaprogramming post is very, very good, btw, thank you
I'm not sure I've ever seen folk art that is inspired by new technology, and that is so imaginative and visually striking. I'd love to see an exhibition of the full notebooks.
Would you mind sharing the source and year for these numbers? The only stats I found were not from 2019 and coal was higher than 9.7%.
May be someone should be a sound proof case for a JBOD..

Disks suspended with cables?
Box filled with sound absorption materials?
Whatever it takes.

Or if that cost ~= cost of SSDs, just buy SSDs.

Me? I have a 12 TB SAS disk connected to the system with an easy to turn off switch so I power it up only when I need to backup something. Others times it stays unmounted and powered off.
My whole digital footprint is only a TB....
"Splitting" does not propagate, or happen with any locality - it's the wave function of the entire universe doing the splitting, so there's nowhere for it to propagate!
Faster Algorithms with Preprocessing
It's a simple left-wing and right-wing issue. It's in the interest of the left wing to have a weaker nation.
it's weird, it's almost advertisement for murderers to buy the book...
Mine is in the kitchen for exactly that reason. No matter how quiet it is, any sort of constant noise like that of an hdd drives me nuts. But I fully agree normal desktop tower is the way to go. Enough space inside so it doesn't easily overheat and lots of room for expansion.

Using it for routing with DNS block list, media file server and off site backup.

One thing I can recommend after decades of fiddling around with home servers: If you don't need it for the high availability, don't use raid 1. Raid is not a backup. Use another drive, preferably larger, and run something like dirvish or Borg once a day or however often you see fit in your case.
That sounds like a practice suitable for 13 year old boys, not professionals.
By harming do you mean on price? Big tech has the potential to harm through externalities (privacy, control of the media, etc.). A sufficiently free market - with appropriate safeguards to ensure competition and prevent regulatory capture - tends to deal with price just fine, but not with externalities.

Warren's argument here is a straightforward free market one: free markets only work when there's a free flow of information. If Amazon both runs the market and participates in it, it's an inherently unfair playing field. Her argument is not that we should break up companies that we don't like or even those that hurt consumers; her argument is we should break up companies whose intact existence threatens the fundamental nature of free markets.

All that said, as it happens, she opposed Comcast's attempt to buy Fox https://thehill.com/policy/technology/396559-senate-dems-urg... and the T-Mobile / Sprint merger https://thehill.com/policy/technology/429618-dem-senators-ur... — opposing both on the grounds that they're anticompetitive.
What an incredibly sad reason to be somewhere you hate. I cry for you.
> typically not in a line for babysitting and don't go around clicking britni's nude photo.jpg.exe

Do you understand what a drive-by attack is? Defender is the last line of defense against unknown vulnerabilities, assuming you have the latest security patches...

> Windows updates are better if controled
It's a good analysis, bit I can think of Kuala Lampur's KLIA airport T2 (low cost terminal) as a major exception.

Burger King at the airport, for example, has the exact same prices as the city, and they actively encourage people to spend little money.

There is free water, a reasonably priced airport hotel, and even free showers at international gates. There are plenty of free seating (so you don't have to go to a cafe), free WiFi throughout the airport, and a few convenience stores scattered around.

It's not that the flight tickets are expensive either. The airport tax is less than $5, and tickets are super low cost for all Air Asia destinations.

The high rent, airport cut, human costs, etc can make things more expensive, but don't forget the stores charging 2x the price just because they can. What are you gonna do? Go back through immigration and security again? I dont think so.
Yes, it will mark the end of world war 3 because humanity will be able to survive by traveling to a new planet in a different solar system. Deep space exploration becomes viable because we are no longer dependent on solar panels, instead we carry our own mini sun within our spacecraft and simply sail forth!
If being competitive internationally comes at the cost of exploiting workers then I don't want it and neither should any other modern country.
What you wrote is almost a half of the "meander WTF-manifesto"!
SIMD-X: Programming and Processing of Graph Algorithms on GPUs
It’s been a long time. If you ever saw the JavaScript “wat” talk, you get the idea.

We have since rewritten liquid mostly in C and it has a strict parser mode that’s done with proper approach instead of my hacky regexp based approach.
Thanks for a good twitter thread. Later on that thread has some interesting statistics about the estimated power output of these fires and how much it is over the average: https://mobile.twitter.com/m_parrington/status/1151905483625...

Scary stuff, I hope this is not kicking some feedback loops in to action. -edit: typo
All of that can be automated via CLI.

Here are a few tools:

- hub https://github.com/github/hub

- lab https://github.com/zaquestion/lab

- git-extras https://github.com/tj/git-extras
Zillion thanks for whoever post this.
My 7 years old laptop just got massively faster than ever.
If you know the stops of the 6 train in Manhattan, the trick is that the stops are in Fahrenheit starting at 33rd street = 0˚ C. Each stop up town is +5˚C. Stays within 1˚C until 110th street.
I wrote the script because I did not wanted to use ddclient :D and it's terrible config syntax. Also, it corrupted the cache regularly for some reason.
Fancy seeing your comment just as I’m listening to Shane Parrish interviewing you on his podcast (to others: The Trust Battery episode, recommended). Respect & keep up the good work!
"...under this administration the FCC has become a puppet for giant internet providers."

If she actually believed this, it would be a fundamental misunderstanding of FCC. FCC helps monopolies and hurts consumers because that is its purpose, since 1934. Neither Democrats nor Republics have ever done anything to change this. Net neutrality is a fine network policy, but it wouldn't need to be mandated by regulation if actual competition existed in this market. FCC throughout its history has acted mostly to prevent such competition.
America is business-first, consumer-last. Always has been, always will be. Pre-election year fud.

Microsoft won the anti-trust lawsuit. Its' primarily penalty was an embarrassment, they gave free copies of their software to schools.
The beauty of living in a free country is that I can make up my own mind.
Microsoft overreached by giving away IE to killing Mozilla. That's what really caused the consent decree to get issued. I find it hard to believe that you would have gotten Amazon/Google/Facebook if Microsoft had a stranglehold on the desktop.

I don't agree with your take on Amazon. We can't trust the US government to police the large companies. The large companies are too good at (a) walking right up to the line or (b) buying off the people who make/enforce the laws.

Don't understand the downvotes either.
I think Warren is fantastic but I feel like her argument for Amazon is flawed and I'm curious to hear counter arguments.

In her example of Amazon being a platform and information aggregator, wouldn't a brick & mortar grocery chain like Safeway/Vons/CVS be guilty of the same anti-competitive practices when they sell "Safeway Brand Fruity Os" next to Kellogg Fruit Loops?

Businesses seem to have been able to be platforms and information aggregators for a very long time and we've had plenty of innovation and competition
That's interesting, any idea why/how KLIA T2 is able to do this? I would think that the increased rent and security prices alone would force the businesses there to increase the cost by something, even if it just covered the costs
E-mail is very far from secure. The overwhelming recommendation for private 1:1 communication is "use WhatsApp or Signal". But you're right that a federated and private 1:1 platform is possible /in theory/.

However Facebook, a 1:many communication platform, is likely impossible to federate while retaining privacy.
Note that when using this approach, you shouldn't use the root domain; you can still use a subdomain with no issues though.

[0]: https://www.freecodecamp.org/news/why-cant-a-domain-s-root-b...
[1]: https://blog.cloudflare.com/introducing-cname-flattening-rfc...
German traffic lights fitted with actual Pong games for pedestrians to play