skysight-inc/HackerNews huggingface dataset:
Your last point is the important part: depending on the type of infrastructure you need you might be able to save money. If you want a cheap place to dump your files, B2 is cheaper than S3 and raw storage hardware pays for itself in about a year. If you need a sophisticated CDN then yeah you’ll need to be huge before it pays for itself. I would consider ditching S3 at the point where I can hire two full time engineers to worry about my storage layer.
I did a few quick searches on differing topics and I must say the relevancy is almost on par with Google. DDG doesn't even come close: especially for typeahead suggestions. Only weird thing is that it doesn't feel fast - may be due to whole HN doing a stress test right now.

It will be nice to default to Web based on previous searches. the default all tab takes forever to load results probably due to images and videos hogging the same page.

It is mentioned as open search engine: what does that mean ? is it open index/api is open or fake open like openai ?

>> we'll never sell your data or follow you around the web and we'll never offer privacy-invading targeted ads.

I don't think the above will age well in search
As a former educator, the only thing I can add on top of this is that training compliance, obedience, and mindless rule-following is a feature, not a bug of the education system.

And I feel like it's drilled into instructors too.
not to mention the power to imprison you.
Or abortion, for example?

"Oh no, we want states level laws for that."
It's most like going from http to https in that it changes the fundamental systems beneath it resulting in having stronger keys, longer keys, composed with different tech. You notice the new onion addresses are much longer, and created differently, this is that change.
The Go team never said it didn't matter. They said they wanted to think through the right design.
It doesn't even have to be something universally understood to be offensive. I wonder what happens when pro-Taiwan posts start appearing? How will China react?
> US upper class in a wealthy area is very different from US lower middle class in another. And the same goes for Europe.

congrats, you managed to miss the point entirely.
> support deal with a local electrician company

Maybe if you're wiring a closet in your office, but no colo facility is letting you within ten feet of their power infrastructure. The best you're getting is a racked-mounted UPS.
I don't have a problem with the government accessing the data per se. Given that the data exists and is commercially available, it would seem silly to tie their hands from accessing it. Police routinely run credit checks or just google people of interest to learn what is publicly known about them and I don't really have a problem with that.
What I do have a problem with is that our privacy laws and culture are so lax that detailed location information has essentially become part of the public record of a person. It seems like one way or the other, governments will find avenues to get at that data if it exists, and if you don't want the government tracking people, better to cut the data off at the source.
I should have said "modern and more popular languages." For the record, I like elisp/lisp, I just don't use them at my day job and have a hard time customizing emacs with them. Emacs is still my favorite editor, but for my day job, I can get much more done in VSCode because it "embraces" (whatever that means) JS much better than Emacs. I wish it wasn't so, and I'm worried about it long term.
Companies pay the prevailing wage in whatever labor market they participate in. The prevailing wage in the UK is lower than in Silicon Valley, but higher than in, say, Oklahoma City.

Not sure why people are still confused about this. But it seems many still don't understand it. The funniest thing is when people try to concoct some sort of fairness argument to explain this, or equally hilarious is when they try to come up with a fairness argument to condemn it.

Different markets have different prices due to differences in supply and demand in those markets. Want developer salaries to be much higher in the UK? Create an environment where a bunch of big tech companies all want to massively increase hiring there. Salaries will go up. Want developer salaries to be lower in Silicon Valley? Get most of the tech companies to leave. Salaries will go down.

One can say that ultimately the reason why Silicon Valley wages are so high is because there is a productive ecosystem that was so beneficial to the creation of tech companies that there was an explosion in demand for local tech labor. That ecosystem consists of easy access to credit and VC funding, existing networks of suppliers and vendors, existing mentorship networks for engineers and entrepreneurs, stable regulations and enforcement of contracts/property rights, together with sufficient local talent to pull off the difficult job of company creation.

London didn't have that to the same degree, and so has a lower demand for tech labor with correspondingly lower wages.
It's certainly an interesting concept. I'm not an expert but from what I've come across, it's currently very expensive to match the resolution of a 27" 4K monitor that's 2 or 3 feet away from your eyes. This is because the headset would need a very high pixel density on the very small screens sitting a few inches from the user's eyes. I'm sure someone has done the calculation somewhere but I couldn't find it. This page says we're at 2,000 pixels per eye but we need 4,000 to get "Immersive VR" (not sure if that will fit this use case) https://www.makeuseof.com/tag/virtual-reality-desktops-save-...

So it might happen eventually. People are actually leveraging "Virtual Desktops" now, but accepting the inherent resolution issues.
Might have been especially relevant to Sony's rootkit scandal, where playing a CD in your computer will prompt a EULA that then installs software (notably unmentioned in the EULA) that prevents you from burning a copies of that CD, plus "phone's home" with IP address and what music is being played.

Luckily nowadays users just install Spotify, no need to bother with rootkits.
Hi Soheil.

Yea... Requiring the default was a tough choice.
You actually can try it out in incognito mode and any other browser.
We didn't want to mess with privacy in incognito mode but just found that without the convenience of a navbar search it's hard to break many years of a monopoly dominating search. I hope we can drop this requirement even in Chrome when we become one of the default options.

But as you found out, installing and uninstalling takes only a few seconds.

Regarding the uninstall bug... not sure why you think that bug is an "evil" "trick" :)
We are just in beta and still have to iron things out.
We are waiting to get approval from the Chrome store and will fix that bug soon.
First thing I was told when I arrived in the US in 2001 and was picked up by a friend from the airport : "If the police says pull over to the shoulder, stop at the side of the road".

Second thing : "Credit score is really important".
Do you use GPT-3 to summarize?
I've used the you.com beta for about a month, and I've switched back to DuckDuckGo because the results were too slow to show up and the elements on the results page jumped around too much. Superficial, I know, but I just didn't want to wait for all the extra answers to pop up.
I am using an XPS that i installed Ubuntu on for dev work and I am facing many of the issues mentioned above.

Whenever i put the machine to sleep I do a check always assuming the risk that the app states I have, might never be accessible again. I still can't get hibernate working on it to make it all just work for me. But each rabbithole into making my life a little easier comes at a cost of so much time that I just don't find reasonable.

Windows has it's pain points but having WSL running makes life so much easier.
The good old what days? All I'm seeing is '*******'
There are a lot of people who report they had covid but never had it confirmed via PCR test or serology.

This is a problem because data from this group purportedly about covid, such as "long covid" symptoms or the robustness of natural immunity, is seriously compromised.

You can see that idea here in this study and also in the difference between natural immunity studies which use self-reported data (which may indicate weak, declining or no protection), compared to studies which use PCR or serological confirmation. The studies in the latter group unanimously confirm the robustness and longevity of natural immunity.
apparently washington was also generally a bad military strategist and tactician, racked by uncertainty and indecisiveness. he happened to get lucky in a couple crucial battles, otherwise we may have had no idea who he was. so luck strikes again, and washington the symbol is more relevant than washington the man.
I'd like to know more about the "built for devs" concept you are presenting to us. What does that mean to you?

For me personally, I rarely perform site:github.com or site:stackoverflow.com searches in my browser's default search engine. I typically just enter a few keywords and try to make sense of what I find.

When I personally think of a search engine built for devs, I think of one that parses queries differently from the natural language processing that seems to be all the rage these days. For instance, when I search "?. C#" I want to know what this operator actually is. Instead, the algorithm omits the ?. and just returns the most generic results relating to C#. https://you.com/search?q=%3F.%20C%23&fromSearchBar=true This is true even when I put the "?." in quotes. One of the results is titled "Null coalescing operator" from Wikipedia, but this is actually misleading since ?. is actually the null-conditional operator. The information is there but it is not easy to find.

The other item on my wishlist for a dev-centric search engine is to be able to persist the main language(s) I am trying to search about. Its mildly tedious to type C3 and then my keywords (..... dammit, C#, this happens ALL the time), in each query to narrow things down and not get javascript results.
Yeah. I always wonder if the complainers do the same deep analysis and whining about how for-profit companies spend their income, or if they just plunk down $120 for Xbox Game Pass and leave happy. Is Wikipedia worth $20 a year to me? Yeah. So they can have it and spend it how they like. Just like Microsoft can with my Game Pass subscription.
Generics didn't affect Java because it doesn't have them after typing: it uses erasure and generates the same bytecode as pregeneric.
As you’ve noted yourself, the government had a large amount of control over the media and the political system as a whole. It would be disingenuous to identify this as the primary factor in the maintenance of the apartheid system (as you have in several of your posts) and yet deny that it had any meaningful influence on the referendum result. The striking fact is that even with the party that introduced apartheid campaigning to repeal it, almost a third of whites voted to keep the system. And as others have pointed out, this was at a point in time where SA had become a pariah state and it was abundantly clear that apartheid could not continue – even to many dyed-in-the-wool racists who had no objection to it in principle.
Idea: get together some money, buy data of 100 of the CEOs of Fortune 500 companies.

Publish everything found, see if the laws are then changed...
But they do. Private companies have killed people with ill-made products [1], pollute our air and water [2], have purposely targeted people for harassment [3], and created drugs solely for addiction [4]. These examples only took 30 seconds of thought.

The idea that businesses (whether public or private) can't hurt me or my family is absurd.

[1] https://en.wikipedia.org/wiki/Fisher-Price#Rock_'n_Play_reca...

[2] https://www.consumerreports.org/water-contamination/how-frac...

[3] https://en.wikipedia.org/wiki/EBay_stalking_scandal

[4] https://en.wikipedia.org/wiki/Sackler_family#Opioid_lawsuits
Ive heard great things about it. And while it is cross platform but you do have to buy it per platform. Which is a bummer.

5 for ios. Free on android. And 30 for windows.

And seemingly no browser version? :(
> Java does have a formal semantics, with a whole chapter on its soundness.

No, there's a chapter on the soundness of its type system. The spec being sound and the type system being sound are very different things. If we consider typescript to be JS's type system, then JS's type system is unsound. If we consider cpython in isolation, under the definition you're using, cpython cannot be unsound, as it is untyped, QED.

If you're talking about whether the language's type system is sound, asking "These documents are just informal prose. Are they sound?" isn't even a well defined question.

> I'm not criticising Python as being exceptionally bad, but we can certainly do it much better.

You absolutely were when you said "But I wish Ruby and Python were this explicit and easy to understand!"
this is a terrible take. why comment at all?
Congratulations on the beta launch! I am all for privacy-friendly search engines.

My 2-cents is default to the familiar list view for search results. The current card-view makes it cumbersome to navigate (horizontal and vertical scroll) and scanning screen-width end-to-end. And with my penchant to serially browse results, it can result in me over-spending time to find what I need. Also, it would force you to have a tighter ranking of results. The current view could still be an option.
xMatters
this is bad because people who opt in think either that their data is not being sold to third parties or that the third party buying data is another company, nobody when opting in assumes that their data will be used in an investigation that can then lead to criminal charges.
What's the unofficial requirements to become a default search engine in the major browsers?
I wonder what, if any, further improvement would be had by comparing xzip vs zstd.

Obviously you need a LOT of CPU to throw at xzip if you want to use it.

zstd is very much more optimized for compression at speeds comparable to traditional gzip.

I use xzip primarily for things that will get compressed to long term storage and the time to create the archive isn't a really important factor.

in this test: https://sysdfree.wordpress.com/2020/01/04/293/

zstd level 19 wins on time vs. xz levels 5 through 9, but the xz ultimate compressed file size is definitely smaller.
My annual max out of pocket cost for healthcare is $5,000. Once I pay the $5k, everything else for free for the rest of the year. How is that worth a $100-200K salary difference?
Show HN: Privacy-focused news feed that groups stories, using NLP
I built Drewes.NEWS as a way to learn NLP and serverless architecture, and to find bias in news by reading the same story from multiple outlets. Now it's evolved into a useful, privacy-focused tool.

It's privacy-focused in that there are no cookies, no usage of Google or Facebook components (like Google Analytics or Ads). No data tracking on users whatsoever.

There are bugs I'm aware of, but am looking for feedback on if this format and function is useful.

For those interested in the NLP side of this or the serverless side, I'd be happy to answer questions about how it was put together. The short version is, I pull down RSS feeds from 33 news sites (approximately 1M stories in the database so far), store them, create a term frequency model, cluster the most recent 10k stories based on TF similarity vectors, then store story similarities.

In the future I'd like to add paging, searching, and more filtering. I'm also thinking about having a URL for each story, that would show all the similar articles. That way, if you don't want to link directly to a particular news source, you can link to the drewesnews aggregate URL, and the reader can pick whichever source he/she wants to read.

Any feedback would be much appreciated!
The article says, near the bottom,

> However, we strongly recommend NOT using it to intervene in the production process, e.g., process control or ensuring safety mechanisms
Some examples of things that make Clojure click quickly are being able to use seq operations on all core data structures instead of learning how to work with list, vectors, hash tables, and sets separately, documentation being great with tons of code examples on clojuredocs.org, and the fact that you know you need to "do everything the functional way" up front means less decision making. And prolific overuse of hash tables speeds things up too :)
Ah, so the "new hotness" is just a Web 3.x point-release. Gotcha. :P
Good callout - we use a higher blocksize than Postgres page size because it gives us a much higher compression ratio, at the cost of some read/write amplification.

And yes - Postgres will automatically TOAST oversized tuples and compress the relevant data (if you configure it to do so). This is much lower impact for us than filesystem level compression, as it doesn't affect the main relation heap space (or any indexes).
I wouldn't dare say how anyone in particular should spend their hard earned money. That is not at all what I was saying.

I can, however, pose a general argument regarding my low opinion of some of the things people buy.

In other words, buy whatever you want, but I reserve the right to say it is stupid.
My daughter (10 years old) barely missed the cutoff for her advanced math classes this year. She's been helping "less gifted" students in class, and I would say is substantially better off than if she's been doing slightly more difficult math problems. This is forcing her to think about math in a different way in order to try to help other kids bridge their gaps. I wonder what schools would look like if this was the norm.
facebook is hiring 10,000 developers in the EU to build the Metaverse.

https://www.reuters.com/technology/facebook-plans-hire-10000...

My daughter is looking to go into software engineering and I was explaining to her that most of the high paying jobs are in the US and there's a big brain drain out of Europe (we're Brits). Not to dissuade her, but that she might consider that as an option on graduation. I was speculating why FAANG don't hire more developers in Europe to take advantage of the pay difference, and then the above story broke literally the next day.
I yanked my mint.com password a few years ago both in frustration and in the hope of improving security. I use Wealthfront to track most of my investments - but I'm reluctant to give them credentials to log in to other financial services.

I loosely track my other financial accounts whenever I log in to them. Effectively I assemble the "holistic view" manually, only once a year, when I do my taxes.
We all committed privacy suicide when we bought smartphones. The data that we thought should be out of government hands, we put into the hands of many businesses. I agree it seems unsettling, but why can’t the government purchase information on the open market?
It should reduce the number of people driving. Sounds like a win.

In the gold standard countries for cycling, this sort of design is done on purpose. Pedestrians get the best route, followed by cyclists, and vehicles have what's left.

Elsewhere, doing the easy work to accommodate cycling, then ignoring anything that would cause even the slightest inconvenience to cars, is the norm.
> I'd want the same protections for people I vehemently disagree with because it's the right thing to do (and aligned with the consitution).

Nah. I disagree. In Germany, its illegal to be nazi-sympathizing. As someone who disagrees with Nazi ideology, I think that sort of law (and societal environment) is healthy and don't think we should protect that.

If that happened in the US then some small group would still be waving the nazi flag as a source of pride the way that some still wave the confederate flag. I don't see a need to protect such extreme awfulness.

> I imagine this will be made more concrete but based on some political affiliation (party registration).

So any topic that is related to a party platform is political? If Bernie keeps tweeting about amazon is amazonian discussions now protected political speech?

> Strawman...?

No its a very real topic. "Gay" marriage is an important issue in many countries. Its becoming less relevant in the political sphere of the US lately, but its not crazy to imagine republicans trying to re-litigate the issue.

Gay people don't think of marriage as particularly political, its just a right they expect to continue having. Religious zealots want to strip that right away, and litigate it in courts. Discussions of the right to marry are classified by some as political discussions.

This is a real topic real people actively discuss and does come up in political discourse.

> as opposed to things that don't suggest action being said that people don't like

Hate speech is not just speech "that people don't like".

Also why should platforms be forced to host speech that is hateful? As is often mentioned here on HN, you have a right to speak, not to an audience. Why should platforms not be able to avoid or dispell people that say things that no one wants to hear?
most BI don't support querying REST APIs
> Photography isn’t racist, it’s physical limitations that come into play.

I wanna pull this apart a bit because I think it's a good opportunity to talk about how systemic bias gets started. Digital sensor evolution is path-dependent. Technologists developed photo-sites that have "enough" dynamic range for most uses before moving on to increase the resolution on a sensor. What exactly is "enough" depends on your test data.

The sensor on a webcam is only "so big" as you say - but how that sensor balances resolution and photo-site count depends on what conditions they consider acceptable. We could build web cams that would see more pigmented faces better - there is no fundamental limitation in the technology itself. It's that a series of decisions have been made over years of development, generally without people thinking specifically about race at all, and we've arrived at a status quo that has adverse outcomes for people with different skin tones.

There was a similar process that happened with film photography[1]. Not that film, as a technology, is unable to capture dark skin - but that the development standards that were tested and distributed were designed for lighter skin.

Like, I agree that the webcams we have aren't intentionally 'racist.' But I do think that the status quo that has led everyone to accept this balance of dynamic range and resolution is reflective of valuing people with lighter skin more.

[1] https://www.nytimes.com/2019/04/25/lens/sarah-lewis-racial-b...
It's not memorization, it's pattern recognition that really counts. What sound "a" mkes is irrelevnt if you're recognizing the relevnt pttern. So it's you who's in the wrong.
My guess was CS6265 which similarly jumps pretty quickly into reverse engineering and binary exploitation. One of my favorite classes!
> certainty

Considering the number of people here commenting about costs but have never managed a P&L, I don't think certainty is high on the list.
iOS 15.2 Beta Adds Messages Communication Safety Feature for Kids
I absolutely think that the government should be able to purchase data in order to conduct investigations.

Unlike private actors, governmental actors are publicly constrained in their actions and representatives of the will of our society.
Not everything IS memorization, but lots of things HAVE memorization. You don't write by regurgitating exact phrases, but your ability to write will be significantly impeded if you need to constantly look up word definitions, spellings, word order, syntax rules, and orthographies. There are certain fundamentals that need to be automatic, and it's fair to require internalization as part of acquiring mastery.
Oops. I think its worse than NSFW. It seem to fetch some pics of questionable age :(