skysight-inc/HackerNews huggingface dataset:
From the Google side: In traditional BigQuery, the answer to all three questions are related. You shard the files by partition key and put the key into the file name. You can filter the file name in the WHERE clause, and the query will skip filtered objects, but otherwise fully scan every object it touches.

There is apparently now experimental support for using Hive partitions natively. Never used it, literally found out two minutes ago.

The number of records per object is usually "all of them" (restricted by partition keys). The main exception is live queries of compressed JSON or CSV data, because BigQuery can't parallelize them. But generally you trust the tool to handle workload distribution for you.

This works a little differently if you load the data into BigQuery instead of doing queries against data that lives in Cloud Storage. You can use partitioning and clustering columns to cut down on full-table scans.
Frontend hottest: Next.js/Typescript/React w/ hooks.

Backend hottest: Rust, Graphql is gaining adoption at the enterprise level.

Edit: ML is still very hot but tough to get a job as a Data Scientist without actual experience.
I'm sceptical about the economics of this. The first problem is the obvious idea of everyone storing their pod as many people have pointed out which is unfeasible, as inrupt itself points out.

The next step is that someone is supposed to host your pod in the cloud, but if this is supposed to protect your privacy the pod has to be encrypted. So then the question is how is the host making money? Charging people upfront for storage in a trade-off for privacy or control has proven to be a deal almost nobody is willing to make, we already have privacy respecting, more expensive services, they're largely fringe. Pods are a technical solution that only make this more complicated.

the fundamental issue that I think breaks this entire idea is that it vastly overrates how many people care about control or privacy.
I would love to know more about this project of yours. Do you have something written about how did you got it started, what lessons have you learned, or plans for the future?
Riot.js – Simple and elegant component-based UI library
"I think you’re misunderstanding."

Actually, the misunderstanding is yours. Technical issues are a small part of the challenge. The 'iPlayer' is not the product, for the most part, the content is.
Wait, do you really believe that amazons retail business has had little or no significant innovation besides whiz bang tech goodness? I’m guessing you were exaggerating to make a more strong sounding statement, but if you meant it, then I strongly disagree.
Some landlords charge application fees for dozens of applicants but they only run the credit check/screening for the first few. Also the amount of personal information requested is ridiculous.

I'd much rather use one of those systems where you get your own report from a reputable company and share the report id. Instead of paying an overpriced application fee to a bunch of places.
I’ve been a Prime customer since it first came out in the early 2000’s, but I’m letting my subscription expire this year. Too much fake crap, and increasingly it’s hard to even find stuff that I’m looking for in the store. No thanks.
JEE to Java? In a positive way? Or as in: this is a humongous framework for what it’s doing (CRUD apps)...
I think we're destined to remain on different sides of the argument. I'm confident rooftop solar still wins; utilities aren't known for not raising rates, and the political winds shift. It might take longer, but rooftop solar keeps getting cheaper every year. SMUD provided power from natural gas [1] doesn't, regardless of how much local utility solar they build. They even call their natural gas a renewable resource!

[1] https://www.smud.org/en/Corporate/Environmental-Leadership/P...
the only famous counterexample is probably the Agera RS 1MW.
Minus the projection, I think all we can say is they were warning us to take their opinion with a grain of salt because they have an ostensible conflict of interest.
https://www.sprinterval.com/

It's like Couch-2-5k for sprint intervals. I think that not a lot of people are into sprint intervals, or understand why they should be.

Got around 70 users of the app per day on ios&android combined, but just couldn't get it to get any more traction. Pretty much mothballed now, removed from app stores.
Best Buy even price matches Amazon so I've gotten the same item from there at the same price, same day, no shipping wait, no $120/year charge for "free" shipping.
Duolingo has the most incredibly inefficient web UI ever
I love how Duolingo makes learning a new language fun, and for free! But i have to say that the web UI is horribly inefficient. All it has to do, most of the time, is present you with a simple sentence which you have to translate. That is it... Looking at the HTML, it is pretty basic as you would expect, but after noticing my laptop's fan struggling like hell to keep my CPU's temperature down, I had to do a little performance test using FireFox... and whoah! this thing is running a million lines of React crap per second! It filled the profiler's buffer in a matter of seconds!!!

Can someone explain what's going on. All I can see is a lot of React stuff (e.g. reactVendor:react-redux/thunk...), but I don't really understand what any of it is doing... Why does it seem to keep doing stuff even when I am not really typing or anything??

It's so bad it's uncomfortable to keep typing for hours, as the keyboard is too hot!

Here's a link to Duolingo for those who don't know it: https://www.duolingo.com/learn

I recommend it for learning a language, but definitely not for learning how to design a lean User Interface :)
Not quite. ripgrep uses Rust's regex engine, not RE2. Rust's regex engine is descended from RE2, but there is no code sharing.

Rust's regex engine does not support backreferences. RE2 does not either. ripgrep does however have a -P/--pcre2 flag which causes it to use PCRE2 instead of Rust's regex engine. PCRE2 supports backreferences and other things, like look-around. (ripgrep also has an --auto-hybrid-regex flag, which will automatically enable PCRE2 for you if you write a regex with backreferences or look-around.)

The reason not to use an engine like PCRE2 for a project like this is because it would be trivially exposed to ReDoS: https://en.wikipedia.org/wiki/ReDoS
Another way to read it is that amazon doesn’t believe the consumer is a reliable counterfeit detector, versus “crappy product”, etc.
One possible high-risk vector: if you live in close contact with others and have shared plumbing, poor isolation betweeen drains might be a potential vector.

In the SARS oubreak, one superspreader infected numerous other people at a Hong Kong hotel. Diarrhoea and vomiting were among the victim's symptoms, and seven other guests on the same floor fell ill. How specifically the virus spread (plumbing, ventilation, housekeeping staff) isn't clear, but as with the cases of cruise ships in the current outbreak, close quarters and susceptible populations is a bad combination.

https://www.cnbc.com/2020/02/14/hong-kong-hotel-hosted-super...

In the present coronavirus outbreak, "patient 31" has been identified as a common factor amonst 23 cases involving a South Korean church:

https://www.nytimes.com/reuters/2020/02/19/world/asia/19reut...

Again: avoiding large gatherings with potentially poor hygiene and/or sanitation, in an oubreak situation, would tend to be useful advice.
Maybe he is limiting it to repositories of 50 MB or less, for example.
The Bank of England’s shifting stance on house prices has big implications
I mean, kinda. But you can buy most of the stuff that you’d otherwise get on Amazon from Costco, Target, or Walmart online, and not have to worry about it being a crappy knock off made with leaded paint. So, I think most people are rich enough to care that much.
[bottom of https://webonastick.com/fonts/routed-gothic/unicode-coverage...]
For the products that are actually regulated like the child support seats: hold Amazon liable for selling product that is illegal.

Make it expensive for Amazon to not police the shit that third parties are throwing on the marketplace - and soon you won't see any fakes any more.

You want to know where Bezos got his billions? Partially because Amazon outright shits on all the regulation that traditional brick and mortar places have - like, not selling product that is illegal, counterfeit or offensive.
There are limits to that as well - defacto standardization can have boons as well due to the "ergonomics" of many competing standards. It brings to mind the old 90s "tons of sound card options to select installing".

Open standards technically can avoid some of it but the equilibrium tends to involve "defecting" to decommoditize and compete leading to a breakdown anyway.
Launched https://www.easydatatransform.com earlier this year. It has sold some licenses and I wouldn't call it a failure yet, but the visit to download ratio is low compared to my other 2 commercial products. Not sure why. I'm pretty sure the traffic is targeted, I am solving a real problem and the website explains what it does. Any feedback would be welcome!
> if they are as good or better than the products they are mocking, are they actually "fakes"

Quality of an individual product aside, the issue surrounding counterfeits is that confidence in the market as whole will wane, which isn't good for anybody.
Old but good reading: https://aphyr.com/posts/323-call-me-maybe-elasticsearch-1-5-...
Where do you run the vps?
As someone working at google, I had never written go code, but I had read quite a bit about how how people didn't like it on places like hn. My impression was that even though personally I would strongly prefer a more typed language like rust, the deficiencies of go were probably overblown.

Then I recently had to write a small amount of go code... and I found out that go doesn't support enums....... what??? Just blew my mind.
> I think that we can all agree that when it comes to Go, simple code is preferable to clever code

What even is "simple code"? The problem I have with Go is when you need to do anything non-trivial the intent of the code quickly becomes lost in lots of for loops. You can try to abstract that away so that your program reads better, but in my experience that has always been a poor decision. I get the impression Go wants me to write big for loops that do lots of work and have lots of scope and that it doesn't want me to break my problems up into steps (like I might in a functional style by separating each stage of the computation). Go wants me to have mutable variables and mutable references. State management in Go is questionable and really left up to the programmer (mutable references and data hiding are too easy compared to functional languages where immutability generally forces you to think harder about your data's structure). Sure, this is usually going to lead to a more performant end-result, but it's not going to lead to the "simpler" result (in my eyes)

There's a lot about Go that I do like - the toolchain and docs are particularly good, and the standard libs are modern yet succinct. It is low-level enough when I want it to be and relatively high-level (nits above aside). The support for concurrency and distributed systems is also good. I can see how "simple" is exhibited there

If I had to guess at what "simple" means to Gophers (well, the Golang team at least) it would be using the fewest number of language primitives/features to get done what you want to get done. There are a lot of peculiar ways channels are used for example where other languages might prefer things like condition variables. The range keyword is overloaded and used different in several contexts but it does keep the number of keywords low. Most Go tends to look the same (low-to-the-ground, verbose)

Go is great until it isn't and when it isn't you have little choice but to brute force around some of Go's clunky pieces. Extracting high-level meaning out of Go source can be difficult because of how verbose it can be. I'm glad it's around and it's a good choice for a lot of projects, but I really wish we could have simple things like generics so we can write cleaner code

In short, Go as a language may be simple (and I think it is) but I need to solve complex problems - either Go helps me with that complexity or it leaves me on my own. Go has chosen the latter of those options and I'm not convinced that our Go code can be simple for many non-trivial applications
Releasing resources is not error handling...
And in Java you don't even need finally for that, there try-with-resource.
Why does the BBC want to 'kill' Netflix? Why isn't it enough to provide their own service? Why do they want to 'kill' off independent competitors?
I never heard about Passive DNS before. Thanks.

That said, shouldn't that be illegal? Where does this data come from anyway? I'm guessing spyware - on the phone, in browsers, and spyware browsers like Chrome.
Simple explanation of how workers in an industry can help each other
A strike is when workers take collective action that benefits all of them, by not working until demands are met. Usually in a specific industry, but there are also general strikes. However, with strikes, if employers do not give in, the workers are worse off as a result of having gone on strike.

This is not a strike but it has a similar characteristic, of group benefit.

If people working in the software industry work less, it helps other people in the software industry.

This argument uses the assumption that work done is linear with time spent working. Some people won't agree with this, but the founder of HN argued[1] that

> . . . real work needs two things errands don't: big chunks of time, and the right mood. . . . There may be types of work that can only be done in long, uninterrupted stretches, when inspiration hits, rather than dutifully in scheduled little slices.

In the simplest case, people work X% less time and receive X% less in total compensation. These people are still just as valuable to their employer.

Due to requiring the same total amount of work, new workers are hired. If they are less efficient, they are also paid less, and so the decision of existing workers to work less does not negatively affect the company.

However, in aggregate, more people employed means fewer people looking for jobs. This pushes wages up.

Result, more people employed in the industry and higher wages for everyone.

[1] http://www.paulgraham.com/procrastination.html
Go-flavored Pascal: A small embeddable self-hosting Pascal compiler for Windows
I'll agree that modern mainstream browsers (and devices!) have an increasingly centralized security model that isn't at all conducive to an open web. But given the current state of the FOSS ecosystem, I'm not terribly concerned in the long term so long as the network layer remains open to all.

(Consider: QtWebEngine, PinePhone, SiFive, OpenTitan, IPFS, DAT, Solid, ...)
I agree, I thought that too. These days they almost always have two links to buy each product, I usually go for whatever isn’t Amazon.
That may have been true once, but no longer thanks to "commingling":

"Sellers on Amazon can pool their goods with the same exact goods offered by Amazon itself, a practice known as commingling. This has advantages for sellers — less processing is needed, so it’s cheaper — but it also explains how Amazon can unknowingly ship counterfeits despite getting stock directly from the printer."

"What Happens After Amazon’s Domination Is Complete? Its Bookstore Offers Clues" NY Times, June 2019
https://www.nytimes.com/2019/06/23/technology/amazon-dominat...
I get told all the time about how the standard library isn't a great example of go code, because of the backwards compat they have to do.
These travel routers [0] [1] support OpenWRT and/or Wireguard, as client and server. They also support connectng to captive portal WiFi networks so they're perfect for travel.

[0] https://www.gl-inet.com/products/gl-ar750s/

https://openwrt.org/toh/gl.inet/gl-ar750

[1] https://www.gl-inet.com/products/gl-ar300m/

https://openwrt.org/toh/gl.inet/gl.inet_gl-ar300m
"The fake glove’s painted-on lines gave off a melted-plastic smell when we used it to hold a heated cast-iron pan for 10 seconds."
I wrote up an analysis of 13 failed commercial software products here:
https://successfulsoftware.net/2010/05/27/learning-lessons-f...
it is from 2010, but I think it still pretty relevant.
(TL:DR mostly a lack of market or marketing)
Netrunner Linux 20.01 “Twenty”
Tldr: House price increases (in the UK) over past twenty years can not be explained by lack of supply (so the build more houses movement is likely to fail). The reason seems to be houses as an investment asset - and the rise in prices has been accounted for by the decrease in cost of money.

In other words solving the housing crisis is not a function of building more houses - it needs (and this is not in articles / Mulhairn analysis) active discouraging of houses as asset investments (taxing second homes etc) and focused welfare services to stop people falling off the bottom of the ladder.

It's going to be a bumpy correction across the entire Wesrern world
I'm going to go with Betteridge's Law here, and say the answer is self-evidently "no"
It’s brought up to prove the opposite. I would suggest reading it through, it’s quite good.
Krita's become mature over the years.
“ the overlap between players of games like Doom and those like Myst is inevitably limited. (The surprising thing is that an overlap exists at all…)”

Really? Is it that rare to like both?

I find this hard to believe.
Hey!, tried Webase and looks very good. While testing it I found something that could be a bug?. I created a new app, and a new table with just one string field, and then whenever I create a new row it gets added twice. (Name of the app/table is Test App/Robot). Keep it up!
Why kubertetes vs docker? And why rust vs D or golang ?
What Is Exploratory Work?
This seems like a solid idea but it seems to me like it needs to be marketed on a per restaurant and it needs to be part of a more comprehensive suite that helps restauranteurs get customers into the restaurant, ultimately.
One thing I've learned in this industry is that it contains many, quite separate universes!
I don't vote: it is a contest of choosing the most convincing liar IMO. If we could vote every year, and vote them out when they do not fulfill their campaign promises, I'd be more inclined to vote.

I'd much rather have a lottery system, because I trust the general population to be honest much more than I trust politicians to be honest.
Jens Nygaard Knudsen has passed away
Dumb question but how is react better than jquery? (Im from 2010 instead of 2017 like op)
Can't you preload the content you want to watch on Netflix and similar?
Yup, they call it "commingling". So even if you make sure it says "sold by and ships from Amazon", and Amazon itself only buys from legitimate vendors, you could still wind up with a counterfeit item introduced by a third party seller.
Turtle is a very nice format to read and write RDF in. There is no same XML serialization of RDF. RDF/XML is very annoying and unintuitive to write and parsing it into triples requires a lot of work so you need a special library anyway. You might as well start with Turtle then.

That being said, it's easy to convert from one format to another: you'll get the same triples. So just use what you like.
Also, a 2 hour (!) interview with Rand Miller by Arstechnica, which has been absolutely killing it lately with their in-depth gamedev coverage -

https://arstechnica.com/gaming/2020/02/an-extended-interview...
That sounds awesome! I am also a motorcycle rider. FWIW Darksky API and data is great!
I would generally agree but it's what BHW deserve
This is great. Thank you for making it!
Maybe you could run that cron job more often for people on the other side of the pond?
Right now, I'm only seeing news for Saturday.
Systems Thinking is essentially a buzzword for consulting to managers and politicians. It is not for engineers. Well, maybe when engineers try to make a point to managers or politicians.
I admit I only dip my toes into the Java ecosystem occasionally. How low is low memory usage? The last microservice-oriented Java framework I used was Spring Boot, but I don’t know that I’d call it lightweight.
nextjs? whats that

you meant "nestjs"?
Something this article doesn't appear to spell out is that the structured format WASM is constrained to means that program CFGs will never contain irreducible loops. As noted, this approach can make it harder for the AoT compilers (they have to untangle the knots to generate valid WASM bytecode), but it makes it much easier for the JIT compilers to perform analysis and transformations at runtime. In that context, it seems like a sensible engineering decision.
I sadly found this article lacking visuals of such a fascinating topic. Here's a video : https://youtu.be/VQJGantR2DA
No non tech person is going to use Duck Duck Go.
Flight and plane wifi generally charge per device, block things like UDP and ICMP that break the internet, filter and MITM websites, including MITMing HTTPS, only allowing port 80/443, all sorts of horrendous malicious/hostile things.
"Java market share is declining" -- yes, 90% down to 86%
The reason for these regulations is that the BBC can produce and offer things free at the point of use (broadly) because of an essentially forced payment. This can have problems because it puts a greater barrier in the way for competitors.

I'm not sure they got it right here but there is a valid reason for this kind of regulation.

> The British TV industry wouldn’t see an on-demand service for nearly another decade.

I'm sorry, what? There was an on demand service before this, as talked about in the article. And it absolutely didn't take until near 2019 to see others appearing.

> Netflix would’ve never stood a chance of getting its current market penetration [in the UK],” says the BBC source. “All the big players would have had the market covered for streaming video-on-demand (SVOD)

That's kind of the point though, isn't it?
My rule is be skeptical of anyone proposing a rewrite who doesn't fully understand the existing system, to such depth that they would feel comfortable refactoring it. Which means anytime someone says "we want to rewrite it because refactoring it is too hard" I tend to not believe them.

There are times when rewrites are less total work, but they're hardly ever "easier" when you account for the cognitive load of making sure the requirements of the rewrite are being accurately captured. Maybe there's an exception if you know the requirements have been drastically simplified, but I doubt that's practically useful.
https://atlas-api.com/

I probably need to promote it better, and get a better landing page set up. It could probably benefit from an interactive map as well.
This can be solved with an "I believe the item I received is a counterfeit" option alongside the "Item is defective or doesn't work" option already present during the return process.
https://parepdf.com A web app for comparing PDF files. Figured that a more intuitive comparison experience would be an obvious advantage. It didn’t gain traction although I still use it personally on a weekly basis.
I believe the https://www.netatmo.com/en-gb/security does on-device AI that recognizes different people, and lets you use an app to tap into and tell it sames (or other ids) of friendlys to ignore. - Notify if new person is detected that has not been labeled as 'supposed to be here usually'

Last I looked into this you can have this avoid cloud data processing completely, so it's private and smart.

Haven't started using it yet, so can't give review and more details yet.
Requirements are fairly volatile -- but the real problem isn't that the requirements themselves are volatile but that the true requirements are so poorly understood (and, thus, the apparent requirements shift rapidly as understanding of the problem domain changes throughout the software lifecycle).
Otrag