skysight-inc/HackerNews huggingface dataset:
Thanks, yeah.
At this stage we really just want to validate if this was a real problem in the ML community.
Down the line I suppose as we scale to handle multi instance training and other use cases, we could probably charge more, say a % of the cost savings in training.
> in fruit flies
a good use case is malicious URL detection for browsers. they can look up locally and get a sense whether the url is bad and then double check against webserver.
Interesting distinction between east and west coast! Could it be because academic fields are less influenced by “looks and impressions”, while SV/technology fields are easily manipulated by people who appear to be experts?

As in: in academia if you say something, people are trained to analyze the veracity of that, and to judge you based on your methodological/academic rigor. Meanwhile, in SV people judge you on past projects and financial conditions, which are not tied to knowledge about reality at all. I don’t know if any of what I am saying is factually correct, I’m just guessing and wondering. Don’t take it as fact, just my biased, un-founded opinion created around what I see online.
I think you have an inaccurate understanding of what monks do. Also I'm not sure if I'd call monks happy so much as I would content.

The better example here is the guy living off of UBI smoking weed and playing video games all day.
And also not O(1) nor intuitive for any non trivial query.

You don't need to have an explicit `JOIN` operator in your language, but any query that goes beyond unconditional tree walking will benefit from using joins under the hood.
that's what I also came here to say....
Surely that is an eating disorder or beginning of one?
I'm curious about the PR strategies at play when governments either saber-rattle or keep secrets.

Announcing breakthrough, surprising even, HAWC tech seems to clue in opponents about what sorts of countermeasures they'd want to start developing.

By contrast, the US has held the high-altitude Aurora/SR-72/whatever tech very close to the vest for decades, when it's pretty much obvious that a new generation of high altitude replacements for U-2/SR-71/etc have been in the works or operational for a long time.

Could this be economic trolling/baiting like what in the 80's, (in part?) contributed to the USSR bankrupting itself trying to keep up with cold war tech?
I feel like using Russia as an example of the standard US diplomat experience is probably misleading. I suppose I wouldn’t be surprised if similar things happened in South American or African embassies, but a combination of our history with Russia and its general temperament has got to make it a one of the places most prone to this sort of non-direct fucking with people.
Anecdotal: the richest self made people I know work the hardest, the poorest don't work at all or as little as possible, by choice (state pays). People who inherited wealth are the unhappiest and the people who do well but not enough to be rich (I guess some type of middle class) whine about it all and want to be rich to vacation the rest of their life (but will probably never get there as they never run, just chug along and keep whining).
In my opinion A Deepness in the Sky is a better book. The spiders are more interesting than the dogs, and the two storylines are much more closely intertwined.
I use them in astronomical data indexing when doing cross-match searches. That is, “could there be a star or other moving object in within 0.5 arcsec of this point in the sky?” Sky catalogs have many billions of objects but the density per solid angle of the sky is extremely variable, and moving objects also make lookups really complicated. Sky catalogs are big enough that they are not storable in memory, and may be in big Parquet tables on the network, so the full lookup is quite expensive.

Bloom filters are great for this because the backing dataset changes extremely slowly, like a few times a year when a survey publishes a new data release.
Yes, and then do a join ;)

I'm not arguing for explicit joins, which are an artifact of SQL and not even the relational model e.g. Datalog as a explicit join free relational language.
I had a similar problem, and the solution was to change out the filter in the non-functioning earpiece [0] with the tool and replacement filters that came with the device.

I also bought a replacement cable, which didn't work, then contacted support for a replacement. Their suggested fix of changing the filter worked. I suspect the reason may have been moisture; I washed the silicon tip with soap and water, then put it back on the earpiece and filter without waiting for it to fully dry.

[0] https://www.youtube.com/watch?v=qbDgTa8Htzo
Read Vernor Vinge's "The Cookie Monster" to see one of the major inspirations for Black Mirror, and a character similar to Elon Musk. Full text here:

https://www.ida.liu.se/~tompe44/lsff-book/Vernor%20Vinge%20-...

Also everyone should read Vernor Vinge's "Rainbows End" to understand a plausible outcome of the technological change we are witnessing today.

It's a bittersweet book, about being a small human in a world where the value of individual creative efforts are overwhelmed by the sheer might of automation and vast collaboration and technological accumulation.

https://en.m.wikipedia.org/wiki/Rainbows_End

You will recognize Pokemon Go, and many other things that happened after the book was published (2006). Great foresight.

Wikipedia: Vernor Vinge is an American science fiction author and retired professor. He taught mathematics and computer science at San Diego State University. He is the first wide-scale popularizer of the technological singularity concept and perhaps the first to present a fictional "cyberspace" (in his novella True Names).

By the way, Adam Back (probably Bitcoin's Satoshi Nakamoto) has referenced the True Names novella in interviews when explaining why Satoshi Nakamoto remains pseudonymous. So Vinge influenced that, too.
For those wondering how this compares to Panama and Paradise Papers, those were leaks from mostly one company. This one includes 14 spread across many jurisdictions.
for 20 hours?
Is he just moving bytes from the file into the file name? He should count the increased size of the file name in the size of the compressed file otherwise he’s not counting all of the essential data you need for the decompression.

You can decompress a gzip file without the file name (think about tar using a pipe.)
Salisbury's clearly well-informed and knows how to ask a question without probing or catering to Thompson. Thompson is home at ease in his snow-covered Aspen hamlet. They're both journalists/writers with a mutual respect for one another and the craft. And the medium in that era was often there to capture a record of the proceedings, not to generate a product of it. It's not a lost art per se, but having all the great interview ingredients from what's on display in this video sure seem to be rare.
Orbs, plural, but the linked article only has a photo of one of them.
Graphistry gets used for all sorts of graphdb + non-graphdb data projects, which has led me to think of it sociotechnically on 2 dimensions:

- Approachable semantics. Graph-y queries like untyped entity 360 views are way easier to write in graph langs. This matters for programmer adoption. But tabular systems can be simpler to implement for doing great on all sorts of other things, so other tricky tasks on SQL have gotten industry weight over decades, while the market rewarded graph query langs more for doing great on graph tasks... and just passable on non-graph.

- Diverging performance for sweet spots. Graph DBs get optimized for graph queries that SQL DBs struggle at, which matters for big enterprise contracts => most revenue. There are competing graph workloads to optimize for -- handling heavy concurrent small read/write queries, big whole graph compute, fancy iterated symbolic reasoning, horizontal scaling, GPU acceleration -- and while in theory you can combine most, reality is even with VC money someone like TigerGraph gets great scaling but not say GPU speed/efficiency of cuGraph, and neo4j wins at usability. SQL engines will have better specializations for HA, GIS, time series, etc. In theory those can be special indexes in graph DBs (I think neo4j uses lucene for text indexes?), and vice versa within SQL. But practically, it takes a lot of time and $$$, so compounding engineering years fueled by enterprise $ is playing out.

So in both cases, we see SQL taking compounding benefits for general purpose use, while the niche graph space goes deeper in its sweet spot. Neo4j and maybe TigerGraph might be 5-10 years away from being great general databases. With the rise of open source for specialized index types and ecosystem adapters, this is interesting to consider!

So does SQL eat graph before graph eats SQL, or more timely, will the graph DB niche grow or shrink? IMO it is a quite interesting time in this space.

In particular, the increase in data scales, rise of NLP knowledge graphs, and need to fuel AI/automation systems with things like 360-views of entities has grown the modern need for graph DBs. Still a small % of general DB use cases, but great wrt current enterprise/tech DB market size (1-10B?) and probably 2-3X that in 5 years. Separately, the new ubiquity of large & high-fidelity operational data (clicks, logs, transactions, sensor reads, ..) have led to a corresponding ubiquity of behavior and relationship questions. Graph intelligence includes working directly from log and SQL DB systems, which are 100X-1000X bigger than the graph db market. That has been fueling our corner of graph intelligence (viz, BI+automation, AI) space.

Anyways, this adds up to Graphistry and basically all of our graph partners are hiring (we do intl remote!), and I encourage folks looking for their next thing to check all of us out :)
Oh, that's elegant.

If I math right, setting 5 bits in a 64-bit word extends the effective length of the hash function by approximately (5-1) * log_2(64) = (5-1) * 6 = 24 bits. In a simple bloom filter of storage size m bits, the hash functions have length log_2(m). All else being equal, the number of hash functions used -- hence the number of memory reads per lookup -- gets reduced by a factor of log_2(m) / [24 + log_2(m)].

(But it's not exactly equal; the storage size m has to go up by a factor of 1.2 (in the OP parameter set), for constant false-positive rate).
History of science, as a scholarly discipline, is unfortunately rather decoupled from science (or engineering) itself. Practitioners of a field are rarely as interested in the field's history as they probably should. History of CS in particular has not attracted much academical interest even among science historians, possibly due to its relative youth and technical nature.
How can you have a 28 hour feeding cycle? The article states that they alternated a 20 hour fast with a 28 hour feeding cycle. Doesn't the 28 hour feeding cycle also include a fast since the fruit flies will sleep at night?
Have you considered the possibility that Fed actually has overall positive role (limited by it working within the mandate)?

I'm not saying it does. But most people with very negative view barely know what Fed does and why it does what it does. Also they don't differentiate between what tools Fed has and what should be done using other means by Treasury and the rest of the government, but was left to Fed because politics is dysfunctional.
One of the best books I've ever read. Not only that, the prequel, _A Deepness in the Sky_, has the most plausible managerial villains I've ever read.

Vinge, man. Vinge.
I'm just reading the book "Attack of the 50 Foot Blockchain" by David Gerard.

https://www.goodreads.com/en/book/show/35525995-attack-of-th...

It was published in 2017, but lists all the false arguments the author of this article makes. Even M-Pesa, mentioned in a lot of replies of the commenters, is mentioned.
I’ve been slowly working on implementing git in Common Lisp: https://github.com/fiddlerwoaroof/cl-git

I think I have most of the object type parsers done for loose objects and pack files, just need to finish implementing the delta ref decoding algorithm.
If you haven't already tried it, a filter replacement with the tool and filters that come with the device could do the trick [0] (fixed a problem I experienced myself). Another common fix is to switch out the cable, though I've only experienced failure due to old filters (3 years usage).

[0] https://www.youtube.com/watch?v=qbDgTa8Htzo
Not OP but my guess is NoSQL wins were data isn't very relational or traditional RDBMS and ACID don't fit. One could even argue that file systems and key value stores are NoSQL solutions that predate RDBMS. Yet a lot of businesses just need something reliable, roughly relational, and with a community of talent.

All that said, the world of successful solutions is not mutually exclusive or limited to only one winner.
Curious, did you eventually start using Sagemaker with spot instances or did you give up on it ?
Also what would you say were the biggest pain points with Sagemaker?
That's fair. I've seen a few mentions of Koka and OCaml 5.0 is going to have effects, though both are relatively niche. I was expecting to hear more about linear types too, I feel like one or two years ago (relatively) lots of people were talking about them, but I haven't seen much coming out of it.
Try watching this video:
https://youtu.be/Bay3X9PAX5k
try this? - https://llimllib.github.io/bloomfilter-tutorial/
I had to read the blog on lynx due to light grey text on white. I wish people will realize many people will have a hard time with that coloured text.

Well a bit concerning in a way. Does this change require GNOME and/or Wayland ? The way I read it it seems so, but little detail there.

I wonder because I use fvwm2 as opposed to Desktops, which I really do not like at all.
I think Excel's prevalence is a sign that tables are natural to people (to the degree we can say a data structure of any kind is natural, but, well) -- the struggles come in, I think, from

- trying to use it with data where tables are a poor fit, or

- trying to use it with data that can't be reasonably represented in more than two or three tables

I still use spreadsheets for simple "databases," but I can't think offhand of any time I've a spreadsheet that requires more than two interlinked tables/sheets.
At this point Netflix is practically begging us to use TPB :)
Buddhist monk fits this article; most people like the GP (unless I read their message wrong) want the happiness (as they saw on youtube; never talked to any of course) but without the cost so they might assume that to become a Buddhist monk type of happy you just 'throw away all modern crap' and meditate and then you achieve it. Only to find out that that does nothing long term although it might alleviate short term stress.
That's fair, and that also explains why "unregular" sex is shown the most, and not "healthy/regular" sex.
> contributed to the USSR bankrupting itself trying to keep up with cold war tech?

Source?
The reality is that RPA, AI, ML, etc ... are still years away when it comes to the industrial sectors (e.g. manufacturing, energy, oil & gas, etc).

Sure there are many PoCs, smaller projects, but in my experience, working on data centric projects with a few fortune 500 industrial companies, none of these technologies have been successfully implemented in production.

Perhaps for some back office & business-level applications, but certainly not for any production related use-cases (e.g. predictive maintenance).
> And generally if you have to scale you have money and money can make any system work

That's the thing, this is not always true. It's true that generally you can throw money and hardware at a problem, but at some point you just reach the fundamental limit of the technology, at which point throwing money at the problem doesn't work.

In fact, being in a position where you can throw money at the problem is _brilliant_, as spending money is easy. So the point of _scalable_ technologies is to enable you to scale just by throwing money at the problem.

Case in point, at my old company we had this _massive_ Pg database running in RDS. It did not scale. Performance was terrible, and made the user experience shit. We were basically using the biggest instance size we could, with a few replicas powering read only endpoints. So at some point we migrated parts of it to Dynamo, and poof all of our problems went away, including operational ones.
The poor quality of an audiophile can still be great quality compared to the average. But any headphones that fit or feel well are better than ones that fall out all the time, even if they're overpriced from some cost/sound quality equation.
Economics at its base is group psychology, and humans are irrational and wildly unpredictable. A lot of economics writing depends on a rational human that actually doesn’t exist.

Hence why a lot of economics is speculative and should only really be applicable to specific cultures that are being studied, since cultural behaviors and expectations will effect economic behaviors and outcomes.

There’s a balance between data and interpretation in economics, which is why it’s a social science. There are disciplines like Austrian economics that discount quantitative analysis, but that’s as wrong as relying purely on quantitative analysis.
I like to think of it as glorified VBA macros, as most software of this class runs on top of Windows automating desktop apps.
Also, that one photo makes it look like it's not a deliberately polished stone, more like a regular wave polished beach rock.
The author seems to have confused 'pilgrim' with 'traveler'

At least, I don't see how to reconcile someone who does (say) the hajj out of religious obligation with the more generic 'some objectives we are wayfaring towards'.

A tourist is also usually wayfarying towards objectives. So is a rally driver.

The author similarly redefines having a religion more along the lines of 'dogmatic belief' - a category so broad that the assertion "I love my wife" might be considered a religion.

There is nothing about nuance between a religious pilgrimage, like Tibetans on a pilgrimage to Lhasa, or a cultural pilgrimage like the Camino de Santiago ... which is closer to tourism, but (IMO) often not the same thing.

I find it hard to think that a Tibetan, moving forward one lying prostration at a time, or a Muslim walking around the Kaaba, would 'thirst for and welcome unflattering comments', as the author writes.
I will clarify, to be fair, that account wasn't under my real name.
HOWEVER I thought requesting goddamn government ID was a bit much. Just let me have my burner FB account...
> the curve has no cofactor

The groups do have a cofactor of 2 ("Curve order must be equal to 2r for a prime integer r"). When they say "There is no cofactor to deal with", they mean they pick a generator that's divisible by 2 (like G=(2,2) in do255e) and use curve point representations that only allow multiples of G.
> It isn't going anywhere until it has a high-level query language (including SQL support), query optimization, internationalization, ACID transactions, blob types, backup and recovery, replication, integration with all the major programming languages, scales with memory and CPUs

I would seriously argue that all of these are necessary for a database to be useful. The sad fact is that no graph databases in existence truly act as graph database, without some weird caveat like "you must have schemas".
In America we can get unanimous support to provide healthcare for CIA agents suffering from a disease that doesn’t exist, but giving free healthcare to regular people is politically unthinkable.

https://www.collins.senate.gov/newsroom/bill-support-%E2%80%...
This is a very nuanced topic that treads on very dangerous grounds on this specific forum, though I am trying my best to remain respectful to all.

I think it's important to remember that there's a difference between legal definitions and what the modern, en vogue morality is. (and keep in mind that the modern morality is not defined, but can change over time as new situations emerge)

In terms of legal documents such as what sex appears on one's drivers license, I imagine that somebody wanting to change their official sex designation can be done, but would require filing some change request or affidavit with the state.

In terms of modern morality, gender identity (gender is considered to be different from biological sex) is considered fluid and may change from day to day. I believe that some people may even choose to identify as non-gender, or multiple genders at once.

Racial identification is another question mark, particularly for Americans and is very convoluted. Look at questions 8 and 9 on the Census form as an example of how officialdom tries to determine race.

https://www2.census.gov/programs-surveys/decennial/2020/tech...

In America particularly, laws based on race are really dumb. What the hell do you do with somebody who is a mix of white and black or is a white person with a hispanic background? Do we need government committees to try and determine if somebody is too white to qualify for some job?

As far as the modern morality goes, there are some number of people who self-identify as trans-racial and seem to identify with a different racial group. I don't know what will come of that.
Not anecdotal: By nature of the structural relations of our society, the richest people are exploiting the labor of the poorest people, which leaves little reason for the poor people to coopperate.
I feel blessed to have some unknown quality that invites strangers to open up and reveal deep parts of themselves to me when I am engaged with them for even the most trivial of interactions. Connecting with all sorts of people in this way has really broadened my perspective on life in a healthy way.

Unfortunately, I seem to have some other unknown quality that keeps people from making that initial approach. I am working on how to make that approach myself, but it often feels forced and I get nervous.
“I know”. This says more about you.
US's answer to Russia's Zircon missile?

https://www.military.com/equipment/weapons/why-russias-hyper...

> U.S. Aegis missile interceptor systems require 8-10 seconds of reaction time to intercept incoming attacks. In those 8-10 seconds, the Russian Zircon missiles will already have traveled 20 kilometers, and the interceptor missiles do not fly fast enough to catch up.
If you mean https://commoncrawl.org/: of course you can. Grab a few specific words from the page and away you go.

Sample searches:

an open repository of web crawl data ⇒ first hit
open web crawl data ⇒ first hit
free web crawl data ⇒ third hit

it seems “data” is essential here.
8 hours between meals isn't fasting by any definition. That is the average you get when you eat the normal 3 times a day.
Thank you for sharing! I’ve been disappointed with my Pro AirPods since I got them at launch. I’m not sure why it didn’t occur to me to look for third party replacements to improve the fit, but I’ll give these a try- thanks again!
> Mach 5 is a bit faster than the Virgin Galactic flight (Mach 3)

Mach 5 is a lot faster than Mach 3, not only in relative terms (it's 40% faster) but in absolute terms as well: around mach 5 is a regime change where the physics of flight get altered and interference effects become extremely significant, small changes to any surface component will have major impact on airflow, and thus will affect any component downstream from them.

This makes air-breathing hypersonic devices a much bigger challenge than air-breathing supersonic ones.