skysight-inc/HackerNews huggingface dataset:
I was wondering when this would come up. Everything people are inventing in the "ECS" space, including the very concept of "ECS" itself is just concepts from databases being adapted to storing small amounts of ephemeral data that needs to be manipulated very quickly in-memory rather than large amounts of data that need to be persisted reliably on disk.

The idea that there's anything patent-worthy in automatically storing like combinations of data with like combinations of data for efficiency is... patently absurd.

But that's where the patent system is, now, I suppose. It's now mostly just a tool to help incumbents raise the barrier to entry so they can fend new entrants off with lawyers rather than merit.
We chose them because they were fairly straightforward to implement and different enough from one another that we could ensure our interface generalized well.

Re benchmarking - at this point we're looking to show directionality, not necessarily blinding speed. We intend to get the tooling feeling right, then work to optimize perf.

Right now, training data comes from the local disk, InfluxDB, or can be piped in from your application via our API. We're looking to build out a set of community-driven components for streaming and processing data. You can learn more about that here - https://github.com/spiceai/data-components-contrib

We'd love for you to contribute!
Unfortunately your second sentence is not correct; patents do this overclaiming game all the time.

(not a lawyer, co-inventor on three patents so I've been through this, unfortunately as I didn't want to participate in that system, consult a lawyer before doing anything rash).

The claim matters, not their detailed description. The most harmful patents work that way: describe in detail a specific implementation, but write the claims to cover every alternative implementation you can think of.
On my default Ubuntu install, the hard limit for open files of a process is 1048576 (ulimit -Hn). So you you have to run a handful of processes.
My $5/mo server can handle several thousand requests per second. It’s mostly a question of what server software you use. If you use some node, python, ruby thing, it’s going to be slow as shit and need a reverse proxy in front of it. If you use a fast compiled language with a good framework, you can rip through requests no problem.

I tried a bunch of different stuff and ended up using Haskell - all of its popular web libraries are fast as hell. Go was fast but its standard library leaked sockets or I was not cleaning up connections properly or something, and it would tank whenever something went viral. All the popular interpreted language backend I tried were absurdly slow, like tens of RPS.

Source for my current thing is at http://yager.io/Server.hs. It also does all my RSS stuff, image processing for my photo gallery, etc.
My dad used to quote somebody in saying, "Education is wasted on the young".

My experience sounds similar to yours. Though, when I tried to go back to school to dive in again, I found the 'system' was highly oriented towards parenting 18yo kids in all the worst ways imaginable. It was nauseating and unbearable being in that environment, and even going through the application/acceptance process (filling out pledges for conduct, right-thinking, etc). Much has changed with online learning, but I still feel the B&M universities are a very ill-fit for independently-minded adult learners.
Rust programs written entirely in Rust
Windows is probably the most important piece of software in the entire world, yet Microsoft does not treat it like the most important piece of software in the entire world. They have no sense of responsibility about foisting this garbage onto billions of users.

I've been a lifelong Windows user, but I've come to feel that Windows needs to be completely replaced. We simply cannot trust Microsoft with mission-critical software any longer.
To clarify, though, this is just an issue for people who are deliberately getting preview builds (aka beta testers), correct? The article feels pretty click-baity with that critical detail not part of the title.
Eurex uses FAST for sure, but I can be wrong about "common".
Last I checked cloudflare was running nginx.
Gemini is the Twins. Sometimes people say that Geminis have two personalities. I think that he is saying that Pushkin is simultaneously a prick and touching/amusing/amazing.
There is a strange rule that each claim in a patent must be one sentence. So they construct these massive run-on sentences.
Bad example considering censorship is also a tool of murderous and totalitarian regimes.
Draft of open spec for digitally-signed authentic photos/videos published
I don't see where in your source the data paints that picture? Social sciences and history is 8%, family and human sciences is another few percent, journalism is also listed out separately, as is liberal arts and humanities... Maybe there are better sources that break things down per major so we can see the growth?
Alpha Zero would be a good start (a generalized version of Alpha Go, that started the current AI hype cycle) https://duckduckgo.com/?q=alpha+zero+github&t=ffab&ia=web
China restricts young people to playing video games three hours a week
I visited Xerox PARC in the 1980s. I was already coding on a Macintosh of some kind, pre-Mac II (color), and in Postscript. The topic of the day for me was print halftoning algorithms. The researcher I spoke with was patient, and interested in new ideas.

It is hard to describe the different information environment at that time, as off-beat print, major newspapers, television and film were active and very influential, yet so different in practice than today.

I came away from my visit to Xerox PARC with a sense of participation despite being self-trained, and respect for those working there (I was pretty young); good times and inspirational overall.

edit-- probably 1985-86 or so..
There is no proof their OpenWhisper implementation wasn't tampered with. And chances are against users, since it's proprietary software.
Mangrove Restoration Frustration
I find that a sense of scale is important to appreciate the Webb. Here are some of my favorite photos,

https://www.nasa.gov/sites/default/files/styles/full_width/p...

One of the taller people in there is 6'4. :)

Here's one with a human for scale standing near the mirror,

https://c2.staticflickr.com/2/1586/26602405532_980d7f8d4e_b....

With the folded assembly,

https://www.flickr.com/photos/nasawebbtelescope/50268583177/...

The JWST going in for testing,

https://www.flickr.com/photos/nasawebbtelescope/25003831358/...

With the sun-shield unfurled,

https://en.wikipedia.org/wiki/Sunshield_(JWST)#/media/File:J...
Google Cloud CDN? https://cloud.google.com/cdn/
Why doesn't Twitter just make their posts unlimited? People would still write short, terrible, infurating tweets, but they could finally stop these run-on multiple-tweet abominations.

Or make an actual blog feature. I know that wouldn't be as "engaging" though.
They are just pointing out the size of crypto market data vs normal market data. I found it interesting, not their fault you didn’t.
The eviction moratorium ended already in most of the country, and Covid-based unemployment benefits ended already in some states.
Why is it so common to bunch email, todos, and calendars together? Is this based on some memory of a desk from the 1980s, where one might sit down to write a letter to one's friend, check the calendar to see what date you should suggest meeting, and then mark on a sticky note that you need to get milk when you're at the grocery store?
Rather more common that the Windows registry: any kind of filesystem.
As a consultant using a client macbook that is heavily neutered by its security and safety protocols... I'm wishing that I were able to install this. Excited to try it in the future.
Nope, I want to say, that even much more data could be processed on very limited hardware, and that it is additional confirmation that current hardware is immensely powerful and very under-estimated.
I've thought often that one could write robust automation engines that boil any SaaS app down into a few functions:

search(terms?: string) -> Promise<Item[]>

expandItem(itemId: string) -> Promise<Item[]> # gets more details for the given item (e.g. a thread) and any child items (e.g. messages within the thread)

...

One could build this for Gmail using https://inboxsdk.github.io/ , and other apps ranging from Slack to Google Calendar to Dropbox to your issue tracker du jour with screen scraping, treating each message or ticket or document as an item. Not an easy task as you'd be fighting against the current of rapidly-iterating frontend teams changing class names and structures as they see fit, but doable. The possibilities of how to collate and visualize this data would be endless!
Calamares(a Linux installer framework) 3.2.42 released
Really well done.
It sounds like they are caching database queries.

> Parts of the blog posts are cached using memcached for 10 mins

That means Django needs to accept the request, route it, pull the data from memcached, render the template.

For such a site I'd just set the `Cache-Control` headers and stick Varnish in-front of it acting as a reverse proxy. That'd likely increase the page load times significantly and make the backend simpler not worrying about manually caching in memcached and just setting the correct `Cache-Control` http header.

As it's budget hosting i'd probably not even bother with Varnish and outsource that to Cloudflares generous free tier, it's cheating as your server (Origin) isn't doing 4.2m requests but the practicality is really convenient.
No thanks. Cloudflare is very harmful to Tor and to user's freedom and privacy in general.
I’m convinced that 80% of the hatred of modern Windows could easily have been avoided if they just made both settings areas have, you know, all settings.
Boggles mine that people believe proprietary platforms blindly. It can't be proved that there's no backdoor added after the initial consulting for OpenWhisper.

Gee, seeing how they defended Whatsapp tooth and nail time and time again, I'm inclined to not be surprised if it was added _during_.
Yes, the rules changed in 2011, as part of the America Invents Act. https://en.wikipedia.org/wiki/First_to_file_and_first_to_inv...
So what is "control of private life"?
> we're okay with this level of uncertainty

no, you are not the customer.. executive management, legal and finance are the target customer
This would be a good quick hack project-- a program that accurately blueshifts JWST images.
I think there's partly a generational divide there. I remember when GNU software was released as tarballs on a schedule of roughly "whenever the maintainer decides to cut a release" and CVS access was limited to the core maintainer(s).
I did work at the power station for SLC-6 around that time. As a long-haired engineer, I always attracted special attention at the guard shack - especially the first week of the Gulf War, when I drove in my old Volvo station wagon with peace bumper-stickers. It's kind of strange how much of the natural coastline was preserved by the base and which otherwise would have been built up.
I’m surprised to discover that promise flattening. Never noticed it before. Thanks!
Lol with my luck this would be like tonight's Rise of the rune lords pathfinder game where my l14 wizard got doppelganged twice.

The first doppelganger first critted a disintegrate spell and killed the rogue 200hp dammage

The second doppelganger one shoted my character.

50% party kills in one round.
The cost doesn't come from a lack of production efficiency. A significant fraction of the cost is for testing/validation of the spacecraft, which must be done for every unit you produce. Simulating operating conditions on Earth is extremely expensive and time consuming.
If I look at traces of all the service calls at my company within our microservices environment, the "meat" of each service is a fraction of the latency -- the part that's actually fetching the data from a database, or running an intense calculation. Often times its between 20-40ms

Everything else are network hops and what I call "distributed clutter", including authorizing via a third party like Auth0 multiple times for machine-to-machine token (because "zero trust"!), multiple parameter store calls, hitting a dcache, if interacting with a serverless function, cold starts, API gateway latency, etc...

So for the meat of a 20-40 ms call, we get about a 400ms-2s backend response time.

Then if you are loading a front end SPA with javascript...fugetaboutit it

But DevOps will say "but my managed services and infinite scalability!"
What would the suggested changes be to the Sherman Anti-trust Act?
A billion minds are better than one.
NoOps Machine Learning
I'm also a big fan of the weather widget they tried to force on everyone's start bar.
I'm also a big fan of how "one drive" is now critical functionality, and windows needs to persistently notify me if I'm not logged into it.
I'm also a big fan of how it's 2021, and their bloated OS still takes like ten minutes to truly boot up all the way.
Here's a band comparison between UV+visible and infrared (from the JWST Wikipedia page) that I thought was fitting given the question:

https://en.wikipedia.org/wiki/James_Webb_Space_Telescope#/me...
Yep, “dichotomous thinking”.
I read it, but I can't say I enjoyed it. I worked on a US Navy ship in the early 1970s, with 1200 psi 975 degree superheated steam. A couple years before I came aboard, that ship had suffered a boiler explosion, killing the four men on watch in the after fireroom. This article was too familiar.
Does anyone use notion and legend that can share if they are similar?
See https://news.ycombinator.com/item?id=28437797
Audio of Ripper the 'talking' Australian duck
Correct, this is a beta build.

With that said, I get that things go bad in betas - this is the point of a beta release - but this still feels egregiously bad. It also highlights the direction Windows is going, which is cause for criticism even if this worked perfectly.
Transparency in Startups
Just like an App Store.
perl actually has a one-liner way of invocation that's modeled after awk.

For example, to print the first field of a line work the default delimiter could be accomplished in perl by running:

perl -ane 'print $F[0], "\n"'

Where $F[0] is the equivalent of $1 in awk.
Great question. It helps to think in terms of vulnerability surfaces and the amount of harm that can be caused by a compromise.

If we use a VPN, then access is controlled to the boundary of that VPN. All code that is running within that boundary must remain secure for our remote services to stay protected. This is a large vulnerability surface, the likelihood of a compromise is proportional to the the size of our vulnerability surface.

If any service within a VPN boundary is compromised, then there are no safeguards preventing an attacker from jumping service to service and causing a lot more harm.

With VPNs, our vulnerability surface is large and amount of harm that can happen is also very large.

In contrast, the approach described in the above guide dynamically creates short-lived access to a specific service. In such a setup, our vulnerability surface is a lot smaller - it is limited to the code of our secure tunnel and our target service. It doesn't include all the other code within the same network boundary because our target is not listening on a network accessible port - even within its local network - it only needs to listen on the loopback address.

Just-in-time, short lived creation and deletion of the Inlet also reduces the amount of time traffic can reach the private service - which further reduces our vulnerability surface,

If a compromise does happen, the amount of harm that can be caused is also a lot smaller, in this setting, because other services within the same boundary also don't have open unnecessary ports - lateral movement becomes a lot more difficult for an attacker.
> I'm not sure exactly what you mean by "run out of TCP sockets", but theoretically speaking, the only limitation is how much memory is available to store the necessary info about the socket (like address/protocol info and process info).

Probably the 65k port limit since each connection will get assigned a remote port, which can be solved by binding to multiple local ports and using a load balancer in front or using multiple network interfaces.
I generally agree with your comment. But the point here is not this is cutting edge performance or anything, but rather that people on HN know how to set up this type of website.

If you have any tips on how to get ~10k rps (or even a more reasonable improvement) on a £4 a month server, I at least would be very interested in hearing about them.
Fair point. But my impression (only that) is that college in 1950 was much less hand-holding and "supportive" in general than it is in 2021. What there was, however, was almost certainly tuned for males (and in fact white males).

I totally agree with your last paragraph.
You do realize this issue was on Windows 11, an unreleased operating system correct? I'm not saying Windows 10 hasn't had its share of critical issues, but I can't remember the last time Microsoft released widely a show-stopping bug to the LTS branch of Windows (that is, the branch you'd be using for "mission-critical" applications).
In that scenario, is everyone hired on a contract basis? Do good workers get dumped after successful projects simply because the requirement they were desired for is complete?

I think companies hire for general skills not just because they aren't clear about goals, but because they're dealing with people. I get why you like the idea but you can't just malloc and delete people, they need some stability. And since the company probably won't be dropping their tech stack with each new project, hiring for knowledge in an area rather than knowledge of a narrower task seems reasonable?
If the holdings are inherently valuable then their value should be stable regardless of how many people are buying or selling.

(In reality there's a spectrum of how speculative any given investment is; basic things like food and land are certainly subject to some speculation, and even hyped penny stocks probably have a nonzero fundamentals case for why they're valuable. But that doesn't mean there's no distinction at all)
Not sure what the exact use case was (i.e. the output of the filtering) but—from reading the first algo—seems to be something to do with determining group membership and permissions for a user.

In that case, was there a reason joins couldn't be used? As it still seems pretty wasteful (and less performant) to load all of this data in memory and post-process; whereas a well-indexed database could possibly do it faster and with less-memory usage.
> The gitlab repo is private now

The internet always remembers:

https://archive.is/20181205151107/https://open_nsfw.gitlab.i...

https://archive.is/20170506185728/https://open_nsfw.gitlab.i...

(But seriously, that stuff is NSFL. I want to bleach my eyes now. A lot of those are like erotic lovecraftian fantasy landscapes.)
I would need to read the article "full investigation" and even then it would be hard to tell how much of this is legit and how much has been taken deeply out of context.
This story has a hint of the recent Venezuelan coup, but the details are still skimpy.

The amount of permits, fees, plans and various payoffs that need to be made for a flight to even cross through middle eastern borders is daunting. This doesn't seem like an imaginary rambo mission for that reason.

There are a lot of questions, but I wonder why they thought it necessary to drag weapons along. Anyone who has ever been involved in a civilian flight over there would have told you how dumb that is.

Couldn't they have just bought a few RPGs and AKs down at the local bazaar like everyone else? They probably could have picked up a few ARs too, right?
I know this may be a bit pedantic, and from a marketing perspective I'm sure everyone is telling you that "you have to market it as AI!", but my pet peeves is that the phrase "time series AI" doesn't make any sense in English. "ML for time series data" makes much more sense to me, is valid English, and from your post sounds like what you're actually doing.
It is important to remember that the sunshade teared during a test: https://www.inverse.com/article/42894-sunshield-rips-keep-ja... and a small detail like that, fibers from the sunshade, affected another space telescope mission, ESA's GAIA: https://en.wikipedia.org/wiki/Gaia_(spacecraft)#Stray_light_...

Putting this instrument operational at the right place is probably an unprecedented mission in terms of automated complexity.
Most People Should Learn How to Code
This short post is for everyone who does not know how to code, or who is thinking about giving up on their attempt because it is too difficult or they may have reached a plateau.

Everyone should learn how to code.

A friend of mine, Afshin, told me years ago Programming is like Mathematics. No one expects me to solve complex problems, know trigonometry, or even pre-calculus. Instead, I was just expected to know some Arithmetic. Because that is what most people need on a day to day basis. He simply believed most people have a better life because they understand how basic math works. "All you need is to know you have 10 dollars, this item cost 8 dollars, and upon purchase you should get 2 dollars in change. This will save you a lot of headache in life. Programming is the same."

We do not expected everyone who learns to read and write to become a fine journalist or a skilled writer or to even understand everything they read. Same with programming, not everyone needs to become an engineer. Buut they just need to know enough to empower them. A marketing analyst who knows a little bit of HTML coding is going to benefit. A secretary who knows a little bit of javascript is going to benefit. A web designer who understands SQL queries is going to benefit. A manager who understands some programming will certainly be more relaxed on set deadlines.

So if you find yourself wanting to quit because you are not as skilled as 99% of the engineers you meet, remember you also are less skilled than 99% of journalists, writers, mathematicians, doctors, yet you know a little bit of Math, you know how to read, you understand how your body works, and all this elevates you.

Learn how to code. Nothing is too small.
You're looking at one electrode. There's ten of those things (though they want to add more). The point is to make good contact with the scalp through the hair without needing to shave and/or apply contact gel.
Yeah, it's not a great look.

I'm plenty fine with content I'm not a fan of being on a platform, but it's pretty abhorrent to be promoting it from official channels.

What he's referencing, not work appropriate: https://odysee.com/@Odysee:8/axxl-on-odysee:c

Their marketing strategy seems to miss the mark and if the company can't understand that it's a huge mistake which will probably not get better.
When you build 20 scopes you can use the fail fast approach to better iterate on the next versions. It's okay if the first few fail.
Given the context, it probably took the poster very little time to implement that fix, without digging into ldapsearch. With massive speedup, for their likely smallish ldap install. Seems like not a bad call at all.
When my stuff has been shared on HN and Reddit, I’ve seen peaks of around 500 rps (according to google analytics), so if you can hit 1k rps you’re almost certainly ready to weather any kind of viral sharing that a blog might experience. Several krps on cheap VPS hardware is easy with a good compiled language backend (Haskell’s Warp is a good one). If you use a node/python/ruby/other interpreted backend, you will need aggressive caching through a reverse proxy.
Apple Event 9/14
Not interested. I'm not patient, and I don't want a laptop with just USB-C ports since I find it extremely limiting.

Plus, x86 and mainstream aarch64 hardware feels like it will always be ahead since it isn't a reverse engineered effort.