skysight-inc/HackerNews huggingface dataset:
HSM are expensive, the performance is bad, and administration is a pain. They're almost certainly running many clusters of their auth servers around the world, and would need significant capacity at all the locations, in case traffic shifts.

It's probably a better idea to pursue short lived private keys, rather than HSMs. If the timeline is accurate, the key was saved in a crash dump in 2021 and used for evil in 2023, monthly or quarterly rotation would have made the key useless in the two year period.

A certificate chain is a little too long to include in access tokens, IMHO, but I don't know how Microsoft's auth systems work.
They’re usually actively heated/cooled
> We cannot recommend external resolver services such as those run by Google, Cloudflare, Quad9, among others, for a variety of reasons. We have no control over how these services are run or what private data is logged. Even though most of these services have explicit privacy policies, they do log some data and we have no control or insight into that.

I find it very ironic that Wikipedia themselves talk about the privacy/logging practices of other DNS services but neglect to indicate a clear policy for their own service. I would imagine it's based off the regular Wikipedia privacy policy but they should clearly indicate that.
A Hohenzollern (ruling house of Germany at the time) had been offered candidacy to a Spanish throne. France agitated that this should not happen, Prussia relented, than France pushed the issue even further saying that not only was it disallowed this time, but that it should be disallowed for any Hohenzollern to do this until the end of time. That was a bridge too far for Prussia - who refused - so France declared war.

The revisionism that somehow Bismarck tricked France into war with the Ems Dispatch comes from people trying to backport Hitlerism 60 years into the past.
It's sad that duckdb timed out on R2 and crashed with OOM on a simple query, but not to expect much.

I think ClickHouse should do well on this test. Five billion records are very few. How can I get the dataset to test?
Saving you some time, if you have a Macbook pro M1/M2 with 32GB of RAM (I presume a lot of HN folks would), you can comfortably run the `34B` models on CPU or GPU.

And... If you'd like a more hands on approach, here is a manual approach to get llama running locally

- https://github.com/ggerganov/llama.cpp
- follow instructions to build it (note the `METAL` flag)
- https://huggingface.co/models?sort=trending&search=gguf
- pick any `gguf` model that tickles your fancy, download instructions will be there

and a little script like this will get it running swimmingly

./main -m ./models/<file>.gguf --color --keep -1 -n -1 -ngl 32 --repeat_penalty 1.1 -i -ins

Enjoy the next hours of digging through flags and the wonderful pit of time ahead of you.

NOTE: I'm new at this stuff, feedback welcome.
Kind of makes you wonder if the first arrow heads were formed when someone was trying to make a sphere and struck the rock with flint (or one of the other suitable stones) and accidentally cut themselves on the sharp resulting shard.
So, no proof then?

Also, your implication that a company is performing illegal activity just because they're successful is rude and uncharitable at best.
Great, so if I have a 25kg sack, a 1 meter sphere being trailed above is only going to make it 24kg. Like I originally stated, a few pounds required an 8' diameter balloon, so 2.5m balloon. That's friggin huge. FYI, at 90k' altitude, the balloon expanded to about 40' before reaching it's burst limit allowing for a return of the payload.
Cloudflare lets you just upload the model itself: https://blog.cloudflare.com/introducing-constellation/

No idea what they're using to run it though. But there's no way I'll stop using Python for working with ML code lol. It just makes life easy.
Make JSON greppable!

https://github.com/tomnomnom/gron

I've been using `jq` for years and I'm always able to cobble together what I need, but I have yet to find it intuitive and I'm rarely able to arrive at a solution of any complexity without spending a lot of time reading its documentation. I wish I found it easier to use. :-(
Pretty provincial attitude probably propagated by some overpaid MAANG bro who doesn't realize that there's an entire industry of tech folks out there who aren't making $300K/yr TC. So if you are making that . . . a little humility is in order.
Capitalism is a system in which those who control capital wield the most power, but without cheap enough labor to work the capital for a profit, capitalism will by definition give way to something else.

Realize capital has no market value without labor to work it. This goes for real estate too, which workers require to rest themselves just in time to return to work to turn a profit for those that control capital.
I learned about ollama here on HN, and have found that to be super easy. Worth a look to compare with this one if you are looking to run LLMs locally.
Love how simple of an interface this has. Local LLM tooling can be super daunting, but reducing it to a simple ingest() and then prompt() is really neat.

By chance, have you checked out Ollama (https://github.com/jmorganca/ollama) as a way to run the models like Llama 2 under the hood?

One of the goals of the project is to make it easy to download and run GPU-accelerated models, ideally with everything pre-compiled so it's easy to get up and running. It's API that can be used by tools like this – would love to know if it would be helpful (or not!)

There's a LangChain model integration for it and a PrivateGPT example as well that might be a good pointer on using the LangChain integration: https://github.com/jmorganca/ollama/tree/main/examples/priva.... There's also a LangChain PR open to add support for generating embeddings, although there's a bit more work to do to support the major embedding models.

Best of luck with the project!
I thinks its a 6.00 beta
I understand why they likely don't, but I wish they'd run this service on wikipedia.org.

As is, this is just another DoT/DoH service for censors to block. If it was run on the main Wikipedia domain/IPs, then it would force censors into choosing collateral damage (blocking all of Wikipedia) or allowing this service to be accessible.
It could also be the case politicians are exploiting voters' ignorance of basic economic principles.
I support individual's choice of whether or not take personal safety measures.
Top Asus routers have serious security flaws that let hackers hijack your device
This is great, JQ is brilliant.

I love JQ so much we implemented a subset of JQ in Clojure so that our users could use it to munge/filter data in our product (JVM and browser based Kafka tooling). One of the most fun coding pieces I've done, though I am a bit odd and I love writing grammars (big shoutout to Instaparse![1]).

I learned through my implementation that JQ is a LISP-2[2] which surprised me as it didn't feel obvious from the grammar.

[1] https://github.com/Engelberg/instaparse

[2] https://github.com/jqlang/jq/wiki/jq-Language-Description#:~....
And, of course, speaking of Lesbia (traditionally identified as Clodia Metelli, otherwise known as Quadrantaria), one should mention her “sparrow” mentioned in Catullus 2: https://www.historytoday.com/archive/natural-histories/catul.... Reading that article again I saw a tidbit I missed before: “As Richard Hooper has recently pointed out, ‘in Egyptian hieroglyphics the determinative for “little, evil, bad” was … śerau, the sparrow’”. And so it is: https://commons.m.wikimedia.org/wiki/Category:Sparrow_(hiero....
At this point I'll take a version of Windows X (whatever the latest is when you read this, now or ten years from now) that has all the bloat removed, or is easily removable, no ads of any kind for any Microsoft apps or services, call it Windows for Professionals, or Windows for Devs. Whatever, add a +$200 price tag to it, and I'll pay you Microsoft more money, to maintain less software (since you'd have to remove more OS specific things), just guarantee LTS for 20 years after release. No forced updates, but updates should be on a predictable schedule and security updates should be highlighted as such.
Defining build time SLIs and SLOs
Surely in the original the physicist was Archimedes of Syracuse?
No, it's an authorized service provider here in British Columbia.
> If they were to for example steal the 5G architecture from another company

What about this article? It says Huawei has the largest 5g patent portfolio in the world: https://www.bloomberg.com/news/articles/2021-03-16/huawei-to...
Director of National Intelligence James Clapper told Congress in March 2013 that the NSA did not collect data on millions of Americans, just three months(!) before Snowden and Greenwald revealed the classified NSA documents proving otherwise. [0] The heads of the intelligence agencies will say whatever they need to say to get what they want. Lying to Congress and the American people is business as usual for them.

[0] https://apnews.com/article/business-33a88feb083ea35515de3c73...
What userspace operations do these metadata attribute lookups map to? Listing a directory will incur an S3 list request, so another a network call though I’m not sure how fast that is.

Note, it’s not that the network is slow, it’s that object storages aren’t designed for low latency access (but with parallel reads can serve data at high bandwidth.)
The thing to keep in mind is that they have competitors still eating their lunch while running 40+ year-old COBOL backends which have their IS departments tearing their hair out regularly.

It's as if the efficacy of a business isn't completely positively correlated with the coolness of its tech stack. I work for one of their competitors, and I'd kill for their tech stack. But ultimately their business revolves around a bunch of professional logisticians and customs brokers being able to execute reliably and effectively, and all tech can do is enable this. I wonder if they realize this.
i tried to keep my feedback as civil as possible:

https://github.com/orgs/community/discussions/13130#discussi...

i'm not sure if i succeeded, but i know additional bad words that i managed not to use.
TFA: "I am sure this could be solved mathematically, but I prefer something quick and practical."
Have you considered whether you're overly attached to the ingroup/outgroup thing with how you characterize the above?

A bunch of liberal people shut down the Seattle capitol for a few days at the height of Black Lives Matter and ironically shot several young black men in the process. Yet I never hear a word about it. They were the ingroup.
Depends on the intent. I don't know Flexport's situation, so I can't say this is what happened. But, it's pretty common to parachute in outsiders to do the terrible things you want to do (layoffs, big policy changes, etc) that you know will have an adverse effect on morale. Then, once it's done, you boot the outsiders and commiserate with the masses..."yeah, sorry, clearly that was a bad idea".
> "I have nothing to hide anyway".

People who make that argument should be forced to have high def webcams installed in their bedrooms and bathrooms.
> the capitalist class would have no power to make workers work harder using the threat of losing their jobs.

They would have to offer higher wages and not just "industry average", like we saw during the pandemic. Then the planned economy folks decided that was the exact moment the free money faucet had to be cut off.
Sounds a bit like the very common story, "We hired this STAR EMPLOYEE from BIGCORP to do BIG things and it was a DISASTER! Help!"

I have often thought about this throughout my career, both being in the reporting chain of said star, and once being that star. The fundamental thing is that a persons performance in a role is much less under their own control than even they often expect. So why is that? Especially in management roles?

People have a reputation that permeates the organization they lead. It will have plusses and minuses, fans and haters, but generally there is a tremendous amount of context about how they lead and how to interpret their actions. There is also a tremendous amount of history about their choices and how they have dealt with both good and bad outcomes from their choices.

Additionally, people who have been in an organization a "long time" (years) and especially if they have "grown up" through that organization, have a really solid network of other folks they can turn to who both know what they can do, and understand what they are asking.

When you change jobs there is a "honeymoon" period where what you do, or don't do, can always be ascribed to "they are new here." It is imperative that new leaders use this period to "course correct" to get to a point where they can effectively lead the new organization they are leading. This is the most important thing they need to do in their first 100 days. Even if you are dropped into a complete dumpster fire, understanding how to "wield" your organization is critical if you want to actually address the fires. On at least one occasion I watched a VP Eng parachute into an org and flame out horribly (even though they had the chops to get the job done) because they focused on "getting things back on track" before "getting to know the organization."

If you work for someone who is new and "previously experienced" (which is to say they got their experience somewhere else). Helping them learn the ins and outs of the organization will benefit both you and them. You because you won't be subjected to obviously stupid decisions which are only obvious if you know how the organization works, and the "new guy" (assuming they aren't a sociopath) will appreciate your efforts and look favorably on your future inputs.
Assessing Readiness of Self-Driving Vehicles
It was much more than that. Russian government banned Iphones for government use as well. https://www.zerohedge.com/geopolitical/russia-says-us-hacked...
It's an authorized third party here in British Columbia. It's the shop Apple recommended I bring it to. Are you suggesting that if I shipped it to an Apple Store or some other first party entity, they would have the part and repair it faster?
Regarding: “requires detailed knowledge of internal infrastructure”

MSFT decided to move their APAC support center for Office365 to China. If there is an issue in APAC engineers usually respond from there. It makes sense regarding time zone and cost.

However, people change jobs etc. Hence this setup will result in a number of good engineers with very detailed knowledge of those systems who live in China.

On the more tinfoil end of ideas: if the office for this work is in a particular country it brings corresponding risks for physical opsec of the infra.
Listening to Taylor Swift in Prison
Gödel also had a short appearance in the Oppenheimer movie, in the scene where Einstein talks about Kurt still being afraid even though they are in the states now.
> Easiest solution would be what we have in Switzerland. If you want that government money, the fiber you lay needs to be accessible to any competitor otherwise you aren't getting any of it.

How would you square that against one of the core objectives of targeting rural, unserved/underserved communities? E.g. consider Iowa[1], a single state which is ~3.5x larger in land (144,660 km^2), ~63% smaller in population (3.2 million), and ~90% lower density (22/km^2) compared to Switzerland...never mind that there are roughly a dozen other states in similar or more challenging situations.

Suppose a small business establishes infra in a way that must be "accessible to any competitor". After laying the ground work and establishing a customer base, what's to stop an asymmetrically well-capitalized competitor from stepping in with the intent of swallowing a relatively small loss to operationally bleed out a much smaller incumbent with no margin? E.g. if your local addressable market were half the population of Iowa with service aggressively priced at what Switzerland customers pay, we'd still be talking about a notional revenue cap that's ~1% of what whales like AT&T and Verizon with growing fiber segments generate annually.

I can imagine how outcomes might work out favorably for consumers when the addressable market is a small, wealthy sovereign nation with significant population density...much less when considering rural communities in fly-over states that the rest of the country has a tendency to neglect yet whose economic contributions remain significant.

[1] https://www.census.gov/quickfacts/fact/table/IA/
Note that the OP repo doesn't yet support GGUF format.
The ostensible reasoning is "think of the children" horseshit, but history proves such a powerful capability will be abused for unrestrained spying.

Key escrow for the entire US and world was floated with the Clipper chip (1993-1996). That was strangled in its crib because trusting thousands of people at NSA or GCHQ to just not stalk people is sheer fantasy, just as the Snowden leaks revealed.

iMessage stores the e2ee key in iCloud by default, which effectively makes all of a user's communications decryptable by governments and Apple at any time.

To offer a centralized service with actual privacy without zero knowledge p2p constructions, then it falls victim to the Lavabit problem. If you want security and plausible anonymity across your own devices, not metadata, then use a fork of Signal such as Session. (Signal is irreparably broken by being tied to phone number, which is a universal tracking device. The only people who use Signal are drug dealers and software engineers who don't know any better.)

https://en.wikipedia.org/wiki/Clipper_chip

https://en.wikipedia.org/wiki/Lavabit
The sad thing, is that somewhere out there there’s an infotainment PM at an automotive company taking note of every item in your list and saying “let’s implement stuff like that in our infotainment system! It’ll be a (jazz hands) differentiator!”

The auto manufacturers still have this delusion that they’re competing with Apple and Google on infotainment, instead of seeing the truth that better phone integration is not only the technically better solution, it’s something the customers want, and something that saves the company money. But you can’t get someone to understand something when their salary requires that they not understand it.
He's got a reputation for being particularly brutal on workers -- this is the guy who was, after all, responsible for Amazon's warehouse and logistics conditions, including working with GC Zapolsky to go after unionization and workers' rights efforts. Amazon's retail profitability pretty much rests on his ability to squeeze every cent out of employees' sweat, but the human toll has been high. (One particularly telling story about Clark is that he oversaw Amazon's noncompete lawsuit against his longtime friend and best man at his wedding, logistics head Arthur Valdez, when Valdez left Amazon for Target.)
Astronomers discover new quiescent galaxy
Correct, there's been no ammendment to the bill, only promises it's not going to be used.
The fact they voluntarily trade their own resources for these devices is the evidence I would point to.

They may care about "about lung cancer" and other aspects of the product, but they make trade-offs.

Consumers are ignorant about many aspects of the products they use. I do not trust politicians to somehow know what those asymmetries are and divine what our true preferences are.
I didn’t finish reading the whole thing yet—need dinner first. But maybe the reason they never interact with gun loving, immigrant-hating, uneducated yayhoos is because they’re looking at a statistical amalgamation of individual beliefs. Most republicans won’t fit that mold because they’re a mass of individuals with different beliefs and these lumps of commonality are weak, but natural modalities of a social species. In other words they hate a caricature—an enemy that only really exists in statistics but not in the real world.
Newly discovered comet Nishimura could be visible to naked eye this weekend
Who are you quoting and why? Bill Gates never said that.
Yes it does. Or do you mean the OP's github repo?
This is an overly simplistic analysis.

People may work hard for a number of reasons of which unemployment is only one - more money, a promotion, personal interest in the outcome (e.g. scientist), personal work ethic, you like this job more than other jobs (job preference due to management, coworkers, location, job type).

Once again Marxism oversimplifies the world and ignores a lot of nuance.
It's a little bit ironic that the package is called "onprem" but the second line imports an external model from huggingface...

from onprem import LLM
url = 'https://huggingface.co/TheBloke/CodeUp-Llama.....'
llm = LLM(url, n_gpu_layers=43) # see below for GPU information

Anyway looks like a great little project, nice work!
It more closely resembles Russia's bans on Iphones due to security reasons. https://www.zerohedge.com/geopolitical/russia-says-us-hacked...
Both your scenarios blame the new CEO instead of the old CEO. I'd wager the old CEO created a huge mess that the new one couldn't clean up.
Wouldn’t that depend on the social safety nets in place? Say unemployment in Europe versus the US. Also nothing stopping a terminated person from seeking other employment opportunities.
Hackers exploit MinIO storage system to breach corporate networks
What do you mean?

https://github.com/ggerganov/llama.cpp/releases/tag/master-6...
Did you ever go back and tell anyone that at 16 you knew that decades of basic dentistry were wrong?
Consumers often purchase insurance for low probability, high impact events. I would infer the fact that consumers are not purchasing insurance for these devices means they don't think it's that big of a deal.
“Conscious machines are impossible!” Wrote the conscious entity, to the other conscious entities. This is a bit odd.

I would meekly suggest, if you use some human sound, like “artificial,” or “natural,” to label something, it makes no difference to the Universe. It’s energy waves all the way down. Aka, we play by the rules of the universe. Unless the author of this article can prove he is a zombie, there is such a thing as “conscious atomic system” which can be replicated.
Which then cycles back to ML methods. Diffusion models are non-equilibrium stat mech.

Sure building a better HMC algorithm might not be a good use of time, but the spirit of MCMC is alive
React state management in 3 lines
What about private farms and home businesses?
There is a way to keep arbitrarily large logs and be fully compliant with GDPR with a little engineering.
I lived in both places. Almost all the parents of my kids friends in public school in Hayward regularly went to church. I knew not a single person that attended church in Chicago.
In my case, this website did show a very annoying "disable your adblocker" locking popup.
And the trick to be able to go on without following this idiotic advice is to click on a link that is very very small at the bottom left of the popup and that says: "continue without supporting us".
Is that so? I would have thought if you heated boiling water you’d turn the excess heat energy into steam pressure or something.
cGPT is exactly "just" an LLM though. a sparse MoE architecture is not an ensemble of experts.
Maybe if you interpret it generously. "more effectively organized" could mean almost anything.

Very true; Napoleon was quick.
Migratory hunter gatherer bands still exist, and no observation of them through history has found kings or slave owners among them. Nor is there historical evidence. I'm not sure how a migratory hunter gatherer band which has few possessions and moves from place to place would have some slave owners who not work and the others as slaves.

In fact much of the world was like this only a few centuries ago.