skysight-inc/HackerNews huggingface dataset:
I think the third type of “no” just sounds a lot more confusing or contradictory to the engineers and programmers who are tasked with trying to implement a solution that both fits the requirement, and allows the company to continue doing business mostly they were before.

Of course, on the other side, the full command is “change how you provide your service in this way that we’ve specified, or stop providing it.” There is no mathematical contradiction or impossibility here, they just don’t mind if they yank away your livelihood, don’t let them off the hook by assuming they are stupid (they might be, but they probably have someone clever who can feed them enough car analogies…).
There are iterative methods for optimizing the number of clusters in k-means (silhouette and knee/elbow are common), but in practice I prefer density-based methods like HDBSCAN and OPTICS. There's a very basic visual comparison at https://scikit-learn.org/stable/auto_examples/cluster/plot_c....
Never got this attitude. Plenty of people are roped into wars; this doesn't make them any better or worse than anyone else. More pitiable? Certainly.
And how exactly does that work since they all use the same processors or offshoot of the same processors and the same OS?

So who gets the operating system? The processors?
Which swathes of New Orleans do you claim are still like this? I live in the Lower Ninth Ward for the record.
When the nuclear apocalypse has passed, and the last remaining humans are living underground on mushrooms, somewhere an economist will claim growth using a model updated to include the work done by ants, and somewhere a bureaucrat will update the tax code to collect on it.
I guess taking title + text snippets from original authors, and monetizing them without consent.

The question if it is anti-competitive is up to legislation, which looks like may change.
Just have to say, I’m enjoying playing with llm so much. Being able to easily play with this technology at the command line feels like magic. Thanks for the awesome work!
Aren't we running out of text to train AI? You need much more data to train a smaller LLM to match a larger LLM performance. Considering how everybody is starting to clamp down on their user's data, we might have issues getting enough to train something on the scale of PaLM to reach optimal performance.

On that note, everyone is probably salivating over Discord's data. So so much chat based and detailed conversations, all neatly organized into groups...
> How exactly does the existence of search take audiences away?

Oh, that one's easy. Because the old media companies used to curate which stories people see, and now the search engines do it, but do it in a way that also shows competing sources. So then legacy media outlets lose a lot of traffic -- and political influence -- to random blogs and social media.

Somewhat ominously, Google has mostly stopped showing the latter in search results. If you like conspiracy theories, this happened not long after those companies filed a lot of lawsuits and pushed for legislation against them, and once they did the number of lawsuits and proposed legislation declined.
Reducing Memory Usage in My Render Web Service and Celery Task
> I have a physical collection of majority of the “greatest hits” from 90s and early/mid 2000s

Would you mind listing your collection? I'd love to add some (many) titles to my (small) collection of old programming books.
All I did was to upgrade to iOS 17. did not install anything new. Also I dont use private relay and I also dont have limit IP tracking enabled on my home wifi.
What's super cool is that the dev container extension works over the other remote connections. So I can remote SSH from my Chromebook to my Ubuntu box, and then open the dev container on Ubuntu. And everything works as expected.
PASTEUR LABS (https://pasteurlabs.ai) | Full-time | REMOTE (worldwide) | Sr+ Engineers (for MLOps, Data Engineering, 3D Game/Physics Engines)

At Pasteur Labs [1], we develop computing technologies that enable scientific and industrial challenges to be approached in new ways: that is, a first of its kind AI-native, developer-first platform of in-silico playgrounds for human-machine teams experimenting and building in industrial R&D, energy security, & adv/additive manufacturing arenas. As a public-benefit for-profit startup, our mission is Nobel-Turing [2] technologies to advance science and society for all humankind.

The pursuit calls for industry hardened and intellectually curious builders who thrive in interdisciplinary territories that are often less-traveled. The team brings deep, diverse expertise from Deepmind, Cerebras, Vicarious, SpaceX, NASA, CERN, Sandia, Nvidia, Autodesk, and more. With fresh venture funding and Fortune500 customers (+100 more on the waitlist), we’re looking for ambitious, intellectually curious software engineers that can consistently contribute in non-trivial, impressive ways as we ship and scale our flagship product platform — some call it “live intelligent digital twins” and others say “cyberphysical testbeds for AGI”, while most view Pasteur Labs product catalogue as “Unity for industrial R&D.”

We’re looking for Engineers at or above Senior level expertise in one or more of MLOps, Data Engineering, 3D Game/Physics Engines.

With HQ in Brooklyn NY [3], we are an internationally distributed team the runs remote full-time — from San Diego to Stockholm and everywhere in-between. The full team gathers 2x per year for Pasteur Labs “onsites”, alternating sites such as Montreal, Amsterdam, Texas, London, NYC etc.

While we don't list requirements for degrees or years-experience, everyone needs to demonstrate high-caliber engineering and problem-solving in multiple domains; we're dedicated to scientific rigor and robust engineering for complex and dynamic environments, so prove to us that you not only fit in but that you can make us better.

If what we’re doing speaks to you, please get in touch! Send your CV/resume and other supporting info/demos/etc to us at careers@simulation.science

[1] https://pasteurlabs.ai/

[2] https://arxiv.org/pdf/2112.03235.pdf

[3] http://newlab.com
You're right, my apologies.

It is unfortunately too late to edit the original post :(
I disagree; i think the proliferation of ads is a type of malware that has far more detrimental effects on society than credit card theft (which, incidentally, wouldn't be a problem if the industry bothered to protect their cards with basic authentication on use, which they refuse to)
Measure wind speed and direction with ultrasonic anemometer and Arduino
I found that attending my home state university afforded me access to facilities and resources I would never have had on my own, and to not just a wealth of knowledge but also mentors and incredibly capable guides for how to navigate that knowledge while putting into productive practice.

Motivation and internet access can get some of those things, but even among those things one would struggle to find them in one place and so readily available to them.
To me Wayland has the problem that too much functionality is done inside it. Basically it does the function of the display manager (X), compositor and window manager. While the last two were usually done by the same component also under X (while not strictly required), having the display manager and the window manager as separate components makes sense. Also having the compositor as a separate application to be fair, since that way the compositor could crash but the window manager would continue to function (without compositing, but this is not a fondamental thing).

The window manager can crash, but under X it can be restarted (or is restarted automatically). You don't loose all your windows and open applications. On Wayland this is not possible. In GNOME if you type F2 and r you restart the graphical session under X, useful if some extension created some trouble. Under Wayland no way, log out and log back in and loose all your work. Is this good 21st century design? To me, not.

A program should handle a single task and should do it well. X did one thing, the window manager another, the compositor another, XScreensaver another, etc. If I want to substituite a component I could.

Also X is a client/server program, Wayland is not. Why does it matter? Under X I can run applications on a remote server and they are rendered locally. I use it time to time, because it uses far less bandwidth than using (let's say) VNC, since the rendering happens locally and only X drawing commands are passed trough the SSH connection (instead of a video stream). Wayland decided that this is not needed.

To me Wayland is not that good design. It's not reliable after nearly a decade of being "nearly done", while X still works and it's still solid as a rock. If only they spended some time to improve X instead of rewriting everything from scratch... whatever.

And if we want to talk about performance... to me it seemed that 10 years ago Compiz under X with a crappy GPU was more reactive than the modern Wayland window managers.

Finally... X did have the possibility to change DPI of the fonts in the ~/.Xresources file! Yes, natively. Thus a window manager that only used X primitives (such as i3) did work flawlessly on HiDPI screens from decades. They seems to be still figuring it out in GNOME under Wayland for fracional values...
Most people with a university degree don’t have a traditional university education.

I’m very much pro-education, and think that US high school should include the first two years of a current university education (grades should be roughly split between D, C, B and A, where D means “meets curriculum requirements”).

After that, I don’t think many people should go to a university. Instead, the state should provide up to 10 years of vocational education (splittable and redeemable at any point in life) or 8 years of university education (subject to a B or better average in high school).

Most vocational programs would be under 3 years, so you’d get three-four cracks at finding the right profession for you.

University track would be targeted at educators, researchers and entrepreneurs.

I think this would be better for every socioeconomic demographic in the US, and also help alleviate the housing shortage, enable modern manufacturing, fix many current issues with healthcare, and so on.)
Unions will only be able to increase wages while preserving the company if we remove cheap, low wage foreign competition. I think that has been a root problem for awhile.
To elaborate on my comment on the other thread, a workaround to overfitting is to train on so much distinct data that the model can't overfit.
Newer large datasets optimize for diversity, as the AI industry is slowing coming to the realization that better data is much more important than large amount of bad data for training LLMs.

The writeup of SlimPajama, a heavily-deduped dataset, is a good starting point: https://www.cerebras.net/blog/slimpajama-a-627b-token-cleane...
There are early accounts "sergey" (2008) and "larry" (2009) which smell interesting, though they've never posted or commented.
Preservation and archiving can be done regardless of copyright status. Disney wants to renew their copyright because they don't want their stuff distributed.
> Can I do X with SwiftUI? Who knows. Does it support Y pattern well? Absolutely, and here are a dozen examples. Such a pain in the ass.

Exactly this. Don't even get me started if you are writing a Mac Catalyst app too.

Can I use this NSEvent? No? I gotta create a bundle that's built for OSX and then load that dynamically and pass stuff as AnyObject from my AppDelegate.

Oh I'm getting .rotation and .magnify events. Is there any API I can call to ask the OS the positions of the fingers on the trackpad? No? I need to go through the GestureRecogizer? But that is returning 0 touches for a .magnify event.

All I wanted was to get the current location of the fingers so that I can decide on which axis to zoom more on. Oh there is a plist for Application Supports Indirect Events. Downstream effects not documented, well, that's how it is developing for an Apple platform.
I think there is one escape from this, basically confining more and more "growth" to artificial numbers on paper (or in a DB).

Cryptocurrencies are kind of going in that direction, where the "value" that is reported as economic growth doesn't correspond to any kind of real-world matter or activity, but is simply assigned to some specific group of bits.

I can kind of believe that this virtual kind of growth could continue a long time without boiling the planet, but of course that doesn't make things less absurd, as the "value" would represent nothing objectively useful and would have to be maintained artificially - either through scarcity mechanisms like PoW etc, or through locked-down devices and ecosystems.

So that kind of "growth" could go on forever without burning the planet but would probably be a step back for civilization.
Why should Apple be forced to sell their IP? The Mac has less than 15% market share? Should Google, Microsoft, Qualcomm and Amazon also be forced to sell their IP?

Intel has 80%+ of the computer market. Should they be forced to license their IP? Should Google be forced to license their search algorithms?
I’ve started using Remote OSS [0] with some custom scripts to install and run the remote code host. Works great on remote servers and even with devcontainers on remote hosts. You can use a script like the one here to handle automatically installing and setting up the tunnel [1]. I’m working on a PR that adds a way to automatically run custom scripts to set up the tunnels as well [2].

[0] https://open-vsx.org/extension/xaberus/remote-oss

[1] https://github.com/CGamesPlay/dotfiles/blob/master/files/.lo...

[2] https://github.com/xaberus/vscode-remote-oss/pull/9
Thea's a lot of rhetoric, so let's get really specific about how these laws are supposed to work.

You do a search. You get ten blue links. One of them is to a newspaper website. Google has to pay that website - but not any of the other 9 websites.

You see a cool web page. You post a link on Facebook for your friends and say 'hey, read this!" If it's a link to a newspaper, but not to any other kind of website, Facebook has to pay them.

Google and Facebook not 'co-opting their content.' You need to be really clear about this - we are talking about links. In Meta's case it might be a link posted by the newspaper itself.

Let's extend the principle here: someone posted a link to my website on Hackernews - so Hackernews has to pay me. Really? They post it on Reddit and Reddit has ads, so I get a percentage of the ad revenue. Really??
Name one product market where Apple's share is more than 60%.
The fact that Apple is even allowed to charge more than 100% markup is one of those tell tales signs of "you might be living in a suboptimal society when".
I suspect it will work within limits against single drone attack and will be less helpful for multiple drop, multiple drone attacks.

As the article says: Tires burn.
That's a useful hint, thanks. I fed it through GPT-4 and got some interesting leads: https://chat.openai.com/share/400f76ae-b53b-4d07-ac31-adcef2... and https://chat.openai.com/share/48650db8-5a29-49c5-84b2-574f53...
Yes and raise prices on everyone? How do you just “tax Apple” and not everyone else?
Given all the common/shared pieces underpinning their hardware and software, that would likely be disastrous for almost everything split out. Cloud services could probably find a way to stay afloat, but the Mac would be at risk as would wearables. iPhone would quickly lose its hardware edge over Android with it no longer making financial sense to invest so much in custom chips. It’s hard to see an outcome of a split that doesn’t end up entrenching Windows and Android as monopolies.
Unlocking and flashing Androids is (in general) much easier today than it was 10 years ago, mostly due to Google's efforts with fastboot and other software infrastructure. Modern Pixels are really easy to hack on.

> in practice the vast majority of users end up running proprietary builds with big G's telemetry baked in

The vast majority of users are always going to do this, regardless of how easy it is to install a custom OS.
https://archive.ph/Rq8Vg
If we are thinking of the same tweet, it was from an influencer who shows off these different tools on his YouTube channel. So of course he's subscribed to all of them. Quite the disingenuous framing
There are financial and career incentives for filing patents. Filing a patent, and being against software patents in principle, are perfectly compatible. Like proponents of FOSS using proprietary software.
> Does that sound familiar? It should, you could use that same description for containers

The reminds me of java but with native web browser support instead of applets.
We Europeans need to wake up. Big tech companies in the US (and soon China) are practically robbing us at this point.

The neoliberal dogma that tariffs and trade barriers are bad is economical suicide for Europe.
Probably because is a exceptionally, top healthy food for humans, plus the procedure has a sense economically also for the maker. We could be breeding hemlock instead but it could be sold only once to each customer, and it does not have omega 3
Crazy how big Apple has become. Yet I haven't bought or voluntarily used a single one of their products in the last 5 years. Interestingly though, as a developer, I was forced to use Apple laptops at 2 of the last companies I worked at. I feel it creeping into my personal space. I have some resentment against the company as a result. It's better than Windows but I'm less productive with it than on Linux. It may even have (in a small way) contributed to me losing my job in my last company due to various UX gotchas I could never get used to and lost motivation (I'm a developer so all the small things add up).
Young people, pregnant women and drivers should avoid cannabis – study
Who's gonna break them up? The government itself, that enables companies to grow this big, and whose politicians are paid and dined by megacorporations?

Or did you mean you and me?
I'll have to think about that. It currently uses path parameters from the julienschmidt/httprouter router implementation, which I think are pretty important. How would you expect to define and receive path parameters?
>“Work it out” is generally a demand to invent new mathematics, but sadly, mathematics doesn’t work like that

The article invalidates a somewhat reasonable point by saying this sort of thing. A cryptographic end-user application is not "mathematics". It's a piece of software, running on a piece of hardware, and there is no platonic, infallible security going on. This is the sort of 'no' people utter if they have ideological objections disguised as technological ones.

In reality any system, including cryptographic ones exist on a curve. Differentiated systems for access exist. The honest criticism would be that a system with a backdoor is less secure, but it's certainly possible to enable privileged access to third parties while excluding others, it's just riskier. But risk in reality also exists with any encrypted application, because it runs with keys stored on a phone, not in some untouchable maths dimension.

How much you move between access and security is absolutely a question of policy and architecture, not some theoretically impossible thing.
https://archive.ph/ljBsv
> Yes, and for decades, it's been a bad idea for SQL Servers that grow over time.

I never said storing BLOBs was a great idea, but for smaller databases, like you say, and with small files, it is an option and it won't wreck your performance like you think in many cases. The profiler knows how to handle this, and if you query doesn't need it, they aren't going to impact it like you are saying. As always test, test, test.

For large databases, that's why I meantioned FILESTREAM. Those are not in the database, they are essentially pointers to files on disk.

> To make matters worse, when a new version of the file arrives, people never overwrite the existing file - they store the new version as a new row or object

This may be a requirement? And if it is, you have to store it somewhere. Using FILESTREAM you are free to put the actual files wherever you want. The database column says where to find it.
You need a public ledger of land ownership, it’s a public benefit.

Otherwise, title and ownership of land always be an open question. How do you know some lienholder doesn’t have title to property without a public register?
> One of the big things that makes Apple products so compelling is the integration and shared engineering between them

That's also the biggest reason why I avoid their products. Their compatibility with non-Apple products is limited. And Apple doesn't care.
I am wondering how much value social network data like Twitter or Discord really has when compared to something like Wikipedia or textbooks.

It is mostly unformatted, contains slang and is often far from the truth. Is this data really all that useful for training an LLM?
I used vim for 10 years (not really an advanced user, but comfortable with it), and I just learned Emacs for the last 6 months...

I am now completely confused by the Emacs vs Vim religious war.

The two programs excel at completely different layers of productivity.

I can't think of any software that radically approaches improving your workflow like either vim or Emacs, and they are both wholly unique.

I also use evil mode in Emacs and while it feels like a great match, it has some impedance mismatch in some emacs packages.

It really makes me wonder if there is a deeper layer of integration that can be done here to really allow people to take the reigns off their interaction with computers.
That implies the memory usage is proportional to the depth of the AST, not the total size (which is the point, I think).
That "nerd harder" thing is something I keep coming across in the professional world and it is something of a paradox. It comes from someone who knows you are intelligent and more knowledgeable in a given area than they are, and who wants you to solve their problem, but they are unwilling to accept that your intelligence/knowledge extends to whether or not something can or cannot be done reasonably (Reasonable here being excluding things which are technically possible, such as lifting Rhode Island into some kind of Earth orbit, but aren't really quite feasible or practical).

One guy I worked for had a bad habit of starting unicorn hunts and a lot of "this looks easy from fifty thousand feet" foolishness with the phrase, "I know you're real smart but ..." and whatever followed was more a statement of how convenient it would be if something were true, rather than if it were true, possible, and so on.

Nerd harder, nerds.
It's as dead as Ruby on Rails.

Neither will ever be popular.

Because it's always be easier to learn and spin-up an Express.js or any front-end library with a single index.html and tinker away.

> than into doing anything relevant outside the Ember community in the last decade.

Quite dishonest, and not sure why you're turning this into measuring exercise, so I won't bite.

> Might as well have said Dojo and Knockout, it would have meant the same thing.

Someone should tell Apple, HashiCorp, DigitalOcean and Microsoft they're not cool anymore releasing new stuff in Ember.js, must pick a new JavaScript framework of the year!
I'd figure it would be easy to target Linkedin spam to the alumni, since the schools are in the same profile where they get the workplace. Instead they wrap their requests into invites to connect, get bounced and I don't know if this still a thing but Linkedin used to throttle your ability to send invites if you get enough rejections... But thanks for explaining, I used to be completely mystified by this behavior.
It’s one year. Insurance is a spread of losses over the time and over population. What was their aggregated loss/profit over let’s say last decade?