skysight-inc/HackerNews huggingface dataset:
I would add "limited json support" to this list.

Under the hood, SQLite treats json as strings, you have to do some strange stuff with extract and computed fields indexing to index into it, which can be a bit fragile.

My use case these days is hybrid rdbms / nosql, where most of my tables have defined columns for frequently queried data, and a jsonb "data" field for everything else.

Postgres has impressive jsonb capabilities, and with 14 the index operators making querying it a dream.

I love SQLite, but postgres' jsonb handing makes the additional operational overhead worth it to me.
Twitter makes it impossible to dig in replies past a very low number of them. Hell, if the tweet is not the last in a chain, you often can't see any replies at all. It is explicitly optimized for very different things than public discussion.
You even get a rejection email?
This strikes me as unnecessarily bitter and cynical. Application is a two way street. Would you even want to work for a company like that?
We unplugged a data center to test our disaster readiness
I also classify cold marketing campaigns as spam. Anyway, my concern is that this tool may work once to warmup the email, but after the real users start pressing the spam button in Gmail, then the warmup effect will disappear and all the future emails will be marked as spam. Also, Gmail has a lot of tools and tricks, so I'd not be surprised if they can detect this.
Well, it's still there. Google's Deja probably did not help, "democratizing" Usenet. That said, here we go - another point in favor of strict moderation.
Ecosystems and African Agritech
For a bit of background, go to: https://x.company/projects/loon/

I was working on the Air Traffic Control side of unmanned free balloons in 2020, and Loon was an exciting project. While it's a shame it wasn't financially viable, they had it working with up to 60-ish balloons in the stratosphere at any given time. This was an amazing accomplishment.

The navigation was equally amazing. It was Loon who did some real research on stratospheric weather. While many meteorological entities throughout the world knew and understood tropospheric weather, the stratosphere was mostly unknown. In addition to AI, Google really did expand the knowledge and science of stratospheric weather.
First sentence of your linked article: Many people don't want the things they say online to be connected with their offline identities.

I do 100% agree. Sadly, I don't think it'll be possible to stay anonymous in the future. Not because of credentials or personal data, but the things we say and the way we say them online. These things will be enough to link personal accounts and alt-accounts. Sure, you can obscure and keep quiet about things, but what's the point then anyways?
I think your first and second sentences contradict each other. If content gets removed, it's removed. Why do you care if the moderators remove it as "misinformation" (which is probably is), or for being hate speech, or being stupid?
Grafana uses SQLite as its default database
How do you deploy your application? Is it possible to do without downtime?
Interesting! Gauging from the original Reddit post, it seems that people exist on a spectrum regarding this for whatever reason.

This could explain a lot about why some people learn certain stuff faster than others. For example, maths encoded into language is just a set of meaningless rules you have to memorize, but when you process it in concept-space the ideas behind maths make so much more sense. So, if you have someone who processes stuff mainly through language, their speed of learning math is significantly slower than someone who processes them in concept-space.
Even a common name can be helpful when trying to locate someone. I've given some sparse personal information on Hacker News that would definitely allow someone to find me should they know my name, even though there are thousands of people in the US alone that share it.
I'm using SQLite for a small personal project that's live in production and so far I love it (both for its simplicity in development and for its performance).

But I've run into on prod that didn't exist in dev on my MacBook M1, and I'm curious if anyone has any suggestions:

My app is basically quiet and serves requests in the dozens (super easy to run on a tiny instance), but for a few hours a day it needs to run several million database transactions, N+1 queries, etc. Because of the high number of IOPS needed, a small instance falls down and runs suuuuuper sluggishly, so I've found myself needing to shut everything down, resize the instance to something with more CPUs, memory, and IOPS ($$$), doing the big batch, then scaling down again. That whole dance is a pain.

Were I using a more traditional postgres setup, I'd probably architect this differently -- the day-to-day stuff I'd run on Cloud Run and I'd spin up a separate beefy instance just for the daily batch job rather than resizing one instance up and down over and over again. The constraint here is that I have a 50GB+ sqlite db file that basically lives on local SSD.

Any thoughts?
The racist overtones to Noah Carl's work certainly did his case no favours, but he was doing scholarship whose poor quality is easy to see. Before you get tenure (or the watered-down approximation that the UK has), academia offers essentially no job security: only around of 1/4 of researchers starting their first post-doc will succeed in getting a permanent academic position. I wonder what he was thinking?
Then using the platform becomes work. People realise it's not worth the effort and everyone apart from the nutjobs quit.
> One may also not want to contribute to those leaders on principle, and instead reward the other leaders even though it costs more.

Of course, just don't expect me to care about your housing costs if that is your reason you choose to stay in a high COL area.

And I'm not sure what precedent that example sets relevant to me because nobody I know would try and induce their own abortion in an anti-abortion state instead of just driving out of state and going to a professional clinic.
cumulative count of posts having matching URL over time
Ok so if you change Twitter entirely to some other thing that others have tried and failed at numerous times then you will....have it both ways? Wat?
I disagree, just slapping GA on websites is shady shit. Not because the individual webmaster is doing shady stuff with that data but because this gives Google a ridiculous amount of data.
The real benefit of the in-house solution is that marginal compute costs are zero. And while this current example is just for fun, I do want my researchers and engineers not worried about the compute cost of every experiment or line of inquiry.

I dig the cloud for production, but for R&D I like my people to have fixed costs and close to zero marginal costs.
Fibers don't run concurrently with the main thread. They're like preemptive multitasking, not simultaneous multitasking.

For example, if you have a long-running database query, disk I/O, or some other blocking function, you can't simply send it to the background and do something else while waiting for the result. Network requests are better, but only because the underlying functions support a rudimentary form of async calling.
I think this is precisely a scenario that suits Mastodon.

Users will organically flock to instances close to their interests. Celebrities will surely have their own instances and niche interests/non-famous people will have their own (to reduce the noise). And users will have the ability to follow whichever they want (including both).
Honestly, this video is sad, but it's incredibly tame compared to criticisms of western Governments you see every day online. China even with their firewall can't stop people sharing this kind of thing widely. Everyone knows all their "official" figures around Covid are made up. I think they are backing the wrong horse on this occasion and their strategy could backfire bigtime. I don't think the other countries will have much sympathy if there is widespread hunger and unrest in China. Will be interesting to see what happens.
Will Musk let Trump back on Twitter? I dislike the latter but was under the impression both are kind of buddys? It's just I thought a lot of advertising revenue was driven by polarization of issues and both have used Twitter to push the boundaries on that...
Oblique Strategies is particularly useful because it doesn’t pretend to be giving you new ideas. Each card offers a new vector of approach that may be helpful if you’re stuck, but you need to have something to work on.
Part of the answer has to be that companies don’t want to solve it because it would destroy metrics that buoy ad prices. Charge per tweet or per account and the problem would be gone overnight.
Show HN: Automatic Instrumentation for Go Applications
Real name policies have done nothing to make Facebook less toxic, because bigots in general don't mind their real names being out there. This is what happens when you ignore systemic power imbalances. The bigots have that power and as a result they don't fear consequences.

The Republicans announcing public lynching of trans kids are doing it under their real names.
If the landscape was more granular people would be cross posting stuff and using aggregation services. That was already the case to some extent. I think the answer is to let people be people and watch it all burn. Maybe someday some future society will learn from the mistakes we are making. But I don't think those mistakes include failing to protect ourselves from being exposed to inflammatory ideas. That sort of track record just gives conspiracy theorists more credibility.
Yes, I use it for builtwithdjango.com . I have not a single bad thing to say about it, not one!

It is so convenient to have it as a file, especially when you are just learning to do software development.

And the performance has not been an issue once.

One thing to note is that my site is not Facebook size. It only gets ~40 page views a day. And most of them are just for viewing, so no database opertaions.

So, I'm not going to be the most credible voice here. FWIW, I know that Pieter Levels, who runs multiple projects like nomadlist, remoteok, rebase, uses both SQLite and plain JSON files for storage.
I completely agree! It's like the difference between fishing in a stocked pond versus wading a trout stream, between taking a whole afternoon to cook a meal from scratch versus getting fast food, or between watching a classic play and watching a Michael Bay movie... Yes, technology gives us the ability to remove all downtime and have only action all the time. But I don't think I'd want to.
Prayer is a form of rubber ducking for me.
This is interesting to read- For me Logic is the lightest on CPU of all the DAWs I use. (Ableton 11, FL Studio, Reason 12,UAD Luna, Cubase 10.5) on my iMac pro (base model 8 core Xeon with 32gb ram)

Ableton, while it is my main daw and by far my favorite, is pretty CPU heavy as of Version 11.(10 was not quite as bad) The others are more or less similar in performance in terms of track count and latency. Ableton is completely usable but I usually start having to freeze tracks as the track count hits ~24ish depending on what plugins Im using.

With Logic, I can usually get closer to 2x that amount, but I should probably do a more apples to apples comparison.

I do have my eyes on the Mac Studio as my next Audio computer, but Im hoping to stretch my iMac Pros lifespan closer to the 10 year mark if I can...
A real name policy mainly hurts privacy and not much else.

Those people tend to avoid platforms with effective "censorship" as they call it, and that can be done without names. The majority of internet users doesn't spend much time thinking about privacy or anonymity, and it's not uncommon that people make death threats under their real name or end their career with dumb posts on social media.

What we need is smaller communities with better moderation. Twitter with its lack of structure is the opposite and acts more like a global spam folder, and discourages meaningful posts by limiting their length. Insults and other toxic language always fits nicely in a tweet.
I should have just fixed this if you refresh.

There is a value I expect to find in LOCAL STORAGE that is null when you first try play the game — I was not allowing for that.

I should have know to blow away local storage when testing. Since I have been developing it, of course, at some point that value was added to my local storage and I was free to write all manner of bugs that assume it is there.
> We have learned things since then. Have you?

We have learned to read the documentation before we judge things.
He hasn’t been banned because despite your claims it is neither stalking nor extortion.
As a guess, from what I've seen, about 90% of the private sector. Some of them also use some other project management software, of course, because some higher level executive wants them to, but to actually organize their own thoughts and coordinate efforts, they mostly use spreadsheets.
Now that you put it this way - is this going to be another python 2-to-3 problem? I hope they have some solution to quickly bring everything to the new version; the proposed changes seem reasonable though.
That seems not to be the case with Facebook. Real name policy, plenty of reasonable people remaining. And plenty of nutters whose opinions aren't "perfectly in line with the corporate-backed, advertiser-friendly status quo".
Yea, like enforcing the seemingly obvious “don’t use the fucking office network for torrenting”.

I nearly lost my mind when I got a DMCA notice from our ISP. I never thought I’d need to lecture a team of professionals that the consequences of losing our office internet would be significant to the business.
C macros are powerful enough
to create entire functional languages at compile time,
which is far beyond any
constexpr functions.
https://github.com/rofl0r/order-pp
I don’t really get the response here.

OCR the contract text and reveal the meaning of the clauses and how common they are. Flagging for further review.

iOS already does OCR on all images now, just no comparative analysis.

Not exactly farfetched, could save everyone time, could be baked into the OS, nothing for indie devs to salivate over.
Twitter is not "trying to solve this problem", they are embracing it and benefiting from it. They are strongly incentivised to keep the bots because it gives them a massive boost in their number of active users and the valuation of their company.

I don't think this would ever change unless they go private with someone that has no intention of selling it. I have no idea how successful Elon would be at removing them, but at least he intend to try to do it.
That's not a 180. To show a 180 you need to show Ellen Pao also saying that “it’s a private company, they can do what they want”.

I don't think that was ever Ellen Pao's position. What you've done is taken two groups of people:

* People think that twitter is private and should do whatever it wants (hence can moderate if they like),

* People that think twitter has a big public influence and therefore has a responsibility to act in a certain way (ie, moderate a certain amount)

And claimed that these two positions are in opposition and therefore hypocritical. But there is no hypocrisy because they're not the same people, they just disagree.
Got it. I had missed the little-o.
this is no blockbuster dead end company, elon will have significant influence over the 2024 election
> (Of course you'll be able to find a bunch of death threats from random accounts all over, I could find a handful in a few minutes, but that's largely outside of anyone's control.)

I think this is what I don’t understand about the general sentiment that Twitter is some kind of uber-censored platform. Sure, high profile accounts and tweets can sometimes be removed, but have you ever tried reporting tweets?

9 out of 10 times that I report tweets threatening violence or harm against someone, I get a notification a few hours later that the “moderation team” has reviewed that tweet and found it not to be in breach of any policies.
Twitter’s reporting system is ineffective at best, and I almost wish I had seen the kind of heavy handed moderation that people prescribe to Twitter here.
The implication here is Tesla is doing something about climate change.

The irony is that Tesla worsens climate change by selling billions of dollars of carbon credits which enable polluters.

If it actually wanted to make a difference it would forgo those credits which would force polluters to actually reduce pollution. Instead it's just a wash.
There's a difference between receiving hate for merely existing and receiving hate for espousing harmful beliefs.

If you got hate for having Christian imagery or references in your profile, that would be awful. But if "being a Christian" means quoting Leviticus 18:22 at homosexuals then that is an action you're taking and getting pushback for.

I find people like yourself in traditional power structures genuinely believe the enforcement of the existing structure is a "neutral" act or position to hold. I think this delusion is how you come to think of politics you actively engage is as merely "being". It's not, and no on else is obligated to pretend it is.
Parler, Gab, and Truth Social are all right wing extremist sites because they don't moderate and they want to attract that demographic. I assume someone creating an alternative to Twitter because Musk buys it would intentionally not follow that path.

Still, an alternative wouldn't succeed.
I'm saying let Twitter do the work of blocking those users. Instead of hitting the "ban" button as they do now, they hit the "Nazi" button. Now they're Nazis and everyone who says "I don't want to see Nazis" won't see them. It's not any more work on the user's part.

And I haven't seen a reason that this is any more tedious work on Twitter's part than the work they do blocking it. Maybe one argument is that Nazis are more likely to post illegal stuff, so banning them early preempts the work of looking for reasons to ban them later.
> Have you seriously not heard about using different browsers for different accounts on the same site ? Many Androids will even let you install the same app twice to use different credentials.

If you need to pay the bills in person for the two different households, do you exit the building and re-enter before paying for the second one?

If you need to do both things in the toilet, do you do the one thing then leave and re-enter to do the other?

Last time I heard the technology should help people, not the other way.
Simple implementation of RC with multithreading implies a lot of atomic counter updates which clog a multicore cpu fast.

Therefore you apply techniques like Apple's ARC, or deferred-coalesced counter mutation.

Add cycle leak detectors and the RC scheme is looking more and more like a really slow garbage collector, albeit a low latency one.

Note that simple RC is not deterministic or good for real time either because of the possibility of release/destruct cascade. Which looks pretty much like a GC pause (because it is one).
I had a four hour operation on my knee late last year. I still don't feel like I've got my short term memory back. Glad to know it isn't just me.
> But if I understand correctly it's more the driver/ORM's problem than sqlite's?

I think so. sqlite is pretty reliable in my opinion and I never hat these issues anywhere else, but this bug made me switch my DMBS for a small side project from sqlite to postgres.

> One to look out/test for early if I go in this direction though.

You're welcome!
"he did not interfere with WPs reporting."--this just means, Bezos doesn't directly deal with the editorial staff and reporters. In other words, you don't see legally admissible evidence for his interference. Next time, work with c-level execs, and see how they create the impression of 'non-interference' and yet interfere.
Slow Television
> REAL verification for all

... is how you crush political dissidents.
IMO, this is a skill that can be practiced (I feel the same way about Aphantasia).

i.e. I believe that even people who don't have it could learn it.

However I do concede that some some will barely feel like doing it and they'd be doing it well already. While others will really really have to work for it before they can achieve it.
I wrote a command line tool that automates that ALTER table flow (create new table, copy data across, rename and drop old table) - you might find it useful: https://simonwillison.net/2020/Sep/23/sqlite-advanced-alter-...
I think that iOS CoreData is just SQLite under the hood so I imagine a lot of iOS apps use it as the main data store
Thanks for the detailed reply.

> you could have defined Matrix as a weird & wonderful opinionated dialect of XMPP, defining an HTTP transport; expressing the stanzas as JSON; defining a decentralised MUC, and generally twisting it until it basically looked nothing like XMPP and would necessarily lose backwards compatibility.

All of these except decentralised MUC are implementation details, and relatively minor ones at that. Nobody using Matrix needs to know or care what the underlying transport is [1] or whether it uses XML or JSON. So calling them out as design goals that led to the genesis of Matrix strikes me as slightly strange, since they have basically zero effect on the utility of the system.

Wanting a single monolithic spec is a perfectly reasonable desire, but there's no reason that couldn't be an overlay of the XMPP specs — an agreed set of extensions that all compliant clients implement — giving the best of both worlds. (This already exists for XMPP, in fact, in the form of yearly compliance suites, the most recent being [2].)

Are there other strong reasons why Matrix could not have simply been a decentralised MUC extension to XMPP?

[1] Of course, there has been an HTTP transport for XMPP since 2003, so even if we accept that transport does sometimes matter to the user — e.g. in restricted networks — this wouldn't be a good justification for starting from scratch.

[2] https://xmpp.org/extensions/xep-0459.html
I definitely have an issue where composing English sentences takes a little bit of working memory, and if I'm concentrating on a task that can't spare that one or two items of working memory, and someone insists on talking to me, I end up speaking a jumble of English words (and sometimes non-word English sounds) back to them and waving my hands to indicate I can't be distracted, and I'm aware that I'm not making sense. It's the only way I have come up with to try and convey that I'm not ignoring them to try and be rude, but composing a meaningful utterance will force me to throw away a lot of mental work.

In college, I was once concentrating on some Mechanical Engineering homework in the fraternity library late at night. One of my fraternity brothers asked me "What did you just say?". Me: "nothing. I'm working". Him: "No, you said 'Noun?' and you said it like a question.". I'd apparently had a language center missfire while co-opting some language working memory to work on a 3d spatial reasoning problem.
A very good point that embarrassingly highlights my lack of knowledge about it. Thank you for the correction.

I suppose a decent, easy system for evading its tracking would just be for rich people to swap keys to their private jets. Or chartering. Or flying commercial. Etc.
I wish any of these were true, so at least somebody had some use. Unfortunately, the latest reorg means that my manager has to go to another physical location than me. I have in fact never seen my current manager in real life, only by videochat.
I’d be curious to hear how you deploy new versions of your application with SQLite. Can it be done without downtime?