skysight-inc/HackerNews huggingface dataset:
I'm not sure how mad to be about this. Honestly, at the moment I kinda think it's a good thing on balance.

I believe climate change is a huge, urgent concern. And I think it would be hugely helpful to have carbon removal technology in our risk mitigation portfolio. If fossil fuel companies, out of self-interest, want to support a legitimate research institution doing that, I'm not sure I should complain.

If Stanford starts spouting propaganda that we can procrastinate on getting off of fossil fuels because their carbon removal technology will solve everything, I will definitely condemn them mercilessly. I assume the fossil fuel companies are already spouting such propaganda or funding someone to do so, since they've been spouting anti-climate risk mitigation propaganda for decades, and I am already condemning them mercilessly for that anyway.

I actually think carbon removal could spur renewables development because in theory it's a flexible sink for spare power. Set up a CO2 removal station in the desert, power it with a few square miles of solar panels, and run it when the sun shines. We could get a lot of demand for solar panels out of this, and that will encourage the further development of commercial scaling up. And the more renewables scale up, the more I think fossil fuels will be squeezed out of existence because they won't be able to compete on price.

EDIT: I am open to the possibility that this is completely unrealistic and is just another distraction from the fossil fuel industry. But the arguments need to be made on technical grounds by knowledgeable people. Here is an interview by an expert making that argument: https://www.protocol.com/climate/carbon-dioxide-removal-cost...

> Yet ambition and momentum may not be enough to reach that milestone, according to Howard Herzog, a senior research engineer with MIT’s Energy Initiative. He’s been studying carbon capture for over 30 years (even writing a book about it in 2018) and is more skeptical given the capital costs to build CDR plants and the enormous amount of energy they need to run. He sat down with Protocol to talk about why he thinks $100 per ton is “pure fantasy.”

By the way, I really liked this quote, and I wish all the "we just need to"-ers would read it:

> When people think things are too easy, they won’t address the hard decisions, even though those hard decisions may end up with a better solution. At this point, I don’t know if liming the ocean is a great idea or not, but it has a lot of potential, and we have to look at things like that if we want to get to net zero. And people say capturing carbon dioxide from the air for $100 per ton will get us to net zero. But if it’s a fantasy, it’s not going to get us there.
How to debug C++ lambda expressions with GDB
It's not the voters, it's the local political machine. You guys are hackers and you can't even be bothered to scope out the problem before you start opining. Anti-humanism is THE San Francisco Value. https://aaronlee.substack.com/p/anti-humanism-is-the-san-fra...
I just leave my cellphone places on purpose. Later I call them back with an excuse like "Sorry, I left my phone in the kitchen and was at my desk." Anyone that calls me regularly knows to expect this. I do keep my phone on and near me during standard business hours, but even then I might not answer a family call and give a work excuse.
Same idea as here:
https://www.wired.com/story/tiktok-platforms-cory-doctorow/

Gmail is being Enshittified.
Shameless plug:

https://github.com/dfhoughton/ranagrams

I find it a good time killer. Note, there's a word list in the repo, but `crate install ranagrams` starts you off without a word list.
OK, fair enough. I will stop doing it. I get down voted a lot for it :)
I'm happy to see more love to assertion.

I worked on a 15K loc Python project. We didn't have tests because it was hard to isolate.

We started to puts some asserts here and there on parts of the code we weren't sure about.

After few months, we simply puts assert _everywhere_ and it quickly became a weird but efficient way to cover our backs and it help us to make refactoring fun.

With assert, you can start to think if particular branching is relevant or should be placed on the caller side.

We consider an AssertionError as a developer error and it makes a real difference in investigation time between other errors that could raise.
> environmental issue with low density is mostly cars

Suburban houses require more resources and energy to build, maintain, heat/cool. Transport is just a small part of it.
As a concrete example, while my awk skills are extremely rusty, here's a program which will normalize the input line, create a table mapping the normalized name to the matching original lines, then at the end it only displays the ones with at least 5 anagrams.

I tried to avoid modern awk features, like asort, to be something that would have worked in the 1980s:

{
# Convert to normal form:
# 1. Fold to lower case
# 2. Bin the letters to get frequency counts
# 3. Only consider lower case ASCII letters
split(tolower($0), letters, "");

# Ignore asort() in modern awks and do a bin sort instead.
for (i in letters) {
c = letters[i];
repeats[c] = repeats[c] c;
}

normal_form = "";
for (i=97; i<=122; i++) {
c = sprintf("%c", i); # no chr() in a 1980s awk
normal_form = normal_form repeats[c];
}

table[normal_form] = table[normal_form] "," $0
delete repeats;
}
END {
# Only show the ones with at least 5 matches
for (i in table) {
match_str = table[i];
split(match_str, matches, ",");
num_matches = length(matches)-1
if (num_matches >= 5) {
# print the number of matches, then the match string
printf("%d%s\n", num_matches, match_str);
}
}
}

When I try it on a word list I have handy, here are the most common words:

% awk -f anagram.awk < words_alpha.txt | sort -n -t, | tail -5
13,elaps,lapse,leaps,lepas,pales,peals,pleas,salep,saple,sepal,slape,spale,speal
14,anestri,antsier,asterin,eranist,nastier,ratines,resiant,restain,retains,retinas,retsina,stainer,starnie,stearin
14,apers,apres,asper,pares,parse,pears,prase,presa,rapes,reaps,repas,spaer,spare,spear
14,arest,aster,astre,rates,reast,resat,serta,stare,strae,tares,tarse,tears,teras,treas
15,alerts,alters,artels,estral,laster,lastre,rastle,ratels,relast,resalt,salter,slater,staler,stelar,talers

Certainly Perl is more succinct, though note that even up to Perl 4 in the early 1990s you would need to use the string concatenation method to store the list of matches in the table.

But, "painful"? No. Not to someone who knew how to use awk.
Qui suis-je ?

Me voici Sultan !
Nuitisme vocal
Silice mouvant
Io, vent musical !

Le voici musant
Mot inclus à vie
Ce motival insu
Là vous émincit

Cultivons amie
Si il vaut ce nom
Son val muet ici

Indice:

Si nul vice à mot
Vu ici slame ton
Nom c'est via lui
Vaincu tel, omis

Who am I?

Here I am, Sultan!
Vocal nightism
Moving silica
Io, musical wind!

Here it is, musing
Word included for life
This unknown motive
There, it slices you down

Let's cultivate, friend
If it's worth that name
Its silent valley here

Hint:

If no word vice
Seen here, slams your
Name, it's through it
Defeated as such, omitted
... so just ban it already. this is getting tiring as we're in the 3rd or 4th year of this nonsense.
for a fun experiment, ask bard, bing and chatgpt this question "what is the copyright status of "GPT"?"

Bard:

The copyright status of GPT is currently unclear. GPT is a large language model developed by OpenAI, and it is not clear who owns the copyright to the model or its output. OpenAI has released GPT under a permissive open-source license, which means that anyone can use the model for free. However, the license does not explicitly state who owns the copyright to the model or its output.

Some experts believe that OpenAI owns the copyright to GPT, because it was developed by OpenAI employees and using OpenAI resources. Others believe that the copyright belongs to the users of GPT, because they are the ones who are actually creating the output. This is a complex legal issue, and it is likely that it will be litigated in the future.

In the meantime, it is important to be aware of the copyright implications of using GPT. If you use GPT to create something that is copyrighted, such as a poem or a piece of music, you may need to obtain permission from the copyright holder before distributing your work. You should also be careful not to use GPT to create something that is defamatory or offensive.

Here are some additional things to keep in mind about the copyright status of GPT:

The copyright status of GPT may vary depending on the jurisdiction.
The copyright status of GPT may change in the future.
It is always best to consult with an attorney if you have any questions about the copyright status of GPT or its output.

Bing:

According to my web search results, “GPT” is not a copyrighted term. It is a commonly used acronym in the field of natural language processing (NLP) to refer to the Generative Pre-trained Transformer model developed by OpenAI. However, it’s important to note that the GPT model itself is protected by OpenAI’s intellectual property rights, including patents and trademarks1. There are reports that OpenAI may be trademarking “GPT” soon2.

ChatGPT:

As an AI language model, "GPT" (Generative Pre-trained Transformer) is a proprietary technology developed by OpenAI, a privately held research organization. Therefore, the copyright of the GPT technology and associated materials, such as research papers and software code, belongs to OpenAI.

It is important to note that copyright protects the specific expression of an idea, not the idea itself. So while other organizations can develop their own AI language models inspired by GPT, they cannot copy or reproduce the exact implementation of GPT without permission from OpenAI.

Additionally, OpenAI has released several versions of GPT under different licenses, including the Apache License 2.0 and the Creative Commons Attribution-ShareAlike 4.0 International License. The specific copyright status of a particular version of GPT depends on the license under which it was released.
It housed 33,000 people. While on paper that's extremely dense it's not necessarily scalable - and kind of provably so, since they tore it down and evacuated everyone who lived there.

What would the sewage infrastructure look like for a 1km square with almost two million people in it? How about the ventilation? Police and fire? It's not really tenable.
Consuming Psychedelics Temporarily Improves Man's Color Blindness
>Similarly, StableDiffusion's image quality progress has in my experience stalled out, whereas Midjourney continues to dramatically improve every couple months, and easily beats SD. Open source isn't a magic bullet for quality.

MJ only does one style, and you can emulate that just fine in SD if thats what you want.
A few years back I looked around what options exist for building a cross-plattform app. It should support mobile platforms (at least Android and iOS) as well as the web, properly.

The problem with cross-platform frameworks is that they either focus on a good mobile experience, and web becomes an afterthought, or vice versa, meaning mobile basically embeds a browser. Flutter is one of former; back then the web variant was in alpha and basically just a canvas that couldn't even adjust aspect ratio. Since web had priority for our project (accessability, reactive scaling, etc.), this was a no-go.

We ended up going with Ionic (which is basically Cordova with some components on top). The web experience is tweakable to a low level, and the mobile experience is acceptably good, even if not perfect. And we get to cover 3 platforms with the effort of building for ~1.2 apps (there is some platform-specific work involved still).

I'm not even sure if cross-platform is at all solvable in a perfect way, since the UI patterns between mobile and web are just too different.
I'm always baffled when I see people using a desktop web browser without an ad blocker. We have the technology to fix this, folks! It takes like two clicks! Use it!

https://ublockorigin.com/
Starship is designed to be both highly capable, for manned space exploration, and cheap, to launch 10s of thousands of gen2 Starlink sats. There are even more important synergies in that Starlink is what gives SpaceX a high valuation compared to companies that are only in the launch business.

If it all works as intended, both Starshiip and Starlink will have great advantages as a result of this strategic synergy. Or if, for example, Starship is trying to be too many things at once, it is a house of cards.
Donating towards and voting for political candidates who have communicated effective measures of education reform as part of their platform. For what its worth, I'm not really interested in grandkids, so that's not what I'm optimizing for (rather, a high functioning educational system for any child who needs exposure to one, broadly speaking). I am a fan of civilization and contributing to its improvement within my influence sphere.
may I ask what your use case is for the vector db?

struggling to see the reason for the sudden demand
There are two things that make a good LLM. The amount of data available for training, and the amount of compute available. Google's bard sucks in comparison to Open AI, and even compared to Bing. It's pretty clear that GPT4 has some secret sauce that's giving them a competitive edge.

I also don't think that Open Source LLMs are that big of a threat, for exactly this reason. They will always be behind on the amount of data and compute available to the 'big players'. Sure, AI will increasingly be incorporated into various software products, but those products will be calling out to big tech apis with the best model. There will be some demand for private LLMs trained on company data, but they will only be useful in narrow specialties.
If you're going this far, might as well do as the author did and add a pi-hole to the mix, issue some credentials to your phone and block ads and/or other stuff via DNS everywhere you go. I also use this to remote into my work computer from wherever I am, using my travel laptop, an iPad or even just my cell phone.
Replit now has Postgres databases. Do you know if it's possible to use pgvector on replit?
Right, we've never heard any news of employees of other social media apps targeting exes, reporters, or celebrities.

/s

We totally have.

EDIT: I worked for Amazon in customer service back in the early naughts. They had an explicit alert set up for most celebrities that would basically get a CS rep fired if they went in and snooped. It was put in place because people went in and snooped.

20 years later, and more information about our lives is entrusted to these sites. It's absolutely happening at all of these companies. If it isn't happening, it's because of new policies and procedures resulting from prior incidents.
> My claim that the passkeys are strictly worse than passwords applies specifically in the sense that, as a form of authentication, passkeys do not prove that the person logging into the site is actually the person they say they are.

This isn't theory. Design should be data driven rather than ideologically driven.

> It is easier to hack or steal a phone than it is to read your mind.

Mind reading is observably not the only way to obtain somebody's password. As you say in your next paragraph, this is extremely important when considering passwords. Plenty of things work great if you simply exclude all the cases when they don't work great. Everybody sucks at detecting phishing, even security professionals. This is demonstrated through clear data. "Well, I had to do something to get owned" is not meaningful. We should not care about the ideological purity of practical systems. We should care about their practical outcomes.

> Those situations are exactly why password systems must be designed NOT to store the password on any devices, whether that's a file on a phone or laptop, or a cell in a database. Every time the password is written down, it is effectively already compromised as an authentication tool because it's no longer just something you know.

This is also largely wrong from a practical perspective. Chrome can happily store your saved passwords on disk if you don't want to sync with a backend service. This adds minimal risk, since a rouge program that can read all your files is very likely to be able to fuck you even if the passwords are only ever temporarily stored in memory.
Wholly dependent on what you mean by "took off" but I'd argue Haskell qualifies. It was a nothing language for two decades before finding its footing and is now used in quite a lot of places (TIOBE puts it near TypeScript).
> a secret word for phrase that both you and the service you want to sign into know

That would not be a password, that would be something you share. An actual password must be possible to verify without it being stored on any device. On the service side, it's the same as for certificates, as you describe. The service can't store the password because that would invalidate it's usefulness as a way to prove someone is who they say they are. This is why we store a cryptographically secure hash code instead. It is also why the password hash code must be generated on the user's end, not on the service side. You never want to "transmit" passwords in plain text because transmission across the internet is an act of making copies of the data transmitted in the memory and storage of all the devices it transmits across. The moment you send a password across the internet, it is compromised.

So as the service, you don't know the password, you only know that the hash code you received matches the one for that user, and you are reasonably certain that there is no known way for someone to generate that hash code without knowing the real password. Therefore the person trying to login in must be who they say they are.

Passwords and private keys only work as authentication if no one else knows it, has possession of it, or can get access to it. If there is a flaw in any one of those aspects, then the system doesn't actually prove a person is who they claim to be. It only proves that a person is someone who knows, possesses, or has access to that thing. That might still count as evidence that they are authentic, but more will still be needed to actually prove they are authentic.
https://archive.ph/hb8iz
Wiener is part of the political machine that has destroyed SF. I didn't read the threats, but they're understandable. These people are as bad as African dictators, and steal more. https://aaronlee.substack.com/p/anti-humanism-is-the-san-fra...
https://www.reddit.com/r/StableDiffusion/comments/y649yn/pro...

Nothing so… social
The frequency of shark attacks at the beach is correlates with the number of ice cream sales, therefore, ice cream must cause shark attacks! /s
If you're going to design an app that you want to run in a browser, not a website but an app, why wouldn't you make use of canvas? Especially if you're designing a language that compiles to native code on as many platforms as possible.

I do get the accessibility issue with it but to me it seems that's been sacrificed for ease of development. A trade-off. Genuine question, is there a way to make canvas accessible or is it designed inaccessible? Or is flutter using it in an unintended way?

I'm certainly a happy user of dart/flutter. I'm not targeting the web. I would never use it for a real website but I definitely would for an app though if I was moving anything into the web.
That's pretty funny. Why is this a problem?

I don't like the use of facial rec but I don't see an issue banning these people. Which of these is the issue here?
> do not need to worry about escaping quotes in strings because of the {} syntax

Perl has strong support for that: https://perldoc.perl.org/perlop#Quote-Like-Operators

You can basically use any character as a delimiter except whitespace.

All of these lines are equivalent:

$str = 'Hello, world.';
$str = q{Hello, world.};
$str = q[Hello, world.];
$str = q(Hello, world.);
$str = q<Hello, world.>;
$str = q|Hello, world.|;
$str = q!Hello, world.!;
$str = q#Hello, world.#;
$str = q%Hello, world.%;
$str = q=Hello, world.=;
$str = q 7Hello, world.7;

Note that when you use a letter or number (actually any character that's legal in an identifier), you need a space after the "q".

You can also do it with other types of quotes, like double quotes (that support variable interpolation). These are equivalent:

$var1 = 'abc'; $var2 = "Value of var1 is $var1.";
$var1 = 'abc'; $var2 = qq[Value of var1 is $var1.];

And you can also do it with regular expression matches:

if (/pattern/) { whatever(); }
if (qr|pattern|}) { whatever(); }

and substitutions:

s/pattern/replacement/;
s|pattern|replacement|;

sed also has something similar:

echo abc | sed -e 's/abc/def/'
echo abc | sed -e 's#abc#def#'
You can also do it from the settings of whatever browser you want. It exists under Settings > Chrome, and Settings > Firefox, but only if you have those browser installed. The option is always under Settings > Safari, though.
This is once in a while kinda useful, aside from the data layout issue for stuff like a FourCC.

Rust has e.g. u32.to_le_bytes() to turn an integer into some (little endian) bytes, but I don't know if there's a trivial way to write the opposite and turn b"1ert" (which is an array of four bytes) into a native integer.

Edited to Add: oh yeah, it has u32.from_le_bytes(b"1ert"). I should have checked.
Question for the community. Email verification is easy. The provider sends you an email, you click the link in that email, and the process is complete. When it comes to domain verification, what if the provider sends an email to the address listed in the domain's WHOIS? It seems much easier than dealing with DNS records, but I may be overlooking something obvious here.
For friends from China who are interested in Crystal,i create the Github crystal-china org, https://github.com/crystal-china, and I also hold https://crystal-china.org domain name, although there is still no time to build a website.

Let us discuss use Chinese in TG,Discord, and do something together.
Seems to me that the storage TB/$ is rising at least slightly faster than the total size of these kinds of archives. I wonder how long it will be until we can feasibly keep personal copies of zlib (and libgen, and scihub).

How big is the z library archive, anyway?
I have been using Gmail since 2004 and I haven't ever seen a single ad there.

Edit: I just checked and it seems that the ad blocker might be blocking them. What's interesting is that I did not install that ad blocker myself, and I'm using Chrome. Does Chrome come by default with an ad blocker that blocks the ads in Gmail?
Why not just buy a computer that is correctly-sized to play games, rather than buy an AI-sized computer that you mostly use for games?
This seems extremely similar to https://github.com/newhouseb/clownfish
> Do any of the web accessibility issues come up for other platforms as well? How does the iOS screenreader handle Flutter-generated views on iOS?

Unfortunately I haven't done much accessiblity-focused work with Flutter yet, however the docs do mention there are some capabilities but the amount of info there seems slim: https://docs.flutter.dev/accessibility-and-localization/acce...

> I'm not sure I understand the distinction between web apps and web sites. Don't both of those experiences need to be accessible?

The distinction as I understand is websites are usually more document-orientated focused mostly on reading (e.g. a blog, or even Hacker News), whereas web apps are more focused on user-interaction (e.g. spreadsheet apps, email apps).

Due to Flutter's large bundle size and long initial load time it's definitely not suitable for things like news sites or blogs where initial load, SEO, and readability are all important.

I would agree they both need to be accessible, but there's also extra cons to Flutter Web that make it not the best choice for websites even if it did accessbility perfectly.
Nah. Funding research to show your business isn't a problem is shady. Funding research to solve the problem could be a good thing, depending what the find.