skysight-inc/HackerNews huggingface dataset:
Tokenization for models like GPT or BERT can be seen as compression. That is, frequent words are separate tokens. Frequent sequences are separate tokens. On the other hand, if a sequence is very uncommon, then it will contain many tokens.

Sure, you encode bit-by-bit. But it is a fixed-length code, which is even worse than character-by-character.

Maybe you only get worse training and inference time. But I wouldn't be surprised if the encoding also serves as a Bayesian prior, and with a different encoding, you get worse results (for given data).
The same is going to happen to the (once) Great Salt Lake. It's going to be a disaster, the vast majority of the population of Utah lives along the Wasatch Front nextdoor and downwind from it, and all the heavy metals and toxic chemicals that are stably suspended in it from the Kennecott copper mine and the old Geneva Steel mills are going to turn into dust and go straight into their lungs. There's going to be a ton of cancer just like all the towns along the shores of the dried up Aral Sea
Techies in tech industry are basically eating the rich .. A lot of buzzword to suck investment money in.
I strongly dislike that you engaged in the shoe scalping arbitrage business, but at the same time really appreciate you sharing this information. Excellent writing covering a fascinating adventure!

Question: With the Twitter RSVPs, do you think Nike implemented automation to automatically give you the code when you responded with the correct code in a fraction of a second? If so it implies that on some level Nike was fine what you were doing.
I'm not so sure it offers an "advantage" but it's rather just something we seem to have evidence for - indeed it does not answer any questions rather raising more possibly
This is a really solid reply - I would emphasize “know your buyer.”

We thought we had a solution to a problem. We were told from the end users we had a solution to the problem. We thought we knew the value to those people as far as pricing for the product. But the actual buyer didn’t at all value our product the way the end user did, especially when factoring switching costs etc and it was crippling.
Though maybe not very useful directly for taking lecture notes, I like the Feynman technique for self driven learning. It's pretty sparse for layout and specific details, but the guiding principles are simple and keep you moving in the right direction: summarize your current understanding of a discrete topic in simple terms, iterate toward further simplicity as you learn more.

______

Step One: Choose the Concept You Want to Understand.

Write it on the top of a sheet of paper.

Step Two: Pretend You Are Teaching the Concept to a Child.

Write an explanation of the concept on the paper as though you were teaching a child.

Step Three: Stuck? Go Back to the Source Material.

Re-read or re-learn the material until you can complete step two.

Step Four: Simplify & Create Analogies.

If your explanation is wordy or confusing, simplify the language. Create an analogy to help understand the concept.

_____

https://law-hawaii.libguides.com/notetaking/feynman
"over 10% of English speakers are from cultures with a continued tradition of having more than two genders"

Can you name a example? Genuinly interested. Do you mean neutrum?

"But he advocates for, and aids, the harassment of people I care about."

This is something not tolerable.

"It's not about blame; it's about trust: he doesn't deserve yours."

And he never had my trust. I never heard of him. I simply observed that on his blog he made some valid points mixed in with some prejudices and of everything else I had no idea before - and while asking exactly that further down, there came no more examples, of him doing wrong, besides having a different opinion.

So my main point was and is, that this whole debate has gone off rails a long time ago. Funnily enough, yesterday I was banned from a Telegram group, I stumbled into, found they were "critical of the gender agenda", and they all had of course "homosexual friends who also thinks that", but behind the masks and after asking more questions, they turned out to be very trans- and homophobic, liked their bubble and any other viewpoint was not welcome and I got kicked out.

And so here my initial comment is flagged as well, apparently from the other side.

Is there really no more middle ground? Is there really only the option of choining the racists, or submitting totally to the latest progressive agenda and staying up to date to the most recent words I have to learn to not offend anyone, or otherwise risk a career ending shitstorm?

This is my problem with this whole debate, it polarizes and increases the rifts in society. And it does not convince people of anything, it just scares people to speak up their mind. I am pretty progressive I think and when I still have the wrong opinion, that needs to be flagged, well, good luck convincing any "normal" people out there and not pushing them more to the other extreme side.

(directed not necessarily at you, but at the people who flagged my opinion above)
While they quote the article they don't make it clear who they are quoting or that it is speculation. Yes, one can check the article to see if the quote is coming from information from Meta, but one shouldn't have to.

>we know they've made similar types if decisions to maximize engadgement

Name a similar decision. The closest thing to this I can think of is from gacha games and not social media sites.
Honestly, for many simple programming tasks/questions, I find it’s already rivaling Stack Overflow and Google for quick results. Just last night it flawlessly wrote me a scaffolding for a Bash script that parses specific command line flags
Lol kids + rabbits + in-laws who own dingos. All it takes is for one rabbit to piss on a doona, one kid obliterating 3 pairs of clothes in a day via mud/dirt/being bush rats (then multiply that by 3) and doing a house load of sheets or towels and blamo. 7 loads easy. Or atleast 7 small loads. Now 3 tops generally.
Use proper fixed-width fonts! :P
I don't think life can be evaluated as a snapshot in a moment of time. Life is a process, and it affects a population. I think even the most conservative definitions may agree on that.

Antifragility plays well with this definition: it doesn't describe the state, but the potential and the ability to change. Taking into account the huge populations, and the fact that only a couple individuals must survive hardship in order for life to prevail, I can see the antifragility.
You may not be the target audience of NetBSD. Actually, of any of the BSDs.
And then people will go to jail.
Similar (ish) lawsuits, (like the one against Juuls) haven't been dismissed. What makes you think this one is different?
TikTok offers their service to people they know to be teenagers, during school hours, when those teenagers are inside the school building (with TikTok's tracking of users, they surely know it.)

I don't expect this lawsuit to succeed, but it's not entirely without merit and I do think the school district has some standing if for no other reason than because TikTok is serving videos to, and accepting uploads from, students who are actually in school.
So, if I understand it, the plan is that you'll:

1. Receive an ordinary warrant in a criminal case, which will have non-disclosure language.

2. Take the canary down.

3. When, say, 6 months later, the case goes to trial and the warrant is unsealed, you'll put the canary back up, having logged the warrant.
This made me laugh, yes I agree in a way. Maybe some day we will discover amino acid constituents on earth or another planet and it will fill in more of the blanks. It's the definition of chicken and egg though
Why is everyone using straws as an example? First, they are not what I am talking about -- we used to get beverages in re-usable containers and now it is almost impossible to find anything in glass. We don't need plastic to-go containers, we don't need everything in a plastic wrapper or vacuum sealed in a thick plastic container (as evidenced by companies not doing that and having zero problems with their products being damaged). These are just a few things that could be changed with zero inconvenience to the consumer. In fact, the plastic sealed packages that require a chainsaw to open being discontinued would be a convenience for consumers, since I have never met a person who didn't hate them.

Keep your plastic straws.
This is what ChatGPT does, for instance.
It wasn't, actually. I made that comment before I read the complaint. The statutory basis of their complaint is that Facebook constitutes some specie of nuisance, hence my later comment that even if we took their factual assertions at face value the charge asserted should be void for vagueness.
The same is true of trees! They've independently evolved many times [1]. Any solar-powered biome will probably have trees.

[1] https://eukaryotewritesblog.com/2021/05/02/theres-no-such-th...
Do you mean to use Ory Kratos in a self-hosted manner? From a brief look it seems like you aren't rolling your own auth when you use this, but rather integrating it into your application.

What am I missing?
5 mass extinctions and it's still going. Seems quite hardy.
My friend mentioned this just before I published and I think that probably is the fastest largest thing you can get which would in some sense count as one machine. I haven't looked into it, but I wouldn't be surprised if they could get around the trickiest constraint, which is how many hard drives you can plug in to a non-mainframe machine for historical image storage. Definitely more expensive than just networking a few standard machines though.

I also bet that mainframes have software solutions to a lot of the multi-tenancy and fault tolerance challenges with running systems on one machine that I mention.
Why not a single FPGA with 100Gbps ethernet or pcie with NVM attached?
Around $5K for the hardware and $5K for the traffic per month.
The software would be a bit trickier to write, but you now get 100x performance for the same price
> Well, that's a big question; hope you don't mind if I reflect a bit before attempting to answer!

Not at all, please take your time! And if you have more insights, feel free to post them later! I'll check again the comments for the next few days, because all this is so intriguing to me!

> I was living in the US in the 80s and 90s

This begs many questions: where you born here? Where do you live now? (and ...why?)

> Have you read Microserfs yet? https://en.wikipedia.org/wiki/Microserfs
> It's a pretty good capture of our Zeitgeist

I haven't but if it's a good capture of the 1990s zeitgeist, I will!

> (any specific qs, go ahead and I'll do my best)

Besides the lack of optimism, what are the other differences between now and then that stand out to you?
> I really don't understand how someone could take good note while also listen...

I type moderately fast, only write when I think "I won't remember this" and review notes as soon as possible to address the pending points. I'm not bottle-necked by this, unless I'm doing a presentation.
John Carmack tweeted something that made me noodle on this too:

>It is amusing to consider how much of the world you could serve something like Twitter to from a single beefy server if it really was just shuffling tweet sized buffers to network offload cards. Smart clients instead of web pages could make a very large difference. [1]

Very interesting to see the idea worked out in more detail.

[1] https://twitter.com/id_aa_carmack/status/1350672098029694998
>The beef itself is arguably one of the healthiest foods available.

What are you talking about? Are you just going to say this without any citation whatsoever? What do you mean by 'healthy'?
Burying plastics in the ground; returning carbon to where it came from.
If I forgot I had edited a file and I’m leaving it as if I hadn’t, I will want to know.
Ask HN: Hetzner VPN in US traffic routing through Germany?
I have "US" servers in VA and OR with VPNs that route through them. The IP addresses show as German IPs and traffic is getting routed through Germany. This blocks a lot of my services and incurs high latency from the states. What is going on here, are people experiencing similar issues?
Most projects I encounter these days instantly reach for kubernetes, containers and microservices or cloud functions.

I find it much more appealing to just make the whole thing run on one fast machine. When you suggest this tend to people say "but scaling!", without understanding how much capacity there is in vertical.

The thing most appealing about single server configs is the simplicity. The more simple a system easy, likely the more reliable and easy to understand.

The software thing most people are building these days can easily run lock stock and barrel on one machine.

I wrote a prototype for an in-memory message queue in Rust and ran it on the fastest EC2 instance I could and it was able to process nearly 8 million messages a second.

You could be forgiven for believing the only way to write software is is a giant kablooie of containers, microservices, cloud functions and kubernetes, because that's what the cloud vendors want you to do, and it's also because it seems to be the primary approach discussed. Every layer of such stuff add complexity, development, devops, maintenance, support, deployment, testing and (un)reliability. Single server systems can be dramatically mnore simple because you can trim is as close as possible down to just the code and the storage.
It reads like a gpt response lol
The phrase "biomass" is misleadingly vague.

The article is aboit dedicated biomass for electricity production, which given the cheapness of solar and wind is a little like dunking on steam-powered cars. I'm not aware of anyone arguing for that as an approach. We did these sums a couple of decades ago.

On the other hand, wwste food, sewage, manure, and various other things that would become methane are useful to capture as it can be GHG negative comparrd woth letting it rot. That is also "biomass".
I think if there were evidence of targeting children with advertising, deliberately locating near schools or other intent, then yes, you could see a lawsuit.
If you don't have a remote position already then I would suggest you make it clear to any potential employers this is your intention. I have been working a remote job for many years and I only recently found out I am required to be in either Canada or the US. I had no intention of leaving but it was always something I thought I could do until I found this out.

Then make sure you have good equipment and by that I mean stuff that you can work on anywhere. Maybe taking your work to a local coffee shop to test out how it feels. Personal I have a very hard time typing on a small keyboard as a larger gentleman. I take my keyboard with me when I travel for work, which I luckily don't do a lot.

Then you may need to plan your trips carefully. You may be without internet for days if not careful. This may not matter but if you hit a deadline while out of service your employer may not be happy about your lack of foresight.

Finally, if being alone is a concern then don't do it alone. You could find someone who wants to go with you, or just meet people as you travel by staying in hostels or what have you. Travelling by yourself will be lonely but for me that's a good thing.
What the Lord intended
We must not inconvenience anyone at any cost! Even if it creates a layer of plastic on earths surface and we get microplastic in our spines.

It would have been easier to believe in a better future if people could stomach tiny inconveniences.
> isn't ale just beer said another way

No. Ales are a subset of beers.

> I hate the IPA fad because it's keeping brewers from making good lagers. Can I have both please?

Yes, of course. Seeing this so much in this thread makes me feel like it's 2012 again. I travel a lot in North America and like to check out the local breweries when I do. There are always plenty of non-IPA options.
In 2001-2003, browsers crashed every 5 minutes then and Google's search didn't crash nor freeze nor slow it due to not being covered in ads and popups (having only 1-3 ad results at the top of the page with green text was a massive improvement). On tech forums back then, people would say, "is this even sustainable?"

Microsoft search and the other ones were just "there was an attempt" tier and gave complete nonsense results. When Google debuted, it was the only time web search substantially improved. There were no other big innovations in web searches ever, from that day on.

> These days you can just throw stuff at it like “that movie about the depressed guy with a plane engine that falls on their house”

I have looked for obscure queries like yours for 10 years and have not found them. For example "that movie where police vehicles are dispatched and they all crash for seemingly no reason on the way to the scene". It just won't find it because nobody talked about it (in a manner that would cause words that stick out to match), simple. And now days it's even worse because it does that new "rounding" thing and gives me:

- The 25 Best Police Movies of All Time
- Dispatched (2014)

That first result simply contains nothing to do with my query other than the world "police" and "movie".

Now days when you try to use a web search, you can't be smart and search strings that are likely to be used by someone discussing your topic of interest anymore, because it will always "round" them. It will also look at each word as if they are the literal thing you are in search for. I don't know if it's still possible to search bodies of text to get around that, but I'm not sure if that feature even ever worked. Back in 2005 when all these people were raving about intitle: inurl: inbody: whatever, none of them worked consistently, and you would also get scolded for hacking if you used them "wrong". Even searching something like "powered by phpbb" got me banned or scolded once when I wasn't even using it for hacking but rather as a workaround to narrow my search to only forum websites.
Thanks but these guys appear to be quite expensive up here. Cheapest MoCA units I can find on Amazon.ca hover around $163 C$ a pair. However, in the process, I discoved that DirecTV DECA adapters can be used on "dark coax" for $41 C$ a pair. Whoa! They top out at 100MBit/sec, but that would be plenty for my use case. And I just happen to have a fair bit of this "dark coax" running through my house.
> base64 encoding and application level decoding is also an accepted practice

I feel seen. I remember suggesting this during a design discussion where the issue was how to embed an arbitrary document in another, where the embedded document could even be ill-formed. Everybody told me it was a gross and dirty hack and ignored the suggestion.
> for Go, do you rely on `net/http/fcgi` to run it?

Yes.

> Do you have any example I can have a look at?

https://github.com/John-Nagle/vehiclelogserver/blob/master/v...

There's not much machinery required.

package main
import (
"database/sql"
"net/http"
"net/http/fcgi"
)

//
// Called by FCGI for each request
//
func (sv FastCGIServer) ServeHTTP(w http.ResponseWriter, req *http.Request) {
body := make([]byte, 5000) // buffer for body, which should not be too big
if req.Body != nil {
len, _ := req.Body.Read(body) // body of HTTP request
bodycontent := body[0:len] // take correct part of buffer
Handlerequest(sv, w, bodycontent, req) // handle request
}
}

// Run FCGI server
func main() {
sv := new(FastCGIServer)
fcgi.Serve(nil, sv)
}

// Handlerequest -- handle one request from a client
func Handlerequest(sv FastCGIServer, w http.ResponseWriter, bodycontent []byte,
req *http.Request) {
// GENERATE REPLY CONTENT HERE
w.WriteHeader(statuscode) // internal server error
w.Write(content) // report error as text ***TEMP***
}

That will run on low-end hosting at Dreamhost.

So there you are, in a modern language, with hard-compiled code with good performance, and reasonably good fault tolerance. Next step up would be a load balancer and redundant databases.
Particular in the context of car sharing (ShareNow, Miles, WeShare, etc.). Because you need to do the crappy touchscreen thingy every time you enter a vehicle.

You drive different models from different vendors all the time. Everything is slightly different. The IVI system has commonly incomprehensible UX with deep menus.
It mostly feels designed by committee (which it is, I worked on one such system for the flagship modes of one of the top German car makers a few years ago and good deep insight into the process).

Physical, standardized buttons would go a long way.

If you buy a car you'll have an initial learniung curve and while it sucks you can cope.

As a occasional user, you're in a world of pain. I don't understand why vendors do not do IVI firmware that is tailored for the car sharing/car renting market.

It needs two buttons after booting up (and they can be on a touch screen even):

1. Connect phone (Android Auto/Apple CarPlay)

2. Connect Bluetooth

That's it. Many cars still do not offer the former at all. Either way, the latter or both options are commonly hidden deep in nested menus in the IVI's preferences.

Early on, there were attempts. For example, car2go (now ShareNow) which was owned by Daimler, had a function, ca. 2014/2015, where it would remember the radio statio based on who was using the car.

I.e. the IVI firmware of the Smart car (they only had Smarts then) was somehow integrated with the car sharing app/user profile. And it was location based. Driving car2go in Milan, Italy the cars recalled my fav. radio station there but when I was coming back to Berlin, the station I had set using a car there was automatically on.

And then the next generation of Smarts was rolled out and the feature was not only gone, the firmware the cars had was just stock standard. I.e. they didn't add something like the bluetooth shortcut I mentioned above which I had expected and deprecated the feature the previous model had.

It's almost a decade later and nothing has improved -- rather the opposite.
A Woman Who Abandoned a Successful Music Career to Perform for the Dying
Is there a specific law that these firms are supposed to have violated? (Does there need to be? I am not a lawyer.)

Does the school district have standing to sue on behalf of the students? (Is the injury that they pay more for mental health services for students?)

I’m genuinely curious. There’s a surface analogy to the cases against opioid manufacturers and distributors, but those are controlled substances whereas YouTube is clearly not.

There isn’t even a clear causal effect of the from YouTube -> depression, IMO. Research on this has been quite low quality.

And what about the role of the parents who are the owners of the phones on which their children run TikTok?

Again genuine curiosity here, not trying to be a jerk.
To play devils advocate...

How people imagine one can faithfully squeeze dynamic range of ~10 to 120k nits onto a typical 250 nit screen? How about a printed medium that reflects at most 100 nits in typical viewing conditions?

I love the expression that professionals use, simply "tones are good". That's it, zero insight on to how it's done.

Our eyes (or eye-brain combination) has also been found to do quite a lot of processing on it's own. For example white balancing (famous blue/gold dress story). Relative colour perception. Illusion of depth based on "cues", etc.
My first money for programming was building in VB5/6. And then Alan wrote the Inmates are Running the Asylum which I thought was a good book about building for humans
https://www.goodreads.com/book/show/44098.The_Inmates_Are_Ru...