skysight-inc/HackerNews huggingface dataset:
I've been hearing this for years, but I've never had the mental model for it. Maybe I just have to try it out.

There's a very neat project (can't remember the name, and some details below may be wrong,) that mounts a FUSE filesystem that uses only tags.

Paths have identical syntax to hierarchical ones, only each segment of a path is a tag.

so `/document/taxes/2020` would return a collection of files, but you could also write `/taxes/2020/document` and it would mean the same thing.

The advantage is you can use standard unix tools like ls, mv, cp, etc. as well as R/W using standard programs (like how you'd export an image.)

I'm sure there's edge cases to it, but I always found the idea very neat. Anyone remember what I'm talking about?
Using the TSLA Price Endgame to Understand Options
print gpt.submit_request("Give me insights")

>>> You are spending way to much time browsing.
Except it does not exist [1]. Please do not spread misinformation.

[1]: https://pubmed.ncbi.nlm.nih.gov/27557747/ (Adrenal fatigue does not exist: a systematic review)
For modern databases, the extra normalisation is an incremental optimisation that you usually won't need.

But I think she's if anything been in the industry longer than I have and the versions of mysql I first ran in production were a different story.
Anarchism-capitalism isn’t a exactly a right wing ideology. It’s really only useful to think of it that way in comparison to the traditional anti-capitalist flavors of anarchism.
I was using bbs’es in the late seventies, so not quite further back. Still, cool story, bro. :)
We had a test database that contained 1 record. Nobody paid much attention since the focus was on the problem, not the database.

The database included several newly developed "stored procedures".

Time elapsed... and it was nearing the time to ship the code. So we tried to populate the database. But we could not. It turned out that the stored procedures would only allow a single record in the database.

Since a portion of the "business logic" depended on the stored procedures... well, things got "delayed" for quite a while... and we ended up having a major re-design of the back end.

Fun times.
Oakland, CA - always in a comfortable range. Underrated in most “best weather” rankings.
I worked for a lead early on in my career who changed my life through observing his management style

One thing he did: ask questions he already knew the answers to on big meetings

I initially thought he had a bad memory. Instead, he was thinking like a new hire. What would a college hire want explained right now?

And you’re also right, once someone with sway has asked a question - and been met with an honest answer - it makes it easier for others to do the same
How to change page layout in text document software
It feels like there’s some interplay between instinct/emotion and intelligence/decision-making in the behaviours we’re describing, which I felt was a sign of awareness or consciousness.

I wouldn’t say what I experienced was much more than instinct and making a new web, but the emotional response of a mother protecting its young was relatable across very different species, which is useful for building empathy and respect.

The examples in the article are much more interesting from an intelligence standpoint though.
Nah, https://spacehey.com/
Even in MCOL areas with an average-to-high non-FAANG tech salary, "just save 250-500k for a house" is not realistic advice. Even with a FAANG salary that's doable with concerted effort but not if you already have a family.
What has been your experience with the obvious ones? People keep bringing them up because by far they are the biggest contributors for most people.

Couple anecdotes from myself:
TL;DR - Be on the lookout for patterns.

1) I noticed a pattern when I would go home for the holidays to visit family. I was incredibly drowsy on most days, for most of the day. I would eat all I want, which for breakfast might mean pancakes with loads of syrup or french toast with syrup and maybe there's an egg in there somewhere. If I made an effort to vastly reduce my consumption of high glycemic carbs at breakfast, my energy through the day would be immensely better, like night and day improvement.

2) I was also struggling with fatigue during the day sometimes while not on holiday. I found that it was tied to consumption of artificial sweetener in my coffee in the morning. I often wouldn't eat breakfast and just have coffee and be ok until lunch. But if I had saccharine(sweet n low) in my coffee, I would feel very tired. I stopped drinking coffee like this and haven't had the problem come back. My non-doctor opinion is that because artificial sweetener induces an insulin response in the body, but doesn't contribute to any blood glucose, what blood sugar I had was getting pulled out and placed into fat cells. I will sometimes allow myself sweetener but with a breakfast and be fine.
You are going to get a lot of anecdotes with a question like this because we are all a little different - there is no single answer for what works for everyone.

You'll need to be observant, and experiment a little. When are you drowsy? Does that correlate to anything else in the day, such as meals or meetings? Take note of what your routine is before making changes, then start changing one thing at a time, and stick with what works for you. By all means, use people's anecdotes as ideas for what to try, but observe results for yourself and react accordingly.
You needed to be very patient... Not only for the slow download speeds but the limited access lines on the popular boards. The one I frequented most had like 8 or so. This was a lot in those days. So a lot of time was spent redialling until you got a carrier tone...

This also answers your question about the 'industry'. There wasn't much of one, as most BBSes were kept small by the capacity of dialup lines. That BBS with the 8 lines was in a friends' garage and every time he needed a new line the whole street needed to be dug up. This kept advancement slow. There was no big industry, at least not in the Netherlands. There were some big networks like CompuServe which were a bit like a mini internet, but in my country we eschewed them because they were super expensive. Most BBS'es didn't charge anything, or a cheap yearly membership for some extra hours or something. It was much more of a hobby thing than an industry.

Cost was ok for local BBSes. Just the cost of a local call. When I started the cost was 16c per call, but this was dropped soon when modems took off, for obvious reasons. It became 16c per 10 minutes which was still not so bad. My parents (I was in school) could afford it. A bigger issue was my hoarding off the phone line.

Because the BBSes had limited dialup lines, there was also a usage limit per day. So around midnight it was extra busy when people wanted to use up yesterday's allowance or take advantage of it renewing at midnight.

In terms of downloading I didn't do that much. It was too slow and expensive, and boring. During a download you couldn't do anything else with the computer. I mainly spent my time chatting. Of course files were much smaller in those days but downloading was still a boring hobby. The sneakernet was often faster!!

I did download a bit over packet radio (using the 27MC band with modems). It was ridiculously slow (media speed was 1200 baud but there was a lot of contention and interference needing a lot of retransmission so the effective throughput was a lot lower) but I would just leave it on overnight. Still, the sneakernet was much quicker. It would take all night to download 1.5MB from a friend 5km away. Just walking over there with a floppy was a lot quicker :)

There were also mail/group mail networks like Fidonet, where you could batch all your mails and upload them quickly. which was more efficient.
I’ve seen audio systems that use my hand tapping in a pad to “learn” (sample over time) the beat/tempo in real-time.

I wonder if there’s some signal correlated enough with beat to stand in for my hand?

Edit: their code works on samples of audio. [0] A “real-time” solution could be short samples immediately processed after capturing until some quality metric is met.

[0] https://colab.research.google.com/drive/1tuOqNyO9gdMmYJsj33f...
Understanding the Work of Einstein
I've seen enough lawsuits up close to know for a fact that the truth rarely comes out during a lawsuit. What does happen is that (1) either party's lawyer has incomplete understanding of the case, (2) either party runs out of money before the case concludes, (3) either party folds because the other party can afford to endlessly extend the case and (4) either party settles because the cost of the lawsuit exceeds the settlement. I've seen cases won that should have been lost and vice-versa if it depended on the truth.

When you go to court it's alway a crap-shoot, no matter how sure you are of your case going in. This is something people with iron clad faith in the legal system should realize. Courts are at best an amplifier of who has the most money to throw at a particular lawsuit, unless both parties are equally matched and are willing to take it all the way to the highest court the courts are not a fair and level playing field. Rather the opposite.
The way she kept referring to the programmer made me suspicious that that would be the ending. I personally really like that as a way of conveying the message of us all having growing pains and learning the hard way from some inefficient code.

I know I've also had these encounters (specifically in DBs), and I'm sure there are plenty more to come.
Should be treated similarly, in terms of taking it seriously.

"it should be a felony" is definitely a strawman.
Well, then, they are part of the 10,000

https://xkcd.com/1053/
Very often you won't get that upfront research because juniors don't have the knowledge necessary to even start looking for themselves. Because you expect them to come to you with evidence before they ask you, your devs will just avoid asking you and spend hours wasting time instead. Any minimum requirements are a barrier. Barriers are bad for learning.

You need to welcome questions even from people who have apparently done no research at all, or juniors will always worry that you'll accuse them of not doing the "necessary" work up front. If you're kind and approachable, and you don't tell people off for failing to meet your minimum requirements, you can guide them to finding it themselves.
Given this is a "from the start of her career" story, I'm guessing she was running similar versions of mysql to the versions I started with, and if my guess is correct then probably not.

On anything you're likely to be deploying today, just throwing a compound index at it is likely quite sufficient though.
Digital Assets are now covered securities
Highlighting New Comments
I'm not sure your evidence makes the point you intended. The academic meat-grinder is the best way for those international students to get visas.
SEO gets you in the door, the newsletter gets you coming back, and you may also like pays the bills. It's all related.
Are you confusing libel with something else? Can you extrapolate what you mean here? Are you saying that they will be liable for libel (!) if they publish a negative summary of a product?
Oh man, your comment about the need for nuanced skepticism reminded me of the co-CEO of Waymo who publicly claimed he's willing to trust his kids' lives to a driverless car.
- sport

- meditation

- drinking water

- avoiding carbs for lunch (pasta will make you go to sleep)
While I don't remember that specific project's name, I do remember that a lot of that was possible because files in a filesystem often aren't just some hierarchical folder structure. There is often a tree-like structure to be able to find a single file quickly amongst many files, but there was no technical reason why it wouldn't also support off-tree indexing based on tags.

I imagine one of the problems you'd run in to is mass updates since deleting a directory with many files in it below a single tree node is very much limited to that part of the filesystem's tree, but doing it with tags causes updates all over the place.

It does remind me of this more metadata-like FS: https://github.com/marook/tagfs

As well as the thing Apple does in Finder where it has a tag database and dynamic 'tag' directories where it shows you everything that was tagged with that tag. Then the search function would allow selecting files based on tags so you can do many-tag searches and only find the files that match all of them. I think that one is based on an in-filesystem metadata stream.
> In the long run, creating more understanding of the physical world is probably more universally valuable to human flourishing than the far more parochial 'make money number go up'

Citation needed.

Moreover, dedicating resources to finance can be seen as dedicating resources to better dedicate resources.

(I upvoted the article since it's interesting stuff)
I'm 49, I don't know how I never saw that xkcd.
Rupert Murdoch Firm Goes on Trial for Alleged Tech Sabotage (2009)
Hardly.

The shitter of microservices is JSON marshalling. The shitter of hardware is clock jitter.
This is a bad example. Here's an output from gpt-j-6b by EleutherAI:
Prompt(
Jerome Powell was interviewed about the impact of a pandemic on the economy.

> > Interviewer: What would the impact be?
> Mr. Powell: If a major pandemic occurred)

Output(
it could be very disruptive.
> > Interviewer: How disruptive?
> Mr. Powell: Well, it could be disruptive in a number of ways.
> > Interviewer: How so?
> Mr. Powell: Well, one of the first things that would be disrupted would be the supply chain.
)

Using prompts well makes a huge difference.

If you parse the generated output, classify it, then develop a decision tree that uses further prompts to refine the response, you can get more sophisticated, valuable responses.

The output in the parent is comparable to an off-the-cuff interview response. If you emulate a deeper thought process, you can get more meaningful output, and if you use the right prompts, you can access the semantic networks in the model related to your domain of interest.
Calling it a “step” implies moving in that direction. But the problem in America is that the counter-movement against “anti-intellectualism” is just as anti-intellectual. More people are going to college, but they’re not majoring in math and science. We have an ever expanding ecosystem of non-rigorous *studies fields. These are arguably even less valuable than the cultural norms of Bible-thumping small towns. At least the latter has demonstrated itself as a framework capable of socially supporting communities of people who build things. The former has no track record whatsoever.

You can see this exemplified in the fact that, even as we are mocking people for not going to college, we are lowering academic standards and getting rid of gifted programs: https://www.teachforamerica.org/one-day/opinion/stop-elimina.... It’s magical thinking on all sides.
Or repairing this locks the phone and needs a backup login.
> At the very least, it was a half truth, and unrealistic hyping.

It was what the data showed at that time. Calling if half-truth because people couldn't predict course of a pandemic year in advance seems over the top. Do you know what will happen in a year?

No idea who is your president, so I can't comment on that specific communication.
>, the faster you get out of that organization (or into a healthier part of that organization)

But you're not going to get there if you're being death rolled by a crocodile in the middle of the river. My point is not to not ask stupid questions. My point is to dip your toe in the water and see what happens instead of cannon-balling.
It's not always possible, but try to take a 20 minute nap in the early afternoon. Doesn't matter if you fall asleep, just lie down and keep your eyes closed for 20 minutes.

I have far more productive afternoons on the days when I take a 20 minute nap after lunch. Definitely a boon of working from home.
Even if Zillow does, they still take a 12% fee. When I was selling my house a year ago in Texas, Zillow's offer is both lower than comp in the area AND has a hidden 12% fee. Did you know they also charge YOU the repair fee?

I had a chance to talk to an inspector who looked at my place who has previously worked with Zillow to inspect houses that they were buying. The gist is that Zillow are getting the worst houses (the ones with trash everywhere, burnt carpet, feces on the wall). For them to get a "normal" house is very rare. Nobody with a normal house (and better) under normal condition (and better) will sell to Zillow. You can get a 1%+3% fee full service (pro pix, pro staging, pro cleaning, ...) any day of the week and still sell your house in mere weeks. I was not even in Austin. I guess if you don't care about making tens of thousands in a month (or hundreds of thousands in nicer cities), then you have bigger things to worry about.

Zillow's offer was already higher than OfferPad and other iBuyer's services. After my experience on the sell side with Zillow, I am incredibly wary of ALL iBuyers on the buy side.
It was fine on -some- databases 20 years ago. mysql of that era, less often.
When I stopped drinking coffee I also had to stop having carbs for lunch not to fall asleep in the office. I only had a bowl of salad instead. It seems to be a virtuous routine but I gained weight anyway, as for some reason coffee was reducing my overall appetite.
Totally agree, I had early access to the internet through one of the BBS's I subscribed to, textual only of course cause the www didn't exist at first and then even in the early 90's it was still very new.

But in the early to mid 90's we had a dedicated T1 trunk (at work) to connect us to UUNET. All fun times. Even then, I still used a few BBS' at home (including for home internet access) until say like 1995/96 when I moved solely over to Mindspring. Might be a little off on the year I switched but not by much, that is a long time ago.
The difference between ML and symbolic AI is that ML works and symbolic AI doesn't. At my job, dropping the computational load of our ML models is heavily invested in, and every success is celebrated. Everybody wants it to be easier and cheaper to train high quality models, but some things are still intrinsically hard.
Uhmmm try running your terminal at 9600 baud, and see how quickly you get bored with it :) And that's 4 times as fast.

I did this for a while recently because I needed to access something over a serial port and it was not fun. 1200 is really slow.
The last in-person meeting I attended, I drew on a whiteboard, made exaggerated gestures with my hands to point to different parts of it, and established spatial metaphors by establishing one side of the room as the backend, and the other as the front-end.

When people asked me questions, they walked up to the whiteboard and pointed directly, and then scribbled on it to clarify. I felt a lot more connected when I was able to make direct eye contact and get backchannelling. Perhaps it was my perception, but I felt like it was a lot better for communication as a whole.

I'm sure you can replicate all of this stuff in Zoom or VR, but it sure is a lot more clunky and annoying.
Talk to a doctor. I had a vitamin D deficiency that was causing my hyperparathyroidism which among other things (kidney stones) also caused drowsiness. If you have dark skin and live at higher latitudes you should especially consider this as a potential problem. And the good news is vitamin D is cheap and readily available.
You only work 7h per day minus lunch break? Sounds sweet. Do you get paid for full time?
I usually work 7am to 4pm but lately we have been ordered to work overtime so currently I am doing 7am to 5pm and a couple of hours extra on Saturdays.
Personal life pretty much consists of taking care of the kids and maintaining the house.
Fortunately, costs for training superlarge models are coming down rapidly thanks to TPUs (which was the approach used to train GPT-J 6B) and DeepSpeed improvements.
The future is not as dark as it seems because of the rat race of megacorps.

You can use reduced versions of language models with extremely good results.

I was involved in training the first-ever GPT2 for Bengali language, but with 117 million parameters.

It took a month's effort (training + writing code + setup) and about $6k in TPU cost, but Google Cloud covered it.

Anyway, it is surprisingly good. We fine-tuned the model for several downstream tasks and we were shocked when we saw the quality of generated text.

I fine-tuned this model to write Bengali poems with a dataset of just about 2k poems and ran the training for 20 minutes in GPU instance of Colab Pro.

I was really blown away by the quality.

The main training was done in JAX, and it is much faster and seamless than PyTorch XLA, much better than TensorFlow in every way.

So, my point is, although everyone is talking hundreds of billions of parameters and millions in training cost, you can still derive practical value from language models, and that too, at a low cost.
The author makes claims about hundreds of different assets without actual investigation, citation, or even reference to the particular use-cases, business models, or technologies of individual assets, and naturally, the author arrives at her (probably) preordained conclusion. If you want to actually investigate whether the crypto-space is viable, valuable, or useful, then do so, with evidence and specific examples, counter-examples. As it is, the author appears to exercise a sort-of pseudo analysis with intellectual pretensions that only a fool would base their investments upon.
Memory leaks are crippling my M1 MacBook Pro
I don't really think the connection you're trying to draw follows immediately. There are very strong domestic students, probably enough to fill all the top PhD programs. The calculus for pursuing a PhD is different if you're a domestic vs international student. If you're international and want to move to and eventually live in the US, where some of the highest paying jobs in the world are available, then first getting into a well regarded graduate program, which will attract potential employers, coming in on a student visa and then getting an employer to sponsor an H1B is a pretty good strategy. If you're already a top student in the US at a top university, you already have access to those employers and intend to stay in the same country long term, so the opportunity cost of going to graduate school is so much higher.
If your drowsiness sets in after lunch then I'd recommend having a vegetarian sandwich (whole grain bread, shredded carrot and sliced cucumber, sprouts, etc. ) and see if you feel less drowsy afterwards. The sandwich is the epitome of unsatisfying but I've seen a real benefit in not being drowsy later.

Be physically active during the day, and breathe outside air (open a window, go outside, or have a powerful exhaust fan). Physically active means walking around and occasional standing or sitting on a tall stool. Exercise as an 'activity' has never worked for me because it just wipes me out. But walking or biking to places in 10 to 15 minute stretches gets my metabolism up enough that I'm good.

Finally, if none of this works then I recommend seeing a cardiologist.
The *studies folks are complaining loudly and bitterly of their debt and not having cushy jobs handed to them on a silver platter. In principle this should encourage future students not to take those paths.

I agree that I don't like the direction we're headed, but hopefully the natural consequences of that direction will encourage people to revisit their ideological assumptions.
One past thread:

The Arcane Algorithm Archive - https://news.ycombinator.com/item?id=18575316 - Dec 2018 (7 comments)
That’s because of visas. In the US you can study CS at a good school now and make $200k straight out of undergrad. Makes a technical PhD a lot less tempting