skysight-inc/HackerNews huggingface dataset:
Here's a heuristic that works for me, for $foobar, any language and/or sufficiently complicated tech:

Within the documentation, find the sections that deal with the following topics:

* extending $foobar
* embedding C in $foobar
* embedding $foobar in C
* packaging/distributing $foobar
* porting/cross-building $foobar

In my experience, these topics are inherently hardest to implement, last to be documented, and trickiest to understand. As such, they make for worthwhile reading for advanced practitioners.
Yes, strangely, people get emotional about being asked to let their kids die of scarlet fever and other bacterial infections. I’m a birder too, but some new luddism isn’t going to save the environment. If we stop where we’re at, we’re stuck burning fossil fuels, stuck with slash-and-burning the Amazon. If you want save to animals, you need better messaging than “maybe cancer isn’t bad.” Look around the world, places with great longevity have lower population growth, not higher. Places with better economies and more technology are also greener. When you say things like “AI is universally bad” you’re making an ethical judgement about a means rather than an end and ruling out many possible good ends. You’ve read Peter Singer, now go read Hans Rosling.
> Is this symbol also fascinating to you ! How about this one . or this one ?

Yes, they've got interesting histories, and, for example, Shady characters (https://wwnorton.com/books/shady-characters/) has some fascinating things to say about them.
I can’t remember if I’ve ever encountered a UI that annoyed me as much as that virtual password entry.

I ended up getting locked out of my account due to some issue trying to enter what my password manager generated for me and eventually just gave up on ever converting the one small paper bond I was given as a kid to a digital one.

If the goal was to frustrate people away from converting paper bonds, they certainly succeeded.
This isn't going to go over well but it needs to be said:

The solution is obvious and simple...don't go online so much.

It's not nourishment. It's not protection. It's not procreation. It's a fucking slot machine, and the odds will *never* ve in your favor. Succumbing to FOMO is not going to fix and/or change anything.

The Truth is: The System is not designed for Us, it's designed for Them. (Note: There is a spectrum of Thems, choose your poison). To say the answer (i.e. memes) is more of the same (i.e., online is the problem) is naive at best. While I appreciate ppl trying to "self medicate" memes are an enabler. They are a beer & a shot sitting in front of an alcoholic. It's the inevidible waiting to happen. (Note: I'm not making light. Not at all. I have friends doing the 12 Steps. But having an internet hangover and going back for more and more...what is that???)

The point is, memes as a "cure" will only last so long. Eventually it won't be funny any more. The solution is to realize The System is not looking out fir you, and to overcome the gravity of FOMO.
I want to become a von neumann probe, fill the universe with my offspring and go to war.

Until tech can do that it hasnt gone far enough.
the timeline for LLMs and image generation has been 6+ years. it is not a thing where it "arrived just this year, and only just changing". it's been in a development for a long time. and yet.
One can look at the cost of the alternatives and see I'm speaking the truth. Also, demand didn't increase as much as the (likely fraudulent) projections used to justify Vogtle 3/4.

All the "nuclear renaissance" nuclear builds aside from Vogtle 3/4 were cancelled because the utilities realized the alternatives were much better economically. V. C. Summer was cancelled after dropping $9B on it. Even with that sunk cost, it still wasn't worth completing.

What happened between back then and now is two (well, three) things: fracking crashed the price of natural gas, demand didn't increase as much as utilities said it would, and then (later, after fracking) renewables also became much MUCH cheaper. One can excuse the nuclear industry for not seeing this would happen (or perhaps for not wanting to see that it would happen), but that doesn't change the fact that it did happen, and that the nuclear builds turned out to be economically unjustifiable.

Things got so bad for nuclear we were seeing already completed NPPs being shut down because they couldn't even make an operating profit! The other reactor at TMI had been cash flow negative for the last six years it was in operation, for example. In that sort of environment, building a new NPP (which would also have to amortized construction and financing costs) would be totally out of the question economically.
> Whenever people say stuff like this I can't help but wonder what on earth kind of projects they work on. Even GPT4, while useful for things like reformatting or generating boilerplate code and stuff like that, it's still a far cry from any decent dev I've ever worked with, especially if you're not using a popular language like JS or Python.

I mean this not overly sarcastically, but ... have you seen https://thedailywtf.com ? Between my own experiences, and that of some colleagues, I could probably put together at least a half-a-dozen WTF stories that would rival some of the best that site has to offer. There's enough really incompetent people in positions they shouldn't be in to the point that chatgpt - at this point - could realistically provide better output than more than a few of them.
By running the same multiple times, I get different visualization. I don't really understand what's going on, but I like the idea of visualizing embeddings.
> Taken to its conclusion, liability is then on everyone who decides to publish anything that ChatGPT “tells” them

Yes. Just like reading anything else on the internet. An LLM is no different from typing "popular cola logo" into Google search and claiming you invented it. If I type "cola logo" into DALL-E and get a replica of Coca-Cola... that doesn't mean I created that logo and can exploit it for commercial purposes.

> Are the OpenAIs of the world ready to shield their customers from that liability?

Why would they? We aren't suing pen manufacturers because someone wrote something libelous using their pen. We aren't busting down the doors of Crayola because little Johnny used the crayons to draw Mario.
Not my case though. Oddly enough i find 3.5 more accurate in some cases.
Iceberg won’t speed up your queries if you are using BQ native storage. It might speed up federated queries to GCS/S3
AI can’t be a copyright owner. Ergo the violation is on the person using the tool.
All anyone who espouses communism can ever seem to reliably produce is a never-ending dictatorship of the proletariat (which always seems to be run by people who strangely look like the bourgeoisie) and I don't think that should count for much, if anything. It's not just a dead end, it's a well documented dead end with body counts totaling in the millions.
This is a really phenomenal talk (and he's a great speaker)! Thank you so much for sharing this.

I haven't studied this topic much since the days of Michael Pollan's In Defense of Food, and I really appreciated Chris's scientifically grounded overview. I think I'm going to get the book and seriously reexamine my eating habits in this new year.

Thank you again for linking this!
Communism seems bad because Western countries still have a good quality of life for a large percentage of the population. The moment this stops being the case, people in the West will be clamoring for communism. This is just a matter of time and perspective.
Previous: https://news.ycombinator.com/item?id=38526877
But isn't that the users problem? Also with a smarter reverse image search you can detect an infringement with similar reliability as to using google images.
In a heartbeat. It's time for the old paradigms to die and new ones to be formed.

If ASI can exist I don't believe our the old methods of intellectual fortifications will continue to work in the future. Much like castle walls aren't used to protect against guided missiles.
1. These are not even comparable dangers. Reduction in infant mortalty by 98% versus what.. some hormone issues sometimes in some people??

2. The laws of physics have so far prevented us from making technology like a tiny portable button that blows up a planet. Id assume a universe with weak energy constraints like that would have yielded much larger scale organisms, or perhaps none at all.
> It does pose some challenges in statically typed languages when it comes to deserialization of event data

Why is this a challenge? I've worked with similar things in the past and never ran into any issues-- isn't this a very well trodden path?
It's testable! And maybe not just theoretically testable, but realistically testable. So they're not just pontificating, nor even pontificating in a mathematically consistent way.

TL;DR: They're assuming that spacetime is not quantized, but is as GR describes it. This produces a consistent theory that predicts that measured mass will fluctuate very slightly.
Feedback can be very useful in order to let you see things you may be doing wrong in the interview process that you're unaware of. Perhaps you are emphasizing the wrong things, or failing to highlight the right things. Perhaps there are social aspects, customs, other norms that you're deviating too far from. Perhaps you go into an interview without a good knowledge of the company you're applying to, etc.

There are a million little things that can be easily adjusted to improve your chances, and feedback is the only way that you'll know which ones matter. The feedback from a single interview isn't helpful, but the feedback from many interviews lets you spot patterns.

> If you acted on the interview and you got hired, you'll be expected to continue the act probably for as long as you work there.

There is a small kernel of truth here, but this overstates it immensely. Firstly, you shouldn't ever "be someone you're not" -- but adjusting your tactics and adapting to your audience does not have to mean pretending you're somebody else. Second, interviews are performative and everyone knows it. In an interview, you're engaging in a sales presentation. Nobody expects that people will behave identically in everyday work as they did in the interview.
I wouldn't everyone to agree, but I think there's a good argument to be made that all of those companies are more driven by the performance of their stock than anything else. They all make software or physical products, but at the end of the day the primary value of the companies and the impact they have on the economy are largely their stocks.

TSMC could be an outlier there, I don't know enough about the company's financials. The others, though, would fall into the category of companies valued and driven primarily by their stock valuations rather than the products they produce.
i like the MPTT / nested set model to store trees in tables.

https://en.m.wikipedia.org/wiki/Nested_set_model

https://stackoverflow.com/questions/5368299/hierarchical-dat...

this can be used to make these fake trees while avoiding the adjacency structure that's harder to query.
Curious, why are these numbers so different from the officially reported numbers?
Is Layoff.fyi re-categorizing some employees as tech, but official numbers have them as 'administrative', or some such thing.
This is an extremely dangerous precedent that I think you are purposefully trying to put forward.

It's a horrendously bad idea especially for startups to make it apps' faults for how users use their platform. It's only in the benefit of entrenched tech companies to make this precedent.
Beside the really exotic competitions, I was thrilled to discover that there are championships of dodgeball and tag.
Show HN: Laterbase – Save, search and chat with your bookmarks
Get Started with eBPF
> They don't, if we went ahead and were mesmerised by random symbols we couldn't get good at anything because becoming good means you have to filter out the BS from the signal.

As I say, I'm not a good hacker, but I am a mathematician, and the skillsets are not disjoint. It seems to me not inconceivable that some good hackers become so precisely because of their ability to be mesmerised by things other people find boring or trivial, not in spite of it.
I was asked to share a TA role on a graduate course in HPC a decade ago. I turned down the offer.

After a cursory glance, I can honestly say that if this book were available then, I'd have taken the opportunity.

The combination of what I perceive to be Knuth's framing of art, along with carpentry and the need to be a better devops person than your devops person is compelling.

Kudos to the author for such an achievement. UT Austin seems to have achieved in computer science what North Texas State did in music.
I think there's something to be said for the fact that the engineering organization grew through this exercise - experimenting with using telemetry data in new ways that, when presented to other devs in the org, likely helped them to all level up and think differently about solving problems.

Sometimes these wandering paths to the solution have multiple knock-on effects in individual contributor growth that are hard to measure but are (subjectively, in my experience) valuable in moving the overall ability of the org forward.
don't worry ,when the singularity hits next year everything will be free.
https://archive.is/KUSO6
The X-Robots-Tags header already exists as "noai" and "noimageai". Scraping software like img2dataset respects these by default.
Agreed. I don't think doctor shopping is as much of a thing as it used to be and that's why there's so much demand for counterfeit oxycodone tablets
It's a find command that prunes the .git dir.

Personally, I prefer git grep
#37 Figging

Blimey.
Depends on what kind of snowflake we are talking about. Millenial or Gen-Z?
At first I thought this would be referencing Eric Weinstein's Geometric Unity theory, which he claims does just what the title states - which he developed over a 35 year period.

I wonder if this research piggybacks or was inspired by Eric's work, whether acknowledged or not?

Time will tell if their math and experiments fit in with Eric's and which is most foundational.
> If I'm already going through the trouble of doing ELT/ETL and making a clean copy of the raw data, why would I do that in cloud storage and not in an actual database?

Well, depends on your requirements. You can definitely go point-to-point straight into another DB.

One reason to keep data in object storage, is it gives you a sort of “db independent” storage layer. At a previous $work, we had a tiered system: data would come in from source systems (primary application db’s, marketing systems, etc), and would be serialised verbatim in structured format in S3 (layer 1). Data eng systems would then process that data-refining it, enriching it, ensuring types and schemas, etc, which would be serialised into the next tier (layer 2). At this level they’d be nice to use, so the data analysts would operate against this data in their spark notebooks.

BI and reporting, and other applications could either use data from this layer directly, or if they had special requirements, or performed computationally difficult enough tasks, we would add another layer (layer 3) for specialised workloads and presentation layers. Layer 2 and 3 data may also be synced into data warehouses like ClickHouse.

This gave us complete lineage of data (no more mystery tables, no more “where did you get this data from”, etc), and the storage itself is reasonably cheap. Many services can query these storage layers directly, so setting up views, or projections into different layouts - even for huge quantities of data- becomes feasible and achievable with no more engineering effort than a query.

Was it a lot? Yep. Would I recommend or do it everywhere? Absolutely, 100% no I would not. Was it a good fit for that org? Yeah, arguably better than they could utilise, but for them, other approaches were anaemic and fragile at best.

Could it be done simpler now? Yep, but it got the job done then haha.

Edit to add: it was also language agnostic, which was a huge win and is an understated part of these new parquet-based solutions: you’re no longer limited to “fragile python app” or “spark cluster” to interact with your data. Rust, C#/F#, various FE tools for JS/TS (cube, etc). This is a huge win because you’re not longer tied to keeping around an aging spark/hadoop cluster that has gradually encrusted more garbage into it until it’s this massive, ultra-fragile time bomb nobody dares touch that powers mass amounts of back-office-business needs.
Hey HN, I spent the past few days buiding Laterbase, a (free) AI-powered bookmark manager that enables you to save, search, and chat with your bookmarks.

It's pretty hacky, but would appreciate any feedback!
I'm gonna guess it often isn't even their content but is user content they are protecting. So, sounds like a big subsidy/protection racket for Twitter or whatever to train on their users' public content but not let others.
Real-Life Time Travel in Nakatsugawa
Fascia, neglected part of our body, starting to receive attention
AI is definitely having an impact anywhere there is graphic artist, banal marketing material. There are hundreds of types of jobs that need rather ordinary text, and they are all at risk. Amazon had to shut down self publishing already.

There was just a huge writers strike to combat this.

The problem seems to be that unless a company reports layoffs 'because of AI', then people think 'oh it wasn't because of AI'. It is definitely happening, but nobody actually doing layoffs is going to say that is the reason.
Yes, a typical DWH spends a lot of cycles trying to create a single consistent interpretation of the raw data, a data lake is just this raw data, plus whatever ad hoc interpretations of it your data analysts create.

A lakehouse is basically an attempt to get most of the DWH benefit by just making these ad hoc intepretations incremental.
True but it's only an hypothesis at the beginning of the talk and then he doesn't actually talks about it instead he goes into a (too?) quick history of psyops in the US and... end of the talk. The psyop capitalism idea ends up not being discussed.
> And I’m saying that’s impossible

That's both a serious failure of the imagination, as well as a failure to recognize that a large number of problems (of the same kind) have been solved successfully across the world by various legislation. There is a mountain of prior art here, a lot of which is totally non-controversial.
Here's my original talk: four times the length, much more detail, and not paywalled! https://www.antipope.org/charlie/blog-static/2023/11/dont-cr...
Facebook Engineers-We Have No Idea Where We Keep All Your Personal Data (2022)
In the March 2022 hearing, Zarashaw and Steven Elia, a software engineering manager, described Facebook as a data-processing apparatus so complex that it defies understanding from within. The hearing amounted to two high-ranking engineers at one of the most powerful and resource-flush engineering outfits in history describing their product as an unknowable machine.

“We do not have an adequate level of control and explainability over how our systems use data, and thus we can’t confidently make controlled policy changes or external commitments such as ‘we will not use X data for Y purpose,’” the 2021 document read.

The fundamental problem, according to the engineers in the hearing, is that Facebook’s sprawl has made it impossible to know what it consists of anymore; the company never bothered to cultivate institutional knowledge of how each of these component systems works, what they do, or who’s using them. There is no documentation of what happens to your data once it’s uploaded, because that’s just never been something the company does, the two explained. “It is rare for there to exist artifacts and diagrams on how those systems are then used and what data actually flows through them,” explained Zarashaw.
there's an easy fix. the easiest. just don't use data that you don't have the rights to use. apparently that's just impossible.

"but what if we want to scrape the entire web and something makes it in anyway? see, that is impossible". well that's just saying "fuck it" and using bad data anyway. that's not an actual effort to "not use data you can't use" - there was just no way there'd be a 'rights cleared' way to use the entire web anyway. that is impossible. using a clean dataset is not impossible. it's very possible.
The children yearn for the state-owned mines
That this article could have easily been written by the same AI it’s claiming won’t have fast profound impacts on the world is all the evidence I need that this article is wrong.
IMO, this is probably the goal of the NYTimes lawsuits as well
As a side note, I really miss Xee. It was clearly a labour of love and it showed - MacPaw has been a terrible steward ever since Dag handed it over to them.

No updates other than straight up SDK bumps and recompiles, broken loading of random images in recent macOS/Apple Silicon, they somehow managed to break cropping in one of the two or three updates they did, still an Intel binary. Clearly they haven't tested it more than just checking if the app opens.

Really wish Dag had just open sourced Xee3 instead, my opinion of MacPaw plumetted after seeing how they massacred my boy Xee.

The Archive Browser was equally neglected. At least The Unarchiver still works, which in retrospect was clearly the only app MacPaw wanted to take off Dag's hands.
Not limited to recent slang, really - consider all the early 1900s slang that's now part of the language. "Bee's knees," "beat it," "cat's meow," and lots of others. Somebody tested out those phrases and they stuck.

"It sounds cool and kids' parents hate it" goes back to at least the 50s. It's an arms race of kids/teens trying to invent their own slang that their parents won't understand and then that language being picked up in popular culture and becoming more widely used and then kids try to come up with new terms.

(We had a lot of fun with "yeet," "hype," "been knew," and a few others with my kids a few years ago.)
I'm just saying, we do have a system in place to make corrections. Because they have not been doing it, doesn't mean we can toss it all out and start over.
A new brand providing unique apparel (t-shirts, hoodie, tank, crewneck,...) and other print on demand products (bottles, magnets, mouse pads,...) specifically catered to software engineering enthusiasts.
This is really useful. Maybe I'll just yolo it and give it a shot. Display panel advancement doesn't seem to be as reliably "it'll come next cycle" anyway haha. Thank you for your input!
Ghinaona or kamina, but none of them ever saw it as that
This article ignores the fact that three-letter-agencies are behind many of these tech moguls' "successes", and they're in fact being used for total surveillance by the intel community.

I.e., while the tech moguls may dream these SF visions, they're really just a front for dark forces.
What'll really get your noodle going is looking up how a square hay bailer knotter works. My grandpa joked that whoever engineered it was a mad insane guy.
So what? I feel like I’m taking crazy pills when I read these things. You all do realize the same thing happens in your mind with those same prompts right? That’s kinda how it works. Who is surprised by this? Yeah no shit it can kinda reproduce the text it was trained on, so do I! That’s how that works. And the NYT knew for a long ass time this thing was ingesting. Literally saw this in the marketing when I signed up last year.

I wasn’t shocked when I noticed I could query it about ANY math textbook I owned and it could talk with me about it. I did t bitch and gripe, I enjoyed it and have conversations.

Anyway, I’m in the minority I guess. I love that I can talk with it about books and news.