skysight-inc/HackerNews huggingface dataset:
At this size, I doubt it. While SQLite can read JSON if compiled with support for it, it stores it as TEXT. The only native indexing possible for that that I'm aware of is full-text search, and I suspect the cardinality of JSON characters would make that inefficient. Not to mention that the author stated they didn't have enough memory to store the entire file, so with a DB you'd be reading from disk.

MySQL or Postgres with their native JSON datatypes _might_ be faster, but you still have to load it in, and storing/indexing it in either of those is [0] its own [1] special nightmare full of footguns.

Having done similar text manipulation and searches with giant CSV files, parallel and xsv [2] is the way to go.

[0]: https://dev.mysql.com/doc/refman/8.0/en/json.html

[1]: https://www.postgresql.org/docs/current/datatype-json.html

[2]: https://github.com/BurntSushi/xsv
Counterargument: I am readily employable in other related industries and could likely get a significant raise switching. Every time I make an offer to a software engineer who asks for >$50k more than our peak salary, I'm reminded of this fact.

Again, I chose nuclear specifically to fight climate change, not to make the most money.
appreciate it but also whoa this literally just happened and its freaky how up to date you are. consulting is temporary (check out https://www.trychroma.com/ if you are exploring LangChain/OpenAI apps and need an embeddings database) and i'm working on an ai infra startup idea on the side with a couple cofoudners.
Dang, do you do this manually, or do you have a tool to make these, and if so, ~~buy a dozen~~, I mean - can you make it a button?

It would be cool if HN had some better handling of links in the comment box (meaning parsing the title of certain TLD links)
> JSON numbers are also 64-bit floats

In common implementations they are, but RFC 8259 and ECMA-404 do not specify the range, precision, or underlying implementation for the storage of numbers in JSON.

A implementation that guarantees interoperability between all implementations of JSON would use an arbitrary-sized number format, but they seldom do.

No idea what ISO/IEC 21778:2017 says because it's not free.
hn is not Product Hunt :P
Drivers that are near unobtainable except when using the preinstalled OS is a NO-GO.

But it's probably something trivial. I know stories about bleeding edge wifi hardware drivers not being provided by a year old LTS Ubuntu (well du'h). And of course there is the gpu driver shism. But i'm guessing.

Can you elaborate on the changes made by dell?
Sometimes I wonder how these things actually work (I am not talking of the actual cloth designs or their effectiveness, rather about how they manage to get this level of visibility).

This project has been posted nearly everywhere in the last 1-2 years, they made a kickstarter asking (I believe) for US$ 5,000, and they got US$ 5,306 by 36 backers:

https://www.kickstarter.com/projects/capable-design/manifest...

It was the thesis of the designer at the university, later joined by her sister as a marketer, she seemingly made a very good work at marketing, though thw whole stuff still looks more like an art project than anything else.
Maybe more appropriately, Campbell's law:

"The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor."
Shameless plug if you want flashcards in your terminal: https://github.com/JaDogg/sbx
You’ve described std::optional, a special case of std::variant.
"Ultra-crispy" is definitely the style at Fox's, on the southwest side, which I grew up with. And Fox's isn't famous; it's just neighborhood Chicago pizza.

Giardiniera is definitely a modern innovation, though; growing up, I'd be surprised to see anything other than green peppers on a pizza.
a doctor giving generic “eat fruits and vegetables” doesn’t mean anything. it’s just generic words an 8 year old could tell you

you don’t take nutrition in medical school. doctors wouldn’t be able to prescribe a more personalized nutritional plan even if they wanted to

whether or not they say this or don’t won’t change anyone’s life
There is a saying about radio amateurs here: 99% of radio amateurs ruin the reputation of the rest.
However bad Edge is, Adobe Acrobat Reader is worse.

I understand it is a necessary evil for some of the forms stuff, digital signatures, and the full edition for editing.
Might be worth it to brush up on computationally reducible phenomenon and computationally irreducible phenomenon. Breaking determined systems into these constituent parts lets you conjecture with respect to intelligent agents. Critically it shows that arguments from observed inability to successfully model the self are evidence for, not evidence against, the presence of an intelligent agent. The enlightenment view misattributes the evidence for agents as evidence against agents.

An anti-enlightenment koan could be: The student came to the master and asked, “Why are tigers green?” The master responded, “The deer they are hunting can’t see orange.” The student then asked, “It is not therefore it is? How mysterious and inscrutable your answers!” But from that moment onwards the master was de-enlightened.
Without taking a position on the legal arguments:

"How to participate in Monday’s oral arguments" is a deeply offensive thing to say. Once something reaches SCOTUS, it's strictly about matters of law. It's not a question of the merits or whether you like IA or not, and rooting is definitely inappropriate.
my point was that "art", while certainly a viable career should you have talent, cannot be taught.

a bit like programming, or anything else, when i come to think of it...
> The Roman Republic was dead when Caesar won the civil war

The Republic had been in trouble for a long time. IMHO it officially died as soon as the First Triumvirate was created. Rome was in complete control of just three people for many years.

Pompey was the leading figure of the First Triumvirate, so arguably he deserves more blame than even Caesar for the downfall. The fact that more senators chose him over Caesar says very little about how truly republican any of them were by that point.

The war between Caesar's party and Pompey's party was really just a battle for who would be Dictator for life. Neither of them had any intention of handing real power back, because they could honestly tell themselves it was unlikely to fall into any better hands.

Had he won, Pompey would have continued to (through military threats) control the Senate the same way he had for many years prior to the civil war.
One thing that has helped somewhat is being more thorough in my exploration of repo's that are doing things that are similar to what I'm trying to do.

I want to use nix with a nim project, so I wrote a script that walks through all of the repo's in nimble (nim's package manager) and then filtered those for ones that had a flake.nix in the repo root.

Going through them was a helpful dose of context. It's like you gotta approach it from theory to practice and from practice to theory and eventually your efforts will meet in the middle. I think. I have glimmers of meeting in the middle happening.
This article is from an entire decade ago, and a decade in UX is enough time for all the things to change.

Does anyone have insight as to how much of this still holds true? Or is the Japanese web a totally different place now?
Lol, so it's like decaffeinated LSD?
The whole point is that journal prestige is harmful and fake. It's prestige by association. That's not how science should work.
Yep!

We do the switch to parquet, and then as they say, use dask so we can stick with python for interesting bits as SQL is relatively anti-productive there

Interestingly, most of the dask can actually be dask_cudf and cudf nowadays: dask/pandas on a GPU, so can stay in the same computer, no need for distributed, even if TBs etc of json
Detroit style doesn't get enough love. I feel like it's the perfect balance of pillowy thick but not filling you up. Laying stripes of sauce on top gives you a different flavor in every bite too.
The term used by people that seek these things out appears to be “visual effects”[0] and it apparently includes any sort of change in visual perception. I have never come across the term pseudo-hallucination to describe these phenomena before this comment.

[0] https://psychonautwiki.org/wiki/Visual_effects
I mostly agree with you, however:

> A modern phone could last weeks as a browsing device, if looking at static html

That's what I do. Weeks is a bit of a stretch. Maybe one of screen time is limited. That said, discord (the website) drains my laptop battery almost as fast as gaming does. They do spawn a separate WebGL context for each animated emoticon. Crazy, crazy thing

> Put another way, people concerned about power usage, should realise that using node, means burning more coal/NG. Literally.

Sure. At the same time, though, a single car trip to the movies burns orders of magnitude more energy than all your gadgets running JS for an year.
Ask HN: How is gtp-3.5-turbo so much cheaper?
I understand gtp-3.5-turbo is 10x cheaper per token than other gtp-3.5 models. And that OpenAI has been cagey about technical details so we can't know anything for sure. But I'm interested to hear views from people with better knowledge of LLMs, is it likely that they've found a way to make it ~10x cheaper to run (in electricity costs etc) or is it more likely it's a strategic loss to make it harder for competitors to get a foothold in the market?
Eating fruits and vegetables is not typically good medical advice when we’re talking about acute issues.

Advice for a healthier lifestyle, more energy, longevity, etc? Yes of course. Advice for sleep apnea that’s already set in and affecting a patient nightly? Not at all.
A job opened on my team where I am working at as contractor. My boss told me to apply for the job.

I got an email back right away from HR stating that I didn't meet the requirements of having a degree.

Joke's on them, I already work there.
The SVB story: narrative and causes
Well if you need to convert json to parquet to do anything fast, then what is the meaning ? You will end up wasting way more resource in that conversion itself that your benefit is all equalized in the cost of extra storage utilization (since now you have json and parquet files both). The whole point is to do fast operations in json itself. Try out clickhouse/clickhouse-local.
Workshops for C++ on Sea 2023
Being a high-end plumber doesn't take much college.

I joke, but most lawyers actually don't make a ton of money. Like programming, the profession is very bimodal. By the time you get out of law school, unless that law school is a big name like Harvard or you get a good clerkship or associate job, you will be heading for a career that tops out at $200k/year if you don't burn out in the mean time.

Plumbing, electrical work, and other trade work is weirdly lucrative and doesn't come with nearly as much "ladder climbing" as a legal career. Also, a mid-career trade worker can specialize (taking only very lucrative and weird jobs) or start to manage other tradespeople. Plumbing and the other trades are a lot like software engineering in that sense, and the reward for being the plumber who knows how to deal with water pumps in high-rises is similar to the reward for being the software engineer who can program GPUs (or some other niche skill). For example, I happen to have met one of the people who does the HVAC in Google NYC, and he makes the same amount as a senior SWE at Google.
Probably a good thing! Four year degrees are oversubscribed and have been a low ROI for many students (the “please cancel student debt” crowd).
Zipline (Drone Delivery Company)
Thought the money was available guaranteed by fed by following monday
I've been seeing python at least once every week for a looooong time. Years. A decade maybe. You are not missing anything. It's a big steamy pile of horse manure.
I agree completely.

Playing the devil's advocate: On the other hand, making a whole new language is rarely a way to GTD now, it's usually an investment in the future. For surviving into that future the language usually needs the involvement of the community. And for that one has to consider what new/different/radical things does the language offer to the public to hook them on. May be it's OK to sin a little and get straight closer to v1.0? Of course, a few will hurt but they'll live.
Ugh stop. Not every conversation has to be about GPT.
Have you ever tried a Chicago neighborhood-style pizza? Or are you just dismissing it on spec?
I think he means enlisting in the military or a police force, accruing that job experience, rather than getting an undergrad degree, and then going straight to law school.
Maybe in part. But it’s also because medical practices are for profit enterprises and don’t make any money by telling patients to stop drinking alcohol, but make a bunch of money charging out CPAP machines to insurance companies.

Doctors “have given up” implies there was a time when doctors would dish this stuff out as a treatment plan. At least in the US, I don’t know if that’s ever been true.
I still don't understand why I need to buy the DIY version to not get Windows

I've asked this before and responses are just "its really easy to assemble!"

that isn't what I am asking though

I am asking why I cannot buy an assembled FrameWork laptop without Windows

its easy on your side - just do everything you would do and instead of installing an OS, just ship it
Nearly 200 banks at risk for same fate as SVB: study
I have a modern Golf diesel (2014) and love it[1]. I think they pipe artificial or modified engine noise into the car when you give it the beans.

Sounds awesome ...as long as you don't open the windows. If I do it still sounds OK but you can tell it's a diesel.

I've had it from new and it's still so good on fuel I guess I'll keep it till it dies. My record is 82mpg (UK gallons) on a motorway run. Nothing's ever gone wrong on it and it's cheap to service. It has all the features I need like Adaptive Cruise.

Not sure I'd replace it with an ID or whatever the new VW replacement is but there's something just right about the Golf design.

1. Luckily it's from just after the Diesel Gate affair.
I love the edit in GH. So much.

Thank you for the work you do and for how much you have contributed to people learning over the years. <3
Hate to say it, but this is why I'm incredibly glad I didn't drop out of college even though I had a solid gig ready to go.

I knew I wasn't cut out for being an perpetual founder and that I'd definitely encounter greater challenges not having a degree than the challenges standing between me and my degree at that point in time. ($7k and 1 year of my life with classes I wasn't sure I could stomach).

Wish you the best, but for those considering this always assume you maybe aren't the best - think about what comforts you're giving up. I will say, anyone you talk to on the college / dropout risk/reward problem are highly biased. Dropouts who have achieved success are susceptible to survivorship bias and will vehemently tell you college isn't necessary. PHD's will always espouse college as the only route because they burned their entire 20's in college.
The same people who made PLoS are the ones reforming eLife. Exact same.
OpenBGPD 7.8 Released
Prompt Engineering Guide (Web Version): Guides and Papers for Prompt Engineering
Radon is the primary component of natural background radiation. It's an alpha emitter.

https://www.epa.gov/radiation/radiation-sources-and-doses

https://en.wikipedia.org/wiki/Radon
College stinks, but what will happen to “blue collar” young people who do not make it into the “white collar” apprenticeship pipeline, who would have previously achieved so through college. Oh yeah, well they can just choose college. But as this apprenticeship thing becomes more popular, what will the competition be like?

Young people! The labor market is turtling…what are we going to do?

Edit: I’m choosing a more tasteful description for the American labor market. Thank you for expressing your distaste with the original one.
I was speaking of the engineering teams that existed before database administration was formalized as a field at all. Mainframe, batch processing, and written in C: proprietary company-specific applications.

Analogously, it may not be long before crud websites are created, end to end, by non-tech people with mostly natural language.

That being said, today’s crud web developers won’t be out of work. Their experience writing/designing code will be put to use in more complex, potentially yet-unseen applications.
Yeah, the UC's application system is a bit ... disingenuous is the wrong word, but it's a win-win for applicants and colleges: all the applicant has to do is check all the boxes and pay the not-terrible application fees and bam, they've applied to all the schools. This pretty much forces all the students to apply to most, if not all, of the campuses. Which gives every UC campus the maximum possible applicant pool.
> I don’t understand why they took this risk.

They, and many other people around the world, got it into their minds that Covid had suspended all normal rules and left them free to do whatever they thought to be a reasonable response to the circumstance, which in this case was "the normal libraries are closed so we'll give out free access to all our books."
One of the things you're fighting against is that a lot of people just don't engage if there's a lot of text. I write a fair bit for our marketing department and we basically never publish the 3000-4000 word whitepapers that were routine when I joined the company any longer. Even reports I write based on survey data are fairly light on the word count because people just don't read the longer pieces.
I got my degree at 35 because of this. Not that I actually learned much of anything in the program, I was there purely for the paper.

This is where schools like WGU excel for those of us just seeking credentials for what we already know. The terms are six months, you can do as many courses as you want during that six months. Over half the courses are just a final exam. You take a pre-test on day one of the course. If you score high enough, you can take the final exam the same day and be done with the course. If one were very determined and knew most of the material going in, you could complete a BS in six months for a total cost of under $4000.
It also grows the intellectual souls, exposing people to far more depth of thought. It also builds professional networks. If a person is smart enough to receive it, more education is almost always good.

Of course money is a factor, and schools have gotten insanely expensive. I’m glad to hear that more people are finding alternative routes - it shouldn’t be that everyone needs college because quite frankly many career paths don’t require it and many aren’t smart enough for it (and thus the debt will be crushing).

But I wouldn’t dismiss its value in being taught how to think. I wish there was a bigger focus in physics, math, and philosophy for those who didn’t know what to do - learn one of those and you can do just about anything.
> Logical replication is also great for replicating to other systems - for example Debezium [1] that writes all changes to a Kafka stream.

So I'm looking for a Rust library (or a C library) that receives a Postgres logical replication stream and is compatible with Postgres 15, does you know of something?

Debezium is unfortunately written in Java, and I think your Powersync is proprietary right? (I didn't find a Github link). I can find stuff like https://www.npmjs.com/package/pg-logical-replication but again, it's Javascript.
Ask HN: Would you know a “Python idempotent incremental update manager”?
I maintain a fleet of edge devices, including their embedded software written in python. There is a release every two weeks or so, which usually consists on pulling a new set of docker images.

My current pain comes from the fact that, sometimes, I have to update the docker-compose.yml on the unit, or add a library, or change something outside of the unit.

I am currently writing a (python) script and a documented process for every update, which is gently becoming a pain in the xxx for the units which are not available so often, and for which I have a few updates late.

I would love to have this pile of scripts ran through automatically with a higher level command, and create the skeleton of a new migration script on demand.

Hence the question: how do you manage such remote incremental update manager ? I am looking for something as simple as alembic, but obviously to run scripts not DB migrations.
What should the lesson be from Silicon Valley Bank?
The bar for fiduciary misconduct is pretty high. Even $10 billion on the metaverse didn't come close to it because management could say with a straight face they believe it's the future.
>Compared to what? It was nearly two years just for the portion with Pompey.

The period prior to Caesar (i.e. Marius, Sulla, and Catalinean period, etc.) and the post-Caesarian civil wars?

>Of course it did involve a great many people from Italy and a great many Romans.

Show me a serious battle in Italy or a battle in Rome that resulted in serious destruction or disruption to the operations of Rome and the Italic peoples as a result of Caesar's civil war. Corfinium? Brundisium? It's nothing.

> It failed after very nearly succeeding multiple times and after months of skirmishes, sieges, storming of cities, back-and-forth trench warfare on huge scale, and marches and counter-marches. It was a slug fest between large forces.

It was a handful of battles and sieges. It's nothing compared to other campaigns. It's hard to believe that you're not actively being disingenuous rather than incidentally illiterate in regards to the broader historical context.
The key names of all the identically shaped objects are repeated and can all be interned into sharing the same strings, saving a huge amount of memory. That's why csv files can be much more compact that the equivalent json files: they only list the keys once in the first row.
Seriously, this is what creeps me out most about the latest advances in technology. Eventually I won’t be able to trust that anything digital is authentic. Think of how much of our planet now depends on digital interactions.

Some of the abuse we are about to encounter can be dealt with via solid authentication/identity practices, but without some sort of extra verification it’ll soon be impossible to tell whether audio/video sample is authentic in cases where the person carrying the identity is also the one faking it.

I get that there are potential solutions to this problem, but none of them are simple enough for an elderly person to sort through whenever they go to do some thing that requires extra verification.
If the software eng market gets really really bad I might just become a licensed electrician and manage 4-5 electricians. I could remember enough of the 40% of an EE degree I finished before pivotting to CS.

Another option is getting some BS real estate certs and building some kind of middle-man operation where I facilitate / officiate sales of high end homes to rich people who can't view something before they buy (more common than you'd think).
Congrats! I'll be watching :)
I was always a huge fan of Serious Eats, but Kenji's head-mounted camera setup makes most of his videos unwatchable for me.
In fact, Kenji just released a book about Wok cooking!
hahah I did the same post on ph, I was very lazy to edit that lmao
You need a little cushion and it’s silicone valley, just round it up to a 5