skysight-inc/HackerNews huggingface dataset:
But it's not clear at all. So maybe back off the take downs until you have better data.
I like the naval terminology, even though I don't understand most of it.

Not having read the Hornblower books since adolescence, I can't compare them, but on "characterization" : sorry, bro. O'Brian's the master of it. Two very good actors took on Jack and Steven (Russell Crowe and Paul Bettany) and made a classic movie.
Really appreciate this post. I've been thinking a lot about hnsw and researching / playing with them.

Adding parallelization to the mix could really help with a thought experiment I've been trying to tackle: if you wanted to embed the entire internet in a way that's feasibly hostable and updatable, how do you do it?

Well it sure can't live in RAM. And as the index gets large, insertion gets very slow.

Let's leave the RAM bit aside for a bit.

So what if we cluster and have one index per cluster? Well it turns out features often belong to multiple clusters, not one.

Ok so we soft cluster- but it turns out choosing the number of clusters is also very hard. So maybe we use HDBSCAN.

Well that is very slow at scale too.

I talked about this on Twitter and Leland McInnes responded suggesting UMAP (he's the lead author of both HDBSCAN and UMAP papers - was a bit starstruck)

So if we now reduce dimensionality of embeddings with UMAP to say 5 dimensions in order to create soft clusters with HDBSCAN and create one hnsw index per cluster using the full / non-reduced embeddings (consider a member to be a point where the cluster is its kth most probabilistic).

And the problem is starting to get more tractable. Search requires the umap step and calling predict proba on HDBSCAN to find which k clusters / hnsw indices to search.

Now the problem is updating... What if we add a bunch of documents and clusters are effectively different? Seems like either you need to start with a representative sample so you don't need to rebalance, or come up with a reclustering step. The MST of HDBSCAN might simplify this.

So the RAM thing- yeah. Well, now that we have a bunch of individual cluster-based indices, we only need to load the ones the current search requires.

And we might not even need to do that. I built this approach I called "portable hnsw" that actually served the indices as parquet files which supports range requests, so you don't even need to load the whole thing into memory. (Unless you want to update the index)

Really interested in your thoughts.
SOC2: What we learned? Write what you do. Do what you write
Yeah, I’m not sure how often these tools will really help me with the things that end up destroying my time when programming, which are stuff like:

1) Shit’s broken. Officially supported thing kinda isn’t and should be regarded as alpha-quality, bugs in libraries, server responses not conforming to spec and I can’t change it, major programming language tooling and/or whatever CI we’re using is simply bad. About the only thing here I can think of that it might help with is generating tooling config files for the bog standard simplest use case, which can sometimes be weirdly hard to track down.

2) Our codebase is bad and trying to do things the “right” way will actually break it.
I absolutely loved the 3D / gradient look and feel of Bootstrap 2.3.2 and thought it lent a very easy elegance to plain web pages. Some people complained that it made everything look the same, but I remember the default look of the web in the 1990s and having something like Bootstrap 2.3.2 as a default look and feel of a browser would have been amazing.

BTW, if someone could point me to a look and feel for the very latest Bootstrap which is as close as possible to the 3D / gradient look and feel of Bootstrap 2.3.2, I would be forever grateful!
>I’m not sure why I’m obligated to be bound by laws that I had as much to do with the passage with as the tax rules in Georgian era England

because one, it's impossible to completely rewrite the system every generation. there's always going to be someone who wasn't born when the set of laws in place were made

and two, there's nothing about a law being old that means it can't be changed. if enough people feel the same way you do, then the law can be changed, the constitution amended, etc.

in fact the framers of the constitution WANTED it to be a living document, changing as technology and society changes. they'd likely be aghast at how little we have changed it and how people are clinging to it as a religious tome that is sacrosanct and must be applied as it and the world existed in the 18th century
Given the double meaning of “play date”, it’s not surprising that it would cause a higher score, even if it used a different TLD.
Location: Lisbon, Portugal
Remote: Yes
Willing to relocate: Maybe
Technologies: Django, Python, Vue, C, Java, JavaScript, Typescript, PyTorch, Nordic Firmware Development
Résumé/CV: https://www.surf-the-edge.com/wp-content/uploads/2024/01/Resume.pdf
Email: artur.ventura@gmail.com
Website: https://www.surf-the-edge.com/

My name is Artur Ventura, I'm a Senior Software Developer Engineer with a cross functional expertise in every level of
software development. Developing software on a professional level, in scenarios of
hundreds of thousands of users for 13 years. Focused on Applied Artificial
Intelligence, in particular Natural Language Processing pipelines. Just finishing the sale of a company and looking for a new challenge.
Not by itself, but in combination with this line, maybe (for TTS that incorporates some sort of model for pronunciation):

> You may not use, adapt, modify, or process the Licensed Content in any way with AI technologies. This includes but is not limited to [...], utilizing AI tools...
Sure. However, not all orgs has yet reached that level of automation.
The stations are indoors and clean. Homeless people could sleep on the floor if they wanted to, but that doesn't happen.
So this project would presumably violate its own license if the AI used to generate it was trained on content using the license?
Something like GitHub Copilot presumably
>DOM is efficient
>No it's not, here is the data
>something something it doesn't matter because it's fast enough.

So you agree that the DOM is slow? Or, by this logic, can I call any terrible code 'efficient', because if I run it on modern hardware it will still be faster than 'good' code run on machines from 20 yrs ago?

But also, it's not like all this inefficiency is free; every millisecond that is spent running inefficient code requires power. Multiply that by trillions of operations computers are doing every day, multiply that by billions of computers worldwide and we end up with waste of resources that literally change the planet. Not to mention the e-waste of all the hardware we force out of the usage "because it's too slow"
Seeking Work | Remote

If you're a startup looking for a senior developer or a business interested in MVP to test a hunch, or maintaining some legacy code - feel free to reach out.

Available for both short and long term (>9 months) contracts.

Tech Stack: Python Django, JavaScript, MySQL, AWS, Node, Firebase

Résumé: https://kashifaziz.me/kashif_aziz_independent_consultant.pdf

GitHub: https://github.com/kashaziz

Some projects:

- Pipeline to generate weekly book rankings for one of the leading newspapers in the US. The system ingest rankings from variety of sources, process and generate top 150 rankings, published weekly on the website. (Django, MySQL)

- Backend to ingest data from harvesters, store and produce reports (Django, Postgres, AWS)

- Backend for an unofficial mobile app for a leading golf website in US (Django, MySQL)

- Backend for mental health app (Django, MySQL)

- Backend for food delivery marketplace in Sweden (Node, Firebase, Google Cloud)

- Backend for digital illustration system for life insurance provider (Django, MySQL, Azure)

- Backend for financial app for employee benefits management system (Django, MySQL, AWS)
Any views/comparison regarding freakwan versus reticulum https://github.com/markqvist/Reticulum ?
Pretty much the same here. I used mIRC extensively as shareware from 1994 to early the late 90s/early 2000s, then switched to BitchX and later irssi. It wasn't until somewhere around 2010 I purchased a license for all the joy mIRC had allowed me to access. Whenever I do a reinstall of my server and need to temporarily connect to IRC meanwhile I find myself downloading and using mIRC if only for a couple of hours since I use Windows as my desktop o/s.
Typo both on HN and TFA. It's "hierarchical".

Reminds me of when there's a typo in a codebase and the auto completion just replicates it across everywhere.
> If they had to read their own document, it would probably be far better written.

Perhaps not; I've always had a strong impression, whenever reading documents derived from tax policy, that the "architecture" of such documents is the way it is mainly for maintainability.

Which is to say: the effective tax code at any given moment, is the emergent result of the interactions of all the current tax laws on the books. And there are many such laws. And those individual laws can be updated or repealed; and new laws can also come in that, through a few simple statements, make sweeping changes to the meanings of other laws.

As such, the tax-filing instructions, ideally, have to be constructed in such a way that they cope efficiently with someone being able to pull a single jenga-block out of the tower that is tax law, that topples over a whole slew of other instructions and definitions. The team of tax lawyers and technical writers that maintain the instructions should not have to sit down and rewrite every instruction on every schedule/form, just because one of the core definitions changes. Because that's gonna happen a lot! Every year, even!

If I was in charge of a team of (automation-minded) lawyers and technical writers maintaining the tax-filing instruction repository, I'd probably, ideally, want to factor out the instructions into separate modular files per law — with each file acting as a sort of Aspect-Oriented equivalent of Javadoc. (Or, actually, something very much like Inform 7. See e.g. https://i7-examples.github.io/Bronze/source_1.html)

So you'd see:

• Paragraphs that interpolate definitions as constants from other laws' modules;

• paragraphs that have implicit AOP hooks for other laws' modules to inject additional language into;

• the ability of a law to override specific sentences or wording of the language of the laws so far;

...and so forth.

This would be hell to read, but it'd sure make the job of dealing with changes in the law easy. (And it wouldn't be something you'd really read anyway — more often, it'd be something you'd carefully poke at, while watching the compiled result change live in a split pane. Like writing LaTeX in LyX.)

---

To be clear, I don't imagine that any existing set of tax-form language is actually maintained using some weird AOP DSL.

Rather, I imagine that the maintainers are manually doing the same business process that use of such an AOP DSL would formalize.

They're maintaining a very non-intuitive "storage architecture" for all the instructions that go into these forms, to minimize re-working when the law changes; and then — mostly manually, but maybe with a bit of Excel — collating them together into new schedules and forms each year.

And it's that "storage architecture" — despite not being something as rigid as source code — that still nevertheless forces the language of the instructions into the form you see at tax-filing time, with the weird grammatical shapes, the distant definitions, etc.
I get that, but sitting in a drawer unused until you die is only a little different than land-filling it. Find a local makerspace, electronic enthusiast mailing list or other place interested people might hang out and offer it to someone who might be able to put it to work, esp someone who might not be able to afford the toy otherwise.
Not in the US - I think they use diameter and weight.
I don’t want to be promoting any particular cloud GPU services but you literally can rent those GPUs in single and multi GPU configurations if you need to. Even for H100 it’s only around $2/GPU/hour and comsumer grade ones like the 4090 are even cheaper of course.
What an incredibly stupid work to put online. Or maybe I'm the fool and this is meant to troll me?
Little endian is the vast majority of stuff today due to the dominance of x86, but back when big-endian ruled the day. That's why network byte order is big-endian.
Since Oct 7, Israelis use TikTok more than all other social networks combined
You can generate them using Graphviz's circo layout engine. https://graphviz.org/docs/layouts/circo/

According to them/Wikipedia, the layout's name is simply "circular layout". https://en.wikipedia.org/wiki/Circular_layout
Yes I think that’s what it’s called. It depends on where you take your photos I suppose but certainly if there are no familiar landmarks, it can’t make inferences from the specific types of plant visible etc.
Hard to interpret his phrase of additional fearmongering makes it worst (therefore nothing is better). What did it mean for you?
My first reaction as well, it's not clear if search algorithms fall under this definition of "AI"
Not even remotely correct.

Each country in the EU has different income tax systems and other types of tax.
VAT is just one aspect that generally doesn't cover even half of the tax burden.

OP is talking about the overall tax system.
Are plant species also becoming extinct?
There is improve and there is trying something new. Rails have been around for nearly two centuries - they are a solve problem. We don't need to innovate on many parts as there is nothing wrong with the old technology with some minor updated. We already know what works well for a standard train system. Innovation generally tries things that look good to politicians who don't understand trains, but in reality people who understood trains 100 years ago had the idea and rejected it as a bad idea - and the reasons they are bad ideas didn't change!

there is a lot of room to improve trains. However it all starts with standard gauge steel track, with standard sizes tunnels, standard switches, standard control algorithms (with computers this had recently had a revolution, while there is room to improve this is again in the mostly solve area), standard "rolling stock" and so on. Let me bring out here two standards that are a bit new: platform doors - now that someone invested them and proved they work everyone should retrofit to them; and elevators - it is criminal that many stations around the world still haven't been retrofitted (criminal as in I think someone should be in prison anywhere you find they have not been retrofitted) Once you have all the standard stuff laid out you can make a few tweaks to see what works, but only a few as we know the standard stuff works.

Make sure when you look at standards above you look at what others have done. If you have an idea odds are someone else has already tried it: find them and figure out how it works - sometimes you can tweak to be better sometimes you realize it is a bad idea.
Well-written and fun piece, but I don't share OP's appetite for universal text editing unity.

> I hate context switching. I want my input sequences to always work, no matter what software I'm using.

Context switching is a skill, and an increasingly important one. To use the example of this essay, I certainly don't expect to have the same response to my input if I'm using PyCharm full-tilt as I do with an HTML <textarea>, and I expect both of these to be different from a coloring book I'm sharing with my child.

The differences in these interfaces are highly valuable, and the cost of enjoying each of them is relatively small in that it requires the maintenance of the mental (and sometimes physical) skill of context switching.

To apply a bit of reductio ad absurdum: if this were globally and successfully applied through the realms of technology, even unto genetic and geological engineering, we'd expect a car, a lover, a mountainside, and an HTML <textarea> to share the same context and afford for the same muscle memory.

(If this sounds like too far a reach for a comparison, please pause and ponder for a moment just how _diverse_ text input has become in your life, across all of your devices and apps, with all of your relations both human and computer. Now consider that this diversity is likely to grow in ways that are difficult to imagine in the years to come.)

Even if this is somehow abstractly possible (and obviously we can't even imagine what it looks like from here), is it desirable? Is there something so important about avoiding context-switching that we'd be willing to forego the diversity of joy that arises from interacting with the elements of life differently?

Of course I assert that the answer is 'no', but I think that it's obvious even in the realm of text editors. I love having copilot in my IDE, but there's no way I'd want it in a <textarea> subject to the whims of javascript I might have forgotten to disable. Similarly, I'm happy to have a web application respond in reasonable ways to keystroke events that I enter in a text area, but I don't want that for my CLI. Etc, etc.

tl;dr: Context switching is a skill that requires work, but it's worth the richness it empowers.

P.S. I actually like quote-completion. ;-)
I bought one on eBay, thinking maybe I'd make a joke video on how to secure your voice assistant: with a clapper! Clap to turn on the Echo or whatever, wait 27s for it to boot, say 'Alexa, what is the weather, then clap to turn it off.
Maybe they care more about breaking library code than user code? Not saying I agree but maybe that explains some of their decisions.

I don't know if changing the realloc() NULL behavior to undefined necessarily breaks code. It definitely leaves the door open to the possibility of breaking code on standard library users but it's still up to the implementation to change the behavior for the code to break.
MLanguage in this context is not M, aka MUMPS.

MUMPS ("Massachusetts General Hospital Utility Multi-Programming System"), or M, is an imperative, high-level programming language with an integrated transaction processing key–value database. It was originally developed at Massachusetts General Hospital for managing hospital laboratory information systems.

https://en.wikipedia.org/wiki/MUMPS
Queues: FIFOs, stacks, code diffs, and other bad words
The Myth of Meritocracy Runs Deep in American History
Wordpress is incredibly complex when compared to a static site that can be served ~entirely from a CDN. A database-backed blog has been outmoded now for years.

If you don't want a pre-built theme, you don't need the plugin ecosystem, and you don't need/want a WYSIWYG editor, there's no reason to choose Wordpress.
Good question. Another question is, how will a court in a foreign country answer?

Court decisions in the US on jurisdiction of cross-border internet postings have been contradictory, and I know of none in non-US countries. Each country gets to rule on jurisdictional matters on its own terms.
The Billy Ireland Cartoon Library and Museum is a fantastic place.

I was on a backstage tour a few years ago and seeing early 20th century cartoons at original size was such a treat.
Yes, and heavily subsidized by other parts of Canada via transfer payments.
SpamAssassin has a Bayes filter that you can train with ham and spam. This has basically been a thing since forever.
Dupe: https://news.ycombinator.com/item?id=38816867
I want something similar for my mortgage calculation. For example I cannot get my bank (TD Canada) to inform me of how much each payment goes towards my principal. I'm pretty sure I've calculated it properly, however the number is often in the 10's of dollars off from what the bank reports my outstanding balance is after a payment is made.

Also don't get me started that I can't use an api to get my account details and statements in Canada.
Even with this context, seems a little dumb. Copyright maximalists are constantly trying to invent new rights that they've never had. If a person is allowed to read training material acquired legally, then so too must their LLM experiment be allowed to read it. The LLM reading it creates no new copies.

Moloch didn't win here. Everyone else did. We get new technologies, the copyright owners got everything they were promise, just not more.
I think author was thinking that by using AI model to roast itself it would be an ultimate win in their book, the AI kills itself.
There is a bit of learning curve to figuring out the most effective ways to collaboratively code with GPT, either through aider or other UXs. My best piece of advice is taken from aider's tips list and applies broadly to coding with LLMs or solo:

Large changes are best performed as a sequence of thoughtful bite sized steps, where you plan out the approach and overall design. Walk GPT through changes like you might with a junior dev. Ask for a refactor to prepare, then ask for the actual change. Spend the time to ask for code quality/structure improvements.

https://github.com/paul-gauthier/aider#tips
It’s remarkable growth.

If there’s anything China can teach the world it’s that the state has a large role to play in creating growth and development and that any country can develop to be an advanced economy. 40 years ago China was poorer per capita GDP than Ghana.

South Africa where I live, was always significantly richer than China. We are at risk of losing our car assembly plants. The government isn’t helping set up electric vehicle assembly here. In fact there’s so many more things we could be doing, like providing housing to people.
Video game company layoffs are creating an industry crisis(2023)
Does the outrage about parents' past failures help the starving children in the present?
I wonder if this might be an educational issue? Maybe people are learning "convenient lies" about how Git works so they can get started, and don't move forward to learning the real truth of the matter?

Just speaking from the perspective of someone that's used git since nearly the very beginning (and CVS and Subversion before that), Git's strong adherence to the Unix philosophy ("give enough rope to hang yourself") was definitely a breath of fresh air compared to the restrictive systems.
> How many optimally greedy criminals are there?

Bernie Madoff might be close to an example; his scheme kept going for an _amazingly_ long time, and he made some effort at times to reduce inflow to keep it somewhat under control. There was probably a world in which it only came out after he died; as it was he was kind of unlucky with the timing.

Of course, there might be plenty of optimally greedy criminals out there, and you’ll never know; more or less by definition they do not get caught.
Carlo Ratti Wants to Remake New York into a 'Playground City'
Tesla overtaken by China's BYD as biggest EV maker
Same as looking back 15-20 years ago from now, though.

Very few jobs now where you put together basic webpages with HTML and CSS (Frontpage, then Wix/Wordpress etc replaced you). Very few jobs where you spend 100% of your time dealing with database backups and replication and managing the hardware (the cloud replaced you). Very few jobs where you spend all your time planning hardware capacity and physically inserting hard disks into racks (the cloud replaced you, too).
I’m pretty sure it’s karma farming to some degree. I see it so much with news stories which will have articules with similar content rewriting each other, and end up like this posted repeatedly over a week or so.

Anyways, I flagged as duplicate, nothing new in this piece compared to the ones from 3 days ago.
Doing a bit more digging, it's using cytoscape[0] which is similar to graphviz. If you search your favorite search engine with "Cytoscape Session Viewer", you'll find many websites displaying the same type of graphs (select layout: circle).

FYI, circo doesn't always output a circle. I recently created https://github.com/MegaManSec/SSH-Snake/blob/main/tools/SSH-... using circo.

[0] https://cytoscape.org/
I think the author is trying to be a bit flippant by using the AI against itself