skysight-inc/HackerNews huggingface dataset:
> Instead you mostly created an abstraction of the problem that no one cares about: that there exist certain synthetic language constructions that LLMs have difficulty with. But this is both trivial (consider a language that requires you to factor numbers to decode it) and irrelevant (there is no relation to what humans do except in an abstract sense).

Thanks for your feedback. I think our manipulations do establish that there are nontrivial inductive biases in Transformer language models and that these inductive biases are aligned with human language in important ways. There's no universal a priori sense in which Moro's linear counting languages are "simple" but our deterministically shuffled languages aren't. It seems that GPT language models do favor real language over the perturbed ones, and this shows that they have a simplicity bias which aligns with human language. This is remarkable, considering that the GPT architecture doesn't look like what one would expect based on existing linguistic theory.

Furthermore, this alignment is interesting even if it isn't perfect. I would be shocked in GPT language models happened to have inductive biases that perfectly match the structure of human language---why would they? But it is still worthwhile to probe what those inductive biases are and to compare them with what humans do. As a comparison, context-free grammars turned out to be an imperfect model of syntax, but the field of syntax benefited a lot from exploring them and their limits. Something similar is happening now with neural language models as models of language learning and processing, a very active research field. So I wouldn't say that neural language models can't shed any light on language simply because they're not a perfect match for a particular aspect of language.

As for using languages more directly based on the Moro experiments, we've discussed this extensively. There are nontrivial challenges in scaling those languages up to the point that you can have a realistic training set, where the control condition is a real language instead of a toy language, without introducing confounds of various kinds. We're open to suggestions. We've had very productive conversations with syntacticians about how to formulate new baselines in future work.

More generally our goal was to get formal linguists more interested in defining the impossible vs. possible language distinction more carefully, to the point that they can be used to test the inductive biases of neural models. It's not as simple as hierarchical vs. linear, since there are purely linear phenomena in syntax such as Closest Conjunct Agreement, and also morphophonological processes can act linearly across constituent boundaries, among other complications.

> The one language that you use that is most similar to the linear languages cited by Moro, "Hop", shows very little difference in performance, directly undermining your claimed refutation of Chomsky.

I wouldn't read much into the magnitude of the difference between NoHop and Hop, because the Hop transformation only affects a small number of sentences, and the perplexity metric is an average over sentences.
Waitlists can't be Show HN's, take a look at https://news.ycombinator.com/showhn.html

You could post this when it's ready for people to try.
Notably, the definition given in the Wikipedia entry referencing TRAC means that "homoiconic" is a property of an _implementation_, not of a language. This would mean that Lisp, a programming language, could not properly be described as homoiconic, since it admits multiple implementations including those that do not have this property (eg, SBCL rather clearly doesn't).
China's startups suffer as investors exercise redemption rights
I don’t follow - how do you mask a bad taste (bad coffee) with a bad taste (burned coffee)? I.e. if it’s going to taste bad then use a lighter roast, cheaper and faster anyway.
New RAG evaluation and LLM-as-a-judge capabilities in Amazon Bedrock
Arrow keys also work now, thanks for the feedback!
>> to clarify, i have nothing to do with this site, i used it once, years back and there was a free tier or at least a free/crippled version at that time

https://news.ycombinator.com/item?id=42291616

Per ‘bagpuss, the backup was free when they used it, and they were referring to the backup, not the CMS.

So, I would argue you were mistaken.
Location: Sydney, Australia

Remote: Yes

Willing to relocate: Yes, seeking relocation to Sydney via sponsorship or 6-month contracts under a Working Holiday Visa from 27th December. Alternatively, I am open to full-time remote work for businesses not based in Australia (though I intend to be based there).

Technologies:
- Python (Flask, Django)
- Node.js (Electron, macOS, Windows, Linux)
- React
- Vue
- GraphQL
- Android (Java)
- Docker, AWS
- Nomad, Terraform, Ansible, PLG Stack

Résumé/CV: https://drive.google.com/file/d/1QA780CBZnhsYmgPhYeLszRiTEc4...

Email: See attached résumé

I am a Senior (Fullstack) Software Developer with over a decade of experience in early-stage startups, including leading the development of an end-to-end encrypted messaging platform at SaltDNA (Android, Desktop, Backend, DevOps) targeted at police departments, government agencies, Magic Circle law firms, and private wealth management firms. I also addressed critical stability and scalability issues at MonolithAI, an engineering AI company.

My preference is for a long-term position in Sydney with visa sponsorship, but I am also open to 6-month contract opportunities. Alternatively, my visa allows for remote work with businesses outside of Australia. Relocating from Belfast, UK to Sydney, Aus on the 27th December.
Oh dear. The writer of this article really wants "AI" to be the new nuclear bomb and have the whole world locked in a state of cold war 2.0 with China in the role of a more technological advanced and slightly mysterious soviet union.

Economist on China is getting worse and worse.
Location: Tampa, FL

Remote: Yes, EST or CST

Willing to relocate: ASAP

Technologies: React v17-v19, JavaScript, HTML5, CSS3, Angular, Responsive Design, Tailwinds-CSS, Cypress, RTL, Mobile-First Development.

Résumé/CV: https://c.mail.com/@1432189282805621866/y48OlXLdT6OExBKGcx_5...

Email: alexander1.15.1943@gmail.com

Also just shy of completing "The Frontend Developer Career Path @ Scrimba"
https://archive.ph/Np6T6
It's still mostly opt-in.

I guess the danger is that creators of libraries start barfing all this stuff into the interface, forcing client apps to deal with it.

But at least that lets you know which libraries you may not want to use.

Here, I'd just make the primary logging callback interface take an actor, and have an internal convenience utility method to wrap the details of calling to it. A client would very typically want logging to be serialized in any case. (If there's really a legitimate use case for a non-serialized sink, you can provide an interface for that too, but it shouldn't be the default or too prominently exposed.)

~Copyable and explicit ownership has pretty limited uses as well, and should only be used in specific situations where you really need it for something (not just because they added it to the language recently). It's really an optimization, and as such, should mostly only be used when profiling shows it's needed.
you probably claim to be aware too.
I would argue that Tcl is almost "bicameral" in the OP's sense. The application of the "dodekalogue" rules - https://wiki.tcl-lang.org/page/Dodekalogue - largely corresponds to the "Reader". It goes further in that it also specifies substitution and evaluation rules, but it is similar in that it only applies a few basic structural rules, and knows nothing about the specifics of individual commands.

Tcl's equivalent of the "Parser" is built-in to each command, which decides whether to interpret its arguments as data, code, option flags, etc..

I suspect this division of responsibilities is very helpful for metaprogramming techniques.
I suspect the problem there is that the multiple paths to a new location will not yield consistent results.
Ideas are dime a dozen.

Execution is the sauce.

If you are proposing ideas, have a working MVP to demonstrate this.
waging war and trying to destroy people's hopes and dreams is a cynical, toxic, failing strategy for environmentalism.

It communicates that environmentalism cant maintain mindshare based on its own merit, and must obstruct and tear down other goals. Unfortunately, this alienates anyone one who holds values on par with environmentalism.
I still can't believe that everyone alive in the 21st century has been damned to forego a vibrant public domain because some lawyers were afraid Mickey Mouse might fall out of copyright.

Free Culture by Larry Lessig was an excellent book on the subject. He fought the copyright extension in the Supreme Court and founded the Creative Commons. The experience showed him the degree to which money has corrupted the US political system, so he moved his expertise from intellectual property to election reform. He was briefly a protest candidate for president, who vowed to make his reforms and then resign.
There certainly have been times when they've saved me some time like on cloudformation, nginx, etc.

That said, there have also been occasions when Sonnet/ChatGPT-O1 have hallucinated so badly that I would have actually saved time in the long run by just doing everything manually - scriptable TTF creation, WTX extensions, etc.

I'd rate them as a wash for most of the work that I do, and losing them would be no significant loss.
4/ For a moment, I thought that the corn dogs and wine from a plastic cup were specifically tied to opera. I suppose that the Met doesn't use good crystal at the concession stands.

3/ Yes, high school productions. Listen to some kid flat his way through a big song, then to his buddies in the seats shouting that He the Man!
I'm not a linguist but I think this bit of jargon leaked into tech from ham radio, which is old enough that "homebrew" (in the sense of building your own radio set from components) referred to a still-earlier time when people actually did commonly brew their own beer at home. "homespun" retains a similar meaning in general usage.
ChatGPT is more efficient google for me, so yes, I would be slightly less efficient.
Indeed, the Rust macro system was designed by people who had worked on the Racket macro system previously.
Smartest move by Musk in a long time imo
Optimality of Gerver's Sofa
For better or worse, social media (I’d even go as far as saying Facebook) has changed the world. As cringey as that book sounds, people loved hopium of early 2010s. Maybe I was young and naive as well, but I also believed that such connections will unite the world somehow.
And yet.

The slight sweet-bitterness to a real fresh red delicious apple is completely unmatched by any other apple variety I've ever had. It tastes like apple. It is satisfying and juicy and doesn't overwhelm your stomach with sourness or sweetness.

I think people just don't realize how fast Red Delicious apples go mediocre and have rarely tasted the real thing.
I personally dislike how-to-play videos. If you blink and miss something, hunting around a video is much worse than scanning a rulebook. I also do not have the patience to sit there for 10-15 minutes.
Granted, I overstated the escaping pollution part. It seems like people are not alarmed enough about climate change and pollution to believe extinction[0] will happen anytime soon. That would mainly be the motivation for rich people, and not just pollution but many other issues they are not interested in solving.

Frankly, the least selfish reason to go to Mars is to avoid extinction. Barring that, is it such a great thing for "humanity" to explore Mars for curiosity, commercial ventures, and leisure? Apparently many of the commenters here seem to extol things that can be great for "humanity" while lashing out at mentions of real issues not getting enough attention right now. I'll restate what I said: is it so important that we with privilege continue to have greater privilege? Or if you believe we can just fix these issues and get our space exploration too: do you really think that will happen with reasonable likelihood? The feel-good narrative of having our cake and eating it too is just too delectable.

And to those of you saying I would shut down everything for one cause, you're blatantly wrong. I'm saying we should focus on this cause and look to the remainder for things like space exploration. What we have in reality is focusing on things like space exploration and hoping. We are misallocating resources. Yes, perhaps we will get magical technology from the money currently going into it, or from space exploration. I ask you if you think the likelihood is reasonable. If you're here to talk about mere possibilities, don't complain when others bring up feasibility.

[0] Or just a lot of people dying, doesn't have to be nearly everyone.
There appears to be a misunderstanding in this thread.

The xenomorphs are not silicon-based.

In Alien, Ash (the android) notes that the facehugger utilizes utilize silicon-based processes to replace its outer layer...he specifically calls out the "interesting combination of elements". [1] It wouldn't be necessary to call out the use of silicon for the outer layer if the entire organism was silicon-based.

Also, it's clear that the xenomorphs utilize carbon-based food to grow baby xenos. In Alien, the host complains of starving before the baby pops out of his chest. Moreover, humans lack sufficient quantities of silicon for a baby xeno to grow in a human. In David's lab (Alien: Covenant), David's notes and experiments also indicate a duality to the creatures, and also that they are not strictly organic lifeforms, but are a fusion of organic and non-organic life...which is part of his fascination with them.

[1] In the novelization of Alien, Ash goes even further, stating that they facehugger is both carbon-based and silicon-based.
You lost me at "he speaks clearly and specifically on most issues", but I can agree at him being in the spotlight more. Any interview I watch on a podcast or a speech of his is hard to watch. Tons of rambling and vague answers or complete dodging. It was only clear to me recently he was serious about Tariffs.

From my perspective, Dems campaigned on reducing inflation (which they've done) and policies like the child tax credit or first time home buyer credit. Not that I necessarily agree with the last two, but...
Location: Brazil (ok to work in US and Western Europe timezones).

Remote: Yes.

Willing to relocate: Not yet.

Recently used technologies: Kotlin, Javascript, Typescript, Python, SQL (Postgres, Sqlite) ; Android app dev; NodeJS, Ktor; Apache Spark, Jupyter; Terraform, Kubernetes; GCP, Azure.

Other: application architecture, solutions architecture, testing (TDD, legacy systems), integration, software development process, business/technical problem solving.

Résumé/CV: https://www.linkedin.com/in/palmaec/

Email: emiliocpalma@gmail.com

(This submission is trimmed from old one here: https://news.ycombinator.com/item?id=39218493)
Hi! This is a blog post sharing some low-level Linux networking we're doing at Modal with WireGuard.

As a serverless platform we hit a bit of a tricky tradeoff: we run multi-tenant user workloads on machines around the world, and each serverless function is an autoscaling container pool. How do you let users give their functions static IPs, but also decouple them from compute resource flexibility?

We needed a high-availability VPN proxy for containers and didn't find one, so we built our own on top of WireGuard and open-sourced it at https://github.com/modal-labs/vprox

Let us know if you have thoughts! I'm relatively new to low-level container networking, and we (me + my coworkers Luis and Jeffrey + others) have enjoyed working on this.
> There was the idea that person to person public discourse could resolve many societal problems.

Nobody thought this.
Location: Durham, NC
Remote: Yes (or Hybrid)
Willing to relocate: No
Technologies: Typescript, React, Express, NestJS, Go, Java, AWS
Resume/CV: https://linkedin.com/in/axbolduc
Email: axbolduc@gmail.com

Website: https://axbolduc.com
GitHub: https://github.com/axbolduc

I am a full stack software engineer with expertise in Typescript and React. I am always looking forward to new opportunities that challenge me and help me grow as a developer.
Yeah, I'm 52 and at some point in the last ten years, night driving became really painful. I don't know how much of it is due to my eyes changing, versus "improvements" in headlights (of oncoming traffic; I notice that old lights have a nice warm dim yellow, while newer lights tend to be a bright cold white). or from grease on my inner windshield :(.

But yeah, it totally turns what used to be a routine and relaxing process into an exercise into "is that a tree or a person dressed in dark clothing?"
Story in the sense that we understand everything (perhaps even our most fundamental perceptions) through stories - events described over time with meaning/significance ascribed to particular things. There's a beginning, middle and end - in its most basic form.

If we model "situations" in AI in a similar way, my intuition tells me it would be similarly useful.
Is there a way to make "make" simulate those builds so one could tell where the cause for the races is in detail?

Have you tried?

make —-dry-run
I was going to post something about giant hogweed, too. Never felt its wrath, thankfully, but some stories I've read are horrible.
I do :)

https://jvidal.dev/memento-mori
I will risk and mention myNoise, but in general any field recording long takes (e.g. freetousesounds) soung good. Mind is fantastic at detecting an exactly repeated sound, so anything that avoids it.
> New Versions

KJV 4 lyfe, son!
it's an unfortunate terminology collision.

- array languages: rank is the dimensionality of an array, i.e. a vector is rank-1, a matrix is rank-2, a N-D array is rank-N

- linear algebra: rank is the number of linearly-independent columns (and also rows)

So for example, if you have a 5x5 matrix where 4 of the columns are linearly independent, it would be rank-4 in the linear algebra sense, and rank-2 in the array language sense.

I guess (though I've never really thought of it before) that you could say that the array-language definition is the rank (in the linear algebra sense) of the index space. Not sure if that's intentional.
Why does religious belief require a disclaimer?

Do other philosophical positions, like atheism or panpsychism?
There are a lot of suggestions here that seem problematic. For example, the idea that you should read everything and actually understand every detail. While it's a good idea to read a lot about your craft, this task is literally unlimited in the time that it can consume. Do read about best practices, a lot, but experience is probably even more important, and my suggestion is about maximizing the benefit of your experience:

I suggest this high level idea, which I have done in isolation in the past and caused tremendous growth. Think of something you'd like to optimize, run an experiment over a year and take careful notes. For example, once I decided I wanted to minimize defects that I released into production. For a year, I tracked every single defect I released into production, and made brief notes about how I could have avoided it. This led to me completely changing my attitudes and approaches about what is important. I discovered, for example, that very few of my production failures were caused by me writing code with bugs, and that by far what I needed to do is improve my testing strategies, what kind of data I test with, and how faithfully I represent the production situation during unit testing and end to end testing, and how I approach testing in general. There were a lot of observations and approach changes I made, but the thing that made these really stick is that they were my own lessons. Everything in my process was rooted in a hard lesson I learned myself. Whenever someone asks me why I do X I have a war story to back it up.

The point is, you can figure out for yourself the big areas to improve if you set a goal for a thing you want to improve, and carefully record your results, and review those periodically and look for commonalities. You can look at the advice from others endlessly, but the best teacher is experience, usually your own. Make the most of your own experience by figuring out what's important to you and think about process improvement for yourself and those that you work with, as a first class thing.
Apple is really good in making OTHER PEOPLE'S fabs work for their purposes. Running their own manufacturing was never particularly a forté.

Apple currently really enjoys being on the very latest process node. It's not a given that they could match or improve on that with their own fab (Sure, there is a lot of VLSI design and materials experience, but that does not automatically translate into a state of the art process, and is unlikely to contain the magic ingredient to get Intel back on top).

And in the unlikely case it SHOULD work, that will only invite further regulatory headaches.
I first got irritated a bit by this as well, but then the game Myst came to mind.

So I'm willing to accept the limitation, and at this point we know that this can only get better. Next I thought about the likelihood of Nvidia releasing an AI game engine, or more of a renderer, fully AI based. It should be happening within the next 10 years.

Imagine creating a game by describing scenes, like the ones in the article, with a good morphing technology between scenes, so that the transitions between them are like auto-generated scenes which are just as playable.

The effects shown in the article were very interesting, like the ripple, sonar or wave. The wave made me think about how trippy games could get in the future, more extreme versions of the Subnautica video [0] which was released last month.

We could generate video games which would periodically slip into hallucinations, a thing that is barely doable today, akin to shader effects in Far Cry or other games when the player gets poisoned.

Fiebertraum engine.

[0] https://www.youtube.com/watch?v=AJaV92DXN0s&t=218s
Fascinating, thanks! The author's standards may be more permissive than expected... We might be able to build whole cities without impacting the view from Earth!