skysight-inc/HackerNews huggingface dataset:
No matter how sophisticated the pivot selection is, you can always risk having some degenerate worst case. I recommend having something like a heapsort fallback after a certain recursion limit is reached, as do pdqsort, ipnsort and vqsort(I'm a little fuzzy what their fallback is, but they have one).
> The (relatively small) percentage of people that generate the bulk of the content on Reddit do rely on third party apps

Is that published somewhere? I would find those kind of usage stats really interesting to see.
Of course. I was pushing back against the claim in the original post, which argued for socializing transportation costs on economic grounds:

>Transportation is a service that's critical to economic function.

Transportation is not amongst the subset of goods/services where having individual market actors pay for its production leads to economically sub-optimal under-production.

Whether transportation should be subsidized for other reasons is an entirely different subject.
No offense taken whatsoever, I'm new to HN, and glad this post gained more tracking and sparked interesting discussions.
hamdiish1
For those who interested, there some new researches in the field [0]. It usually possible to create more compact token representation from given text, but my guess the greedy "optimal" tokenizer might harm the performance of the model?

[0] https://www.reddit.com/r/LocalLLaMA/comments/140gcn7/new_tok...
Please add "unabomber" to the title?
In Switzerland we have a duopoly since forever, Coop vs Migros. Aldi and Lidl are also players but it is still mainly a duopoly. And that worked quite well, at least for the ~25 years I lived there.
> If you really want the full TK experience I implore you to live in the woods for a decade and see how you feel about humanity. No laptop instagram or electricity. Will you have any empathy left for the rest of society upon your return?

It's important to remember that living alone for any significant period of time is not natural for human beings. It's not something that brings you closer to yourself, it is a stress on your mind that distorts your real, social self into something else.

Some people will be able to stay healthy after such an experience, some will not - just like any other stressor on our bodies. But losing empathy is a mental illness in itself, not some rediscovery of a bond with nature.
> Despite it being reviewed every well upon release, gamers expected even more.

Gamers expected what was presented in the initial demo. A really dynamic world that changed depending on your creature's abilities, a sandbox game where you could affect things by designing different types of creatures.

All this was scrapped, and what was developed was very different than what was shown in the early prototype demo:

https://www.youtube.com/watch?v=T8dvMDFOFnA

No wonder gamers wanted the thing they got excited about in the first place.
> the group was surveilled because they were known to have fought in syria

That's not correct. One person fought against Daech in Syria, then a few years later a dozen persons get arrested ; most of them don't know one another. You can't really talk about a "group" and certainly can't say they took arms when only one of them did (and for an arguably very good cause which was approved by the State on paper).

I agree with you the video title is misleading, though.
Valid point! But I strongly believe it depends on how you define success. On paper, you’re right, Reddit is the textbook definition of a successful company, with insane amounts of soft power.

However I think that it’s still valuable to look a level deeper at the specific decision making that’s going on at the management level, and how that’s affecting the overall dynamic which has caused Reddit to be popular for so long.

Specifically, these changes disproportionately affect power users and mods, two groups of people who are largely responsible for creating the content that most Reddit users come to the site for in the first place as well as moderating that content to ensure the quality is high (all unpaid!)

In any case, time will tell if these decisions help or hinder the IPO. My personal gut feeling is that reddit will be around in 5-10 years time, and possibly even growing in terms of popularity but we’ll probably see a decrease in quality of content and moderation and potentially a few competing sites existing on the fringes.
> but funnily enough mistakes such as these happen in every intelligence service

There's advantage in appearing incompetent and creating traps to distract from actual active capabilities that are working.
Those viruses are slightly more related to SARSCoV2 than RaTG13, however note 1) that they were found even further away from Wuhan than was RaTG13 and 2) that they still remain too different from SARSCoV2 to be its direct ancestor.

One of the things we know for sure is that that about 50 years of evolutionary changes separate RaTG13 and BANAL-52 from SARSCoV2, so they are not its direct ancestors.
If you're going from 20TB to 32TB then it barely affects your RAID reliability at all. You don't need to increase parity in that case.

And nobody that's price conscious would make a 5+3 RAID so I'm not very worried about such an extreme scenario.
>Actually, we can be sure that a computer with a stateful predictive generative world model is likely to be conscious and self aware.

The idea that computation leads to consciousness is ridicolous. The claim that some functioning world model leads to inner experience seems to not even be worth considering, because it is so obviously wrong.
I don't know if your underlying assumption holds at all.

In the end the GPL resolves these issues and enforces stuff. Obviously most companies don't want that for different reasons.

Without GPL, as a company you take the code and if neccessary at some point, you employ somebody to further develop it in house (when maintainer gives up or something).

Why pay and share and give that advantage to your competitors?

The key to open source is when governments develop policies for using open source instead of paying licenses for proprietary software and maybe pressure from customers to companies which use open source software.

But average people don't know and don't care at all about open source ... :(
I've paid more to take longer by train, for greater convenience and comfort.

I agree with your point in general, I'm just quibbling that speed is the decider.
It always seemed (to me at least) that the most promising path to legal reform would be to argue that substances found naturally in nature cannot be outlawed. Dunno if this idea actually ever proved to be useful in the law & politics of psychedelic substances.
This is not entirely correct, from what I understand. The source of the "anomalous token phenomenon" is that those texts were included while training the tokenizer but not included when training the models. It is not clear they would necessarily induce the same effect otherwise (i.e., if both the tokenizer and LLMs were trained with those "counting" texts).

EDIT: notice that the "tokens" that trigger the "glitch" are not the numbers themselves but the usernames of the people counting on that subreddit (which appear nowhere in the training dataset, due to a cleaning step that removed the "counting" texts)
Ublock origin or Brave now blocks those. A must have.
We don't need manager at all. An automation tooling with AI can do that job better than any human.

We need real engineer.
I’ve grown my channel to around 35,000 subs now - link is in my profile.

As someone else has pointed out - decide if you’re doing it for revenue or for fun. This will determine how happy you are going to be.

To be successful you need to find a niche. And then stick to it. This can be very difficult if your goal is to have fun AND make revenue.

Typically, YouTube will show your videos to your subscribers first and based on their reaction will show it to more people - or just kill it.

This means that you have to stick to a very tight niche - the one that resonates with your subscribers.

If you can pull it off, then having people watch your videos because of “you” rather than the content you post can be a winning formula. This frees you up slightly on the niche side of things. But you will need to have an amazingly entertaining personality to make this work.

I write a bit about my frustrations with being stuck in a niche here: https://atomic14.com/2023/03/06/the-curse-of-youtube.html
I develop the Caddy web server, and I rely on open source sponsorships for my living. To be part of a more secure and reliable Internet, have your employer sponsor me (mholt) on GitHub!

Doesn’t that mean he needs users? And especially corporate users? The more he has the more $ he makes
Tao Lin’s work is interesting because it makes the normally abstract philosophical questions of authorship in art suddenly a bit more tangible. Should we care what creator says about creator’s own art? People see all sorts of layers of meaning in his work, and he personally methodically debunks every such finding[0]. One might wonder, are we doing the same to works of authors who are no longer alive to correct us? Does it matter that we do it? Does author’s intent matter, or only our interpretation of the work?

My personal view has been gradually trending from “it only matters if I like it” to we should (if we are aware of it), we probably do, it does (and we shouldn’t), and yes, creators and their intent matter (although it doesn’t mean we can’t make our own conclusions and have own takeaways). Tao Lin somewhat contributed to that.

[0] Some suspect he might be doing it ironically, in what I guess would then be an immense art project encompassing his whole life.
I think the issue is that any energi i spent on trying to make my apps have a less of a co2 footprint would be better spent engaging in climate questions instead, preferbly using ones profession.

Ie doing stuff like writing applications that scrapes metrics and show how green the energi grids are realtime, doing real time stuff around planes current climate effect given the amount of planes up in the air etc.

If thats not an option just vote with climate in mind and engage in public discussion around these issues would probably have a lot more potential
Hmm I could use a reminder of what those acronyms say. SMR is the one unusable for desktop stuff because of the sloooow writes? What is HAMR?
For stuff like that I think Numba really shines. But yes I get the issue.

Julia is great, but sometimes a bit less user friendly than Python, it's quite easy to shoot oneself in the foot performance wise using Julia.
My favorite is "bubble memory". Everybody was convinced we were going to store all our precious data on these itty-bitty little bubbles. It was all over the trade publications, very hype, such bling, much buzz:

https://en.wikipedia.org/wiki/Bubble_memory

And then it just basically turned out to be a flop.
Same. The overall game itself is a bit meh, but it's fun creating different kinds of creature.
Where do you buy $5/TB tape at retail?
People are willing to put in thousands if not millions of working hours into shoehorning things into the language they already know, unwilling to learn a language that already has a good set of basic principles and concepts, that would enable the thing they envision.

People will build huge C and C++ libraries for realizing distributed systems that they can then use from Python, instead of getting to know a language on the Beam VM, because they only want to stay in the mainstream ecosystems or are unwilling to deal with new concepts like in Elixir or Erlang (for starters lets say lightweight processes, distributed system, pattern matching, proper recursion (TCO), the functional programming view of things. Some of those are very scary for many Python developers.).

Fortunately there are those on the other side as well, stubborn enough to try to implement things in those more niche languages that they prefer, based on technological merit of basic principles and concepts of a language, rather than just doing what everyone else does. So sometimes something really great and interesting comes out of that.

Often however, the shoehorning masses are simply too many, the people knowing the other ecosystems too few, to keep up with them or the newest developments, further enabling the "but this is what everyone else is doing!" kind of mindset. Something something "beating the averages" here.
> Not even in salary in many places

What needs to die is this trope. Few places cut salaries when people move to EM role. This might be true for some big tech companies, but even then it's only in the beginning. If you look at companies that have unified levels for SDEs and EMs (Google, Amazon), you can see that on the same level EMs have slightly higher TC.

Not to mention that there's a whole world outside of big tech where moving to management is considered a promotion (and often the only way to grow, because dual career ladder is not implemented everywhere). The cases where EMs make more than SDEs are really way more common than the reverse situation.
Dijkstra's Letter to the Council (2001)
Surely Ted believed what he was doing was a great good, a service to rouse the masses to revolt against modern society (or something like that.)
You might reuse simple LLaMA tokenizer right in your Go code, look there:

https://github.com/gotzmann/llama.go/blob/8cc54ca81e6bfbce25...
Core Elements of an Internal Developer Platform
Exactly... I went there looking for how one can sell out one's key/value store to Russian state mafia for profit! Isn't that what Merkelizing means? Oh, sorry, its merklizing. Never mind.
> democracies have to work together and build mutual trust, and not spy on one another.

The first part seems true, but the second part doesn’t follow. Spying on allies seems an entirely reasonable, possibly even necessary, part of effective diplomacy.

I trust what you are saying more when I can verify congruence with things I can observe.
https://i.ibb.co/GMqptmr/Screenshot-20230611-034813-Firefox....

Ff Android. Cut off the right margin
Serious question then, how do all the Chan sites exist?
*Regressing
Certainly for desktop software and user utilities I take consideration of power consumption and idle load especially. There is a strong overlap with performance but also there is being a well behaved application that doesn't consume resources when the user isn't directly doing anything.

Its a common reason why I get rid of open source self hosted apps. If they hammer the disk all the time or seem to constantly impact the CPU when they shouldn't be then it gets replaced. I want my NAS asleep unless it has to be doing something. Its a consideration I raise bugs around and its something all software I have ever written takes account of.
In my experience engineers have more “free time” than eng. managers. As a senior engineer I have not many meetings per week, and the tasks I need to accomplish I can arrange time for them the best way that fits me. So, on Monday I could work fully focused, let’s say, 4h, and call it a day. On Tuesday spend 2h in meetings and another 2h to do PR reviewing… I have almost absolute control over my day, and that feeling is great.

On the other hand, even though eng. managers mostly do meetings, their calendars are usually packed with them. Even worse, they may have one meeting at 8am, another at 12, and another at 4pm… that kills your day completely since you have to stay available during the whole day. Definitely something I would hate.
I /definitely/ don't have perfect autobiographical memory, but do have an above-average recall for code. And a tendency to dig deep to understand how systems work.

One of the most satisfying feelings in the world is when someone has a Weird Error and you can point them to the exact spot in some complicated framework code that's responsible for the trouble they're having.
Have you ever been imprisoned (lived) in a max security prison?
Living in Airbnbs full time isn’t easy (2021)
€3bn to rival AWS that is going to be more secure and will also only use green energy, sounds like something EU bureaucrats would come up with.

I'm deeply disappointed that the EU is afraid of doing real investments with realistic goals into information infrastructure while it happily throws away billions on the failing Ukraine war.
And most of his arguments about the Left specifically is the generic list of conservative/right-wing characterisations of the Left (obviously the rest of his philosophy has little to do with conservatism, mainstream or otherwise!). Leftists hate strength and rationality. Leftists only pretend to care about minorities. Leftists are self-hating losers who are afraid of competition

Genuinely amazed someone identifying with the Left would find these ideas interesting, and if so, they're going to love the deep philosophical musings on leftism offered by the likes of Tucker Carlson and Ron de Sanctis!
> No tuples: I found this to trade some convinience (no need to name anything)for worse refactoring (adding a value to a tuple or reordering the fields breaks everything, doing the same to a record doesn’t).

Did you mean better refactoring?
> because it really should be built into the browser.

It is? And I imagine that's why it "sucks" for you, since I think you actually mean it should be built-in to the HTML / Styling of the site. But that would defeat the purpose, to a degree.
Wastewater, Fossil Fuel, fluoride: is it goodbye to Safe Climate Limit?
It sounds to me like you could use model managers and just call it a service layer.

>in practice, changing your data model in some way is actually pretty common

I find this to be very true on some projects and very not true on others.

Where it is true the abstraction would be beneficial but if you assume all projects have this problem and therefore jam the abstraction into a project that doesn't have it you're just creating overhead.
Again, it's an explanation only a passive bystander.

They're declarative, idempotent, and intended to manage infrastructure, operating systems and clusters, and coordinate application delivery, key rotation and configuration. Repeatability, rollback, and version control are the basic design tenets.

Sorry to hear that an OS upgrade broke your scripts once, but that's hardly the fault of configuration management tools in general or the Puppet/Ansible/Chef/Salt family in particular.

As you might tell from between the lines, I have some experience with these tools in various environments. But I also see the need for another generation, mainly because of the large shift to Kubernetes application delivery. The insistence of these tools to manage the entire OS stack makes people regard them as too complex for what they need. It is my personal belief that the concept of a host is limiting the continued acceptance of this type of tools and I have been spare time experimenting with other primitives to describe state on, such as binary file archives.

Playing with Nix, it is my impression that it is quite similar to other configuration management tools, a host is still the basic entity we serialize state on. State transitions are a linear graph.

What people describe as problematic with configuration management in general is usually perceived complexity, and Nix seems to have the potential for more of that. But I have not used Nix in anger, or in any type of real world complex environment, and I would be very happy to learn from someone who has experience.
Call for Germany to scrap English lessons in primary schools
This would seem like a good way to remedy the problem, but afaik, the limits also include the Oauth clientid. So, limits are actually tied to the client application as a whole -- not just user usage. This is where the limits for a popular app quickly fall over.
1. The agent loop runs in GPT4, so the prebuilt binaries come with access to our own OpenAI key (via our hosted proxy)

2. It works with any git repos, you just have to clone them on your local machine first
Shameless plug for a short post/guide to “the good bits” of asyncio from a few years ago:
https://charemza.name/blog/posts/python/asyncio/I-like-pytho...
I have yet to be convinced that HFT is anything other than a big scam for skimming fractions of percentage points off of everything it can get its mitts on.
Yikes; I know there have been a couple of high profile psychological experiments that have gone wrong, e.g. Stanford prison experiment etc, but even with that context these CIA based studies on students seem like huge ethical red flags; even from a 1970s perspective. But I would like to point out that the eyeroll vilification of LSD just for fun in this article is not ideal; many drugs can induce an individual to be more suggestible and many drugs can hurt individuals that are already prone to schizophrenia and other psychotic breakdowns
No, you can’t trust ChatGPT for anything. Check, check and check again.

Don’t want to be like that lawyer citing made up cases.
Super Meat Boy comes to mind: https://news.ycombinator.com/item?id=3387628
Not really as I've shifted my focus over the years to other areas of software/business development and left ML behind.
The most obvious alternative is https://sourceforge.net/projects/fis-gtm/, but there are a few others, depending on the size of the application at hand. https://yottadb.com/ is another big one which started on GT.M a few years ago, or http://minimdb.com/. See also https://www.mumps.dev/implementations.cfm.

If you don't depend on the MUMPS/ANSI-M language or don't have to be backwards compatible, a lot more alternatives with similar features are available, e.g. https://github.com/facebook/rocksdb run behind e.g. Node.js.
It is very hard to 'prove' this greed-flation. The coordination happens only through the market in this theory, so there is no damming communication evidence, or even testimony that can prove this is what happened.

Perhaps something to make customers more price-sensitive by making price comparison easier or by forcing more disclosure around when price-increases happen.

The best solution is to stop high inflation. That lengthens the window you can keep prices lower than your competitors, to take market share. But inflation is very difficult to affect.
A different way to do math
Didn't know of it.
It reminded me of Plato's.
even Budapest has an autonomous line
If it's a simple app, check out this flask+dataset(sqlite) approach: https://github.com/void4/lazyweb/
All of the big web servers have some mechanism for implementing server side basic auth (which I assume OP is referencing with ".htaccess". Nginx for instance:

https://docs.nginx.com/nginx/admin-guide/security-controls/c...
The only reason I discovered Elixir was through an unbiased cost benefit calculation while working on my last startup.

This was in early 2017, and my search essentially went from a variety of JS frameworks to RoR to Scala + Play and then eventually to Elixir + Phoenix. The ecosystem was much smaller then but of the options that were viable, it was by far the most productive.
Tokens are just integer numbers, showing their position in the big vocabulary - it's that simple :)

And vocabulary is just an array / vector / list - it depends which programming language you use, each has each own terminology for that data structure.

For example LLaMA vocabulary has 32,000 tokens.