skysight-inc/HackerNews huggingface dataset:
Hmmm, is there any way for a model to predict / edit its own tokens as it learns?

Kind of a recursive, self-evolving tokenization process?

I’m pretty new to deep learning, so this analogy might be off. But I’m reminded of convolutional layers inside image-based models. Could we have “tokenization layers” in a GPT model?

---

Edit: I asked GPT-4 about my idea.

It said it the comparison between tokenization and convoluational feature detection is a “someawhat accurate” analogy. And it agreed that making the encoder a fixed separate process that doesn’t evolve during training does limit the GPT model in certain ways and introduce quirks.

But it said that it might increase the computational requirements significantly, and that the transformer-architecture doesn’t lend itself to having “tokenization layers”, and it isn’t clear how one could do that.

It did say that there may be ways to work around the main challenges, and that there is some research in this direction.
I would love to help you with that, but you're right Val Town can't run Chrome... Is there a hosted-playwright api service we could use?
Coffee doesn't cause tooth decay. Sugar causes tooth decay. You can drink Coffee without sugar.
What I hate about Elastic is it special grep syntax I can never get right...

I tried loki around v1.0 and it didn't seem to offer much back then...
More like intelligence == human. ChatGPT is superhuman in many ways.
I sold GPT-4 on Pawn Stars in this GPT-4 simulation
(creds: I was down to McMurdo as a researcher three times)

I suspect this has to do with space and weight constraints, and probably a touch of old-school procurement practices.

In the not-too-distant past, basically everything was flown to south pole station, so weight was at a premium. Powdered milk weights a lot less than UHT milk. Now they do a traverse to the pole with sleds and tractors, so weight is less of an issue, but volume might still be.

On top of that, procurement may be slow to change. If, in fact, weight is no longer a constraint, it might take years for procurement to change to include buying UHT milk.
The GPT model is enough complexity, information, pattern matching to simulate human responses to a high degree. Reasoning about it the way we reason about people may not be 'right', but it is effective because the algorithm is designed to match what people do.

Let Neuroscientists chuckle all they want. In another five years, I really wonder if we won't have something resembling AGI to a high degree.
That's pretty cool. Do you know if the code is available for this?
I think it's much more common than you think - especially since Covid. You're definitely not alone - I can certainly relate to some aspects, more than I would like.

I have some observations:

- you indicate in the comments that you expected more from sobriety. We all do - I was in a similar situation as you. Think of it as a building block - being sober, in itself is not a sufficient condition, but it's definitely a necessary one. And frankly, congratulations to you - it's already a huge achievement.

- why did you move to a country where you don't speak the language ?

- It seems to me, that you aim to do something meaningful, work with people etc. Well, as with alcohol, you need to answer yourself honestly some questions - one of which is why do you stay at this job ? It doesn't seem like there is a path to making friends there (team remote) and it's not interesting.
Exactly - it blows my mind how normalized the permission Access your data for all websites is (I think it's Read and Change all your data on all websites for Chrome). I use only one or two extensions because of this. Why does a procrastination tool need such an insanely broad permission?
That's up to you, but "that isn't possible yet with this two-month-old technology" is very different from "that isn't possible".
"Among postsecondary Title IV institutions in 2020–21, there were 1,892 public institutions, 1,754 private nonprofit institutions, and 2,270 private for-profit institutions."

https://nces.ed.gov/fastfacts/display.asp?id=1122#:~:text=Am....
Well, having a smartphone is still optional in most countries, I suppose in Germany as well.

Movement on the other hand is a mandatory thing for many people unless you want to sit at home all day...
Api cost have have seen a very steep increase in cost. To the point that most third party apps will likely give up.

Including some where it just feels wrong : app to help blind people use the site for instance.
A DevOps junior should be able to start a VM just about anywhere, and without specialized experience.

AWS/GCP/Azure knowledge definitely helps when deploying there, but it's also not really necessary to get something running.
Maybe focus on all the non-essential shit people buy every day then first.
It's not digital only, I have a physical version. Whether or not you can get a card depends on your locality. Nevertheless, I don't understand why it's so much more inconvenient to understand and purchase compared to the 9 euro ticket. With that you could get a paper ticket or buy on app and the rules for what it did were consistent everywhere.
IIRC I've payed it via Paypal (you need an account with the official national railway provider though, which kinda makes sense for a subscription service) and it was available instantly as a QR code
Tooth decay is inevitable unless ur eating meat with water as your diet.
Umm... why?

It should be a conversation between you and your company. Employment is a two way street.
you gotta admit that it probably didn’t feel as clunky thou
I see. A most peculiar dystopia, indeed.
This is the case for all digital travel tickets though, no?
Yes, if your threat model is "what if Google locks me out?" Then you won't want to rely on a Google passkey as your only way of logging into a website.

Ideally, websites will support multiple passkeys per account. I think having both Google and Apple passkeys would be sufficient since I think I would be unlikely to be locked out of both.

Apparently Tailscale doesn't have multiple passkeys per account, but they recommend creating a backup admin account, and you could use a different kind of passkey for it.
It should be touch sensitive so it can detect when somebody pokes you in the eye.
Its not a complex issue, stop your BS.

Its an occupation started by the Arther Balfour deceleration in 1917.
Started with Zionist crime gangs that later turned into the mossad and other occupational military forces who run the apartheid occupation.

It doesn't matter where Palestinians come from, why they live there, etc, ITS AN OCCUPATION, as simple as that.

Its an occupation of one of the holliest lands for all three religions, with ethnic cleansing against Palestinian Muslims and Christians, through every way possible, killing journalists, children, families, mass killings.

Yet when Palestinians go to defend their land and their rights they are called terrorists, what unfavorable coverage are you talking about?
Palestinians throwing Molotovs against occupation forces? Terrorists, Ukrainians doing the exact same thing? Heros.
HogQL: Direct SQL Access for PostHog
Agreed. After recently finishing up a migration off ECS, it is madness and feels like OP just wanted a contrarian take.

Honestly, if they had said: "So instead we set up some bare-metal EC2 instances" I would be on-board.
"Penalties are supposed to stop people from violating the law."

That only works based on prior evidence. Either somebody prior to the potential violation was penalized or the weren't; either people fear, based on the prior, suffering the same penalty, or no worries mate the prior offender wasn't punished.
Air source heat pumps apparently work pretty well and are much more practical to retrofit.
> I've also found it's more capable of reasoning than most people

full stop, FTFY
This product isn't in the public's hands yet, so I think it's a bit early to conclude that it's categorically creepy.

But even if it ends up being a bit creepy, a) I think Apple is well aware of that and b) again I think this highlights how important they think it is to send the message from day 1 that solving for isolation is a top priority and intrinsic to their end-goal.
> I typically buy two liter sodas in plastic bottles and avoid softer plastics.

If you drink that plastic is the least of your problems

> It's also potentially a reason to switch to an electric vehicle -- to avoid exposure to gas fumes while refueling your vehicle.

Car interiors are off-gassing nasty shit all the time, especially when they sit in the sun
I imagine that Trump's legal team is a little too busy to sue the DeSantis campaign for libel.
Didn’t realise caffeine was used IV in anesthesia. Apparently it speeds up awakening (which makes sense to me as a non-medic).
https://theanesthesiaconsultant.com/2019/06/18/intravenous-c...

But the story in OP is that the patient received caffeine IV at the beginning of the surgery (inducing severe anxiety).

Does anyone know why you would do this?
How so? Those are sunk costs.
I think Google still has a decent chance of catching up. It's just a bit surprising to see them fall behind in an area they were supposed to be leading, especially since they wrote the paper which started all of this. Also, Anthropic is already kind of close to OpenAI, so I don't think OpenAI has some magic that no one else can figure out. In the future, I predict that these LLMs will become a commodity, and most of the available models will work for most tasks, so people will just choose the cheapest ones.
... I built that into my RSS reader
If they can get into a FAANG, I think they're already maximizing their income compared to the rest of the industry (not everyone in Tech works at FAANG). I would focus on broadening my knowledge of as many things as I find interesting and not try to specialize for a few years because platforms and languages are always going to change, but there are a lot of core things that everyone needs to know:

- HTTP/TCP/UDP and basic networking
- Client/Server architectures
- Machine learning basics
- Cloud Computing basics

Every platform has a different flavor of these things, but if you understand the basics a lot of the knowledge carries over (or you at least can see why one framework picked a particular trade-off over another)

Also, I'd learn a little bit about Product, and what Product Managers do. Lenny's Podcast is amazing for this. Thinking about Product and how it leverages Engineering is really important. Customers don't give a shit about your backend architecture, they just want a good experience. I think that helps keep you from going down too many technical rabit-holes
Attempting to live on regional trains would be pretty unpleasant
"a huge dud", sorry.
Tire rubber is a huuuuge source of airborne microplastics.
Even though I loathe spying, I must admit that the US (or any country for that matter) does not really have any natural or legal obligations to respect privacy of foreigners abroad.

It is their own business to protect it themselves.
Bitcoin is still clearing transactions just fine every ten minutes like nothing happened.
26 million Soviet citizens died saving them too, so by this weird argument shouldn't everyone in Europe leave NATO and embrace communism?
Music. String ensembles are the best, choir is a close second. Rapid response, mild euphoria, no unpleasant side effects. Repeated exposure can induce fatigue, making it an excellent sleep aid.
I thought that was a person who was climbing in through a window and was shot by police? Were there others?
That seems a strange way to look at things to me. If you're going to give credit for things that a devops engineer can do inside the Kubernetes platform, why not given equivalent credit for what a devops engineer can do with a Terraform module that would achieve substantially similar levels of automation and integration with ECS?
Yeh it’s fugly
I'll also add, most food products down there are "expired" already. When I was down there, it was often a challenge to find the oldest piece of food. I think we found 5 years + beyond the Best By date.

Best by dates for shelf stable/frozen food are often not safety related, so the antarctic program just charges forward with whatever they have.
Yeah I cant imagine what repairs on that would be. It sounded like the structural integrity was pushed to the panels? So maybe it would be easier to repair but unlikely?
I hear you. I live in the Midwest and see endless monoculture fields dedicated to mostly corn and soybeans. It’s very disappointing.

I think the tough part is finding crops fit for human consumption that actually grow in these areas and can be farmed efficiently at scale.

Soy is not a great example IMO because it is difficult for humans to digest without fermentation.
Yeah, for sure. I can't get anything done in the office anymore. At this point, we just go in once every couple of weeks, when we can all arrange a lunch, and it generally just turns into a: Do a bit of office maintenance, and socialize with coworkers day. I actually quite like it.
Exactly.

But I think at the moment it's easier to get someone to install an extension as long it mentions GPT or AI.
I just started toying with Janet recently & so far it’s very pleasant
It's just a language model.

I've asked it to prove the Riemann hypothesis, GPT-4 replied it can't, since none of the training data say anything about such proof.

Then I asked it to prove statements of the implications of said hypothesis (I tried 2 or 3, don't remember which), without calling them by name or mentioning Riemann, and it confidently proved them in a way that it reads like it knows what its doing, though it really doesn't. It just takes bits and pieces from proofs in the same field of mathematics that kinda hold together language-wise.
The physical card has a chip, which is digital.

The point is that the ticket has a unique ID which is tied to the owner.

Normal non-digital paper train tickets just indicate "someone paid this" but aren't tied to a unique personal identifier.
I don't think that's an accurate description of these errors at all, honestly. It's not a matter of ChatGPT "interpreting" anything. It's a matter of it assembling a response that is linguistically most likely, given its training.

That's categorically different than hallucination, which is an active misinterpretation/invention of sensory data.
I think the confusion comes from there being lots of transportation providers where you can buy the ticket.

The different providers can differ in what payments they accept and how they send you the ticket. Some also include extra benefits.

According to their website, Mainz, for example seems to sell them in their app and accepts credit card, as well as PayPal payments.
I don't understand what's preventing me from manually removing these URL parameters as well, just like I currently do with UTM params when I copy/paste something into a chat app.
The trick is doing so without demeaning the value of basic carpentry. Which would be obviously silly in building a ship, but in computing we frequently have people looking to become software engineers without encountering or learning the fundamentals of the field.

This particular project comes from people who regard fundamentals as optional.
Conway's law is about mapping teams to code+infrastructure (generally: areas of responsibility), not about mapping code to infrastructure. It's about people and politics.

You're right that K8S is an answer to Conway's Law: our people don't get along or can't collaborate or we have too many of them, so we will split them into team per service and force them to collaborate over network interfaces. Likewise, the infrastructure people will communicate with the other teams using Dockerfiles.
> Most useful values frameworks have inherent tension in them.

That's ostensibly why Cantrill was going on [fairly entertaining] tirades about the difference between principles and values. By providing a cultural foundation of muddled and inarticulate precepts, and by ambiguating values and principles, leadership was being derelict in its duty to own the responsibility for discernment in scenarios where principles were in conflict with each other.
Some level of anthropomorphism seems expected, especially, in the context of a product called “chat” and with the focus on the conversational aspect.
Show HN: Tremor 3.0 – Open-source library to build dashboards fast
Time to remove the Beta label. Tremor v3 is here, adding:

- Global theming via tailwind.config.js

- An out-of-the-box dark mode

- A new Tremor CLI helping you set up projects faster
It wasn’t intentional so it’s not exactly lying
Just curious, why do you think it's easier to change others' behavior rather than your response to it?
I assume it only blocks known tracking. Using lists, similar to how content/ad blockers work.
There's long been a divide between what people call hard vs soft AI, or strong vs weak AI, or narrow vs general. The definitions are a bit fuzzy, but generally a hard AI or strong AI would be able to think for itself, develop strategies and skills, maybe have a sense of self. Soft AI in contrast is a mere tool where you put something in and get something out.

Now some people don't like using the term AI for soft/weak/narrow AI, because it's a fleeting definition, mostly applied to things that are novel and that we didn't think computers were able to do. Playing chess used to be considered AI, but a short time after AI beat the human chess world master it was no longer considered AI. If you buy a chess computer capable of beating Magnus Carlsen today that's considered a clever algorithm, no longer AI. You see the same thing playing out in real time right now with LLMs, where they go from AI to "just algorithms" in record time.
Like Google.
Wait until Google implements something and shoves it down everyones throat in Chrome and then has all the Google fanboys claiming that its the best thing since sliced bread and thus should get implemented by every other browser just because Google did it?

That's how we ended up in the situation where Google shipped U2F, sites implemented their implementation and then when the standard WebAuthN was built it was not compatible so sites had to be updated to be standards compliant, and it took a while to do so.

Or when Google added WebP without clear consensus. Or when they added FLoC or Topics API, or whatever else they have cooked up. Or things like WebUSB, WebMIDI and others?

There's a glut of Chrome only sites out there, and it continues to grow as web developers test just on Chrome but not the other browser engines. It's turning into the next IE 6, I remember the time there were a lot of "Made for IE 6" logos and graphics on sites and they did not render well or at all in Netscape.
This is completely wrong. They are saying they only don't strip PCM parameters because these are anonymous and somewhat privacy preserving. Apple is still uninvolved in the link attribution or other tracking here.
I want to explain this from my perspective so you can maybe see why this is happening:

I remember all the talk about quiet quitting and working home and all that, but because media has slowly shifted away from that, I seemed to think about it less. In fact, I completely forgot about quiet quitting until you just mentioned it, when I realized they have slowly blocked it out.

Imagine that. It took me a while to realize that. And I still needed something to remind me of it. A lot of people aren't constantly reminded about it, which means they'll think more about whatever is currently in the media and keep falling for their trap.
Explore prompt variations with your custom LLM with Prompt Studio
We finally became LLM agnostic! I'm Sara, co-founder of Prompt Studio: https://prompt.studio and I'm so excited to share that you can now connect to a language model you are hosting yourself with your own API. Next thing coming is collaboration and workspace features! We're also going to go open-core soon. What are your pain points when working with prompt engineering? If you had the chance to try Prompt Studio, what are you missing in its features? We are highly flexible and can be very quick at shipping new features! Thank you in advance :) Feel free to reach out to us at info@puffly.ai for more information!
I work in networking, not particularly close to the hardware. I have colleagues who manipulate IP addresses by looking at the string representation of the address, splitting on the `.`, casting each part back to an integer, etc. Their code breaks as soon as we use a netmask other that /24 or (shock, horror!) we run in an IPv6 environments.
Many many years ago, I worked on the code that ran the electronic signage for Deutsche Bahn's platforms and arrival/departure boards.

I sure hope those poor UX software developers didn't have to face the same over-the-top bureacracy and change control committee nonsense we did.
Maybe Wren? It has classes and method syntax too but it's mostly C like: curly-braced blocks, operators are pretty much the same, slash and slash-asterisk comments, if/while/for with parens, ... Statements are not terminated by semicolons, though.

https://wren.io/syntax.html
Isn't this a cat and a mouse game? The moment this actually start causing problems they will change how parameters work. Maybe the easiest would be to use a single encoded parameter which would be decoded on the server and Apple or anyone else won't be able to change a thing about it.

This is a MITM attack where Apple plays the good guy(or control freak, depending on how you feel about it) but MITM attacks are nothing new.
In a ducted system the ductwork and air terminals reach an economic happy medium that does not really balance with trying to make the filter pressure loss the driving factor.
Excellent point! We are prone to forgetting about things like that :)
Yeah this is a very naive and somewhat potentially harmful measure. Think of all the old .asp and .php websites that basically route you to a page by just throwing a big old fat query string into the URL.

The way this can be bypassed is:

Before: mylink.mydomain?tracking_id=abc123
After: mylink.mydomain/home/abc123/

Yeah, it might wreck SEO. But if you're really trying to track users and see who clicked on your email or whatever, it's probably the case that you don't care about SEO in this specific case.
Right, the general "open sewer" is what I would expect on early things. And even there, I'd expect everyone was in favor of "clean" water. Question is on the agreement of if things are clean or not. With bacteria being something folks didn't know about.

To be fair, I can see the analogies to the air systems. I just hesitate to think that "clean water" was a controversy.
Amazon is reportedly trying to offer Prime subscribers free cell phone service
They kinda are. Recently some lawyers got banned from Madison Square Garden because MSG corporate bans lawyers involved in cases against them from their venues. They found a lawyers image somewhere and fed it into the "banned from this establishment" facial recognition group .

Nobody really knew about this till the lawyer showed up to a show there with a girl scout troop going to a Christmas Show and was denied entrance. If they can do it to a lawyer..

https://news.ycombinator.com/item?id=34104400

Of course the lawyers are suing, but its kinda over the top and the show was missed.
Ask HN: Which books evoked the love towards your favorite subjects?
Sometimes people come around books, after reading which, they get a new found love for that subject and start pursuing it more in a deeper way.

What is your favorite subject that you started loving because of a few books that you read?