skysight-inc/HackerNews huggingface dataset:
Am I missing something? From what I understood from Wolfram description of GPT and GPT in 60 lines of Python, a GPT model's only memory is the input buffer. So 4k token for GPT3, some more but still limited for GPT4.

To summarize the GPT inference process as I understood it, with GPT3 as example:

1) the input buffer is made of 4k token. There are about 50k token. So the input is a vector of token ids. We can see it as a point in a high dimensional space;

2) The core neural network is a pure function: for such an input point, it will return an output vector as large as there are token. So here, a 50k element vector, where each entry is the probability that the associated token is the next element.

The very important thing here is that the whole neural network is a pure function: same input, same output. With immensely large super fast memory this function could be implemented as a look-up table, from an input point (buffer) to an output probability vector. No memory, no side effect here.

3) The probability vector is fed into a "next token" function. It doesn't just take the highest probability token (boring result), but use a "temperature" to randomize a bit, while using the output probabilities;

4) The next token chosen is inserted into the input buffer, keeping the same total number of token. Go back to (1) until a "stop" token is selected at (3).

So in effect, the whole process is a function from a point to a point. "point" here is the buffer seen as a (high dimensional) vector, so a point in a high dimension space. The generation process is in effect a walk in this "buffer space". Prompting puts the model into some part of the state, with some semantic relation to the prompt semantic content (that's the magic part). Then generation is a walk in this space, with a purely deterministic part (2) and a bit of randomization (3) to make the walk trajectory (and its meaning, which is what we care about) more interesting to us.

So if this is correct, there is no point in injecting a lot of data into a GPT model: the output is defined by the input buffer size. Just input the last 4k token (for GPT3, more for GPT4) and you're done: everything else would have disappeared. So here, just input the last 4k token of a repo and save some money ;)

To avoid this limitation, one would have to summarize the previous input, and make this summary part of the current input buffer. This is what chaining is all about if I understood correctly. But I don't see chaining here.

Sooo... Am I missing something? Or is the author of this script the one missing something? I don't mind it either way, but I'd appreciate some clarification from knowledgeable people ;)

Thanks
Then don't make them private?

I keep thinking that having depf was a mistake
I never knew about <dl> until I saw this post. So I never missed them.

What is the advantage of <dl> over bullet-lists?
Have you looked at Spack (https://github.com/spack/spack)? Disclaimer: I lead the project.

Spack essentially is nix with dependency resolution. spack packages can have conditional (nearly) anything: versions, options, compiler choices, dependencies (including virtual deps). The resolver can make choices about all of those.

See here for more details: https://arxiv.org/abs/2210.08404
Yes! Something like ControlNet is great for this. I use this[1] API on Replicate specifically because it offers the various methods (depth maps, edge detection, etc.)

Replicate sometimes give you free use (I forget if this model does), but if you pay then an image output will cost you about one cent.

Give it your image, write a prompt (something like "a modern living room"), choose your ControlNet model from the drop-down, and submit.

If you choose depth map, for example, it will generate its best guess depth map for your image and use that to steer the Stable Diffusion output. It's fascinating, and a lot of fun to play with.

[1] https://replicate.com/jagilley/controlnet

Edit: I'd love to see what you produce, if you do use it.
I'm happy to say Word, whatever version of PDF ULTRA DELUXE PRINTER 9000(TM) turns up first in search results, and Wix are at least analogous to a toolchain. It's three tools that they'd use in sequential steps, taking the output of each step and using it as an input to the next.
> If a work's traditional elements of authorship were produced by a machine, the work lacks human authorship and the Office will not register it.

I imagine many people have a workflow where they generate images with Stable Diffusion and retouch in a painting app, do some inpainting and retouch.

It seems all of those should be covered by copyright (nothing above makes me think they won't, at least).
A lot of problems with calculating that expected lifetime though: which variables can you include out of race, income, gender, job, recent purchase of a motorcycle, being diagnosed with cancer, etc?
imperialism takes many forms, not only the highly militarised one we are used to by the US.
take the Belt and Road Initiative, the financial invasion and indebting of countries half way around the globe.
Well Pornhub's brand became radioactive less for promoting sex work, more for being non-responsive when people requested to remove child rape videos of themselves from the platform. They reacted to a scandal breaking out over this by removing everything from their platform which wasn't professional paid sex work which is nominally better vetted than amateur content.
With WebGPU it will be faster - libraries like ThreeJS will use WebGPU when possible.
Taking Apart IKEA’s Latest Air Quality Sensor
TS by itself is not fully sound which could complicate such a compiler.

Example: https://www.typescriptlang.org/play?#code/MYewdgzgLgBAtgTwLI...

In the example above, the problem is that typescript allows casting function types to omit optional arguments, and also allows using a function with n arguments as a value where a function with >n arguments is expected
Man who was wrongfully sentenced to 400 years is freed after 34 years in jail
The 'handwavey' thinking here is from those who state as a 'fact' that the human brain is an LLM
This is my reason why I hate them: https://lwn.net/Articles/676831/ and specifically this: https://lwn.net/Articles/676938/

All the discussions from the Docker team regarding SystemD feel like they want to push Docker Swarm and see SystemD as a threat to their business model. It would not supprise me if they downtalk Lennart Poetterin on a personal level.

Also to this day if we want to setup complex test scenarios we need the --privileged flag to run Docker in Docker.
I haven't met a good professional programmer working in webdev who didn't know their way around linux.
I've met plenty of bad programers who got into this field for money, didn't know how their way around unix, were barely able to do fizz buzz and would be better doing something else. I haven't hired them though. Not knowing one's way around linux is a sign of lack of curiosity and passion for the topic.

It's obviously different in some fields (like gamedev) where the code produced by the dev is not supposed to run in a linux environment.
My guess is that lawmakers in Western countries will soon make this illegal. Without actually defining it well.
Industrial systems for one
4% atleast IMHO. I'm guessing 26K today will be 28K atleast in 2025.
I think typescript support was a priority aspect to be addressed for Vue 3 making it sort of a first-class citizen. The whole new composition aspect of it was to address large codebases and large-scale applications. So I understood that V3 makes all the difference if TS support and working on larger project is important for you. In fact, I think if you are coming from React and try it out, you are highly likely to feel right at home there.
On my case was : ZX Spectrum +3 -> TurboBASIC/QBasic -> VisualBasic 3 to 6 -> PHP + early JavaScript -> C, C++, JavaScript, Java
Yes, that’s why it’s funny
> not understanding how technology works when it's so central to our everyday lives just seems baffling

I don’t know. I appreciate the sentiment and would also like more tech literacy, but there are lots of areas central to our lives and I think it’s unrealistic to expect a good understand across it all.

I think it’s on us to be able to adequately communicate and understand the needs of those that ask us for help.

Just as you would want a doctor to explain what your condition is in a way you would understand.

Having buildings to live in is pretty central to most of our lives too, and we have some knowledge and intuition of what looks safe and can be used, but most of us leave the engineering to someone more in the know.

Farming too, I rather people in the industry work on maximising yield to feed us all with tools made and tailored for them.

I think when people go to the quickest solutions for them in tech (i.e. Ms 365, Spotify, John Deere, ABC MRI Scanner etc), I’d rather have them focused on the details of their trade than learning how to use a terminal, jailbreak a tractor or replace a magnet in an MRI scanner.

Those that want to, great, but I think most don’t have the time or interest to take on that kind of deeper learning.
I am a solo founder even though I have built a small team. This shit is hard. Like really hard. Really really really hard. This is my 9th year and I can't tell you how many times I self doubt. Yet I keep going. Keep pushing. I am nowhere I wanted to be 9 years ago but I have seen just enough moderate success that I see a better future. I strive to get better. Not just make more money but learn. I have learned so much. Would I go back and give up all this even though I want to jump off a cliff at times ? Heck No.

You need to be mentally the strongest to survive this stuff. People would say BS like "You don't need to grind it to be successful blah blah".

I am not sure if you are solo solo or just a solo founder with some team members. If the latter, focus on building a great core team. Team that you know you can rely on. It helps take some pressure off even though you can never switch yourself off as a founder. That is how we are wired. Can't change the wiring.

Also, I am sure there are ways to talk to other similar people IN PERSON. All the online stuff is ok but not enough. But regardless, if you see yourself on the right path even a little bit, don't give up.

Remember that entrepreneurship is not about WHAT you are doing. People do many businesses in their lifetime. It is a way of life. I just can't see myself living my life dong something in a FAANG or a corporate company (I did that for 10+ years initially btw so I know how it is).

Cheers and remember that many people would kill to be in your shoes.
Everyone has an accent that tells where they are coming from. People who think they don’t have an accent simply don’t know that they have one.
Correct, but it's also a common [false] view that sysadmins can't code. Even if I emphasize my limited) experience in code and leave out details about my sysadmin work, I get asked what did I do, etc. "Oh you're a sysadmin" and that's where the conversation ends.

But let's gloss over the fact that I can set-up the testing and production environment on my own along with the DB, schema, do the routing, proxy and everything in between. Then, back it all up.
I like to surround myself with people where learning, teaching and curiosity are the norm.

I know the feeling of being looked down on. And vice versa I’ve been just as guilty of doing so when I was younger.

Both fundamentally sucks and doesn’t lead anywhere.

Managing our ego is hard, but even just the attempt goes a very long way.
Very inspiring stuff! I hope one day we get to see the magic behind libnc.
Project Kuiper, Amazon’s satellite broadband network
I'm not sure that the commenter was negging here but instead showing that the language used in the prompt was imprecise (in a similar way that we might get system requirements in reality). The takeaway I got was more that the commenter was showing surprise at how well that ambiguity was resolved regardless. A more interesting experiment to run might be to intentionally reduce the precision of the task e.g. something

In a 10x10 arena, work out if there is a path shorter than 5 steps from one start to finish with water tiles taking two steps and avoiding as many fire tiles as possible.

But you can go even better than that really. The author jumps down to a more code oriented description too soon (10x10, etc.) but ChatGPT (3.5) does ok with just the original problem (I removed the text about A* and Djikstra's from the english version of the problem statement:

PROMPT:

In Mewgenics, movement abilities use pathfinding to get the cat from his origin to his destination.

Cats have a maximum movement range stat and tiles have a cost (in this case its 1 for basic tiles and 9999 for blocking obstacles). We also have water tiles that cost 2 to path through.

The complication comes in when we add Fire (and other hazard type tiles) into the mix. Fire tiles don’t cost extra to pathfind through like water tiles do, however a cat really wants to avoid pathing through the fire tile if it can. If there’s a lot of fire tiles it should go through the least number of them it can.

ANSWER:

To solve this problem, you can modify the pathfinding algorithm to take into account the hazard tiles, such as fire. One way to achieve this is by using a modified A* algorithm.

First, assign a high cost to hazard tiles such as fire. This cost should be higher than the cost of regular tiles, but lower than the cost of blocking obstacles. For example, you can assign a cost of 5 to fire tiles.

Next, modify the heuristic function used in the A* algorithm to take into account the distance from the hazard tiles. For example, you can modify the Euclidean distance heuristic to add an extra term that takes into account the distance from the closest hazard tile. The closer the cat is to a hazard tile, the higher the heuristic value should be.

Finally, when selecting the next tile to visit, prioritize tiles with the lowest total cost (including both the movement cost and the heuristic cost), but also consider the number of hazard tiles that the cat would need to pass through to reach that tile. You can add an extra penalty term to the total cost that increases based on the number of hazard tiles the cat would need to pass through to reach the tile. This penalty term should be high enough to discourage the cat from pathing through too many hazard tiles.

With these modifications, the cat should be able to find the shortest path to its destination while avoiding hazard tiles as much as possible.
Reminder that Calibre [https://calibre-ebook.com/about] has the ability to send news sources directly to your Kindle, handles news sources that require a subscription like the NYT [https://manual.calibre-ebook.com/news.html], as well as literally any RSS feed. The only thing Calibre needs is a better UI, but that's not too different from most OSS projects. It is better than anything Amazon could ever hope to offer and as a bonus you don't give the bald man more money to destroy society.
Yup, and given that my entire career has been in startups environments, people who lack that passion and interest are usually not a good hire. Not knowing one's way around linux is a major red flag because it shows they lack curiosity for their chosen profession.
no need for heroics, just don't "lie" about it by signing statements
Fast Ethernet is better than no Ethernet, and gigabit is unachievable in low-end FPGAs.
Kudos to you for doing it for 13+ years. As a fellow solo founder, I know how hard this thing is. In my 9th year and going strong (with plenty of self doubts along the way).
In my years as developer I found typing to be the least of my concerns.
I've been feeling FOMO (for lack of a better term) about recent AI & ML/GPT progression.

It feels like ML/AI it might be the beginning of the end for a large class of things (if I wanted to be alarmist I'd say "everything") -- and the fact that Fabrice Bellard has jumped in and done the absolutely obvious rising-tide thing (building an API that abstracts the technologies) speaks volumes.

Releasing something like this fits to Fabrice's pattern of work -- he built Qemu and that served as a similar enabling fabric for people to run virtual machines. QuickJS quietly powers some JS-on-another-platform functionality.

Simon was right. The Stable Diffusion moment[0] is already here. It's going to accelerate. It was already moving at a speed that was hard to follow, and it's about to get even faster.

There are too many world-changing things moving forward at the same time, and I'm only looking at such a small cut of the tech sphere. I don't know what to do with myself, I feel so thoroughly unprepared.

[0]: https://simonwillison.net/2023/Mar/11/llama
> I asked it to stop adding disclaimers as you can see.

This is the first example of an extended dialogue with GPT-4 that I have read, and the fact that it failed to obey the request to dispense with its repetitive disclaimers was perhaps the most interesting thing to me about it. It seems somehow more fluent to me than GPT-3, as though its verbal IQ has increased a few points, but GPT-3 was already quite articulate; I havent yet seen any examples of clear new abilities from GPT-4.

The substance of the dialogue struck me as generic and lacking novel insight, though the bar was of course set rather high (essentially 'Describe revolutionary new physics'). I've also been jaded by the past few years of advances in AI; if I had seen this transcript ten years ago I would have been surprised and impressed that an AI could have a conversation about theoretical physics, and could demonstrate an ability to discuss relevant concepts in a reasonable and confident manner.

The ability of large language models to exhibit sophisticated verbal reasoning, albeit not yet reliably so, is their most striking feature to me, and I do think that has great scientific potential; perhaps GPT-4 isn't yet a major advance in that respect, but I imagine an important foundation has been laid. I should say I'm grateful to you for publishing this Ramraj; the transcript and the impressions you and others have shared in this thread have been illuminating.

Anyone who is curious about the application of AI to theoretical physics may be interested in the work of the MIT physicist Max Tegmark and his group, which is still at an early stage. Here are some videos in which he discusses AI and physics, in increasing order of detail:

https://www.youtube.com/watch?v=dinfiuGqoQw (6 minute clip from a conversation with Lex Fridman)

https://www.youtube.com/watch?v=9atnfAHBfSI (20 minute presentation)

https://www.youtube.com/watch?v=pkJkHB_c3nA (49 minute presentation)
Very far imo.. I mean it delivers what it is, an average of much content out there.. and it is good at it, yes. So in a way, maybe the better future stack overflow with a nicer interface (however what could it do if there weren't stackoverflow to start with?)

But on the other hand in new uncharted territory, it sometimes fails on the simplest shit: Asked it recently how to do one thing with enlighten (that I knew was possible with tqdm, but was almost sure not possible with enlighten).
It just hallucinated up parameters to functions that didn't exist. Several rounds continued where it had that from, if different version. I asked it even for the reference where it meant it had that from.. and it referenced me fully confident a readthedocs url with tqdm and enlighten mixed, that didn't exist.. it is hilarious how it confidenlty can tell you one bullshit answer after the next.. dialogues always
"hey are you really sure about xxx, did you look it up"
"yeees, very certain, I did!"
"But this doesn't exist"
"Oooh, Im very sorry, you are correct and I am wrong, the next bullshit answer is: ..."

The history disappeared I hope I get it back once, but the dialogue til getting to "No, it may be not possible with this library" was amazing, I'm really scared for our futures building up on that and what will happen if everything from business presentations to lawyer letter exchanges will build up on that..(:
Self aggrandisement for sure - but then again it’s probably better than a possible alternative of Promptgrammer (prompt + programmer)
You had to be “that guy”, didn’t you?
> “Trigger warning” was originally intended to warn about descriptions that could literally trigger a dissociative episode for people suffering from PTSD

To the extent it was, it was based on a completely misinformed idea of how triggering in PTSD works. In practice, if not in intent, it has been, from the beginning, an appropriation of the language of PTSD to serve as a vehicle for expressing personal value judgements and content preferences that have nothing to do with that. And there is research, IIRC, that it is actually counterproductive, inducing stress without helping anyone avoid PTSD triggering.
FAQs extension permits the admin to create and construct a dedicated FAQs page, where all customer's queries & concerns are assembled with an easy interface. All FAQs are portrayed nearly on one page with the collapse/expand the feature.

The FAQs & Product Questions Extension is a very important module to engage & reach targeted audiences & customers. With this extension, it is very simple and easy to add and edit questions & answers from the Magento admin panel. All customer-generated questions will be displayed in the questions grid and the admin can select questions to add answers and allocate to specific categories.

Features

Admin can easily enable/disable this plugin without any technical Help.
Add any numbers of FAQs from admin
Enable/Disable FAQ category with a toggle button
Manage categories and edit them anytime from admin
Search questions instantly by using keywords
Easy to navigate to any category and search by category
Create and assign questions to categories and product vise
Show FAQs tab on the product page
Show FAQs tab on the category page
Allow customers to submit their questions
Notify customer with email when questions are approved by admin
All Page in Mark up FAQs with structured data.
Apple News is the unhealthy model Amazon is trying to follow.

Yet again, Apple leads the market into digital feudalism, and their fanboys are happy to lead the charge.
Visual programming is useful in some niches, but for general purpose you either have to have less power than a text based programming language (and users will beg you to add that power) or it will become exactly as complicated as a text based programming language, but more cumbersome because whatever you're doing is slower than typing.

I feel like the whole idea of visual programming comes from some fundamental idea that the hard part of programming is learning the syntax, which I just don't agree with at all.
Airtool – Tools and Resources for Startups and Founders
A search engine of more than 1200+ tools & tons of resources for Startups, recommended by unicorn founders.
> void fn() { int tobias; delete &tobias; }
<malloc>: ** error pointer being freed was not allocated

i wouldn't say that's an illegal op per se, if anything it's a pretty safe op! tobias only ever existed in thought, not in body :( :(

maybe a compiler WARN or IGNORED_OP
No, it’s not just theory. Like anything in C++, codebases and their styles widely vary. But my comment holds true for the vast majority of developers I have worked with over the last decade. With the exception of the special “placement new“ operator, it is nearly obsolete to use new and delete.
Do you have the same judgement you invented or would you like to mind read other's opinions and generalize groups of people some more?

How I took that is you just don't want to commit to your own statements, so you speak through these "others"...

And backend isn't just web. I was using a catch-all to call out how, misinformed, ignorant, and offensive your statement was.