skysight-inc/HackerNews huggingface dataset:
Prompt engineering is just communication skills. I could tell you which of my coworkers would make good or bad prompt engineers just by looking at their transfer notes on tickets.
Right, but when you say an LLM can’t do basic arithmetic you’re presumably talking about mental arithmetic, right?
FYI you don't need Windows Store to install Terminal. You can download it from a browser as well
With search, you can "tune" the query by using related references to the documents.

Ideally, we include documents that are relevant to the topics at hand and eliminate documents that aren't. Using prompt chaining, or an iterative process of labeling and extracting features, we may be able to increase the efficiency of the final prompt.

Obviously this increases costs, but so does repeated fine-tuning.
Is this just about gatekeeping the word 'engineer', so that its purity isn't tarnished? I know that software engineers were scoffed at by electrical engineers, who I bet were scoffed at by mechanical engineers, who were probably scoffed at by, you know, people who built siege engines or whatever.

Is prompt engineering 'real' engineering? It seems easy enough to test whether knowledgeable, self-proclaimed prompt engineers can outperform a random person with only moderate experience requesting information from an AI in a reproducible way.

If they can't, then there is probably no engineering involved in prompt engineering, at least at present.

If they can, then it seems like they're probably not doing it with magic, so there is some set of reproducible techniques involved. At that point, would it be fair to call it engineering?
Ah! A McKinsey alum.
Bloomberg contemplating life without its founder
https://archive.ph/XUjPC
I empathize especially with the author's account of "covid nose." For me, Coca Cola now tastes like patchouli. When I say that out loud, it's easier for others to believe I'm simply a hypochondriac, or that I've forgotten what Coke tastes like, or possibly it's made differently where I'm from. As far as I can tell, it's nerve damage. How could I forget the taste of summer vacation?

Back when smell loss was a common side effect of Covid, the NYT ran a series of articles on retraining one's sense of smell, by e.g. smelling all the jars on the spice rack. I found those articles patronizing. I can instantly recall what both Ceylon and Korintje cinnamon are "supposed" to smell like, but those memories are now mismatched with my olfactory system. All I can do is decide whether to accept the new sense, or just avoid the taste altogether.

We don't discuss smell like we discuss our other senses. Perhaps it's due to the difficulty of producing smell on demand, unlike within the visual or auditory domains. Despite being one of our most basic senses, smell seems to lie behind an inherent veil of subjectivity. My experience with continuous olfactory "hallucination" made me second guess that.
By that standard, you should be really careful with matcha — you mix it will non-bacteria-killing water and then drink the whole thing!

I don’t know whether most pathogenic bacteria can survive prolonged dry storage conditions, though. And, if you’re worried, you could likely pasteurize your fancy tea by heating it, dry, to 60C or so for a while.
One word: FTX.
I used to think this but increasingly I think it's a fool's errand.

Wikipedia might have been like that in the past but it's long been corrupted. E.g. see the Philip Cross affair.

For a while on the Ukraine war I tried to find unbiased commentary and news but I think it was basically impossible.

The best I could find after looking all over was stitching together stories from sources who were biased to one side but still at least somewhat committed to the truth.
For everyone alive today, it is probably even much closer in time (perhaps as recently as 2,000 years ago).

https://www.scientificamerican.com/article/humans-are-all-mo...
What about their fine tuning API? https://platform.openai.com/docs/guides/fine-tuning
Stinkbugs
Is social engineering just snake oil?
Feeding it the whole conversation again sounds like a perfectly valid way of keeping internal state though. It's part of its thought process.
The search+prompt approach has another benefit, which is that allows a chat interface to "cite it's source", something you really can't do with just parameters (fine-tuned or not.)

Although a lot of people are working on hallucination reduction, I think we're a long way off from that in the general case. So having the ability to point to a real piece of data, outside the model, is important for applications where accuracy matters.
Unfortunately that's table stakes what matters today is AI unless Sundar can change the narrative.

Also it doesn't matter what any of us think, it matters what the market thinks as in where does the stock price go.
This is a deeply stupid paper that isn’t supported by the sources it cites. According to the source data, the only Chromebook with a firm number for greenhouse gas emissions from manufacturing is the Pixelbook, and according to the same data it has the least embodied carbon of any laptop in their database. Other laptops in their list have as much as five times as much embodied carbon.
The fact that this is currently the third highest voted comment is just sad. As other sibling commenters have said virtually every sentence here contains ridiculous falsehoods or is just "r/antiwork" levels of nonsense.

And it's not that Google doesn't have major problems, a lot of which can be laid at Sundar's feet, or that he's wildly overpaid.

It's that these types of reactionary missives just miss the point in every possible way.
Because they took upon a very hard task, and kept punching it year, after years, through, low margins, highly cyclical market, extremely low returns on capital, tricky clients, and a marathon like RnD expenditures.

They are the leader because everybody else dropped out, and went to make money on something easier, like making Wordpress websites.
https://www.sciencedaily.com/releases/2017/04/170417182822.h...
Agreed. A good error message could help the user make it work.
Or, 2,000 years ago - if by “all living people” you mean everyone alive right now.

https://www.scientificamerican.com/article/humans-are-all-mo...
Satya Nadella is the counterexample to almost every excuse people make for Sundar's impotence. He took a larger, more inert desktop software company known for being monopolistic and greedy and turned it into the innovative backing of almost everybody's technical and knowledge infrastructure in one way or another. In contrast, Sundar has taken an innovative, creative company with a money printer, massive user engagement, and an incredible brand, and turned it into a monopolistic ad sales company.
https://www.scientificamerican.com/article/humans-are-all-mo...
Except you are giving them the password and trusting them to discard it after validating it. If it's purely client side, then the bank is trusting you to follow the password requirements which is also out of the question.
I have no idea how you make the law in the way that does not also punish other humans/businesses and give a massive windfall of power to large businesses that buy up copyright.
We definitely have to take the packages to our local DHL pickup location, but at least Amazon.de pays for the shipping. Seagate would've wanted me to send a broken hard drive with valid warranty to the Netherlands on my own dime.

They would've also just sent out another hard drive of the same model, so I would've either had to wait for that to get to me in order to rebuild my RAID, or just buy a new drive and get shipped an unnecessary drive. Amazon just returned my money so I got a new drive immediately.
The argument regarding "source code" is misleading and not entirely relevant. It's worth noting that Telegram's backend is also closed source, yet its supporters often overlook this fact.

Decompiling and inspecting mobile apps is relatively simple, so if there were any issues with the WhatsApp client, they would likely have been uncovered already.

As for Telegram, its messages are stored in plain text on their servers, and it doesn't offer default end-to-end encryption. This means that if Russian secret services were to gain access to Telegram's backend, they could easily read all the messages.

Therefore, when using Telegram, it's important to be aware that its administrators have the ability to read all of your messages.
There are some naturally caffeine free tisanes - I'd suggest rooibos or honeybush.
Intent/mens rea doesn't work like that unless the law explicitly specifies so. By default intent simply means intent to perform an act, as opposed to intent to cause harm. In some specific cases, like murder, intent to cause harm is an element, but that's the exception not the rule.

For example if you intentionally take someone's property, maybe you took their phone away because you genuinely thought their phone was causing them harm and wanted to help them, you have the mens rea for theft.

However, if you unintentionally took someone's phone, like you mistook someone else's phone for your phone, then you don't have the mens rea for theft.
IANAL but a quote from a Cornell article says

> The five fundamental rights that the bill gives to copyright owners—the exclusive rights of reproduction, adaptation, publication, performance, and display—are stated generally in section 106.

Seems it can be argued that generative AI violates many of these rights. Again I’m not a lawyer so I’m sure there’s some historic legal stuff that impacts the interpretation - but taking a copyrighted work and allowing a neural network to adapt it in any way seems like a clear violation?
Interesting. But not supported for their chat models.

I like how the fine-tuning page talks about how fine tuning is supposedly better, though.
Not American, but Texas seems to be USA Hungary, i.e. continually advances laws that are fascist that encroach on the constitution with the hopes of one day overthrowing it entirely.
The first, second, and fourth links are about pupil dilation generally. They don’t say anything about eye color. They most certainly say nothing to support your assertions about the connection between eye color and the perception of pupil dilation.

The third link (the Reddit thread) does mention eye color but only in the context of the effects of dilating drugs (drops). This also is irrelevant to the topic at hand.
I’ve always thought it was exactly the Monty Python “I’d like an argument please” sketch, including the “abuse” service provided the next room over.
A couple weeks ago I'd have agreed with this wholeheartedly. The complexity ceiling in particular. But then I found myself having to quickly do a bunch of "creative coding" to come up with some realtime visuals to support a stage show. I auditioned a bunch of things like processing.js, Rust equivalents etc., but also Max/Jitter, TouchDesigner, and something called Isadora. Those latter three are all basically no-code environments for visual and audio programming. They have building blocks like wave generators and dividers and things, they look (to a musician) like a modular synth but it's absolutely programming, and can be at a fairly low level (you find yourself implementing logic gates naturally, for example).

Anyway... I thought I'd struggle without a language to call into but in fact they work really well. I settled on Isadora (on a metric of fastest-time-to-cool-output) and I haven't hit a limit yet.

So my reason for writing all this is that I think, and I know I am rambling here, that domain specificity is an important factor in the success of a low/no code tool. Generality exposes the complexity ceiling.
>Telegram being the only network not blocked in Russia

This is not true. WhatsApp is still working. They banned facebook and instagram but not whatsapp. Viber, Signal, Threema, Wire still works, too. The only blocked currently, i think, is Line.

Not saying "trust telegram", but still.
My advice is to watch out for confirmation bias. There are a lot of people in the world thinking about this problem and whatever it is that you or I are thinking about related to it is probably just as important as anyone else's ideas.

The only way through this is to vocalize what we're thinking in a clear way, such that those ideas take hold and manifest in others. Even though we may try, we can't build this alone and creating false vacuums isn't going to help much.

Consciousness itself is likely a result of having a body, emotions and thoughts.
Mistakes Building a SaaS Company
I’ve tried to switch to Powershell a few different times and I always find it to occupy this no man’s land between a quality shell and a quality scripting language. As a shell I find it inferior to BASH and as a scripting language I find it inferior to Python.
Maybe its just me but the only way I can make "serious work" interesting is by gameifying it in some way.

Eg, can I get this code to compile and pass the test case on the first shot (less of thing with the quality of developer tools these days)? Can I weave our team name into the first letter of each title slide for this boring presentation? Instead of this busted, ancient, Python 2.4 script can I just do this in shell?
That implies that quite a few Justices lied to get on the court. As far as I'm aware, all of them claimed that lots of precedents were settled law during confirmation hearings.

I refuse to believe that anyone would lie to become a judge. It's flat out unamerican.
The Cretaceous-Paleogene extinction event and security practice
When it comes to video projectors (as with most things tech), the "Best" varies depending on how you'll use it. This is because projectors must inevitably make engineering trade-offs. I've owned a bunch of different high-end consumer projectors over the past several decades going back to RGB CRT tube models. IMHO, the most helpful answer I can give you is to point you to the key trade-offs so you can decide which is best for your unique mix of needs.

First, is the trade-off between brightness and contrast. Projectors perform best in light-controlled environments. Stick a blank piece of paper where you plan to put your screen and set the lighting to your normal viewing. That piece of white paper is the blackest black your projector will be able to create (baring using special non-white screens which have their own trade-offs). The bottom line, is if you don't have a suitable environment you need to go with a PJ able to throw a lot of lumens and the trade-off is poor contrast. I'm a huge PJ fan but honestly, in some environments some form of LCD or OLED screen is the best choice.

Next is how large your screen will be. The larger the screen the less light per inch a PJ can throw. Also remember that projectors have limits in how far the unit must be from the screen to throw a given size image. Many rooms don't have infinite flexibility in where you place the projector.

One counter-intuitive thing I'd suggest considering is whether a "4k" projector is really best for your needs and budget. There are some outstanding projectors that use various shift techniques to throw a 4K signal with three native 1080 chips. In many rooms the results are indistinguishable from native 4K in sharpness from your viewing position. Realizing this lets you put substantially more budget toward contrast, lumens, color fidelity etc. Also, it's important to assess what video sources you'll mostly be viewing. Frankly, the source quality options available to most consumers in North America across streaming, cable, satellite and OTA broadcast is surprisingly awful. And there's a LOT of bullshit claims being made by various providers. In the era of variable compression, resolution is essentially irrelevant unless it's backed by sufficient encoding AND delivery bandwidth. For most people, every dollar spent on a projector over ~$5k to $6k will only be visible when watching high-quality UHD Blu-Ray discs in a blacked-out room.
There are corporate solutions (like the Paragon drivers), they just suck. Paragon tried merging this code into the Linux kernel, but the code was so bad and unmaintainable that it was rejected. The FOSS solution is using FUSE, but that requires a UNIX-like OS for easy porting. Unless Windows ditches the NT kernel altogether, I don't think you can expect native filesystem extensions beyond NFS support.

GNU philosophy is not about moneymaking or footing the bill. Sometimes a problem gets worse when you throw money at it.
How Harvard careerism killed the classroom
I'm familiar with Hayek and can't really discern exactly what you're referring to. You'll need to be a little more specific.
It's weird to see Google getting picked on for this. Other manufacturers are a lot worse and provide a lot less guarantees about updates.
100% agree.

And the "sophisticated" part is important. This is where Gensler failed hard. You have to make the case.
Tesla gives update on its game-changing 4680 battery cell
Yeah my kettle as a 140F setting. Works for me. I also use 170F for Yerba mate.
Pretty sure that with enough money to can solve almost any visa issue one way or another (investor visa etc)
> I don't believe you can summarily call Ethereum a security without more homework.

Ethereum voluntarily changed its definition since the last time SEC gave it "not a security" status.

> That's where Gensler failed. He may not be wrong, but he needs to show his work.

I am sure he would be very happy to show his work to the court. Thus the Wells notice to Coinbase and the lawsuit against Bittrex. He is just not required to show his homework to Coinbase, much to the dismay of crypto shillers.
At each new token processed (edit: either if the token comes from the user or has been generated), this dynamic internal state is updated via a formula based on the model parameters and latest processed token.

To make this more clear, if you process 1000 tokens the neural network will have gone through a sequence of 1000 states.

Each of these states can be probed and analysed, by training a classifier on top of this state, for the content they contain (whether thoughts or emotion : some states can be classified as "happy", "sad",...).

This is not yet mainstream view but viewed through this prism and anthropomorphising a little, it can been seen as a stream of proto-consciousness, where during the conversation the inner state of the neural network has gone through various thoughts and emotions.

At the end of the chat session, this internal state is not persisted (but could be recreated from the produced conversation as it is deterministic). This internal state size is big and proportional to the length of the context window (If you want to persist between sessions you can by simply keeping the last "context window size" tokens produced and recompute the features).

At the next session you start with a fresh new internal state.

The conversation produced is persisted for use as input for future training where good conversation will be encouraged and bad conversation will be discouraged via Reinforcement Learning with Human Feedback.

The dynamics of this internal state is what Large Language Models learn.
It turns out that giving the devices away and then losing money every time someone says something near them is a bad way to run a business.
Should we also retroactively introdue laws to make shovels and pencils illegal? Those also made a lot of people obsolete. Let alone tractors and cameras. Do we have to go back to a time before the flintstone?
I find this quite similar to the issue of free will: If we live in a generally deterministic universe, where is the space for independent decisions of individuals? Was every single decision we take already predetermined before we were born? A lot of ink has been spent on this topic, and as far as I know, only a small minority of people actually deny free will. One assumption I have is to why is because it absolutely sucks from an emotional point of view, and it is a terrible idea to base fe. a justice system on.
Not sure why I thought it was a copy!
Not only Texas, we have plenty of "Hungarys".
If street defecation is your metric than about any place in semi-developed world is equally great.

Why all these Fortune 9000 companies run their business via Bermuda rather than home jurisdictions again?
Formula 1 website (*on iOS/iPhone) has the same issue right now once you hit customise the literally 100s of options appear but the accept/reject/save appears for a microsecond and disappears as it loads. Hitting the X doesn’t save.
Haha, I just pictured iPhone users if one day all the colorful icons disappeared and they were presented with a white on black text prompt instead) Not gonna happen.
Spoiler alert: this covers fine tuning encoder-only models (BERT) and not GPT models - which will be done in a later post. The former has been covered by many examples and articles over the past several years, and I was hoping for some insights on LoRA and fine tuning of GPT. Looking forward to reading the next article!
The European Space Agency launches out of French Guiana in South America for this reason.

I assume we don't launch out of Mexico because rocket technology is tightly controlled by ITAR, so there's no way the government would allow any of it to go to another country's sovereign territory.
It's amazing how much misinformation and vague information there is on this topic. I tried getting to the bottom of this in the following post in the OpenAI forum:

https://community.openai.com/t/fine-tuning-myths-openai-docu...

Bottom line is that fine-tuning does not seem to be a feasible option for adding new knowledge to a model for question answering.
https://en.m.wikipedia.org/wiki/Scientific_method
Does AI really "adapt" a "work"? Or does it learn from looking at the world and then create its own works, just like a human does?
You didn't read my comment correctly, didn't say it tastes better. It's just that lactose free being the exception and not the norm prevents lots of people from enjoying it. I don't have intolerance, it's quite rare in Europe. But it's a problem for lots of the world population, which is why I believe lactose free should be more present.
In fairness, "all buns glazing" is also blatantly plagiarized by the same measure.
To begin with, this is definitely not related to engineering... And, yes. Of course, yes.
For everyday stuff like that it's easier to put the NLP in a BI tool, and some of them already did that.

If you're doing more involved stuff then writing a good prompt will probably need as much analytical and domain knowledge as writing SQL.
Moving generally sucks. Moving is traumatic whether it is forced or not and whether a migrant or not. It can be almost the same trauma when moving to the other side of a large city as moving to another country. Kids still change schools; spouses still change jobs; housing and community changes; distance to friends and family changes interactions; etc

At least a migrant has the option of returning to their home country with a network of family and old friends; natives are stuck jobless and with high cost of living or choosing to uproot and migrate to a new country with lower cost of living, becoming migrants themselves. There is no stress-free ride for anyone.
Which is weird because Dobbs was a rebuke of ambiguity in the Constitution. There’s no ambiguity in “separation of church and state”. However, if I was a conservative, I’d want to distance myself from Dobbs as far as possible because the next most ambiguous item in the Constitution is the second amendment.
When you say prediction my discharge disposition do you mean extracting from the document a statement of what the discharge disposition was? Or do you mean based on m extracted clinical characteristics, predicting what it should be?

For extracting what it was if it's in the document, you can use the indexing approach described in the article. For predicting what it should be, you'd probably be better off using llm as an extraction mechanism and then using structured data models to classify discharge disposition