skysight-inc/HackerNews huggingface dataset:
Assuming you would want to fine-tune over a codebase or set of documents, I would argue vector databases and fine-tuning are completely different tools.

I would strongly recommend against fine-tuning over a set of documents as this is a very lossy information system retrieval system. LLMs are not well suited for information retrieval like databases and search engines.

The applications of fine-tuning that we are seeing have a lot of success is making completion models like LLaMA or original GPT3 become prompt-able. In essence, prompt-tuning or instruction-tuning. That is, giving it the ability to respond with a user prompt, llm output chat interface.

Vector databases, for now, are a great way to store mappings of embeddings of documents with the documents themselves for relevant-document information retrieval.

I would highly recommend skimming this RLHF paper for how demonstration data was used to make a model prompt-able [1]. Keep in mind RLHF is another concept all together and we might be seeing a revolution where it might become optional (thanks to LIMA)!

1: https://huyenchip.com/2023/05/02/rlhf.html
They wouldn't cut rates anyway, with inflation at 7.2%.
mIRC

Initial release date: February 28, 1995
Beyond Compare by Scooter Software.

Beyond Compare is perfect software (in my not so humble opinion). I use it every day.

https://www.scootersoftware.com/
I guess they mean he’s old? I mean, compared to the last guy who was president he looks active, trim, lacks all the word salad, and healthy, but that’s a low bar to clear.
Is this Paris? Only city I could think of with your description. Because there were no shopping malls in the 18th century. The precursor to shopping malls were bazaars which are very old. So that part of your comment seems not chronologically and terminology accurate.
Reason for failure:

Ordering takes longer with QR than saying:

I'd like a double bacon cheesburger, extra bacon, lettuce and tomato on the side with a side of fries and medium sprite in a large cup.
> They trained on publicly-available (no signup with TOS agreement) data, on the theory that training is fair use.

They openly state they used thousands of books from a pirate site as a training source. Go look up the datasets listed in the GPT-3 paper.
I had a job where they gave training on how to constructively engage with the open source community, and one of the big points was, "you don't suck, the patch sucks".

Oh you have a bug in the patch? No, there's a bug in the patch. Oh you missed an edge case? No, there's an edge case nobody had documented yet.

The point was mostly about how to give feedback on the patch, and to never phrase it about the person personally, but perhaps it would help to try and catch yourself thinking of the feedback this way and have your internal dialog look at the patch as being separate from you.

Yes, it's your work, but it's always a work in progress, and it's everybody's work to try and make incremental improvements to the code, to the process, etc.

I used to think I didn't like working with inexperienced engineers, but I noticed that what I actually didn't like was people who were unwilling to candidly discuss ways to improve, whether they were junior or senior - it's just a little easier to spot in people more junior than one's self. So kudos to you for recognizing this, because if you can learn to absorb constructive feedback it's a real game changer for you and for everyone around you too.
So set up a shell company that uses GPT4 to make public domain examples of what RLHF data would look like, and then the parent company takes that data afterwards since it's public domain. Shell company didn't break TOS.
>Since covid, rents increases have far outpaced salary increases. And since 2022 so have bill, groceries, everything.

Same story in the US.
https://en.wikipedia.org/wiki/Doctor_of_Arts
> Health care requires other people’s labor though. If you make that a right you risk needing to implement some kind of forced labor system (sure it can be obfuscated as much as you like).

You have the right to an attorney. The state hiring and assigning public defenders isn't "forced labor." I don't know where this canard came from. It makes no sense if you spend more than 10 seconds thinking about it.
Some of the people releasing popular models/LoRAs on civitai do alright via Patreon in addition to getting a lot of praise from the SD community, that seems like incentive to me.
DVDs should not be overlooked for backup. The Millennium type have been simulated to withstand 1,000 years.
Sometimes it can sting a little to know that I did a crappy job at something, but I see a lot of value in learning from it.

When my brother was in art school many years ago, he asked me to critique his work. After a few polite comments, he explained that I wasn't being helpful and the end result would be better if I didn't hold back on brutally ripping it apart. That mentality has stuck with me. I want people to tell me if my code is crap.
Ask HN: Which AI code assistant do you use?
So I’m wondering which tools people are using for generating their code on a day to day basis. What are the most popular IntelliJ plugins? Are you using GitHub Copilot? Have you tried Android Studio Bot? Etc
Never have I seen someone so succinctly articulate what the fuck went wrong with the Web.

Seeing social media, for example, go from "fun way to catch up with friends and family" to "pump ads, FUD and FOMO to our users as efficiently and accurately as possible, 24x7x365" has been an incredibly sad experience.

Seeing Google go from "I can type a question and find what I'm looking for" to "I have to append site:reddit.com to every query to avoid SEO-optimized puff pieces because Google can't be trusted" is disheartening.

I really hate having to be so overly aggressive in blocking ads and trackers on my devices because collecting this telemetry is the only way for many Internet companies to survive these days.

It doesn't help that talking about this with non-Internet-savvy people who were hoodwinked into the status quo makes me sound like a stereotypical doomsday cult subscriber.

I really hope the rest of the world agrees with the future you're describing here, Vlad.

Thank you so much for writing this. I'm proud to help support your mission in fixing the Internet.
My most successful strategies for my personal growth in this area have been

1. Work to separate my personal identity from my work. This is really hard for me and takes regular reflection and work, but over time it is possible to separate the two.

2. Frequently remind myself that everybody makes mistakes, it is simply part of being human.

3. Practice humility by welcoming the feedback and expressing gratitude for the ability to learn and grow. A little self-deprecating humor doesn't hurt either, and can soften the intensity of the feelings associated with receiving criticism.

Best of luck in your personal growth journey
The course where these notes came from: https://www.cs.toronto.edu/~rgrosse/courses/csc421_2019/
Yes, but I wouldn't be surprised if signing a meaningless letter an aide wrote gives better PR than pushing for a failed bill. And it's hard to imagine a pro-Palestine bill actually passing.
Nah, people will get over it quite quickly. Before it happens people imagine that others will be all upset and do something, after it happens realpolitik kicks in and the world quickly adjusts to the new balance of power. Much of the world has a vested interest in the US staying the dominant hegemon and militarisation of space won't change that.
Perhaps use the pdf split function to order 4 quarters of the pdf in separate binds
Interesting, just yesterday I was googling something about transformers and had arrived on your page.
I don't think Deno's gonna help deal with something like Webpack, is it?

Webpack's for building browser bundles, Deno's about running TypeScript server-side, isn't it?
The first version of the visual programming language / software vvvv first appeared in 1998:

https://visualprogramming.net/
I mean, that's a good point, for sure. However, I'm just the messenger here, you should ask them. I've talked to a lot of them.

I think that, in terms of insulting the leader... most Chinese are pretty happy with Xi? But yeah, totalitarian regime, insulting leader, bad idea.
But they made the misstake of being born at the wrong place.
Was it really a benefit? The only benefit is belief that Germany won't let euro fail and will bailout anybody no matter how shitty situation is. On the other side, this prevents fixing root causes. Why fix anything and make people angry if you can ride the wave, hope for the best and in worst case someone will bail you out?

That's why we have this massive inflation. No real value is created, yet everybody is flush with the money. Pandemic was just a perfect excuse for BS that is brewing since at least 08 crisis.
A defect of being solo developer.
Ahh sorry, I see what you're saying now. Yeah I guess it's in PSPACE if the length of each game is polynomial in n, and EXPTIME if games can go on for longer.

I guess chess (without the 50-move rule), checkers, and go (with a certain ruleset) can go on for longer.
State economies do differ dramatically though, and monetary policy can indeed affect them in opposite ways at least for a while. And state revenues are almost entirely collected by the state aren't they? There are funds for interstates and railroads, and schools, but often schools are primarily funded at the city level by property taxes.
One problem a QR-menu solves is that at least there is always a menu at hand, and you don't have to ask some-one for the menu, or have them take it away.

If you have physical menus, you should ALSO have a QR menu, just to make sure that people can order (additional) dishes and drinks without having to ask or hunt for a menu first.

And don't get me started on multiple physical menus that look the same externally, but one is the wine list, the other is only for lunch, etc.
How to Get Started with AI as a Software Engineer?
Lockfree Programming: A Mental Model
If you want to teach it eg. all of the text in your private training manuals and internal documentation, which wouldn't fit in the input token size.
> especially with the new competition from bun

Competition seems to always lead companies to drop what makes them special in pursuit of the other guy's customers. They could have chosen to let bun take the npm-compatibility crowd and stick to their guns, but VC funding precludes that.
These kinds of posts are my favorite part of HN. The deep dives into LLM's, state machine theory, fourier transforms, locking data structures, and memory allocation that is miles above the basic posts around the internet you get with searching - but not quite a full book yet.

The author spent 7 months tinkering and cared enough to come back and share that with us.
The problem is that it's just unprofessional.

Code is made to be efficient in a compagny, it's not "personal" or here to make you have feelings. So if you can't discuss efficiency because you'll hurt people it's just bad. If you do art, you create art with respect to your own sensibility emotions so yeah be weary of criticizing someone's art.
What gets measured gets done. DORA and similar cycle time measurements are proxy metrics. They'll distort reality into managers becoming the customer, if used the wrong way. They're no substitute for structured goal setting.
https://web.archive.org/web/20120322223910/http://vaporjs.co...
Actually the biggest blow was not the energy costs, but the interest rates. They went from 1-2% now at 4-5, even 6% for real-estate ( new building and old ) while the prices are still at last year level. For other types of financing, I had a "good" offer which went to 12% interest. I felt like in a 3rd world country. With such expensive money, nothing will be done.

The construction economy is really going dow from mid 2023, everyone has trouble finding projects while the money are kept by the people in banks and not released out of the uncertainty.

However, German economy is so diverse that it will absorb this as well.
I saw the title and went to look up a bunch of paper notepads :-)... (and can share if anyone is interested)

I tend to use Obsidian these days along with the excalidraw plugin (if you just want to try excalidraw without installing Obsidian: https://excalidraw.com/)
stagflation...its in Germany, coming to the US...there is only one way out: we get poorer
Yeah - I struggle to do so, but I’m pretty sure if you stay away from processed foods and carbs, eat plant based vegan ~85% of the time, full omnivore the other ~15% (again excluding processed sugars, carbs etc.) that’s the model
> A website? You had actual websites? We got mostly PDFs of paper menus. And they would often give you an actual paper menu if you asked.

Not just any website. Often it sends you straight to some online ordering portal like Toast or Doordash. And this bring all the slow performance and pop-ups and adware that implies. Very fun to try to load these bloated web apps when you have 1 bar of cell signal.
My tactic is to meditate on the fact that there is always someone better than me at some thing that I’m doing at some point in time.

Learned this lesson mostly from sports, fwiw.
Comma didn't exist yet.
We use a Python Fabric script to automatically generate the conf and deploy it to each server when a new server, or client user, is added to the wireguard network.

The master config is essentially the Fabric script. It contains each servers IP, public key, etc. We even do server-server pre-shared keys.
You can click through to see the report. Above 100% means they performed better than the competition, not they handled every picture well.

> Pixian.AI had 241 images that were rated good, or not rated and identical. That's 87.0% of your 277 images.

> The competitor had 201 images that were rated good, or not rated and identical. That's 72.6% of your 277 images.

> Pixian.AI achieved 241 / 201 = 119.9% of the competitor's performance

> The report is based on a set of user-provided images. We then reviewed the services' respective results separately and rated them as either good or bad. The comparison was done in a blind manner, without labels indicating which result was Pixian.AI's and which was the competitor's. We then tallied up the results and produced this report.

https://pixian.ai/comparisons/cwsslt8d78zl7vq/share/5e51cd3d...
>True, but every system has flaws. For the most part the Euro and ECB has been a benefit for every country in it.

Except Italy alas.
you should make it a post of its own ><
They don't have a majority sufficient to make such a law (or a super-majority to override a veto).
> Your time traveling Roman asking for the portal rather than the door has basically just invented his own dialect, not learned English to any meaningful degree.

A fun argument for how important this is: The only reason we have Middle Earth, Lord of The Rings, etc is because Tolkien needed a world and a history to embed his languages in. Otherwise they couldn’t have any real meaning. He could construct the grammar, yes, but not the semantics.

Even something as simple as what our shortest words encode tells a lot about our culture or history. We use short words for things we say often.
Denuvo would like a word with you.
Good thing everyone lives in Phoenix and SF XD
Aleph One is the open source continuation of Bungie’s Marathon 2 game engine
GP's logic is exactly why I wanted to convert. Your findings are exactly why I didn't (only the up-front delta was about 5x worse in my case).

If we can't remove the skew in the economics, it's going to be very slow to make progress.
My current favorite corp speak is “we can’t wait to share it with you”. Seems like it’s in literally every product announcement. At least this one is positive
I'm curious why PayPal bans Palestinians. It's not like they want to limit their addressable market.

Seems likely related to OFAC, which is tough to google casually

https://ofac.treasury.gov/sanctions-programs-and-country-inf...

Nothing specific to Palestine on the country programs, but OFAC explains further that our sanctions are much more complicated than country-by-country here:

https://ofac.treasury.gov/sanctions-programs-and-country-inf...
>> One reason is etiquette. Everyone knows it’s rude to take a phone out at a table, but that’s what a digital menu demands.

I disagree with the everyone knows part. In certain age groups, I don't think they actually consider it rude to be glued to their phone regardless of location. Whether I agree with them or not, social norms evolve.
I’ve been in this relationship. If someone knows what to say to hurt you, and uses it with precision to cause that hurt, they’re not on your team, even if their criticism isn’t “baseless”.

In the professional world, giving feedback with tact and respect for the contributor is what we get paid for and enables a team to contribute to the company’s success.

If someone on the team doesn’t feel like they’re treated with respect, even when their work needs improvement, it doesn’t matter whether the feedback was given with good or bad intentions.
Tbh I asked GPT-3.5 and it responds correctly. Do you have an example where it fails?
Blocking AI-related articles on Hacker News
Ah yes, instead of having people do things that they can do within a year lets not do any of those things until somebody spends decades building enough power plants to replace all of our current ones.

You should look up Critical Path [1]. If you want to go things done faster, creating a long critical path is not a good idea. Of course, if you want the status quo to stay the same it's a great idea.

[1]: https://en.wikipedia.org/wiki/Critical_path_method
Jay, I liked your tutorial on Transformer models. Helped me a lot when I read it in 2020. One of the best resources on a topic then. Thanks for your work! Fingers crossed for your new endeavour.
Does this replace the OP? Or is "An Infinite Descent into Pure Mathematics" a complementary book?
https://www.academia.edu/6037370/Some_Observations_on_Robust...

> We can think of a tree as a dynamic system in equilibrium with respect to the forces of gravity. Tree growth takes advantage of horizontal symmetry around a vertical axis as a way to distribute gravitational forces so that the downward force due to gravity on one side of the tree is balanced by the downward force of gravity on the other side of the tree. When the wind blows, the new force acting on the dynamic system of a tree responding to gravity temporarily shifts its current state, as mea-sured by the tree’s position in three-space, to a nonequilibrium configur-ation, and when the wind dies down the tree returns to its equilibrium configuration, just as models of linear systems with stable equilibrium points indicate how a dynamic system responds to a transient impulse. Let us imagine the tree as being represented by a vertical, straight line ..
Something like that seems eminently reasonable. Low dollar amount for enough uses that I don't need to think too much every time I press the execute button. Reasonable expiration window. No subscription which I generally prefer. (Though I'd note that Photoshop is getting very close to doing this sort of thing and a Photoshop + Lightroom subscription is actually pretty reasonable--$20/mo--if you use them a lot. That's the sort of price point that a lot of standalone generative AI tools are going to be up against.)
Any financial bill of rights passed would not apply to Palestinians
Because this is a minority opinion speaking.
At that level of a paranoia, there's no guarantee that the CPU doesn't contain a malicious method for detecting and modifying compiler builds, so you better build your own CPU out of TTL chips ;)
>Are you suggesting that they are not to blame?

When they're literally quoting almost verbatim the claims of the researchers, no they aren't to blame. And the vast majority of the time you see an article with some breathless claim, it is capturing the essence of the research summary, or the press release put out by the university or think tank.

See, journalists like their jobs to be easy. They generally aren't spinning whole wool. As Graham's The Submarine describes, often they're basically reprinting something sent to them with minor wording changes.

That's my point. And my point was amply clear in my original post. Blaming the journalists is often nonsensical sophistry. A hail mary to try to recover some semblance from busted research, as if it's the messenger who is to blame. The worst part is that the blame the journalist people create a vacuum in which even worse sources of information grow.

Not sure the vaguely remembered, poorly communicated anecdote (which I can find zero references for) supports your point.
You might want to try NLP Cloud: https://nlpcloud.com
Looks like the great firewall worked well for you. Painting an entire ethnicity as terrorists who slash away randomly at people is exactly the kind of propaganda it serves. Israel does the same for Palestinians. Yes, terrorism exists and should be supressed, but you can’t de-humanize entire populations based on that.

Picture yourself being jailed, taken away from your family, forced to learn another language and change your customs because “people who look like you can be dangerous”.
I think a lot of b2b ERP software gets to be this old. I know of multiple.
Agreed. Pollen's advice basically translates to the "Mediterranean diet", which has also held up well.
What kind of hurdles does someone need to overcome to transfer money to a Palestinian through the bank? Banks deal with the same OFAC requirements that PayPal does.
Supermemo v7, Piotr Wozniak's spaced repetition (and a bunch of other things) platform, was rewritten in Turbo Pascal in 1993. The most recent version, 18, is an obvious continuation of the same interface (to me, the most striking difference from Windows 3.1 to modern is window decorations).

https://supermemo.guru/wiki/SuperMemo_7
It's the other way around. If you're flagged for AML investigation, telling you it would be tipping off and explicitely illegal.
I've had absolutely terrible experiences with Palpal. Lawmakers should be urging everyone to use a better service, forget worrying about PayPal's ban.

The last straw for me was when they blocked a transaction of a few hundred dollars without any explaination. I was talking to a support rep for well over an hour, repeatedly being told that there is no security team at PayPal that can see why a transaction was blocked override the block. I was told the security system was a black box, they wouldn't transferred me to a supervisor, and the end result was a recommendation to try a different payment system like bank transfer.

This happened to be on the day we were selling our house. The buyer came in with a cash offer and a 7-day close. The inspection results came back after the paperwork was already drawn up, when they asked for a few hundred for electrical repairs it should have been easier to do that as an addendum rather that completely redoing the closing settlement sheet. I guess PayPal had better ideas.
You're making some bad-faith assumptions.

Ecosystems die without adoption. A runtime that plugs its ears to the practical needs of users is a runtime that nobody but enthusiasts ever use. And you can't build any kind of sustainable business on an enthusiast-only runtime, VC or no VC.

Idealism requires pragmatism to succeed.
COPY from files up to 300% faster

Load Balancing from client libs

Support for CPU acceleration using SIMD for both x86 and ARM architectures, including optimizations for processing ASCII and JSON strings

new pg_stat_io view that provides information on I/O statistics